[
https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523284#comment-16523284
]
Sivakumar commented on SPARK-24631:
-----------------------------------
The table that I queried was a view. That view was pointing to a actual table.
The only thing I have done is dropped the current view and recreated it. After
that issue got resolved. The same table didn't through any error while the
program was in Spark 1.6. Since we have Migrated to Spark2.2 It thrown error.
> Cannot up cast column from bigint to smallint as it may truncate
> ----------------------------------------------------------------
>
> Key: SPARK-24631
> URL: https://issues.apache.org/jira/browse/SPARK-24631
> Project: Spark
> Issue Type: New JIRA Project
> Components: Spark Core, Spark Submit
> Affects Versions: 2.2.1
> Reporter: Sivakumar
> Priority: Major
>
> Getting the below error when executing the simple select query,
> Sample:
> Table Description:
> name: String, id: BigInt
> val df=spark.sql("select name,id from testtable")
> ERROR: {color:#ff0000}Cannot up cast column "id" from bigint to smallint as
> it may truncate.{color}
> I am not doing any transformation's, I am just trying to query a table ,But
> still I am getting the error.
> I am getting this error only on production cluster and only for a single
> table, other tables are running fine.
> + more data,
> val df=spark.sql("select* from table_name")
> I am just trying this query a table. But with other tables it is running fine.
> {color:#d04437}18/06/22 01:36:29 ERROR Driver1: [] [main] Exception occurred:
> org.apache.spark.sql.AnalysisException: Cannot up cast `column_name` from
> bigint to column_name#2525: smallint as it may truncate.{color}
> that specific column is having Bigint datatype, But there were other table's
> that ran fine with Bigint columns.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
