[ https://issues.apache.org/jira/browse/SPARK-37096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434104#comment-17434104 ]
Saurabh Chawla commented on SPARK-37096: ---------------------------------------- This already fixed as the part of https://issues.apache.org/jira/browse/SPARK-35700. The fix is added in the Spark-3.2.0 and spark-3.1.3. > Where clause and where operator will report error on varchar column type > ------------------------------------------------------------------------ > > Key: SPARK-37096 > URL: https://issues.apache.org/jira/browse/SPARK-37096 > Project: Spark > Issue Type: Bug > Components: PySpark, SQL > Affects Versions: 3.1.1, 3.1.2 > Environment: HDP3.1.4 > Reporter: Ye Li > Priority: Major > > create table test1(col1 int, col2 varchar(120)) stored as orc; > insert into test1 values(123, 'abc'); > insert into test1 values(1234, 'abcd'); > > sparkSession.sql(‘select * from test1’) > is OK,but > sparkSession.sql(‘select * from test1 where col2 = “abc”’) > or > sparkSession.sql(‘select * from test1’).where(‘col2 = “abc”’) > report error: > java.lang.UnsuppotedOperationException: DataType: varchar(120) -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org