sravya created CARBONDATA-4047: ---------------------------------- Summary: Datediff datatype is not working with spark-2.4.5. even in spark-sql its showing as null. .Either the query might be wrong or the versions don't support datatypes. Key: CARBONDATA-4047 URL: https://issues.apache.org/jira/browse/CARBONDATA-4047 Project: CarbonData Issue Type: Task Components: spark-integration Affects Versions: 2.0.0 Environment: Hadoop - 3.2.1 Hive - 3.1.2 Spark - 2.4.5 carbon data-2.0 mysql connector jar - mysql-connector-java-8.0.19.jar Reporter: sravya Attachments: carbon error.PNG, sparksql.PNG
1.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show() <console>:1: error: ')' expected but string literal found. carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 as (select * , intck ("Hours", 'StartTimestamp', 'CompleteTimestamp') as Hours FROM vestedlogs) STORED AS carbondata").show() 2.scala> carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show() <console>:1: error: ')' expected but string literal found. carbon.sql("CREATE TABLE IF NOT EXISTS vestedlogs3 (SELECT *,DATEDIFF(HOUR,StartTimestamp GETDATE(),CompleteTimestamp GETDATE() AS "Hours" FROM vestedlogs) STORED AS carbondata").show() -- This message was sent by Atlassian Jira (v8.3.4#803005)