xubo245 created CARBONDATA-3154: ----------------------------------- Summary: Fix spark-2.1 test error Key: CARBONDATA-3154 URL: https://issues.apache.org/jira/browse/CARBONDATA-3154 Project: CarbonData Issue Type: Bug Affects Versions: 1.5.1 Reporter: xubo245 Assignee: xubo245 Fix For: 1.5.2
Now the CI didn't run Spark2.1 UT, only compile, so when test spark2.1, there are some errors. for example: command: {code:java} -Pspark-2.1 clean install {code} error1: {code:java} 2018-12-07 21:47:20 INFO HiveMetaStore:746 - 0: get_database: global_temp 2018-12-07 21:47:20 INFO audit:371 - ugi=xubo ip=unknown-ip-addr cmd=get_database: global_temp 2018-12-07 21:47:20 WARN ObjectStore:568 - Failed to get database global_temp, returning NoSuchObjectException *** RUN ABORTED *** org.apache.spark.sql.catalyst.parser.ParseException: mismatched input 'location' expecting {<EOF>, '(', '.', 'SELECT', 'FROM', 'AS', 'WITH', 'VALUES', 'TABLE', 'INSERT', 'MAP', 'REDUCE', 'OPTIONS', 'CLUSTERED', 'PARTITIONED'}(line 1, pos 150) == SQL == create table par_table(male boolean, age int, height double, name string, address string,salary long, floatField float, bytefield byte) using parquet location '/Users/xubo/Desktop/xubo/git/carbondata1/integration/spark-datasource/target/warehouse2' ------------------------------------------------------------------------------------------------------------------------------------------------------^^^ at org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197) at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99) at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45) at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53) at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592) at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.createParquetTable(SparkCarbonDataSourceTest.scala:1126) at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.beforeAll(SparkCarbonDataSourceTest.scala:1359) at org.scalatest.BeforeAndAfterAll$class.beforeAll(BeforeAndAfterAll.scala:187) at org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest.beforeAll(SparkCarbonDataSourceTest.scala:38) at org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:253) ... [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: {code} there are another 5 errors in org.apache.spark.sql.carbondata.datasource.SparkCarbonDataSourceTest -- This message was sent by Atlassian JIRA (v7.6.3#76005)