pengzhiwei created HUDI-2195:
--------------------------------
Summary: Sync Hive Failed When Execute CTAS In Spark2 And Spark3
Key: HUDI-2195
URL: https://issues.apache.org/jira/browse/HUDI-2195
Project: Apache Hudi
Issue Type: Bug
Components: Spark Integration
Reporter: pengzhiwei
When execute CTAS in spark2, the follow exception will throw out:
{code:java}
java.lang.NoClassDefFoundError: org/json/JSONException
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeCreateTable(SemanticAnalyzer.java:10847)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genResolvedParseTree(SemanticAnalyzer.java:10047)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10128)
at
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:209)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
{code}
While executing CTAS in spark3, the follow exception throw out:
{code:java}
java.lang.NoClassDefFoundError:
org/apache/calcite/rel/type/RelDataTypeSystemjava.lang.NoClassDefFoundError:
org/apache/calcite/rel/type/RelDataTypeSystem at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzerFactory.get(SemanticAnalyzerFactory.java:318)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:484) at
org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317) at
org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457) at
org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237) at
org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227) at
org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLs(HoodieHiveClient.java:458)
at
org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLUsingHiveDriver(HoodieHiveClient.java:448)
at
org.apache.hudi.hive.HoodieHiveClient.updateHiveSQL(HoodieHiveClient.java:426)
at org.apache.hudi.hive.HoodieHiveClient.createTable(HoodieHiveClient.java:322)
at org.apache.hudi.hive.HiveSyncTool.syncSchema(HiveSyncTool.java:234) at
org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:179) at
org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:130)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
