Sagar Sumit created HUDI-2484:
---------------------------------
Summary: Hive sync not working in HMS mode with DeltaStreamer
Key: HUDI-2484
URL: https://issues.apache.org/jira/browse/HUDI-2484
Project: Apache Hudi
Issue Type: Bug
Reporter: Sagar Sumit
Assignee: Sagar Sumit
Fix For: 0.10.0
Set Hive sync mdoe to HMS and disable JDBC mode:
```
--hoodie-conf hoodie.datasource.hive_sync.mode=hms
--hoodie-conf hoodie.datasource.hive_sync.use_jdbc=false
```
It throws the following exception:
```
Caused by: java.lang.NoClassDefFoundError:
org/apache/calcite/rel/type/RelDataTypeSystem
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzerFactory.get(SemanticAnalyzerFactory.java:318)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:484)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227)
at
org.apache.hudi.hive.ddl.HiveQueryDDLExecutor.updateHiveSQLs(HiveQueryDDLExecutor.java:94)
at
org.apache.hudi.hive.ddl.HiveQueryDDLExecutor.runSQL(HiveQueryDDLExecutor.java:85)
at
org.apache.hudi.hive.ddl.QueryBasedDDLExecutor.createTable(QueryBasedDDLExecutor.java:82)
at
org.apache.hudi.hive.HoodieHiveClient.createTable(HoodieHiveClient.java:191)
at org.apache.hudi.hive.HiveSyncTool.syncSchema(HiveSyncTool.java:237)
at
org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:182)
at org.apache.hudi.hive.HiveSyncTool.doSync(HiveSyncTool.java:131)
at
org.apache.hudi.hive.HiveSyncTool.syncHoodieTable(HiveSyncTool.java:117)
at
org.apache.hudi.utilities.deltastreamer.DeltaSync.syncHive(DeltaSync.java:625)
```
The same works with Spark data source.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
