[
https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392538#comment-17392538
]
ASF GitHub Bot commented on HUDI-2233:
--------------------------------------
vinothchandar commented on a change in pull request #3387:
URL: https://github.com/apache/hudi/pull/3387#discussion_r682094930
##########
File path:
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala
##########
@@ -347,6 +346,8 @@ object DataSourceWriteOptions {
.defaultValue("false")
.withDocumentation("")
+ // We should use HIVE_SYNC_MODE instead of this config from 0.9.0
Review comment:
can we add `deprecatedAfter(0.9.0)` ?
##########
File path:
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala
##########
@@ -399,6 +400,11 @@ object DataSourceWriteOptions {
.defaultValue(1000)
.withDocumentation("The number of partitions one batch when synchronous
partitions to hive.")
+ val HIVE_SYNC_MODE: ConfigProperty[String] = ConfigProperty
+ .key("hoodie.datasource.hive_sync.mode")
+ .noDefaultValue()
Review comment:
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
> [SQL] Hive sync is not working
> ------------------------------
>
> Key: HUDI-2233
> URL: https://issues.apache.org/jira/browse/HUDI-2233
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Sagar Sumit
> Assignee: pengzhiwei
> Priority: Major
> Labels: pull-request-available, release-blocker
> Fix For: 0.9.0
>
>
>
> {code:java}
> java.lang.NoClassDefFoundError: org/apache/calcite/rel/type/RelDataTypeSystem
> at
> org.apache.hadoop.hive.ql.parse.SemanticAnalyzerFactory.get(SemanticAnalyzerFactory.java:318)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:484) at
> org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1317) at
> org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1457) at
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:1237) at
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:1227) at
> org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLs(HoodieHiveClient.java:458)
> at
> org.apache.hudi.hive.HoodieHiveClient.updateHiveSQLUsingHiveDriver(HoodieHiveClient.java:448)
> at
> org.apache.hudi.hive.HoodieHiveClient.updateHiveSQL(HoodieHiveClient.java:426)
> at
> org.apache.hudi.hive.HoodieHiveClient.createTable(HoodieHiveClient.java:322)
> at org.apache.hudi.hive.HiveSyncTool.syncSchema(HiveSyncTool.java:230)
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
