[
https://issues.apache.org/jira/browse/HUDI-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17515633#comment-17515633
]
Rajesh commented on HUDI-3726:
------------------------------
org.apache.hudi.exception.HoodieException: Config conflict(key current value
existing value):
KeyGenerator: org.apache.hudi.keygen.SimpleKeyGenerator
org.apache.hudi.keygen.NonpartitionedKeyGenerator
at
org.apache.hudi.HoodieWriterUtils$.validateTableConfig(HoodieWriterUtils.scala:162)
at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:89)
When SimpleKeyGenerator is used validation kicks in as expected, but leaving
the option causes Hudi to write partitioned folders along side older
nonpartitioned parquet files.
Will fix the bug.
> Switching from non-partitioned to partitioned key gen does not throw any
> exception
> ----------------------------------------------------------------------------------
>
> Key: HUDI-3726
> URL: https://issues.apache.org/jira/browse/HUDI-3726
> Project: Apache Hudi
> Issue Type: Bug
> Components: spark
> Reporter: sivabalan narayanan
> Assignee: Rajesh
> Priority: Blocker
> Fix For: 0.11.0
>
>
> in commit C1, if non-partitioned key gen is used and for commit C2, if key
> gen option is missed, we fallback to simple key gen and the write succeeds. I
> was expecting to throw exception if key gen class is changed.
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
