[
https://issues.apache.org/jira/browse/HUDI-2538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yann Byron updated HUDI-2538:
-----------------------------
Description:
Some configs, like `keygenerator.class`, `hive_style_partitioning`,
`partitionpath.urlencode` should be persisted to hoodie.properties when write
data in the first time. Otherwise, some inconsistent behavior will happen. And
the other write operation do not need to provide these configs. If configs
provided don't match the existing configs, raise exceptions.
And, this is also useful to solve some of the keyGenerator discrepancy issues
between DataFrame writer and SQL.
was:Some configs, like `keygenerator.class`, `hive_style_partitioning`,
`partitionpath.urlencode` should be persisted to hoodie.properties when write
data in the first time. Otherwise, some inconsistent behavior will happen. And
the other write operation do not need to provide these configs. If configs
provided don't match the existing configs, raise exceptions.
> Persist configs to hoodie.properties on the first write
> -------------------------------------------------------
>
> Key: HUDI-2538
> URL: https://issues.apache.org/jira/browse/HUDI-2538
> Project: Apache Hudi
> Issue Type: Improvement
> Components: Writer Core
> Reporter: Yann Byron
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.10.0
>
>
> Some configs, like `keygenerator.class`, `hive_style_partitioning`,
> `partitionpath.urlencode` should be persisted to hoodie.properties when write
> data in the first time. Otherwise, some inconsistent behavior will happen.
> And the other write operation do not need to provide these configs. If
> configs provided don't match the existing configs, raise exceptions.
> And, this is also useful to solve some of the keyGenerator discrepancy issues
> between DataFrame writer and SQL.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
