hudi-bot opened a new issue, #15949:
URL: https://github.com/apache/hudi/issues/15949
In the issue linked below, we found that tables that were upgraded from Hudi
0.7 do not have the *hoodie.datasource.write.hive_style_partitioning* key in
the table configs or {*}hoodie.properties{*}.
[https://github.com/apache/hudi/issues/8653]
As such, when using lazy partition pruning + tryListByPartitionPathPrefix,
hudi might construct a partition path that does not exist, causing a partition
to be created.
While this ticket is not aimed at fixing the issue, we propose that an
additional validation on whether the key exists is performed before the value
of the config is used.
{*}TLDR{*}: Instead of blindly falling back to defaults, we should check if
the config key exists in table properties before ACTUALLY using it.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6202
- Type: Improvement
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
