[
https://issues.apache.org/jira/browse/HUDI-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-3826:
----------------------------------
Description:
Currently, `TruncateHoodieTableCommand` as well as
`AlterHoodieTableDropPartitionCommand` deletes partitions from Hudi table by
simply removing corresponding partition folders w/o committing any changes (and
correspondingly updating the MT for ex)
Instead it should go t/h WriteClient's `deletePartitions` API, similar to Spark
DS does when gets Hudi's DELETE command
You can see that when enable Column Stats Index by default and running our CI
(Setting "hoodie.metadata.index.column.stats.enable"
and "hoodie.metadata.enable" to true)
https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=7926&view=logs&j=dcedfe73-9485-5cc5-817a-73b61fc5dcb0&t=746585d8-b50a-55c3-26c5-517d93af9934
was:
Currently, `TruncateHoodieTableCommand` deletes partitions from Hudi table by
simply removing corresponding partition folders w/o committing any changes (and
correspondingly updating the MT for ex)
Instead it should go t/h WriteClient's `deletePartitions` API, similar to Spark
DS does when gets Hudi's DELETE command
> Commands deleting partitions do so incorrectly
> ----------------------------------------------
>
> Key: HUDI-3826
> URL: https://issues.apache.org/jira/browse/HUDI-3826
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Alexey Kudinkin
> Assignee: Forward Xu
> Priority: Blocker
> Fix For: 0.11.0
>
>
> Currently, `TruncateHoodieTableCommand` as well as
> `AlterHoodieTableDropPartitionCommand` deletes partitions from Hudi table by
> simply removing corresponding partition folders w/o committing any changes
> (and correspondingly updating the MT for ex)
> Instead it should go t/h WriteClient's `deletePartitions` API, similar to
> Spark DS does when gets Hudi's DELETE command
> You can see that when enable Column Stats Index by default and running our CI
> (Setting "hoodie.metadata.index.column.stats.enable"
> and "hoodie.metadata.enable" to true)
> https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=7926&view=logs&j=dcedfe73-9485-5cc5-817a-73b61fc5dcb0&t=746585d8-b50a-55c3-26c5-517d93af9934
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
