[
https://issues.apache.org/jira/browse/HUDI-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17518557#comment-17518557
]
sivabalan narayanan commented on HUDI-3804:
-------------------------------------------
the test given in the description is using test table infra which uses empty
files. So, its not a valid one. I ran a test in TestCOWStorage w/ col stats
enabled and verified that partition meta files are present for col stats.
{code:java}
ls -ltra
/var/folders/ym/8yjkm3n90kq8tk4gfmvk7y140000gn/T/junit6797106666724882735/dataset/.hoodie/metadata/column_stats/
| grep -v crc
total 128
drwxr-xr-x 5 nsb staff 160 Apr 6 23:05 ..
-rw-r--r-- 1 nsb staff 124 Apr 6 23:05
.col-stats-0000_00000000000000.log.1_0-0-0
-rw-r--r-- 1 nsb staff 124 Apr 6 23:05
.col-stats-0001_00000000000000.log.1_0-0-0
-rw-r--r-- 1 nsb staff 93 Apr 6 23:06 .hoodie_partition_metadata
drwxr-xr-x 12 nsb staff 384 Apr 6 23:06 .
-rw-r--r-- 1 nsb staff 12498 Apr 6 23:06
.col-stats-0001_00000000000000.log.2_0-29-48
-rw-r--r-- 1 nsb staff 12483 Apr 6 23:06
.col-stats-0000_00000000000000.log.2_1-29-49 {code}
> Partition metadata is not properly created for Column Stats
> -----------------------------------------------------------
>
> Key: HUDI-3804
> URL: https://issues.apache.org/jira/browse/HUDI-3804
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: Alexey Kudinkin
> Assignee: sivabalan narayanan
> Priority: Blocker
> Fix For: 0.11.0
>
>
> Currently, when enabling Column Stats partition along with Files partition,
> `AppendHandle` will be inserting records for both of them during MT updates.
> However, AppendHandle does create Partition Metadata file only for Files
> partition which leads to failures in validation of the MT.
> Steps to reproduce:
> # Enable MT and Column Stats
> # Run `TestHoodieBackedMetadata.testTurnOffMetadataTableAfterEnable` test
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
