[
https://issues.apache.org/jira/browse/HUDI-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911710#comment-17911710
]
Y Ethan Guo commented on HUDI-8837:
-----------------------------------
The test is added in https://github.com/apache/hudi/pull/12490. Right now the
validation excludes partition column. When adding that in the validation, the
validation fails.
{code:java}
def assertDfEquals(df1: DataFrame, df2: DataFrame): Unit = {
assertEquals(df1.count, df2.count)
// TODO(HUDI-8723): fix reading partition path field on metadata bootstrap
table
assertEquals(0,
df1.drop(partitionColName).except(df2.drop(partitionColName)).count)
assertEquals(0,
df2.drop(partitionColName).except(df1.drop(partitionColName)).count)
} {code}
> Fix reading partition path field on metadata bootstrap table
> ------------------------------------------------------------
>
> Key: HUDI-8837
> URL: https://issues.apache.org/jira/browse/HUDI-8837
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Y Ethan Guo
> Assignee: Davis Zhang
> Priority: Blocker
> Fix For: 1.0.1
>
>
> When adding strict data validation within
> testMetadataBootstrapMORPartitionedInlineCompactionOn, the validation reveals
> that the partition path field reading fails (returns null) for some update
> records.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
