[
https://issues.apache.org/jira/browse/HUDI-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-4022:
--------------------------------------
Description:
we might need to add validation to integ test suite to test data and metadata
table's internal state or steady state. For eg, need to validate that
cleaning has progressed as per the configs.
Archival has progressed as per the configs. archival has archived the timeline
files.
if metadata is enabled, metadata table compaction progressed as per the
configs.
if metadata is enabled, metadata table cleaning has progressed as per the
configs.
if metadata is enabled, metadata table archival has progressed and has archived
the timeline files.
was:
cleaning, archival, metadata table compaction, cleaning, etc.
> Add support to validate table's internal state with integ test infra
> --------------------------------------------------------------------
>
> Key: HUDI-4022
> URL: https://issues.apache.org/jira/browse/HUDI-4022
> Project: Apache Hudi
> Issue Type: Improvement
> Components: tests-ci
> Reporter: sivabalan narayanan
> Priority: Major
> Fix For: 0.12.0
>
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> we might need to add validation to integ test suite to test data and metadata
> table's internal state or steady state. For eg, need to validate that
> cleaning has progressed as per the configs.
> Archival has progressed as per the configs. archival has archived the
> timeline files.
> if metadata is enabled, metadata table compaction progressed as per the
> configs.
> if metadata is enabled, metadata table cleaning has progressed as per the
> configs.
> if metadata is enabled, metadata table archival has progressed and has
> archived the timeline files.
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
