[
https://issues.apache.org/jira/browse/HUDI-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-7898:
--------------------------------------
Description:
We need tests added to 1.x hudi to ensure it can read 0.16.0 tables.
We should have good coverage for all new log formats, diff table types, pending
compactions, pending clustering, completed clustering, failed commits/delta
commits, pending rollbacks, pending cleans etc. diff payloads, key gen,
partitioned/non-partitioned.
Cover all different writers:
a. spark ds writer
b. spark sql
c. deltastreamer
d. spark streaming writer
Reader side validation:
lets account for snapshot read, incremental read, time travel read.
was:
We need tests added to 1.x hudi to ensure it can read 0.16.0 tables.
We should have good coverage for all new log formats, diff table types, pending
compactions, pending clustering, completed clustering, failed commits/delta
commits, pending rollbacks, pending cleans etc. diff payloads.
Reader side validation:
lets account for snapshot read, incremental read, time travel read.
> Add tests to validate 0.x tables are readable with 1.x hudi
> -----------------------------------------------------------
>
> Key: HUDI-7898
> URL: https://issues.apache.org/jira/browse/HUDI-7898
> Project: Apache Hudi
> Issue Type: Improvement
> Components: tests-ci
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
>
> We need tests added to 1.x hudi to ensure it can read 0.16.0 tables.
>
> We should have good coverage for all new log formats, diff table types,
> pending compactions, pending clustering, completed clustering, failed
> commits/delta commits, pending rollbacks, pending cleans etc. diff payloads,
> key gen, partitioned/non-partitioned.
> Cover all different writers:
> a. spark ds writer
> b. spark sql
> c. deltastreamer
> d. spark streaming writer
>
> Reader side validation:
> lets account for snapshot read, incremental read, time travel read.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
