[
https://issues.apache.org/jira/browse/HUDI-7882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-7882:
--------------------------------------
Description:
We wanted to support reading 1.x tables in 0.16.0 release. So, creating this
umbrella ticket to track all of them.
Changes required to be ported:
0. Creating 0.16.0 branch
0.a https://issues.apache.org/jira/browse/HUDI-7860
1. Timeline
1.a Commit instant parsing should be able to read 1.x instants.
https://issues.apache.org/jira/browse/HUDI-7883
1.b Commit metadata parsing is able to handle both json and avro formats. Scope
might be non-trivial. https://issues.apache.org/jira/browse/HUDI-7866
1.c HoodieDefaultTimeline able to read both timelines based on table version.
https://issues.apache.org/jira/browse/HUDI-7884
1.d Reading LSM timeline using 0.16.0
https://issues.apache.org/jira/browse/HUDI-7890
2. Table property changes
2.a Table property changes https://issues.apache.org/jira/browse/HUDI-7885
https://issues.apache.org/jira/browse/HUDI-7865
3. MDT table changes
3.a record positions to RLI https://issues.apache.org/jira/browse/HUDI-7877
3.b MDT payload schema changes. https://issues.apache.org/jira/browse/HUDI-7886
4. Log format changes
4.a All metadata header types porting
https://issues.apache.org/jira/browse/HUDI-7887
4.b Meaningful error for incompatible features from 1.x
https://issues.apache.org/jira/browse/HUDI-7888
5. Tests
5.a Tests to validate that 1.x tables can be read w/ 0.16.0
https://issues.apache.org/jira/browse/HUDI-7896
6 Doc changes
5.a Call out unsupported features in 0.16.0 reader when reading 1.x tables.
https://issues.apache.org/jira/browse/HUDI-7889
was:
We wanted to support reading 1.x tables in 0.16.0 release. So, creating this
umbrella ticket to track all of them.
Changes required to be ported:
0. Creating 0.16.0 branch
0.a https://issues.apache.org/jira/browse/HUDI-7860
1. Timeline
1.a Commit instant parsing should be able to read 1.x instants.
https://issues.apache.org/jira/browse/HUDI-7883
1.b Commit metadata parsing is able to handle both json and avro formats. Scope
might be non-trivial. https://issues.apache.org/jira/browse/HUDI-7866
1.c HoodieDefaultTimeline able to read both timelines based on table version.
https://issues.apache.org/jira/browse/HUDI-7884
1.d Reading LSM timeline using 0.16.0
https://issues.apache.org/jira/browse/HUDI-7890
2. Table property changes
2.a Table property changes https://issues.apache.org/jira/browse/HUDI-7885
https://issues.apache.org/jira/browse/HUDI-7865
3. MDT table changes
3.a record positions to RLI https://issues.apache.org/jira/browse/HUDI-7877
3.b MDT payload schema changes. https://issues.apache.org/jira/browse/HUDI-7886
4. Log format changes
4.a All metadata header types porting
https://issues.apache.org/jira/browse/HUDI-7887
4.b Meaningful error for incompatible features from 1.x
https://issues.apache.org/jira/browse/HUDI-7888
5 Doc changes
5.a Call out unsupported features in 0.16.0 reader when reading 1.x tables.
https://issues.apache.org/jira/browse/HUDI-7889
> Umbrella ticket to track all changes required to support reading 1.x tables
> with 0.16.0
> ----------------------------------------------------------------------------------------
>
> Key: HUDI-7882
> URL: https://issues.apache.org/jira/browse/HUDI-7882
> Project: Apache Hudi
> Issue Type: Improvement
> Components: reader-core
> Reporter: sivabalan narayanan
> Priority: Major
>
> We wanted to support reading 1.x tables in 0.16.0 release. So, creating this
> umbrella ticket to track all of them.
>
> Changes required to be ported:
> 0. Creating 0.16.0 branch
> 0.a https://issues.apache.org/jira/browse/HUDI-7860
>
> 1. Timeline
> 1.a Commit instant parsing should be able to read 1.x instants.
> https://issues.apache.org/jira/browse/HUDI-7883
> 1.b Commit metadata parsing is able to handle both json and avro formats.
> Scope might be non-trivial. https://issues.apache.org/jira/browse/HUDI-7866
> 1.c HoodieDefaultTimeline able to read both timelines based on table version.
> https://issues.apache.org/jira/browse/HUDI-7884
> 1.d Reading LSM timeline using 0.16.0
> https://issues.apache.org/jira/browse/HUDI-7890
>
> 2. Table property changes
> 2.a Table property changes https://issues.apache.org/jira/browse/HUDI-7885
> https://issues.apache.org/jira/browse/HUDI-7865
>
> 3. MDT table changes
> 3.a record positions to RLI https://issues.apache.org/jira/browse/HUDI-7877
> 3.b MDT payload schema changes.
> https://issues.apache.org/jira/browse/HUDI-7886
>
> 4. Log format changes
> 4.a All metadata header types porting
> https://issues.apache.org/jira/browse/HUDI-7887
> 4.b Meaningful error for incompatible features from 1.x
> https://issues.apache.org/jira/browse/HUDI-7888
>
> 5. Tests
> 5.a Tests to validate that 1.x tables can be read w/ 0.16.0
> https://issues.apache.org/jira/browse/HUDI-7896
>
> 6 Doc changes
> 5.a Call out unsupported features in 0.16.0 reader when reading 1.x tables.
> https://issues.apache.org/jira/browse/HUDI-7889
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
