[
https://issues.apache.org/jira/browse/HUDI-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lokesh Jain updated HUDI-9140:
------------------------------
Description:
Filing a tracking ticket for all follow ups from HUDI-9030
[https://github.com/apache/hudi/pull/12888/files#r1985816074]
[https://github.com/apache/hudi/pull/12888/files#r1985858219]
[https://github.com/apache/hudi/pull/12888/files#r1985859138]
Any changes to LogRecordScanner classes. not really required to be fixed right
away.
2. Listing based rollback strategy.
3. Add tests to restore to a commit w/ long history w/ a mix of DC, compaction,
clustering N no of times. all inline table service would do. But restore should
succeed and data validation should remain intact.
4. Fix the IOType as Append for log files with table version 6
5. We will need to check if configs addded in version 1.0 are required for tbl
version 6
6. Ensure these are accounted for in FGR
[https://github.com/apache/hudi/pull/12888/files#r1976856670]
WIP patch:
[https://github.com/nsivabalan/hudi/tree/fixTableVersion6FixesAbstraction]
was:
Filing a tracking ticket for all follow ups from HUDI-9030
[https://github.com/apache/hudi/pull/12888/files#r1985816074]
[https://github.com/apache/hudi/pull/12888/files#r1985858219]
[https://github.com/apache/hudi/pull/12888/files#r1985859138]
Any changes to LogRecordScanner classes. not really required to be fixed right
away.
2. Listing based rollback strategy.
3. Add tests to restore to a commit w/ long history w/ a mix of DC, compaction,
clustering N no of times. all inline table service would do. But restore should
succeed and data validation should remain intact.
4. Fix the IOType as Append for log files with table version 6
5. We will need to check if configs addded in version 1.0 are required for tbl
version 6
WIP patch:
[https://github.com/nsivabalan/hudi/tree/fixTableVersion6FixesAbstraction]
> Follow up from 9030
> -------------------
>
> Key: HUDI-9140
> URL: https://issues.apache.org/jira/browse/HUDI-9140
> Project: Apache Hudi
> Issue Type: Improvement
> Components: writer-core
> Reporter: sivabalan narayanan
> Assignee: Lokesh Jain
> Priority: Major
>
> Filing a tracking ticket for all follow ups from HUDI-9030
>
> [https://github.com/apache/hudi/pull/12888/files#r1985816074]
> [https://github.com/apache/hudi/pull/12888/files#r1985858219]
> [https://github.com/apache/hudi/pull/12888/files#r1985859138]
> Any changes to LogRecordScanner classes. not really required to be fixed
> right away.
> 2. Listing based rollback strategy.
> 3. Add tests to restore to a commit w/ long history w/ a mix of DC,
> compaction, clustering N no of times. all inline table service would do. But
> restore should succeed and data validation should remain intact.
> 4. Fix the IOType as Append for log files with table version 6
> 5. We will need to check if configs addded in version 1.0 are required for
> tbl version 6
> 6. Ensure these are accounted for in FGR
> [https://github.com/apache/hudi/pull/12888/files#r1976856670]
>
>
> WIP patch:
> [https://github.com/nsivabalan/hudi/tree/fixTableVersion6FixesAbstraction]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
