[
https://issues.apache.org/jira/browse/HUDI-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893014#comment-17893014
]
Vinoth Chandar edited comment on HUDI-7665 at 10/26/24 1:34 AM:
----------------------------------------------------------------
One consideration for TT queries is, even with compaction, the older log files
will be needed for TT queries.. So the reader has to be able to build file
slices correctly with log files named both ways... (base vs delta commit
difference)
We believe the file slicing should handle both. but we can still compact so a
file slice does not have a mix of log files named differently.
was (Author: vc):
One consideration for TT queries is, even with compaction, the older log files
will be needed for TT queries.. So the reader has to be able to build file
slices correctly with log files named both ways... (base vs delta commit
difference)
> Rolling upgrade to table version 8
> ----------------------------------
>
> Key: HUDI-7665
> URL: https://issues.apache.org/jira/browse/HUDI-7665
> Project: Apache Hudi
> Issue Type: Task
> Reporter: Sagar Sumit
> Assignee: Balaji Varadarajan
> Priority: Major
> Labels: hudi-1.0.0-beta2
> Fix For: 1.1.0
>
>
> We need to update the table version due to the format changes in 1.0.
> | * Migrating table properties including key generators, payloads.
> * Migrating timeline to new layout
> * Full compact the table and clean, to get rid of log files?
> * Migration path for CDC and incremental queries.|
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
