[
https://issues.apache.org/jira/browse/HDDS-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreeja updated HDDS-14943:
--------------------------
Description:
Add logic to find the valid snapshots of the Iceberg table and rewrite manifest
lists associated with those snapshots by Iterating through each valid snapshot.
We can take help of Iceberg's RewriteTablePathUtil methods to replace
sourcePrefix -> targetPrefix for each manifest file absolute path mentioned in
the manifest list associated with the respective snapshot and then add the
rewritten manifest list file in staging location.
We should also update copy plan with staging -> final path mappings for each
manifest list file rewritten.
was:
Add logic to find the valid snapshots for the table and rewrite manifest lists
associated with those snapshots by Iterating through each valid snapshot. We
can take help of Iceberg's RewriteTablePathUtil methods to replace sourcePrefix
-> targetPrefix for each manifest file absolute path mentioned in the manifest
list associated with the respective snapshot and then add the rewritten
manifest list file in staging location.
We should also update copy plan with staging -> final path mappings for each
manifest list file rewritten.
> Implement manifest list rewrite logic for path migration
> --------------------------------------------------------
>
> Key: HDDS-14943
> URL: https://issues.apache.org/jira/browse/HDDS-14943
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Sreeja
> Assignee: Sreeja
> Priority: Major
>
> Add logic to find the valid snapshots of the Iceberg table and rewrite
> manifest lists associated with those snapshots by Iterating through each
> valid snapshot. We can take help of Iceberg's RewriteTablePathUtil methods to
> replace sourcePrefix -> targetPrefix for each manifest file absolute path
> mentioned in the manifest list associated with the respective snapshot and
> then add the rewritten manifest list file in staging location.
> We should also update copy plan with staging -> final path mappings for each
> manifest list file rewritten.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
