[
https://issues.apache.org/jira/browse/HDDS-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreeja updated HDDS-14943:
--------------------------
Description:
Add logic to find the valid snapshots for the table and rewrite manifest lists
associated with those snapshots by Iterating through each valid snapshot. We
can take help of Iceberg's RewriteTablePathUtil methods to replace sourcePrefix
-> targetPrefix for each manifest file absolute path mentioned in the manifest
list associated with the respective snapshot and then write the rewritten
manifest list file in staging location.
We should also update copy plan with staging -> final path mappings for each
manifest list file rewritten.
was:
Add logic to find the valid snapshots for the table and rewrite manifest lists
associated with those snapshots by Iterating through each valid snapshot. We
can take help of Iceberg's RewriteTablePathUtil methods to replace sourcePrefix
-> targetPrefix in each and write the rewritten file in staging location.
We should also update copy plan with staging -> final path mappings for each
manifest list file rewritten.
> Implement manifest list rewrite logic for path migration
> --------------------------------------------------------
>
> Key: HDDS-14943
> URL: https://issues.apache.org/jira/browse/HDDS-14943
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Sreeja
> Assignee: Sreeja
> Priority: Major
>
> Add logic to find the valid snapshots for the table and rewrite manifest
> lists associated with those snapshots by Iterating through each valid
> snapshot. We can take help of Iceberg's RewriteTablePathUtil methods to
> replace sourcePrefix -> targetPrefix for each manifest file absolute path
> mentioned in the manifest list associated with the respective snapshot and
> then write the rewritten manifest list file in staging location.
> We should also update copy plan with staging -> final path mappings for each
> manifest list file rewritten.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
