[ 
https://issues.apache.org/jira/browse/HDDS-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sreeja updated HDDS-14943:
--------------------------
    Description: 
Add logic to find the valid snapshots for the table and rewrite manifest lists 
associated with those snapshots by Iterating through each valid snapshot. We 
can use Iceberg's RewriteTablePathUtil methods to replace sourcePrefix -> 
targetPrefix in each and update the rewritten file in staging location.

We should also update copy plan with staging -> final path mappings for each 
manifest list file rewritten.

  was:
Add logic to *rewrite manifest lists for snapshots* by Iterating over valid 
snapshots and rewrite their associated manifest lists by replacing sourcePrefix 
-> targetPrefix in each and update in staging location (using iceberg's 
RewriteTablePathUtil)

Update copy plan with *staging -> final path mappings* for each manifest list 
file rewritten.


> Implement manifest list rewrite logic for path migration
> --------------------------------------------------------
>
>                 Key: HDDS-14943
>                 URL: https://issues.apache.org/jira/browse/HDDS-14943
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: Sreeja
>            Assignee: Sreeja
>            Priority: Major
>
> Add logic to find the valid snapshots for the table and rewrite manifest 
> lists associated with those snapshots by Iterating through each valid 
> snapshot. We can use Iceberg's RewriteTablePathUtil methods to replace 
> sourcePrefix -> targetPrefix in each and update the rewritten file in staging 
> location.
> We should also update copy plan with staging -> final path mappings for each 
> manifest list file rewritten.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to