[
https://issues.apache.org/jira/browse/HDDS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sreeja updated HDDS-14938:
--------------------------
Description:
This change introduces support for Iceberg's *RewriteTablePath action* that
accepts location prefixes i.e the source prefix path and target prefix, it also
accepts the start and end version defining the rage of rewrite.
*Prefix Rewrite Configuration*
* Allow specifying:
** {{sourcePrefix}} (existing path prefix)
** {{targetPrefix}} (replacement prefix)
* Ensure source and target prefixes are non-empty and not identical
*Version Range Support*
* Optional {{startVersion}} and {{endVersion}} inputs.
* Validate that provided version exist in table.
* Defaults:
** {{endVersion}} → current metadata version if not provided
** {{startVersion}} → if not set, rewrite applies up to end version from
beginning version.
*
*Staging Location Handling*
* Supports user-defined staging directory.
* If not provided, automatically generates a staging path within the tables's
metadata directory.
was:
This change introduces support for configuring Iceberg's *RewriteTablePath
action* that accepts location prefixes i.e the source prefix path and target
prefix, it also accepts the start and end version defining the rage of rewrite.
h3. *Key Features*
* *Prefix Rewrite Configuration*
*
** Allows specifying:
*
**
*** {{sourcePrefix}} (existing path prefix)
*
**
*** {{targetPrefix}} (replacement prefix)
*
** Ensures source and target prefixes are non-empty and not identical.
* *Version Range Support*
*
** Optional {{startVersion}} and {{endVersion}} inputs.
*
** Validates that provided version names exist in table metadata logs.
*
** Defaults:
*
**
*** {{endVersion}} → current metadata version if not provided
*
**
*** {{startVersion}} → optional (if not set, rewrite applies up to end version)
* *Staging Location Handling*
*
** Supports user-defined staging directory.
*
** If not provided, automatically generates a staging path using:
*
**
*** table metadata location
*
**
*** random UUID
*
** Ensures proper path formatting (trailing separator handling).
* *Metadata Validation*
*
** Ensures:
*
**
*** version exists in metadata log (current or previous files)
*
**
*** version file physically exists
> Implement RewriteTablePath action and validate inputs provided
> --------------------------------------------------------------
>
> Key: HDDS-14938
> URL: https://issues.apache.org/jira/browse/HDDS-14938
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Sreeja
> Assignee: Sreeja
> Priority: Major
>
> This change introduces support for Iceberg's *RewriteTablePath action* that
> accepts location prefixes i.e the source prefix path and target prefix, it
> also accepts the start and end version defining the rage of rewrite.
> *Prefix Rewrite Configuration*
> * Allow specifying:
> ** {{sourcePrefix}} (existing path prefix)
> ** {{targetPrefix}} (replacement prefix)
> * Ensure source and target prefixes are non-empty and not identical
> *Version Range Support*
> * Optional {{startVersion}} and {{endVersion}} inputs.
> * Validate that provided version exist in table.
> * Defaults:
> ** {{endVersion}} → current metadata version if not provided
> ** {{startVersion}} → if not set, rewrite applies up to end version from
> beginning version.
> *
> *Staging Location Handling*
> * Supports user-defined staging directory.
> * If not provided, automatically generates a staging path within the
> tables's metadata directory.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
