[
https://issues.apache.org/jira/browse/SPARK-56175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yang Jie updated SPARK-56175:
-----------------------------
Summary: FileTable implements SupportsPartitionManagement and V2 catalog
table loading (was: FileTable implements SupportsPartitionManagement)
> FileTable implements SupportsPartitionManagement and V2 catalog table loading
> -----------------------------------------------------------------------------
>
> Key: SPARK-56175
> URL: https://issues.apache.org/jira/browse/SPARK-56175
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 4.2.0
> Reporter: Yang Jie
> Priority: Major
>
> Add partition DDL support for V2 file tables. `FileTable` implements
> `SupportsPartitionManagement` with: `createPartition` (creates directory,
> supports custom LOCATION), `dropPartition` (deletes directory),
> `listPartitionIdentifiers` (merges filesystem scan with catalog metadata),
> `partitionSchema` (falls back to `userSpecifiedPartitioning`). Partition
> operations sync to catalog metastore (best-effort). `CatalogFileIndex` used
> when catalog has registered partitions for custom partition location reads.
> `V2SessionCatalog` sets `useCatalogFileIndex`. `DataSourceV2Strategy` adds
> strategy entries for ADD/DROP/SHOW PARTITIONS.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
