Yang Jie created SPARK-56175:
--------------------------------
Summary: FileTable implements SupportsPartitionManagement
Key: SPARK-56175
URL: https://issues.apache.org/jira/browse/SPARK-56175
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.2.0
Reporter: Yang Jie
Add partition DDL support for V2 file tables. `FileTable` implements
`SupportsPartitionManagement` with: `createPartition` (creates directory,
supports custom LOCATION), `dropPartition` (deletes directory),
`listPartitionIdentifiers` (merges filesystem scan with catalog metadata),
`partitionSchema` (falls back to `userSpecifiedPartitioning`). Partition
operations sync to catalog metastore (best-effort). `CatalogFileIndex` used
when catalog has registered partitions for custom partition location reads.
`V2SessionCatalog` sets `useCatalogFileIndex`. `DataSourceV2Strategy` adds
strategy entries for ADD/DROP/SHOW PARTITIONS.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
