Yang Jie created SPARK-56174:
--------------------------------
Summary: V2 file write ErrorIfExists/Ignore modes and INSERT INTO
format.path
Key: SPARK-56174
URL: https://issues.apache.org/jira/browse/SPARK-56174
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.2.0
Reporter: Yang Jie
Complete `SaveMode` coverage for V2 file write.
# `DataFrameWriter`: route `ErrorIfExists` and `Ignore` modes to V2 path with
path existence check matching V1 semantics.
# `ResolveSQLOnFile`: V2 resolution for `FileDataSourceV2` providers, enabling
`INSERT INTO parquet.\`path\`` syntax.
# `FileDataSourceV2.getTable`: use `collect` to handle transforms properly.
# `FileTable`: `userSpecifiedPartitioning` plumbing so DataFrame API
`partitionBy` columns reach `FileWrite.partitionSchema` for V2 partitioned
writes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
