Yang Jie created SPARK-56170:
--------------------------------
Summary: Enable V2 file write path for built-in file formats
Key: SPARK-56170
URL: https://issues.apache.org/jira/browse/SPARK-56170
Project: Spark
Issue Type: Umbrella
Components: SQL
Affects Versions: 4.2.0
Reporter: Yang Jie
All built-in file formats (parquet, orc, csv, json, text, avro) default to the
V1 write path via `spark.sql.sources.useV1SourceList`. The V2 file write path
(`FileWrite`) was disabled since SPARK-28396. This umbrella covers enabling a
fully functional V2 file write path: partitioned writes, dynamic overwrite,
catalog integration, partition management, statistics, bucketing, and MSCK
REPAIR TABLE.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
