Yuming Wang created SPARK-35793:
-----------------------------------
Summary: Repartition before writing data source tables
Key: SPARK-35793
URL: https://issues.apache.org/jira/browse/SPARK-35793
Project: Spark
Issue Type: Umbrella
Components: SQL
Affects Versions: 3.2.0
Reporter: Yuming Wang
This umbrella ticket aim to track repartition before writing data source
tables. It contains:
# repartition by dynamic partition column before writing dynamic partition
tables.
# repartition before writing normal tables to avoid generating too many small
files.
# Improve local shuffle reader.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
