cloud-fan commented on a change in pull request #32781:
URL: https://github.com/apache/spark/pull/32781#discussion_r646684941
##########
File path: docs/sql-performance-tuning.md
##########
@@ -220,13 +220,15 @@ Coalesce hints allows the Spark SQL users to control the
number of output files
tuning and reducing the number of output files. The "COALESCE" hint only has a
partition number as a
parameter. The "REPARTITION" hint has a partition number, columns, or both of
them as parameters.
The "REPARTITION_BY_RANGE" hint must have column names and a partition number
is optional.
+The "COALESCE_PARTITION" hint do not has any parameter. It can merge output
files by AQE.
Review comment:
We can have a bit more discussion about the API:
1. how about other names like `REPARTITION_BEFORE_INSERT`?
2. shall we introduce hint for the INSERT statement? It's a bit weird to
have hint for write in the SELECT statement.
cc @viirya @maropu @hvanhovell
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
