cloud-fan commented on code in PR #44787:
URL: https://github.com/apache/spark/pull/44787#discussion_r1473823018
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -721,8 +721,8 @@ object SQLConf {
"shuffle partitions, but adaptively calculate the target size
according to the default " +
"parallelism of the Spark cluster. The calculated size is usually
smaller than the " +
"configured target size. This is to maximize the parallelism and avoid
performance " +
- "regression when enabling adaptive query execution. It's recommended
to set this config " +
Review Comment:
maybe just say `It's recommended to set this config to true on a busy
cluster to male resource utilization more efficient (not many small tasks).`
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala:
##########
@@ -721,8 +721,8 @@ object SQLConf {
"shuffle partitions, but adaptively calculate the target size
according to the default " +
"parallelism of the Spark cluster. The calculated size is usually
smaller than the " +
"configured target size. This is to maximize the parallelism and avoid
performance " +
- "regression when enabling adaptive query execution. It's recommended
to set this config " +
Review Comment:
maybe just say `It's recommended to set this config to true on a busy
cluster to make resource utilization more efficient (not many small tasks).`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
