Thomas Graves created SPARK-30623:
-------------------------------------
Summary: Spark external shuffle allow disable of separate event
loop group
Key: SPARK-30623
URL: https://issues.apache.org/jira/browse/SPARK-30623
Project: Spark
Issue Type: Bug
Components: Shuffle
Affects Versions: 2.4.4, 3.0.0
Reporter: Thomas Graves
In SPARK-24355 changes were made to add a separate event loop group for
processing ChunkFetchRequests , this allow fors the other threads to handle
regular connection requests when the configuration value is set. This however
seems to have added some latency (see pr 22173 comments at the end).
To help with this we could make sure the secondary event loop group isn't used
when the configuration of spark.shuffle.server.chunkFetchHandlerThreadsPercent
isn't explicitly set. This should result in getting the same behavior as before.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
