xkrogen commented on a change in pull request #31936:
URL: https://github.com/apache/spark/pull/31936#discussion_r600692296
##########
File path: docs/running-on-yarn.md
##########
@@ -811,3 +831,52 @@ do the following:
to the list of filters in the <code>spark.ui.filters</code> configuration.
Be aware that the history server information may not be up-to-date with the
application's state.
+
+# Running multiple versions of the Spark Shuffle Service
+
+In some cases it may be desirable to run multiple instances of the Spark
Shuffle Service which are
+using different versions of Spark. This can be helpful, for example, when
running a YARN cluster
+with a mixed workload of applications running multiple Spark versions, since a
given version of
+the shuffle service is not always compatible with other versions of Spark.
YARN versions since 2.9.0
+support the ability to run shuffle services within an isolated classloader
Review comment:
Makes sense, called this out as the first line of the section.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
