jerqi commented on code in PR #699:
URL: https://github.com/apache/incubator-uniffle/pull/699#discussion_r1130343659
##########
client-spark/spark2/src/main/java/org/apache/spark/shuffle/RssShuffleManager.java:
##########
@@ -188,6 +188,8 @@ public RssShuffleManager(SparkConf sparkConf, boolean
isDriver) {
// External shuffle service is not supported when using remote shuffle
service
sparkConf.set("spark.shuffle.service.enabled", "false");
LOG.info("Disable external shuffle service in RssShuffleManager.");
+ sparkConf.set("spark.shuffle.reduceLocality.enabled", "false");
Review Comment:
Because our data is in the RSS cluster or HDFS, locatity is useless for us.
If rack aware need this feature, we can turn on this feature when we use rack
aware.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
