Hi,

While reviewing ShuffleManager I've noticed that registerShuffle
method [1] takes shuffleId and ShuffleDependency which seems a code
duplication since ShuffleDependency has shuffleId.

Any reason for having shuffleId specified explicitly?

[1] 
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/shuffle/ShuffleManager.scala#L35

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Reply via email to