Hi, While reviewing ShuffleManager I've noticed that registerShuffle method [1] takes shuffleId and ShuffleDependency which seems a code duplication since ShuffleDependency has shuffleId.
Any reason for having shuffleId specified explicitly? [1] https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/shuffle/ShuffleManager.scala#L35 Pozdrawiam, Jacek Laskowski ---- https://medium.com/@jaceklaskowski/ Mastering Apache Spark 2.0 https://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org