Github user jose-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/21293#discussion_r187641941
--- Diff: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ---
@@ -769,6 +796,43 @@ private[spark] class MapOutputTrackerWorker(conf:
SparkConf) extends MapOutputTr
}
}
+/**
+ * MapOutputTrackerWorker for continuous processing, the main difference
with MapOutputTracker
+ * is waiting for a time when the upstream's map output status not ready.
--- End diff --
We can't really make changes that maybe don't change existing behavior.
They need to definitely not change existing behavior, ideally by not using the
same codepath if they need to do different things.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
