Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/22011#discussion_r208092333
--- Diff: python/pyspark/rdd.py ---
@@ -2406,6 +2406,18 @@ def toLocalIterator(self):
sock_info =
self.ctx._jvm.PythonRDD.toLocalIteratorAndServe(self._jrdd.rdd())
return _load_from_socket(sock_info, self._jrdd_deserializer)
+ def barrier(self):
--- End diff --
I don't know why we didn't mark the version so far here but we really
should `.. versionadded:: 2.4.0` here or
```
@since(2.4)
def barrier(self):
...
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
