Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22962#discussion_r232527808
--- Diff: python/pyspark/tests.py ---
@@ -614,6 +614,18 @@ def context_barrier(x):
times =
rdd.barrier().mapPartitions(f).map(context_barrier).collect()
self.assertTrue(max(times) - min(times) < 1)
+ def test_barrier_with_python_worker_reuse(self):
+ """
+ Verify that BarrierTaskContext.barrier() with reused python worker.
+ """
+ rdd = self.sc.parallelize(range(4), 4)
--- End diff --
Thanks, done in 02555b8.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
