Github user xuanyuanking commented on a diff in the pull request:
https://github.com/apache/spark/pull/22962#discussion_r232986340
--- Diff: python/pyspark/tests.py ---
@@ -618,10 +618,13 @@ def test_barrier_with_python_worker_reuse(self):
"""
Verify that BarrierTaskContext.barrier() with reused python worker.
"""
+ self.sc._conf.set("spark.python.work.reuse", "true")
--- End diff --
@HyukjinKwon Hi Hyukjin if you still think this need a separate class I'll
think about the method of checking worker reuse and give a follow up PR.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
