HyukjinKwon commented on a change in pull request #30277:
URL: https://github.com/apache/spark/pull/30277#discussion_r519038459
##########
File path: python/pyspark/tests/test_taskcontext.py
##########
@@ -124,12 +124,12 @@ def f(iterator):
def context_barrier(x):
tc = BarrierTaskContext.get()
- time.sleep(random.randint(1, 10))
+ time.sleep(random.randint(1, 5) * 2)
Review comment:
Previously it failed even when the barrior worked some times. All the
tasks properly waited for each other and finished properly but it looks like it
could still take around a sec when the tests run in parallel.
So I increased the minimum sleep secs and the gap between each task. If
barriers don't work, it will take more than 2 secs because the minimum and the
gap is 2 seconds. If it works, it will take less than 2 seconds.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
