Github user mengxr commented on the issue:
https://github.com/apache/spark/pull/22085
@HyukjinKwon Thanks for the feedback! We will replace the py4j route by a
special implementation that can only trigger "context.barrier()" in JVM.--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
