Github user felixcheung commented on a diff in the pull request:
https://github.com/apache/spark/pull/21494#discussion_r194168480
--- Diff:
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala ---
@@ -179,6 +182,21 @@ private[spark] abstract class BasePythonRunner[IN,
OUT](
// Python version of driver
PythonRDD.writeUTF(pythonVer, dataOut)
// Write out the TaskContextInfo
+ val isBarrier = context.isInstanceOf[BarrierTaskContext]
+ dataOut.writeBoolean(isBarrier)
+ if (isBarrier) {
--- End diff --
so this would be language dependent? would need something for R runner too?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
