Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/22085#discussion_r209464591
--- Diff: python/pyspark/worker.py ---
@@ -275,6 +280,10 @@ def main(infile, outfile):
shuffle.DiskBytesSpilled = 0
_accumulatorRegistry.clear()
+ if isBarrier:
+ paras = GatewayParameters(port=boundPort, auth_token=secret,
auto_convert=True)
--- End diff --
Maybe `params` instead of `paras`?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
