Github user imatiach-msft commented on the issue:
https://github.com/apache/spark/pull/19845
LGTM as long as all tests pass - but what about the other methods that use
"ctx = SparkContext._active_spark_context" -- should those be modified as well?
Can you run those one after the other in sequence too, or do they fail with
the same error? I recall I tried to get the current session just like this in
the first iteration but the python tests started to fail when run in parallel,
that was the original reason to move to use _active_spark_context.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
