Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/21990
> We could just translate the rest of GetOrCreate into Python but then
every time there is a patch of the code in scala it will need a Python mod as
well.
@RussellSpitzer, I actually think we already duplicate some codes in Python
side and Scala side at this code path now (see `getOrCreate` at Scala side and
`__init__` at Python side). They are now duplicatedly executed with this
change. I believe this isn't a orthogonal stuff to handle separately.
If that requires a bit of duplicated codes in Python side to avoid
duplicated code path executions, then I think that can be a workaround to get
through for now.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
