Github user RussellSpitzer commented on the issue:
https://github.com/apache/spark/pull/21990
@HyukjinKwon So i've been staring at this for a while today, and I guess
the big issue is that we always need to make a Python SparkContext to get a
handle on the JavaGateway, so everything that happens before the context is
made cannot just be a wrapper of SQL methods and must reimplement. Unless we
decided to refactor the code so that the JVM is more generally available
(probably not possible) we will be stuck with redoing code in python ...
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
