Thanks
I created the issue
Regards
Carlos
On Tue 9. Mar 2021 at 19:02, moon soo Lee wrote:
> Pyspark interpreter have 'intp' variable exposed in its repl environment
> (for internal use). And we can resolve reference to Spark interpreter from
> the 'intp' variable. However, scala repl environmen
Pyspark interpreter have 'intp' variable exposed in its repl environment
(for internal use). And we can resolve reference to Spark interpreter from
the 'intp' variable. However, scala repl environment in Spark Interpreter
doesn't expose any variables that is useful for finding Spark Interpreter
its
Looks good Moon
Is there a specific reason why you needed the pyspark interpreter to
access the spark interpreter? Could not the spark interpreter
programmatically access itself (and the same for the pyspark interpreter)
Would the issue be to expose the z.interpret() method?
Best regards
Carlos
I see. If you want to specify a file, precode might not the best option.
I found a hacky way to do it. Accessing SparkInterpreter instance object
from PysparkInterpreter.
%pyspark
sparkIntpField = intp.getClass().getDeclaredField("sparkInterpreter")
sparkIntpField.setAccessible(True)
sparkIntp = s
