Re: switching between python2 and 3 for %pyspark

2018-10-26 Thread Jeff Zhang
IIUC, You change the source code spark interpreter by adding another py3spark interpreter, is that right ? >>> Nevertheless, zeppelin_ipythonxxx/ipython_server.py >>> seems catching environment variable from zeppelin-env.sh and not from interpreter settings. zeppelin will read env from both zeppel

Re: switching between python2 and 3 for %pyspark

2018-10-26 Thread Ruslan Dautkhanov
Thanks Jeff , yep that's what we have too in [1] - that's what we have currently in interpreter settings now. It doesn't work for some reason. We're running Zeppelin from ~May'18 snapshot - has anything changed since then? Ruslan [1] LD_LIBRARY_PATH /opt/cloudera/parcels/Anaconda3/lib PATH

Re: switching between python2 and 3 for %pyspark

2018-10-26 Thread Jeff Zhang
Hi Ruslan, I believe you can just set PYSPARK_PYTHON in spark interpreter setting to switch between python2 and python3 Ruslan Dautkhanov 于2018年10月27日周六 上午2:26写道: > I'd like to give users ability to switch between Python2 and Python3 for > their PySpark jobs. > Was somebody able to set up some

switching between python2 and 3 for %pyspark

2018-10-26 Thread Ruslan Dautkhanov
I'd like to give users ability to switch between Python2 and Python3 for their PySpark jobs. Was somebody able to set up something like this, so they can switch between python2 and python3 pyspark interpreters? For this experiment, created a new %py3spark interpreter, assigned to spark interpreter