Hi probably not what u r looking for but if u get stuck with conda jupyther and spark, if u get an account @ community.cloudera you will enjoy jupyther and spark out of the box Gd luck and hth Kr
On Nov 4, 2017 4:59 PM, "makoto" <tokomakoma...@gmail.com> wrote: > I setup environment variables in my ~/.bashrc as follows: > > export PYSPARK_PYTHON=/usr/local/oss/anaconda3/bin/python3.6 > export PYTHONPATH=$(ls -a ${SPARK_HOME}/python/lib/py4j- > *-src.zip):${SPARK_HOME}/python:$PYTHONPATH > export PYSPARK_DRIVER_PYTHON=jupyter > export PYSPARK_DRIVER_PYTHON_OPTS='notebook' > > > 2017-11-03 20:56 GMT+09:00 Jeff Zhang <zjf...@gmail.com>: > >> >> You are setting PYSPARK_DRIVER to jupyter, please set it to python exec >> file >> >> >> anudeep <anud...@gmail.com>于2017年11月3日周五 下午7:31写道: >> >>> Hello experts, >>> >>> I install jupyter notebook thorugh anacoda, set the pyspark driver to >>> use jupyter notebook. >>> >>> I see the below issue when i try to open pyspark. >>> >>> anudeepg@datanode2 spark-2.1.0]$ ./bin/pyspark >>> [I 07:29:53.184 NotebookApp] The port 8888 is already in use, trying >>> another port. >>> [I 07:29:53.211 NotebookApp] JupyterLab alpha preview extension loaded >>> from /home/anudeepg/anaconda2/lib/python2.7/site-packages/jupyterlab >>> JupyterLab v0.27.0 >>> Known labextensions: >>> [I 07:29:53.212 NotebookApp] Running the core application with no >>> additional extensions or settings >>> [I 07:29:53.214 NotebookApp] Serving notebooks from local directory: >>> /opt/mapr/spark/spark-2.1.0 >>> [I 07:29:53.214 NotebookApp] 0 active kernels >>> [I 07:29:53.214 NotebookApp] The Jupyter Notebook is running at: >>> http://localhost:8889/?token=9aa5dc87cb5a6d987237f68e2f0b7e9 >>> c70a7f2e8c9a7cf2e >>> [I 07:29:53.214 NotebookApp] Use Control-C to stop this server and shut >>> down all kernels (twice to skip confirmation). >>> [W 07:29:53.214 NotebookApp] No web browser found: could not locate >>> runnable browser. >>> [C 07:29:53.214 NotebookApp] >>> >>> Copy/paste this URL into your browser when you connect for the first >>> time, >>> to login with a token: >>> http://localhost:8889/?token=9aa5dc87cb5a6d987237f68e2f0b7e9 >>> c70a7f2e8c9a7cf2e >>> >>> >>> Can someone please help me here. >>> >>> Thanks! >>> Anudeep >>> >>> >