Hi,
I'm trying to get spark working on jupyter notebook, I'm using Windows 7,
anaconda2 2.5.0
I have installed toree via pip:
-----------------
pip install toree
jupyter toree install
-----------------
my kernek.json:
------------------
{
"language_info": {
"name": "scala"
},
"display_name": "Spark",
"env": {
"SEND_EMPTY_OUTPUT": "false",
"SPARK_OPTS": "--master=local[2] --driver-java-options=-Xms1024M
--driver-java-options=-Xmx4096M --driver-java-options=-Dlog4j.logLevel=info",
"SPARK_HOME": "C:\\spark-1.6.1",
"MAX_INTERPRETER_THREADS": "16",
"PYTHONPATH":
"C:\\spark-1.6.1\\python;C:\\spark-1.6.1\\python\\lib\\py4j-0.9-src.zip",
"CAPTURE_STANDARD_OUT": "true",
"CAPTURE_STANDARD_ERR": "true"
},
"argv": [
"C:\\ProgramData\\jupyter\\kernels\\toree\\bin\\run.sh",
"--profile",
"{connection_file}"
],
"codemirror_mode": "scala"
}
--------------------
And when I run "jupyter console -kernel toree" I get the following error:
-------------------
Traceback (most recent call last):
File "C:\Anaconda2\lib\site-packages\notebook\base\handlers.py", line 458, in
wrapper
result = yield gen.maybe_future(method(self, *args, **kwargs))
File "C:\Anaconda2\lib\site-packages\tornado\gen.py", line 1008, in run
value = future.result()
File "C:\Anaconda2\lib\site-packages\tornado\concurrent.py", line 232, in
result
raise_exc_info(self._exc_info)
File "C:\Anaconda2\lib\site-packages\tornado\gen.py", line 1014, in run
yielded = self.gen.throw(*exc_info)
File "C:\Anaconda2\lib\site-packages\notebook\services\sessions\handlers.py",
line 58, in post
sm.create_session(path=path, kernel_name=kernel_name))
File "C:\Anaconda2\lib\site-packages\tornado\gen.py", line 1008, in run
value = future.result()
File "C:\Anaconda2\lib\site-packages\tornado\concurrent.py", line 232, in
result
raise_exc_info(self._exc_info)
File "C:\Anaconda2\lib\site-packages\tornado\gen.py", line 1014, in run
yielded = self.gen.throw(*exc_info)
File
"C:\Anaconda2\lib\site-packages\notebook\services\sessions\sessionmanager.py",
line 73, in create_session
self.kernel_manager.start_kernel(path=kernel_path, kernel_name=kernel_name)
File "C:\Anaconda2\lib\site-packages\tornado\gen.py", line 1008, in run
value = future.result()
File "C:\Anaconda2\lib\site-packages\tornado\concurrent.py", line 232, in
result
raise_exc_info(self._exc_info)
File "C:\Anaconda2\lib\site-packages\tornado\gen.py", line 282, in wrapper
yielded = next(result)
File
"C:\Anaconda2\lib\site-packages\notebook\services\kernels\kernelmanager.py",
line 87, in start_kernel
super(MappingKernelManager, self).start_kernel(**kwargs)
File "C:\Anaconda2\lib\site-packages\jupyter_client\multikernelmanager.py",
line 109, in start_kernel
km.start_kernel(**kwargs)
File "C:\Anaconda2\lib\site-packages\jupyter_client\manager.py", line 244, in
start_kernel
**kw)
File "C:\Anaconda2\lib\site-packages\jupyter_client\manager.py", line 190, in
_launch_kernel
return launch_kernel(kernel_cmd, **kw)
File "C:\Anaconda2\lib\site-packages\jupyter_client\launcher.py", line 108,
in launch_kernel
proc = Popen(cmd, **kwargs)
File "C:\Anaconda2\lib\subprocess.py", line 710, in __init__
errread, errwrite)
File "C:\Anaconda2\lib\subprocess.py", line 958, in _execute_child
startupinfo)
TypeError: environment can only contain strings
--------------------------
Any ideas on how to solve that?
Thank you
Regards,
Mercia
Mercia Silva
Data Scientist
((( bjss
t: +44 207 337 9800
www.bjss.com<http://www.bjss.com/>
BJSS ENTERPRISE AGILE
Enterprise Agility - we wrote the book! Complimentary
download.<http://www.bjss.com/ea>
The information included in this email and any files transmitted with it may
contain information that is confidential and it must not be used by, or its
contents or attachments copied or disclosed to, persons other than the intended
addressee. If you have received this email in error, please notify BJSS. In the
absence of written agreement to the contrary BJSS' relevant standard terms of
contract for any work to be undertaken will apply. Please carry out virus or
such other checks as you consider appropriate in respect of this email. BJSS
does not accept responsibility for any adverse effect upon your system or data
in relation to this email or any files transmitted with it. BJSS Limited, a
company registered in England and Wales (Company Number 2777575), VAT
Registration Number 613295452, Registered Office Address, First Floor, Coronet
House, Queen Street, Leeds, LS1 2TW.
