Github user yywwd commented on the issue:
https://github.com/apache/zeppelin/pull/2231
I have solved this problem by editing some configurations in Livy.
SivaKaviyappa's solution: setting "livy.spark.master yarn-cluster" does not
work for me. I do not edit "livy.spark.master" in
Github user SivaKaviyappa commented on the issue:
https://github.com/apache/zeppelin/pull/2231
@yywwd - Few things to check
What are your zeppelin-env.sh and livy intrepreter settings
1.have you set the PYTHONPATH in the zeppelin-env.sh
2.
Github user yywwd commented on the issue:
https://github.com/apache/zeppelin/pull/2231
@zjffdu NoSuchMethodError: org.apache.spark.ui.SparkUI.appUIAddress()
My AWS cluster is EMR-5.14.0, Application: Ganglia 3.7.2, Spark 2.3.0,
Zeppelin 0.7.3, Livy 0.4.0
---
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/2231
What kind of error you see in zeppelin when using livy.spark.master yarn
mode
---
Github user yywwd commented on the issue:
https://github.com/apache/zeppelin/pull/2231
@zjffdu This issue is not related to the codes run in zeppelin. I mean, I
cannot guarantee âUsing Livy interpreter in Zeppelinâ and "Using
Programmatic API" work well at the same time.
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/2231
Sorry, I still not sure what code you run in zeppelin. If it is livy
related issue, you need to ask question in livy mail list.
---
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/2231
Could you share your code that use programmatic API ?
---
Github user yywwd commented on the issue:
https://github.com/apache/zeppelin/pull/2231
@zjffdu I change the yarn mode into "yarn-cluster" as SivaKaviyappa
suggested, Zeppelin works well. However, when I use programmatic API, it will
throw such exception: ImportError: No module named
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/2231
Thanks @SivaKaviyappa for confirming
---
Github user SivaKaviyappa commented on the issue:
https://github.com/apache/zeppelin/pull/2231
This is works for me on aws emr. I am on emr 5.13.0, livy 0.40 , spark
2.3.0. The important change one has to make is by default aws emr brings up
livy in yarn mode. So if you change that
Github user DerekKaknes commented on the issue:
https://github.com/apache/zeppelin/pull/2231
Thanks for following-up. I'm running Livy connected to a standalone
cluster, but in digging deeper it's possible that there is an issue with Livy
always configuring itself to local mode when
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/2231
That method would only be called in livy 0.2. In livy 0.2 the spark web url
will be returned from livy rest api, so that piece of code won't be invoked.
And zeppelin has system test for that, not
Github user DerekKaknes commented on the issue:
https://github.com/apache/zeppelin/pull/2231
I'm having this same issue with zeppelin 0.7.3 + livy 0.5.0 + spark 2.2.1.
I have not yet verified that zeppelin master resolves this issue, but from
inspection I would think that
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/2231
@thesuperzapper @ererermao It works for me on zeppelin master + livy 0.5.0
+ spark 2.3.0
