RE: Unable to connect with Spark Interpreter

2016-11-30 Thread Jan Botorek
I finally decided to move the solution to Ubuntu machine where everything works fine. I really don’t know the fundamental problem, why Windows and Zeppelin not work together. It is certain that there is a problem in Spark Interpreter and Zeppelin Engine communication. Unfortunately, I cannot sp

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

2016-11-30 Thread Ruslan Dautkhanov
Jeff, Yep, that was it. Thank you! -- Ruslan Dautkhanov On Wed, Nov 30, 2016 at 7:34 PM, Jeff Zhang wrote: > Hi Ruslan, > > I miss another thing, You also need to delete file conf/interpreter.json > which store the original setting. Otherwise the original setting is always > loaded. > > >

Re: sparkContext to get Spark Driver's URL

2016-11-30 Thread Ruslan Dautkhanov
Thanks Jeff. ZEPPELIN-1692 will be very helpful. -- Ruslan Dautkhanov On Wed, Nov 30, 2016 at 6:56 PM, Jeff Zhang wrote: > You can get ui by > > sc.uiWebUrl > > And community is working on to display it in paragraph. > https://github.com/apache/zeppelin/pull/1663 > > > Ruslan Dautkhanov 于20

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

2016-11-30 Thread Jeff Zhang
Hi Ruslan, I miss another thing, You also need to delete file conf/interpreter.json which store the original setting. Otherwise the original setting is always loaded. Ruslan Dautkhanov 于2016年12月1日周四 上午1:03写道: > Got it. Thanks Jeff. > > I've downloaded > > https://github.com/apache/zeppelin/blob

Re: sparkContext to get Spark Driver's URL

2016-11-30 Thread Jeff Zhang
You can get ui by sc.uiWebUrl And community is working on to display it in paragraph. https://github.com/apache/zeppelin/pull/1663 Ruslan Dautkhanov 于2016年12月1日周四 上午8:58写道: > Any easy way to get Spark Driver's URL (i.e. from sparkContext )? > I always have to go to CM -> YARN applications -> c

Re: Zeppelin or Jupiter

2016-11-30 Thread Ruslan Dautkhanov
Mich, This page has examples for both Active Directory and LDAP: https://zeppelin.apache.org/docs/0.6.2/security/shiroauthentication.html activeDirectoryRealm = org.apache.zeppelin.server.ActiveDirectoryGroupRealm activeDirectoryRealm.systemUsername = userNameA activeDirectoryRealm.systemPasswor

sparkContext to get Spark Driver's URL

2016-11-30 Thread Ruslan Dautkhanov
Any easy way to get Spark Driver's URL (i.e. from sparkContext )? I always have to go to CM -> YARN applications -> choose my Spark job -> click Application Master etc. to get Spark's Driver UI. Any way we could derive driver's URL programmatically from SparkContext variable? ps. Long haul - it

Re: Zeppelin or Jupiter

2016-11-30 Thread Mich Talebzadeh
Guys, How Active Directory/LDAP and Kerberos are integrated with Zeppelin? thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://taleb

Save the date: ApacheCon Miami, May 15-19, 2017

2016-11-30 Thread Rich Bowen
Dear Apache enthusiast, ApacheCon and Apache Big Data will be held at the Intercontinental in Miami, Florida, May 16-18, 2017. Submit your talks, and register, at http://apachecon.com/ Talks aimed at the Big Data section of the event should go to http://events.linuxfoundation.org/events/apache-bi

shiro.ini [urls] authorization: lock Zeppelin to one user

2016-11-30 Thread Ruslan Dautkhanov
Until we have a good multitenancy support in Zeppelin, we'd have to run individual Zeppelin instances for each user. We were trying to use following shiro.ini configurations: > [urls] > /api/version = anon > /** = user["rdautkhanov@CORP.DOMAIN"] Also tried > /** = authc, user["rdautkhanov@CORP

Re: 0.7.0 zeppelin.interpreters change: can't make pyspark be default Spark interperter

2016-11-30 Thread Ruslan Dautkhanov
Got it. Thanks Jeff. I've downloaded https://github.com/apache/zeppelin/blob/master/spark/src/main/resources/ interpreter-setting.json and saved to $ZEPPELIN_HOME/interpreter/spark/ Then Moved "defaultInterpreter": true, from json section "className": "org.apache.zeppelin.spark.SparkInterpret