Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Patrick Maroney
For issue (1) you might want to try Amazon EFS. While EFS is designed for “big data”, you can use it for other concurrency use cases.  You need to pay very close attention to your storage size/utilization ratios as EFS can complete choke off bandwidth.  I would also look at using EFS for

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Tan, Jialiang
That is correct. In fact I think the scenario is very general as long as we want Zeppelin to be scalable. Unifying storage is not going to be that useful without supporting updating single record. Without that multiple Zeppelin instances working in parallel would not be viable. From: Jeff

Re: Zeppelin Stops Loading Notes

2017-10-17 Thread Paul Brenner
As a bandaid for this, is there anyway to restart the zeppelin web server without killing running spark jobs? I suppose there would still be a risk that anyone actively editing a cell might lose their edits, but this would make it easier than finding a time when multiple people aren’t actively

Re: Zeppelin Stops Loading Notes

2017-10-17 Thread Paul Brenner
Although zeppelin has died a few times since this email came up, today was the first time where I was able to actually check the number of interpreters.  All started interpreters: 7 Spark started interpreters: 5 That doesn’t seem unreasonable to me. Here is what top is showing me, which

Re: Trying to build Zeppelin, hitting the following error

2017-10-17 Thread Michael Segel
Yeah that did it. Now dying with an error about Flink. [ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:3.2.2:compile (scala-compile-first) on project zeppelin-flink_2.11: wrap: org.apache.maven.artifact.resolver.ArtifactNotFoundException: Could not find artifact

Re: Zeppelin Request Logs

2017-10-17 Thread Suresh Ayyavoo
Have you seen /logs folder in main zeppelin folders? logs are created for following modules, more created if used zeppelin-interpreter-angular zeppelin-interpreter-jdbc zeppelin-interpreter-md zeppelin-interpreter-psql zeppelin-interpreter-python zeppelin-interpreter-spark-root zeppelin-ip

SPARK SQL update table based on condition

2017-10-17 Thread Suresh Ayyavoo
Hi All, Senario: update existing row based on column value in a table, this is how is do in SPARK SQL, i'm i doing right? is there any better way to do it in spark sql? 1. Table (zeppelin-report) row should be updated based on column value 1. select * from table1 where id not in(select id from

OpenAM LDAP integration with Zeppelin

2017-10-17 Thread Suresh Ayyavoo
Hi All, Who have integrated OpenAM LDAP with Zeppelin0.7.2? The group are not honoured in zeppelin roles?Any idea? LoginRestApi.java[postLogin]:115) - {"status":"OK","message":"","body":{"principal":"admin","ticket":"81e0db18-a10a-454f-a9b1-c9fa41abc877","roles":"[]"}} -- Suresh Ayyavoo

Re: Error with Zeppelin integration - LDAP

2017-10-17 Thread Suresh Ayyavoo
try ldapRealm.userDnTemplate = uid={0},ou=people,dc=openam,dc=forgerock,dc=org On Mon, Oct 16, 2017 at 6:24 AM, Carlos Andres Zambrano Barrera < cza...@gmail.com> wrote: > > > > HI, > > I am working with OpenLdap with the following structure (see attached) > > I configure all the shiro.ini >

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Jeff Zhang
Unify storage could be done in 0.8.0. But for your scenario, it's not about storage, it's about how to update the storage. For now, for each change, the whole file needs to be updated. You scenario means each change only update one record. Tan, Jialiang 于2017年10月17日周二 下午3:47写道: > I

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Tan, Jialiang
I went through those tickets. Are there any plans on those improvements? When will the storage layer unification be done approximately? From: Jeff Zhang Reply-To: "users@zeppelin.apache.org" Date: Tuesday, October 17, 2017 at 12:45 AM To:

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Jeff Zhang
Still in file format. Tan, Jialiang 于2017年10月17日周二 下午3:38写道: > Thanks for such quick reply. Does Zepplin 0.8.0-SNAPSHOT MONGO DB store > autorizations in db or still in that json file? > > > > *From: *Jeff Zhang > *Reply-To: *"users@zeppelin.apache.org"

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Tan, Jialiang
Thanks for such quick reply. Does Zepplin 0.8.0-SNAPSHOT MONGO DB store autorizations in db or still in that json file? From: Jeff Zhang Reply-To: "users@zeppelin.apache.org" Date: Tuesday, October 17, 2017 at 12:28 AM To: