Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Tan, Jialiang
s, this is a bug of livy interpreter, Could you help create a ticket ? Thanks Tan, Jialiang mailto:j...@ea.com>>于2017年11月4日周六 上午7:50写道: But somehow Spark interpreter works without this problem. Why is that the case if the problem is on Zeppelin UI side? From: Jeff Zhang mailto:zjf...@gmail.

Re: Livy interpreter Scala code string interpolation

2017-11-03 Thread Tan, Jialiang
e of colliding with shell scripts and Scala code? This will be hard to do due to the variety of interpreters supported. Perhaps this can be made configurable? On Fri, Nov 3, 2017 at 10:36 AM, Tan, Jialiang mailto:j...@ea.com>> wrote: Hi, When writing Spark Scala code in zeppelin with Livy in

Livy interpreter Scala code string interpolation

2017-11-03 Thread Tan, Jialiang
Hi, When writing Spark Scala code in zeppelin with Livy interpreter, string interpolation does not seem to work. For example: val devices = sc.objectFile[(VertexId, DeviceAttr)]( s"s3a://${bucket}/${datasetS3Prefix}/${tableName} /dt=${end_dt}/tid=${tid}/${datasetS3Suffix}") I think the dollar

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Tan, Jialiang
torage, it's about how to update the storage. For now, for each change, the whole file needs to be updated. You scenario means each change only update one record. Tan, Jialiang mailto:j...@ea.com>>于2017年10月17日周二 下午3:47写道: I went through those tickets. Are there any plans on those improv

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Tan, Jialiang
ubject: Re: notebook-authorization.json file makes Zeppelin not scalable Still in file format. Tan, Jialiang mailto:j...@ea.com>>于2017年10月17日周二 下午3:38写道: Thanks for such quick reply. Does Zepplin 0.8.0-SNAPSHOT MONGO DB store autorizations in db or still in that json file? From: Jeff Zha

Re: notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Tan, Jialiang
t would require more deep integration with shiro's authorization. Tan, Jialiang mailto:j...@ea.com>>于2017年10月17日周二 下午3:14写道: We want to have a Zeppelin service that serves over 200 people in our company. So we plan to have around 10 – 15 Zeppelin instances behind an ELB. We use S3 as

notebook-authorization.json file makes Zeppelin not scalable

2017-10-17 Thread Tan, Jialiang
We want to have a Zeppelin service that serves over 200 people in our company. So we plan to have around 10 – 15 Zeppelin instances behind an ELB. We use S3 as notebook storage, and hence all our Zeppelin instances are referring to the same S3 location for notebooks. But there is one thing that

Re: Zeppelin Interpreter Page Not Showing

2017-09-28 Thread Tan, Jialiang
reter Page Not Showing Which version of zeppelin do you use ? And could you check the zeppelin server log ? Best Regard, Jeff Zhang From: "Tan, Jialiang" mailto:j...@ea.com>> Reply-To: "users@zeppelin.apache.org<mailto:users@zeppelin.apache.org>" mailto:users@ze

Zeppelin Interpreter Page Not Showing

2017-09-27 Thread Tan, Jialiang
There are cases where after using Zeppelin for a while, its interpreter page does not show. Also I was not able to run any paragraphs anymore (nothing happens when click run button, not even any message). It seems that something is broken. Now I have to restart my Zeppelin instance when this hap

Zeppelin Interpreter Lifetime

2017-09-26 Thread Tan, Jialiang
We are having the same problem as described in https://issues.apache.org/jira/browse/ZEPPELIN-2197 We have one interpreter each user and we have a lot of users. Basically resources got sucked up by all those idled interpreters. There is one comment --- Kill it after idle for a while. How do you