Re: Multiple spark interpreters in the same Zeppelin instance

2016-05-06 Thread vijikarthi
od", we should be able to refer anyone of the interpreters using the alias name like below. %. For e.g., %spark-dev.spark %spark-prod.pyspark %spark-prod.spark -- View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Multiple-spark-int

Re: Multiple spark interpreters in the same Zeppelin instance

2016-05-02 Thread John Omernik
I see two components. 1. To ability to have multiple interpreters of the same time, but use different configuration options. a jdbc1, jdbc2, spark1, spark2, spark3, etc. What ever you want to name them is great, but spark1 would use the SPARK_HOME that is configured, and spark2 would use a differ

Re: Multiple spark interpreters in the same Zeppelin instance

2016-05-02 Thread Rick Moritz
I think the solution would be to distinguish between interpreter type and interpreter instance. The type should be relatively static, while the instance could be any alias/name and only generate a warning when unable to match with entries in interpreter.json. Finally the specific type would be adde

Re: Multiple spark interpreters in the same Zeppelin instance

2016-05-02 Thread John Omernik
keep notebook file >>>>>> portable. i.e. Let run imported note.json file from other Zeppelin >>>>>> instance >>>>>> without (or minimum) modification. >>>>>> >>>>>> if we use user defined identifier, running

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-29 Thread moon soo Lee
have any other thoughts, ideas, please feel free to share. >>>>> >>>>> Thanks, >>>>> moon >>>>> >>>>> On Fri, Feb 5, 2016 at 3:58 PM Zhong Wang >>>>> wrote: >>>>> >>>>>&

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-29 Thread DuyHai Doan
for each interpreters, but it would be >>>>> great >>>>> if we could use "%xxx", where xxx is the user defined interpreter >>>>> identifier, to identify different interpreters for different paragraphs. >>>>> >>>>> Besides, b

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-29 Thread John Omernik
e the same log file. I am not sure whether >>>> there are other cases they interfere with each other. >>>> >>>> Thanks, >>>> Zhong >>>> >>>> On Thu, Feb 4, 2016 at 9:04 PM, moon soo Lee wrote: >>>> >>>>&g

Re: Multiple spark interpreters in the same Zeppelin instance

2016-04-12 Thread John Omernik
gt;>>> Hi, >>>> >>>> Once you create another spark interpreter in Interpreter menu of GUI, >>>> then each notebook should able to select and use it (setting icon on >>>> top right corner of each notebook). >>>> >>>> I

Re: Multiple spark interpreters in the same Zeppelin instance

2016-02-05 Thread Zhong Wang
of each notebook). >>> >>> If it does not work, could you find error message on the log file? >>> >>> Thanks, >>> moon >>> >>> On Fri, Feb 5, 2016 at 11:54 AM Zhong Wang >>> wrote: >>> >>>> Hi zeppelin pi

Re: Multiple spark interpreters in the same Zeppelin instance

2016-02-05 Thread moon soo Lee
otebook should able to select and use it (setting icon on top >> right corner of each notebook). >> >> If it does not work, could you find error message on the log file? >> >> Thanks, >> moon >> >> On Fri, Feb 5, 2016 at 11:54 AM Zhong Wang >>

Re: Multiple spark interpreters in the same Zeppelin instance

2016-02-04 Thread Zhong Wang
find error message on the log file? > > Thanks, > moon > > On Fri, Feb 5, 2016 at 11:54 AM Zhong Wang > wrote: > >> Hi zeppelin pilots, >> >> I am trying to run multiple spark interpreters in the same Zeppelin >> instance. This is very helpful if the

Re: Multiple spark interpreters in the same Zeppelin instance

2016-02-04 Thread moon soo Lee
Zhong Wang wrote: > Hi zeppelin pilots, > > I am trying to run multiple spark interpreters in the same Zeppelin > instance. This is very helpful if the data comes from multiple spark > clusters. > > Another useful use case is that, run one instance in cluster mode, and > ano

Multiple spark interpreters in the same Zeppelin instance

2016-02-04 Thread Zhong Wang
Hi zeppelin pilots, I am trying to run multiple spark interpreters in the same Zeppelin instance. This is very helpful if the data comes from multiple spark clusters. Another useful use case is that, run one instance in cluster mode, and another in local mode. This will significantly boost the