A quite significant side effects about the mechod i mentioned before was that it will create a lots of RemoteInterpreterServer by different note with different Interpreter settings. And i notice that the RemoteInterpreterServer will never stop after it started except the Interpreter setting was changed and restart or zeppelin server was stopped. I want to know that can RemoteInterpreterServer stop automatically after the specified time with no job to run?
2015-07-26 10:52 GMT+08:00 linxi zeng <linxizeng0...@gmail.com>: > Get it ! Thanks for answering my question, i was quite clear about it > after reading the code. And i think this ok for one person that create a > single note to write and run his code. > I'm planning to create a zeppelin server and share it to all the RDs in > our company. To make sure they can parallel run their code and not share > local value for each other, i will create Interpreter settings with > different name for each user, and bind the Interpreter setting to every > note which create by the same user automatically. > Do you think this method is suitable for us to use zeppelin？ Do you have > any good suggestions? > > 2015-07-15 21:45 GMT+08:00 moon soo Lee <m...@apache.org>: > >> Hi, >> >> Thanks for asking question. >> >> The reason is simply because of it is running code statements. The >> statements can have order and dependency. Imagine i have two paragraphs >> >> %spark >> val a = 1 >> >> %spark >> print(a) >> >> If they're not running one by one, that means they possibly runs in >> random order and the output will be always different. Either '1' or 'val a >> can not found'. >> >> This is the reason why. But if there are nice idea to handle this problem >> i agree using parallel scheduler would help a lot. >> >> Thanks, >> moon >> >> On 2015년 7월 14일 (화) at 오후 7:59 linxi zeng <linxizeng0...@gmail.com> >> wrote: >> >>> any one who have the same question with me? or this is not a question? >>> >>> 2015-07-14 11:47 GMT+08:00 linxi zeng <linxizeng0...@gmail.com>: >>> >>>> hi, Moon: >>>> I notice that the getScheduler function in the SparkInterpreter.java >>>> return a FIFOScheduler which makes the spark interpreter run spark job one >>>> by one. It's not a good experience when couple of users do some work >>>> on zeppelin at the same time, because they have to wait for each other. >>>> And at the same time, SparkSqlInterpreter can chose what scheduler to >>>> use by "zeppelin.spark.concurrentSQL". >>>> My question is, what kind of consideration do you based on to make >>>> such a decision? >>>> >>> >>> >
