Re: InvalidClassException using Zeppelin (master) and spark-2.1 on a standalone spark cluster

2017-06-26 Thread David Howell
Hi, I know this issue is resolved for reading from json, and tested for that use case, but I'm seeing the exact same error message when writing to json. java.io.InvalidClassException: org.apache.commons.lang3.time.FastDateParser; local class incompatible: stream classdesc serialVersionUID = 2,

Odp.: do we have IRC?

2017-06-26 Thread Ganko, Marek (Nokia - PH/Quezon City)
Can we use https://gitter.im/ as the communication tool? [https://avatars.gitter.im/default] Gitter ?? Where developers come to talk. gitter.im Where communities thrive. Gitter is a chat and networking platform that helps to manage, grow and connect

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Jianfeng (Jeff) Zhang
z.run is a async call, It just send the message to ask zeppelin to run note instead of waiting until is finished. Best Regard, Jeff Zhang From: Richard Xin > Reply-To: "users@zeppelin.apache.org"

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Richard Xin
Thanks Jeff,It worked in some cases, However it seems it has following issues:example:in Note A I have following paragraph:val message = "Hello Zeppelin" println("Note 1 = " + message) Test Case 1=== in Note B: Paragraph 1:%spark z.run("2CN3UDXMZ", "20170612-231131_191205958") // works but

Re: can Zeppelin runParagraph from different notebooks?

2017-06-26 Thread Richard Xin
%spark run("2CN3UDXMZ", "20170609-233658_1498522009");  (which is spark script written in scala) :288: error: not found: value run run("2CN3UDXMZ", "20170609-233658_1498522009"); ^ Zeppelin Version 0.7.1  Did I miss anything?Thanks,  On Tuesday, June 13, 2017, 8:48:54 PM PDT, Jianfeng (Jeff)

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Richard Xin
just try to understand the comment in the code:// Some case, scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call throws an NPE what are the "Some case", it sounds like Zeppelin developers are not sure how it happened and how to prevent it? I am trying to make a strong case for my company to

Re: Hitting strange NPE

2017-06-26 Thread Serega Sheypak
Drive >> r.appendMessage(AbstractEventDriver.java:65) >> >> at org.eclipse.jetty.websocket.common.events.JettyListenerEvent >> Driver.onTextFrame(JettyListenerEventDriver.java:122) >> >> at org.eclipse.jetty.websocket.common.events.AbstractEventDrive >> r.incomingFrame(AbstractEventDriver.java:161)

Re: Hitting strange NPE

2017-06-26 Thread Serega Sheypak
ommon.io.AbstractWebSocketConnection. > readParse(AbstractWebSocketConnection.java:632) > > at org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection. > onFillable(AbstractWebSocketConnection.java:480) > > at org.eclipse.jetty.io.AbstractConnection$2.run( > AbstractCon

Hitting strange NPE

2017-06-26 Thread Serega Sheypak
scheduler org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session426301004 INFO [2017-06-26 08:47:54,925] ({pool-2-thread-10} Paragraph.java[jobRun]:363) - run paragraph 20170626-081737_1275486301 using null org.apache.zeppelin.interpreter.LazyOpenInterpreter@55b139c6 INFO [2017-06-26 08

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Serega Sheypak
Hi, I have more or less the same symptom if (Utils.isScala2_10()) { binder = (Map) getValue("_binder"); } else { binder = (Map) getLastObject(); } binder.put("sc", sc); // EXCEPTION HERE java.lang.NullPointerException at

Re: NPE in SparkInterpreter.java

2017-06-26 Thread Richard Xin
Anyone? On Thursday, June 22, 2017, 3:00:01 PM PDT, Richard Xin wrote: apache/zeppelin | | | | | | | | | | | apache/zeppelin zeppelin - Mirror of Apache Zeppelin | | | in the code I see // Some case,

Interpreter %sq not found Zeppelin swallows last "l" for some reason...?

2017-06-26 Thread Serega Sheypak
Hi, I get super weird exception: ERROR [2017-06-26 07:44:17,523] ({qtp2016336095-99} NotebookServer.java[persistAndExecuteSingleParagraph]:1749) - Exception from run org.apache.zeppelin.interpreter.InterpreterException: paragraph_1498480084440_1578830546's Interpreter %sq not found I have three

Re: Livy failure

2017-06-26 Thread Иван Шаповалов
Got it, thank you. 2017-06-26 14:58 GMT+03:00 Jeff Zhang : > > The error message is clear, you didn't set the right configuration. You > enable the dynamic allocation, and set max executor as 2 but you set the > initial executor as 3 > > > > Caused by:

Re: Livy failure

2017-06-26 Thread Jeff Zhang
The error message is clear, you didn't set the right configuration. You enable the dynamic allocation, and set max executor as 2 but you set the initial executor as 3 Caused by: java.lang.IllegalArgumentException: requirement failed: initial executor number 3 must between min executor number 1

Re: Livy failure

2017-06-26 Thread Иван Шаповалов
Here is the failure from resource manager 17/06/26 05:55:43 ERROR ApplicationMaster: Uncaught exception: org.apache.spark.SparkException: Exception thrown in awaitResult: at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:194) at

Re: Livy failure

2017-06-26 Thread Jeff Zhang
Could you check the yarn app log ? Иван Шаповалов 于2017年6月26日周一 下午6:40写道: > Hi all, > I am trying to connect and run note via livy > > *created interpreter setting:* > livy.spark.driver.cores 1 > livy.spark.driver.memory 1g >

Livy failure

2017-06-26 Thread Иван Шаповалов
Hi all, I am trying to connect and run note via livy *created interpreter setting:* livy.spark.driver.cores 1 livy.spark.driver.memory 1g livy.spark.dynamicAllocation.cachedExecutorIdleTimeout 600 livy.spark.dynamicAllocation.enabled true livy.spark.dynamicAllocation.initialExecutors 1

Access right management & group roles in Zeppelin

2017-06-26 Thread Petr Knez
Hi, I have question regarding access right management in Zeppelin. Is it possible to manage access to notes or interpreters on group group level (defined in section roles in shiro.ini) or now has Zeppelin only capability to manage these right on user level? I tried it via users and it works fine

Re: How to write a style of printout in a application?

2017-06-26 Thread 小野圭二
Thank you for your rapid and kindly reply, Park. :-) To make clear a little bit. Let's look in conf/interpreter.json on ver.0.7.0, focusing on Spark setting to make simple now, they have 'spark,sql, pyspark,r, scala' in it. I guess they are for executing those kinds programs as script on