[GitHub] zeppelin issue #2950: ZEPPELIN-3432 Fix results object when throwing excepti...

[zjffdu]

Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2950
  
LGTM Thanks @jongyoul 


---

Re: pspark interpreter not working for matplot library

[Jeff Zhang]

Which version of zeppelin do you use ?


Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore) <
naveenakumar_gurushantap.panchappana...@nokia.com>于2018年4月29日周日 上午4:20写道：

> Hi All,
>
> I am trying to run pyspark interpreter by using matplot library which
> plots simple graph,but its not showing any graph plot diagram instead it
> returning one general object, but when we use python interpreter it is able
> to plot the graph.
>
> Pyspark programme
> %pyspark
> import matplotlib.pyplot as plt
> plt.plot([1, 6, 3])
> plt.figure()
> x = [0, 2, 4, 6, 8]
> y = [0, 3, 3, 7, 0]
> plt.plot(x, y)
>
> output: []
>
> python interpreter
> %python
> import matplotlib.pyplot as plt
> plt.plot([1, 6, 3])
> plt.figure()
> x = [0, 2, 4, 6, 8]
> y = [0, 3, 3, 7, 0]
> plt.plot(x, y)
> output:
> it able to plot the programme
>
> can any one please help on this.
>
> Regards
> Naveen
>
>

pspark interpreter not working for matplot library

[Panchappanavar, Naveenakumar Gurushantap (Nokia - IN/Bangalore)]

Hi All,

I am trying to run pyspark interpreter by using matplot library which plots 
simple graph,but its not showing any graph plot diagram instead it returning 
one general object, but when we use python interpreter it is able to plot the 
graph.

Pyspark programme
%pyspark
import matplotlib.pyplot as plt
plt.plot([1, 6, 3])
plt.figure()
x = [0, 2, 4, 6, 8]
y = [0, 3, 3, 7, 0]
plt.plot(x, y)

output: []

python interpreter
%python
import matplotlib.pyplot as plt
plt.plot([1, 6, 3])
plt.figure()
x = [0, 2, 4, 6, 8]
y = [0, 3, 3, 7, 0]
plt.plot(x, y)
output:
it able to plot the programme

can any one please help on this.

Regards
Naveen

Re: Zeppelin 0.8.0 ignoring %dep JAR loading

[Satoshi Iijima]

Hi,

I do not deeply take a look this issue but below workaround works well in
my environment.
Could you try this?

%spark.conf
spark.jars  /path/to/foo.jar,/path/to/bar.jar



2018-04-29 3:59 GMT+09:00 Jean-Francis Roy :

> Hi!
>
>
> That is my workaround for now... It works by changing the interpreter
> settings, but this is not convenient - I have multiple notes that need to
> load different JARs and/or different versions. Previously, I could simply
> have a different %dep step and restart the interpreter, but now I need to
> remember the list of JARs that are needed for each different note and
> change the interpreter's options...
>
>
> Is %dep supposed to be working in Zeppelin 0.8.0 ? I couldn't find any
> information that would indicate that this feature was removed.
>
>
>
> 
> From: Jongyoul Lee 
> Sent: Thursday, April 26, 2018 8:55:36 PM
> To: dev
> Subject: Re: Zeppelin 0.8.0 ignoring %dep JAR loading
>
> I'm not sure why that works but you can add your jar to interpreter tab
> with spark setting.
>
> JL
>
> On Thu, Apr 26, 2018 at 11:56 PM, Jean-Francis Roy 
> wrote:
>
> > Hi!
> >
> >
> > Sorry if I am not using the right mailing list - I'm quite new to
> Zeppelin.
> >
> >
> > I have been building/testing Zeppelin 0.8.0 to test Spark 2.3.0 support,
> > and I am unable to load a JAR using
> >
> >
> > %dep (or %spark.dep)
> >
> > z.load("/path/to/jar")
> >
> >
> > The same code works with Zeppelin 0.7.3 with Spark 2.2.1. Am I doing
> > something wrong (does it work for anyone?), or did I found a bug? I
> > couldn't find any related bug.
> >
> >
> >
> > Thanks!
> >
>
>
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> https://na01.safelinks.protection.outlook.com/?url=
> http%3A%2F%2Fmadeng.net=02%7C01%7Cjfroy%40coveo.com%
> 7Cad076c91bcdd485bd67108d5abd99e17%7Cf1735c1d9ea143b89aea2e71110c
> 26d5%7C0%7C0%7C636603873518159046=i7ujyn6qasHr82GBJASkYuA6zg97pP
> wn5ZCzuzN3psc%3D=0
>

Re: Zeppelin 0.8.0 ignoring %dep JAR loading

[Jean-Francis Roy]

Hi!


That is my workaround for now... It works by changing the interpreter settings, 
but this is not convenient - I have multiple notes that need to load different 
JARs and/or different versions. Previously, I could simply have a different 
%dep step and restart the interpreter, but now I need to remember the list of 
JARs that are needed for each different note and change the interpreter's 
options...


Is %dep supposed to be working in Zeppelin 0.8.0 ? I couldn't find any 
information that would indicate that this feature was removed.




From: Jongyoul Lee 
Sent: Thursday, April 26, 2018 8:55:36 PM
To: dev
Subject: Re: Zeppelin 0.8.0 ignoring %dep JAR loading

I'm not sure why that works but you can add your jar to interpreter tab
with spark setting.

JL

On Thu, Apr 26, 2018 at 11:56 PM, Jean-Francis Roy  wrote:

> Hi!
>
>
> Sorry if I am not using the right mailing list - I'm quite new to Zeppelin.
>
>
> I have been building/testing Zeppelin 0.8.0 to test Spark 2.3.0 support,
> and I am unable to load a JAR using
>
>
> %dep (or %spark.dep)
>
> z.load("/path/to/jar")
>
>
> The same code works with Zeppelin 0.7.3 with Spark 2.2.1. Am I doing
> something wrong (does it work for anyone?), or did I found a bug? I
> couldn't find any related bug.
>
>
>
> Thanks!
>



--
이종열, Jongyoul Lee, 李宗烈
https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmadeng.net=02%7C01%7Cjfroy%40coveo.com%7Cad076c91bcdd485bd67108d5abd99e17%7Cf1735c1d9ea143b89aea2e71110c26d5%7C0%7C0%7C636603873518159046=i7ujyn6qasHr82GBJASkYuA6zg97pPwn5ZCzuzN3psc%3D=0

[GitHub] zeppelin issue #2951: ZEPPELIN-3435. Interpreter timeout lifecycle leads to ...

[weand]

Github user weand commented on the issue:

https://github.com/apache/zeppelin/pull/2951
  
... but we are now trying this in production.


---

[GitHub] zeppelin issue #2951: ZEPPELIN-3435. Interpreter timeout lifecycle leads to ...

[weand]

Github user weand commented on the issue:

https://github.com/apache/zeppelin/pull/2951
  
I can't confirm that. LifecycleManager tried to close the interpreter group 
at 13:06 (see log pasted in the Jira) - 60 minutes after the last job was 
finished. The same interpreter group was started again at 13:17 - from 
Interpreter Log:
```
 INFO [2018-04-27 12:06:40,066] ({dag-scheduler-event-loop} 
Logging.scala[logInfo]:54) - ResultStage 113 (toPandas at 
:23) finished in 0.038 s
 INFO [2018-04-27 12:06:40,066] ({Thread-19} Logging.scala[logInfo]:54) - 
Job 28 finished: toPandas at :23, took 0.082673 s
 INFO [2018-04-27 12:06:40,101] ({pool-2-thread-10} 
SchedulerFactory.java[jobFinished]:115) - Job 20180215-131521_501880463 
finished by scheduler interpreter_101669487
 INFO [2018-04-27 12:09:40,123] ({spark-dynamic-executor-allocation} 
Logging.scala[logInfo]:54) - Request to remove executorIds: 1, 0
 INFO [2018-04-27 12:09:40,125] ({spark-dynamic-executor-allocation} 
Logging.scala[logInfo]:54) - Requesting to kill executor(s) 1, 0
 INFO [2018-04-27 12:09:40,128] ({spark-dynamic-executor-allocation} 
Logging.scala[logInfo]:54) - Actual list of executor(s) to be killed is 1, 0
 INFO [2018-04-27 12:09:40,135] ({spark-dynamic-executor-allocation} 
Logging.scala[logInfo]:54) - Removing executor 1 because it has been idle for 
180 seconds (new desired total will be 1)
 INFO [2018-04-27 12:09:40,135] ({spark-dynamic-executor-allocation} 
Logging.scala[logInfo]:54) - Removing executor 0 because it has been idle for 
180 seconds (new desired total will be 0)
 INFO [2018-04-27 12:09:40,547] ({dispatcher-event-loop-4} 
Logging.scala[logInfo]:54) - Executor 0 on 172.16.16.63 killed by driver.
 INFO [2018-04-27 12:09:40,551] ({dispatcher-event-loop-4} 
Logging.scala[logInfo]:54) - Executor 1 on 172.16.16.63 killed by driver.
 INFO [2018-04-27 12:09:40,552] ({dag-scheduler-event-loop} 
Logging.scala[logInfo]:54) - Executor lost: 0 (epoch 56)
 INFO [2018-04-27 12:09:40,553] ({dispatcher-event-loop-2} 
Logging.scala[logInfo]:54) - Trying to remove executor 0 from 
BlockManagerMaster.
 INFO [2018-04-27 12:09:40,555] ({dispatcher-event-loop-2} 
Logging.scala[logInfo]:54) - Removing block manager BlockManagerId(0, 
172.16.16.63, 33086, None)
 INFO [2018-04-27 12:09:40,556] ({SparkListenerBus} 
Logging.scala[logInfo]:54) - Existing executor 0 has been removed (new total is 
1)
 INFO [2018-04-27 12:09:40,556] ({dag-scheduler-event-loop} 
Logging.scala[logInfo]:54) - Removed 0 successfully in removeExecutor
 INFO [2018-04-27 12:09:40,557] ({dag-scheduler-event-loop} 
Logging.scala[logInfo]:54) - Executor lost: 1 (epoch 56)
 INFO [2018-04-27 12:09:40,557] ({dispatcher-event-loop-6} 
Logging.scala[logInfo]:54) - Trying to remove executor 1 from 
BlockManagerMaster.
 INFO [2018-04-27 12:09:40,557] ({dispatcher-event-loop-6} 
Logging.scala[logInfo]:54) - Removing block manager BlockManagerId(1, 
172.16.16.63, 34862, None)
 INFO [2018-04-27 12:09:40,557] ({SparkListenerBus} 
Logging.scala[logInfo]:54) - Existing executor 1 has been removed (new total is 
0)
 INFO [2018-04-27 12:09:40,557] ({dag-scheduler-event-loop} 
Logging.scala[logInfo]:54) - Removed 1 successfully in removeExecutor
 INFO [2018-04-27 12:15:25,523] ({Spark Context Cleaner} 
Logging.scala[logInfo]:54) - Cleaned accumulator 1428
 INFO [2018-04-27 12:15:25,531] ({Spark Context Cleaner} 
Logging.scala[logInfo]:54) - Cleaned accumulator 1422
 INFO [2018-04-27 12:15:25,531] ({Spark Context Cleaner} 
Logging.scala[logInfo]:54) - Cleaned shuffle 30
 INFO [2018-04-27 12:15:25,531] ({Spark Context Cleaner} 
Logging.scala[logInfo]:54) - Cleaned accumulator 1433
 INFO [2018-04-27 12:15:25,531] ({Spark Context Cleaner} 
Logging.scala[logInfo]:54) - Cleaned accumulator 1431
 WARN [2018-04-27 13:17:26,528] ({main} NativeCodeLoader.java[]:62) 
- Unable to load native-hadoop library for your platform... using builtin-java 
classes where applicable
 INFO [2018-04-27 13:17:26,619] ({main} 
RemoteInterpreterServer.java[main]:260) - 
URL:jar:file:/opt/zeppelin/zeppelin-0.8.1.20180426202048/lib/interpreter/zeppelin-interpreter-0.8.1-SNAPSHOT.jar!/org/apache/zeppelin/interpreter/remote/RemoteInterpreterServer.class
 INFO [2018-04-27 13:17:26,654] ({main} 
RemoteInterpreterServer.java[]:161) - Launching ThriftServer at 
172.16.16.65:46586
 INFO [2018-04-27 13:17:26,657] ({main} 
RemoteInterpreterServer.java[]:165) - Starting remote interpreter server 
on port 46586
 INFO [2018-04-27 13:17:26,659] ({Thread-2} 
RemoteInterpreterServer.java[run]:202) - Starting remote interpreter server on 
port 46586
 INFO [2018-04-27 13:17:27,665] ({Thread-3} 
RemoteInterpreterUtils.java[registerInterpreter]:165) - callbackHost: 
172.16.16.65, callbackPort: 39299, callbackInfo: 
CallbackInfo(host:172.16.16.65, port:46586)
 INFO [2018-04-27 13:17:27,772] 

[GitHub] zeppelin issue #2950: ZEPPELIN-3432 Fix results object when throwing excepti...

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/2950
  
@zjffdu Thanks. I've checked that issue and added the original logic to 
`Job` class as it looks more clear to handle it in one class. After merging 
this PR, others' classes don't have to care the case that `results` is not 
`InterpreterResult` class.


![image](https://user-images.githubusercontent.com/3612566/39399222-ffcf865c-4b54-11e8-823c-42bbac49ac1d.png)



---

[GitHub] zeppelin pull request #2952: [Zeppelin-2572] multiple paragraphs actions

[Savalek]

GitHub user Savalek opened a pull request:

https://github.com/apache/zeppelin/pull/2952

[Zeppelin-2572] multiple paragraphs actions

### What is this PR for?

This PR adds the ability to perform actions on several paragraphs 
simultaneously. He adds the checkbox to each paragraph. When you select at 
least one paragraph in the action bar, buttons appear that perform actions on 
the selected paragraphs.


### What type of PR is it?
Feature


### What is the Jira issue?
[ZEPPELIN-2572](https://issues.apache.org/jira/browse/ZEPPELIN-2572)



### Screenshots (if appropriate)

![33115591-993e6cf4-cf72-11e7-8987-64cb3e137ba8](https://user-images.githubusercontent.com/30798933/39395890-382a5f3a-4aed-11e8-8a2a-b5153354c7ea.gif)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/TinkoffCreditSystems/zeppelin ZEPPELIN-2572

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2952.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2952


commit 9f9a7ca0a636211840a840941b3908bf8b59e6cd
Author: Savalek 
Date:   2018-04-17T14:33:38Z

add multiple paragraphs actions

commit fa594fa497f87afa5e84a84f1d525ee0c2f68991
Author: Savalek 
Date:   2018-04-28T09:40:14Z

Merge remote-tracking branch 'apache/master' into ZEPPELIN-2572

# Conflicts:
#   
zeppelin-integration/src/test/java/org/apache/zeppelin/integration/ParagraphActionsIT.java
#   
zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/socket/Message.java

commit 289cc3820e9623724fd2d30af36dc72de344a1b0
Author: Savalek 
Date:   2018-04-28T10:22:34Z

[ZEPPELIN-2572] remove duplicate 'REMOVE_NOTE_FORMS'




---

[GitHub] zeppelin issue #2950: WIP ZEPPELIN-3432 Fix results object when throwing exc...

[zjffdu]

Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2950
  
@jongyoul Sorry, it seems my mistake in #2926 , revert the changes in 
RemoteInterpreterServer.java should be able to fix this. 


---

[GitHub] zeppelin pull request #2947: [ZEPPELIN-3431] - Fix links, images in docs

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2947


---

[GitHub] zeppelin issue #2929: ZEPPELIN-3412 Enable query prefix syntax in bigquery i...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/2929
  
merged to master & 0.8


---

[GitHub] zeppelin pull request #2929: ZEPPELIN-3412 Enable query prefix syntax in big...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2929


---

[GitHub] zeppelin issue #2903: [ZEPPELIN-3377] Passing Z variables to JDBC interprete...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/2903
  
merged this to master & 0.8


---

[GitHub] zeppelin pull request #2903: [ZEPPELIN-3377] Passing Z variables to JDBC int...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2903


---

[GitHub] zeppelin issue #2903: [ZEPPELIN-3377] Passing Z variables to JDBC interprete...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/2903
  
I think so, @zjffdu what do you think about this in 0.8?


---