[GitHub] zeppelin issue #1809: ZEPPELIN-1866. No meaningful exception for pig interpr...

2017-01-02 Thread felixcheung
Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1809
  
Cool. It also looks like CI is passing.
Merging if no more comment.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1821: [ZEPPELIN-1875] permission dialog code is not s...

2017-01-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1821


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1304: [ZEPPELIN-1190] [WIP] Visit Notebook Revision

2017-01-02 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/1304
  
I think this can be closed


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1892) Display label vertically or horizontally smartly

2017-01-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-1892:


 Summary: Display label vertically or horizontally smartly  
 Key: ZEPPELIN-1892
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1892
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Jeff Zhang


Sometimes, the label would be a little long. In this case, it would be better 
to display label vertically. Attach one sample where the x axis is date. 
There's much overlap between labels, so it is better to display label 
vertically in this case. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (ZEPPELIN-1891) Allow to display percentage in pie chart

2017-01-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-1891:


 Summary: Allow to display percentage in pie chart 
 Key: ZEPPELIN-1891
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1891
 Project: Zeppelin
  Issue Type: Improvement
  Components: front-end
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Priority: Minor


Currently, the pie chart display absolute number, but usually it make more 
sense to display percentage for pie chart. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (ZEPPELIN-1890) Groups in pie chart is a little misleading

2017-01-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-1890:


 Summary: Groups in pie chart is a little misleading
 Key: ZEPPELIN-1890
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1890
 Project: Zeppelin
  Issue Type: Bug
  Components: front-end
Affects Versions: 0.7.0
Reporter: Jeff Zhang
 Attachments: zeppelin_pie.gif

When I add fields to Groups for pie chart. The pie chart changes, I don't know 
how that happens. If the pie chart needs to be updated, it should split further 
for the new fields in Groups, but what I see is the proportion of each part 
changes. This is a little misleading for me.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1822: [ZEPPELIN-1789] Make exported data file name more expl...

2017-01-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1822
  
@Leemoonsoo Sounds good. Let me update then :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1822: [ZEPPELIN-1789] Make exported data file name more expl...

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1822
  
Thanks @AhyoungRyu for the improvement.

How about use 
[`dateFinished`](https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/scheduler/Job.java#L73)
 instead of current time in the file name?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1889) Multiple groups in chart doesn't work

2017-01-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-1889:


 Summary: Multiple groups in chart doesn't work
 Key: ZEPPELIN-1889
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1889
 Project: Zeppelin
  Issue Type: Bug
  Components: front-end
Affects Versions: 0.7.0
Reporter: Jeff Zhang
 Attachments: zeppelin_ui.gif

Attach the screenshot to illustrate the issue.

* Step 1, I choose 2 fields as group, the chart doesn't change, but the legend 
changes. 
* Step 2, I rerun the paragraph, the chart disappear. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1812: [ZEPPELIN-1850] Use yarn instead of npm to reduce buil...

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1812
  
Tested and it works well.
@1ambda Could you explain little bit about how `zeppelin-web/yarn.lock` can 
be updated 
 in case of new dependency or dependency version change in `package.json` ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1799: [ZEPPELIN-1165 : WIP] Code-based job workflow

2017-01-02 Thread cloverhearts
Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1799
  
@zjffdu 
Yes you are right.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1799: [ZEPPELIN-1165 : WIP] Code-based job workflow

2017-01-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1799
  
Thanks @cloverhearts , after reading #1176. This PR is the first phase of 
this feature (implement low level api for workflow), is that correct ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1775: [ZEPPELIN-1745] View revisions in non-editable ...

2017-01-02 Thread khalidhuseynov
GitHub user khalidhuseynov reopened a pull request:

https://github.com/apache/zeppelin/pull/1775

[ZEPPELIN-1745] View revisions in non-editable mode

### What is this PR for?
This is to make view of revisions non-editable

### What type of PR is it?
Improvement

### Todos
* [x] - disable action bar buttons
* [x] - disable per paragraph editing actions
* [x] - disable hotkeys

### What is the Jira issue?
[ZEPPELIN-1745](https://issues.apache.org/jira/browse/ZEPPELIN-1745)

### How should this be tested?
1. initialize `GitNotebookRepo` by adding
```
export 
ZEPPELIN_NOTEBOOK_STORAGE="org.apache.zeppelin.notebook.repo.GitNotebookRepo"
```
in your `conf/zeppelin-env.sh`
2. go to any note and create few revisions using commit menu
3. then switch between revisions, during which you shouldn't be able to 
modify note

### Screenshots (if appropriate)

![revision_view](https://cloud.githubusercontent.com/assets/1642088/21340828/53131054-c6cc-11e6-960b-abf5db905194.gif)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/khalidhuseynov/incubator-zeppelin 
feat/revision-view

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1775.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1775


commit 4c838954d38f13a6714fe9c460687e66bf92f16c
Author: Khalid Huseynov 
Date:   2016-12-16T04:20:22Z

change var name revisionDisabled -> revisionView

commit fa1397df6d0fcc469d09bb86c223e7b2bd1d007a
Author: Khalid Huseynov 
Date:   2016-12-16T08:10:26Z

disable run all

commit 8e978005f99ac1120db08abfe759f3654c3bf846
Author: Khalid Huseynov 
Date:   2016-12-16T08:12:09Z

disable clear output

commit 46238e8395ed93c4db5de575223319f4a604f6c3
Author: Khalid Huseynov 
Date:   2016-12-16T08:18:02Z

disable clone note

commit 50d40ad2af176e029ba31426065e230c41048c25
Author: Khalid Huseynov 
Date:   2016-12-16T08:19:21Z

disable export note

commit 5d9f877722211fcf96482f36c909855bef6936e6
Author: Khalid Huseynov 
Date:   2016-12-16T08:22:14Z

disable revision commit

commit ab8ab4db37d6d374b18bc9590f13f96bd1c58bf8
Author: Khalid Huseynov 
Date:   2016-12-16T08:24:16Z

disable remove note

commit 711c0b325d07f36ece5ed1ab78d086b975bdcbc4
Author: Khalid Huseynov 
Date:   2016-12-16T08:25:42Z

disable scheduler

commit 7d115b821f0734dfb361d1018c0e60b0e7d6d157
Author: Khalid Huseynov 
Date:   2016-12-19T04:21:51Z

disable + new paragraph

commit 19cacbd6116342dd5e11f63eac419b557554df9e
Author: Khalid Huseynov 
Date:   2016-12-19T04:26:37Z

don't show paragraph settings menu

commit c55de951ad0ee97d16530465e3dae1651679
Author: Khalid Huseynov 
Date:   2016-12-19T05:09:27Z

don't show run/cancel on paragraph

commit 00fb556059d561d986b4c4d2ef054f7f79e7d6b7
Author: Khalid Huseynov 
Date:   2016-12-19T08:00:39Z

make paragraph title non-editable

commit 9b85e05e0ffc03653d64984d6e27f283b7b0e4fc
Author: Khalid Huseynov 
Date:   2016-12-20T05:20:07Z

disable editor editing

normally it should be done on change of .revisionView however at that time 
editor isn't loaded yet

commit 7751b69f28d5113226fb36caff6becdb985cfb22
Author: Khalid Huseynov 
Date:   2016-12-20T06:11:50Z

disable hotkeys

commit 81346e9313b2e5c7d5b1bd205df3d2000ffe9dfb
Author: Khalid Huseynov 
Date:   2016-12-20T06:32:15Z

disable editing note name

commit 0946377d72f2dd2bdcec63b425396d2b2c965701
Author: Khalid Huseynov 
Date:   2016-12-20T06:41:34Z

disable show/hide code in note action-bar

commit 46d67af60eab15099a22950e6e191995f92fcc34
Author: Khalid Huseynov 
Date:   2016-12-20T06:43:20Z

disable show/hide output in note action bar

commit 1eea8ce1437e9d8232991c8a236ed911bdfe6cbe
Author: Khalid Huseynov 
Date:   2016-12-20T06:47:25Z

don't show paragraph level hide editor button

commit aff02b95e1b42a9d5031e6f20e28a95e0adebab8
Author: Khalid Huseynov 
Date:   2016-12-20T06:48:13Z

don't show paragraph level hide output buttton

commit e9d3ceb59136e7d51b1bb17b8574e18faa507c9d
Author: Khalid Huseynov 
Date:   2016-12-27T07:07:11Z

disable edit on db click md interpreter

commit 

[GitHub] zeppelin pull request #1775: [ZEPPELIN-1745] View revisions in non-editable ...

2017-01-02 Thread khalidhuseynov
Github user khalidhuseynov closed the pull request at:

https://github.com/apache/zeppelin/pull/1775


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1831: [ZEPPELIN-1883] Can't import spark submitted packages ...

2017-01-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1831
  
hmm, it works in local mode but doesn't work in yarn-client mode. Could you 
try yarn-client mode ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1824: [ZEPPELIN-1850] Remove grunt-contrib-clean (grunt)

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1824
  
LGTM and merge to master if there're no further discussions.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1818: [ZEPPELIN-1873] Use exclusively eslint for javascript ...

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1818
  
LGTM and merge to master if there're no further discussions.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1831: [ZEPPELIN-1883] Can't import spark submitted packages ...

2017-01-02 Thread 1ambda
Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/1831
  
@zjffdu 

I'v just created gist to show `--packages` option download 
pyspark-cassandra. 
https://gist.github.com/1ambda/5caf92753ea2f95ada11b1c13945d261

```
downloading 
https://repo1.maven.org/maven2/com/datastax/spark/spark-cassandra-connector_2.10/1.6.2/spark-cassandra-connector_2.10-1.6.2.jar
 ...
[SUCCESSFUL ] 
com.datastax.spark#spark-cassandra-connector_2.10;1.6.2!spark-cassandra-connector_2.10.jar
 (450ms)
downloading 
http://dl.bintray.com/spark-packages/maven/TargetHolding/pyspark-cassandra/0.3.5/pyspark-cassandra-0.3.5.jar
 ...
[SUCCESSFUL ] 
TargetHolding#pyspark-cassandra;0.3.5!pyspark-cassandra.jar (310ms)
downloading 
https://repo1.maven.org/maven2/com/datastax/spark/spark-cassandra-connector-java_2.10/1.6.0-M1/spark-cassandra-connector-java_2.10-1.6.0-M1.jar
 ...
[SUCCESSFUL ] 
com.datastax.spark#spark-cassandra-connector-java_2.10;1.6.0-M1!spark-cassandra-connector-java_2.10.jar
 (23ms)
downloading 
https://repo1.maven.org/maven2/com/datastax/cassandra/cassandra-driver-core/3.0.0/cassandra-driver-core-3.0.0.jar
 ...
[SUCCESSFUL ] 
com.datastax.cassandra#cassandra-driver-core;3.0.0!cassandra-driver-core.jar(bundle)
 (78ms)
:: resolution report :: resolve 2819ms :: artifacts dl 870ms
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1820: [ZEPPELIN-1841] Some of shortcut key is not working

2017-01-02 Thread soralee
Github user soralee commented on the issue:

https://github.com/apache/zeppelin/pull/1820
  
Thank you @Leemoonsoo !


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1820: [ZEPPELIN-1841] Some of shortcut key is not working

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1820
  
LGTM and merge to master if there're no further comments.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1799: [ZEPPELIN-1165 : WIP] Code-based job workflow

2017-01-02 Thread cloverhearts
Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1799
  
@zjffdu 
I agree with you.
But I am a bit cautious about this part.
In fact, we've re-implemented this functionality in a variety of ways, and 
we've actually implemented it in the parent framework format. (Formerly PR)
If, according to your opinion, I will re-implement it, it will be a form 
that combines my previous PR with the current PR.
I need many people opinion.

perhaps, Woluld you give me for many opinion this about?
commiter and zeppelin users?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1832: [ZEPPELIN-1884] Prevent NullPointerException when JDBC...

2017-01-02 Thread astroshim
Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1832
  
@felixcheung Thank you for review!
Currently only `COMMON_KEY` uses for max line count in JDBC interpreter but 
as like you mentioned it seems more make sense to move the code to `open()` 
method.
Let me fix then.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1799: [ZEPPELIN-1165 : WIP] Code-based job workflow

2017-01-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1799
  
BTW, in the first phase we can provide the high-level framework to allow 
user to call it programmatically, And in the second phase, it would be better 
to allow user to do it though drag & drop in UI. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1831: [ZEPPELIN-1883] Can't import spark submitted packages ...

2017-01-02 Thread 1ambda
Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/1831
  
@zjffdu Thanks for review :) 

Then, How can I load 
[pyspark-cassandra](https://github.com/TargetHolding/pyspark-cassandra#with-spark-packages)
 for pyspark?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1799: [ZEPPELIN-1165 : WIP] Code-based job workflow

2017-01-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1799
  
@cloverhearts What I mean is that the code like following would be called 
many times by users
```
if (z.getZeppelinJobStatus("execute note id", "execute paragraph 
id").getJobStatus().isFinished() == true)
{ z.run("execute note id", "execute paragraph id") }
```
It is just like some code templates, so what I suggest is that we can 
create a high level workflow framework which use these apis internally. And for 
users, they just need to specify the dependency between paragraphs using this 
framework, they don't need to check job status like the code above. 
 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1831: [ZEPPELIN-1883] Can't import spark submitted packages ...

2017-01-02 Thread felixcheung
Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1831
  
right, I'm a bit concern if this would be the right fix for the issue? 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1587: [ZEPPELIN-1609] using pyspark(python3) with livy inter...

2017-01-02 Thread felixcheung
Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1587
  
all green!
merging if no more comment


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1829: [DOCS] Remove outdated 'Security Setup' section in SEC...

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1829
  
LGTM!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1831: [ZEPPELIN-1883] Can't import spark submitted packages ...

2017-01-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1831
  
@1ambda Spark doesn't support specifying python packages throught 
`--packages`, the correct usage is to use `--py-files`. Although this PR could 
resolve your issue, but the issue here is not due to zeppelin bug, it is 
because of wrong usage of `--packages`. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1888) RemoteInterpreterServer processes are still alive even if Zeppelin server stopped

2017-01-02 Thread Ahyoung Ryu (JIRA)
Ahyoung Ryu created ZEPPELIN-1888:
-

 Summary: RemoteInterpreterServer processes are still alive even if 
Zeppelin server stopped
 Key: ZEPPELIN-1888
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1888
 Project: Zeppelin
  Issue Type: Bug
Reporter: Ahyoung Ryu


Not sure since when, but currently RemoteInterpreterServer processes are not 
terminated even after Zeppelin server stopped. 

*How to reproduce*
1. Start Zeppelin 
2. Run a paragraph \w any interpreters -> RemoteInterpreterServer process will 
be shown up (check by ps -ef | grep RemoteInterpreterServer)
3. Stop Zeppelin
4. check ps -ef | grep RemoteInterpreterServer again



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1833: [ZEPPELIN-1880] Fix shell interpreter output streaming...

2017-01-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1833
  
Seems the streaming output works only once right after I start Zeppelin (or 
restart shell intp). Let me dig into more. Thanks for the review @astroshim 
@Leemoonsoo!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1821: [ZEPPELIN-1875] permission dialog code is not stable

2017-01-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1821
  
Then will merge into master if there are no more comments


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1832: [ZEPPELIN-1884] Prevent NullPointerException wh...

2017-01-02 Thread astroshim
GitHub user astroshim reopened a pull request:

https://github.com/apache/zeppelin/pull/1832

[ZEPPELIN-1884] Prevent NullPointerException when JDBC query.

### What is this PR for?
Sometimes users don't want to set the properties which they don't want to 
care about and `common.max_count` of JDBC interpreter is one of that property.
If it does not set the `common.max_count`, NullPointerException will occur.


### What type of PR is it?
Bug Fix 


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1884


### How should this be tested?
 - Set properties like as following image and run select query.

![image](https://cloud.githubusercontent.com/assets/3348133/21585284/02c433ee-d072-11e6-8ca1-d120617bb7f1.png)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/astroshim/zeppelin ZEPPELIN-1884

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1832.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1832


commit f1efda772d70d9f0247d07195ab8913050e2339d
Author: astroshim 
Date:   2017-01-02T06:22:49Z

add checking commonkey exists




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1832: [ZEPPELIN-1884] Prevent NullPointerException wh...

2017-01-02 Thread astroshim
Github user astroshim closed the pull request at:

https://github.com/apache/zeppelin/pull/1832


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1587: [ZEPPELIN-1609] using pyspark(python3) with livy inter...

2017-01-02 Thread purechoc
Github user purechoc commented on the issue:

https://github.com/apache/zeppelin/pull/1587
  
i think CI failure cause is not this PR.
some other reason in other testcase.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1799: [ZEPPELIN-1165 : WIP] Code-based job workflow

2017-01-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1799
  
@cloverhearts This is very interesting. I have a few questions
1. Does the dynamic forms here mean more control flow (like if condition 
and for loop)
2. In case 2, If the markdown interpreter paragraph does not depends on the 
spark interpreter paragraph, we can execute them parallelly rather than 
sequentially. 
3. I think the most important thing of workflow is to define the DAG 
(dependency between paragraphs). Your idea is to run the paragraphs 
programmatically. Would it be more intuitive to just define the DAG (Directed 
acyclic graph), and let the framework to run the dag automatically. 
e.g.

```
val flow = new JobFlow(noteId)
val note = z.getNote(noteId)
val p1 = z.getParagraph(pId1)
val p2 = z.getParagraph(pid2)
val p3 = z.getParagraph(pid3)
p3.addDependency (p2)
p2.addDependency(p1)
flow.add(p1).add(p2).add(p3).run()
``` 
4. Currently we use noteId and paragraphId, but I think these are not 
readable. We'd better use note name and paragraph name. 



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1587: [ZEPPELIN-1609] using pyspark(python3) with liv...

2017-01-02 Thread purechoc
GitHub user purechoc reopened a pull request:

https://github.com/apache/zeppelin/pull/1587

[ZEPPELIN-1609] using pyspark(python3) with livy interperter

### What is this PR for?
using pyspark(python3) with livy interperter

### What type of PR is it?
Improvement

### Todos

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1609

### How should this be tested?
%livy.pyspark3
3/2
check result is "1.5"

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions?  - NO
* Does this needs documentation?  - NO



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/purechoc/zeppelin zeppelin-livy-pyspark3

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1587.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1587


commit c0babf619006cc3a4ac66ffb0904b49e37f3a2ae
Author: purechoc 
Date:   2016-11-03T07:29:43Z

add %livy.python3

commit 3775e47158c7146a8d005af851dd17ca6bfaca7b
Author: purechoc 
Date:   2016-11-03T10:25:07Z

add %livy.python3

commit 7e4210807bcf7483240b06f11081d7cb07e79b88
Author: purechoc 
Date:   2016-11-03T10:49:25Z

add %livy.python3

commit d0e2293327f73fa8ebe89498652cc94db45a02bc
Author: purechoc 
Date:   2016-11-03T23:56:41Z

Trigger

commit 3fc98cd47f88e59f6ae5a0c9e35d476b74df15bf
Author: purechoc 
Date:   2016-11-04T05:33:45Z

add configuration

commit 51140f2686af2cf381ea25dd451097b850f2e396
Author: purechoc 
Date:   2016-11-06T23:39:13Z

Trigger

commit e5db6405e3e87f6425a9503e4fee66167e394b7a
Author: purechoc 
Date:   2016-11-07T00:10:29Z

add properties

commit 55d486ff5987e28f112e81d665c46c4276c47739
Author: purechoc 
Date:   2016-11-09T00:42:24Z

Trigger

commit 476ae2504e24544f44b8bff9a8ed428a6d1b7c04
Author: purechoc 
Date:   2016-12-11T23:38:07Z

Merge remote-tracking branch 'upstream3/master' into zeppelin-livy-pyspark3

Conflicts:
livy/src/main/java/org/apache/zeppelin/livy/LivyPySparkInterpreter.java

commit 7c0f70d6f48852b733f61272a787bd4438733ec7
Author: purechoc 
Date:   2016-12-11T23:53:24Z

refactor code

commit 6f7391fb706efc7f7db4751ac6035ad6e634a953
Author: purechoc 
Date:   2016-12-29T00:08:18Z

update template




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1587: [ZEPPELIN-1609] using pyspark(python3) with liv...

2017-01-02 Thread purechoc
Github user purechoc closed the pull request at:

https://github.com/apache/zeppelin/pull/1587


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[Codebase job workflow] I need your idea and opinion.

2017-01-02 Thread CloverHearts
Hello, Zeppelin our users and our developers.

I am created zeppelin workflow on codebase feature.

But, actually I wish find a good method than my implement workflow method 
better. (before pr https://github.com/apache/zeppelin/pull/1799)

 

for example,  I made workflow is this here.

---

  val result = z.runSync("execute note id", "execute paragraph id")

  if (result.isError()) {

    new throw Exception("job error");

  }

 

// next job or done.

  

---

 

I was created jira issue. https://issues.apache.org/jira/browse/ZEPPELIN-1886 

Perhpas, you have a good idea or have a opinion.

please anytime write to comment.

 

If you can test this feature. 

Check to this pr (https://github.com/apache/zeppelin/pull/1799)

 

 

 

Thank you.



[jira] [Created] (ZEPPELIN-1887) "Run all paragraphs" adds new paragraph

2017-01-02 Thread Lee moon soo (JIRA)
Lee moon soo created ZEPPELIN-1887:
--

 Summary: "Run all paragraphs" adds new paragraph
 Key: ZEPPELIN-1887
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1887
 Project: Zeppelin
  Issue Type: Bug
Reporter: Lee moon soo


Click "Run all paragraphs" adds new paragraph, which is unexpected behavior.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (ZEPPELIN-1886) Codebased job workflow

2017-01-02 Thread CloverHearts (JIRA)
CloverHearts created ZEPPELIN-1886:
--

 Summary: Codebased job workflow
 Key: ZEPPELIN-1886
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1886
 Project: Zeppelin
  Issue Type: Improvement
Reporter: CloverHearts
Assignee: CloverHearts


Hello, Zeppelin users.
I am creating a Zeppelin workflow.
workflow means each interpreter paragraph to run in order on codebase.
And, I find better User Interface part.
all of first, my think about workflow is here.

```
if (z.getZeppelinJobStatus("execute note id", "execute paragraph 
id").getJobStatus().isFinished() == true) {
  z.run("execute note id", "execute paragraph id")
}

```

or

```
  val result = z.runSync("execute note id", "execute paragraph id")
  if (result.isFinished == true) {
println("job is done")
  }
```

or

```

z.run("execute note id", "execute paragraph id")
while (z.getZeppelinJobStatus("execute note id", "execute paragraph 
id").getJobStatus().isRunning) {
  // loop
}

println("next job or done.");

```

if can you see more detail or running example then you can test here 
https://github.com/apache/zeppelin/pull/1799

I need opinion with zeppelin users and developers.

if you have good idea or my sample is difficult or not good then
you can anytime write to comment.


Thank you.







--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1799: [ZEPPELIN-1165 : WIP] Code-based job workflow

2017-01-02 Thread cloverhearts
Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1799
  
create new issue on jira
https://issues.apache.org/jira/browse/ZEPPELIN-1886




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1833: [ZEPPELIN-1880] Fix shell interpreter output streaming...

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1833
  
Tested but i also see the same result @astroshim has.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1831: [ZEPPELIN-1883] Can't import spark submitted packages ...

2017-01-02 Thread 1ambda
Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/1831
  
@astroshim Thanks for review!

It's the expected behavior. If spark submit doens't be properly loaded, 
spark interpreter will die without errors.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1815: [ZEPPELIN-1722] Modernize visualization/transformation...

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1815
  
Merge to master if there're no more discussions 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1821: [ZEPPELIN-1875] permission dialog code is not stable

2017-01-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1821
  
Tested and LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1729: [ZEPPELIN-1758] support livy pyspark Interprete...

2017-01-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1729


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1885) Add retry functionality to JDBC interpreter

2017-01-02 Thread Egor Pahomov (JIRA)
Egor Pahomov created ZEPPELIN-1885:
--

 Summary: Add retry functionality to JDBC interpreter
 Key: ZEPPELIN-1885
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1885
 Project: Zeppelin
  Issue Type: New Feature
  Components: Interpreters
Reporter: Egor Pahomov


I use JDBC interpreter to query against impala and connection sometimes get 
lost. I want to add functionality of retrying(reconnecting) in such cases.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1833: [ZEPPELIN-1880] Fix shell interpreter output streaming...

2017-01-02 Thread astroshim
Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1833
  
Hi.
In my case it seems doesn`t work properly.. What am i missing?

![test1](https://cloud.githubusercontent.com/assets/3348133/21593751/75fa43be-d0cf-11e6-8f83-aa102458dc29.gif)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1831: [ZEPPELIN-1883] Can't import spark submitted packages ...

2017-01-02 Thread astroshim
Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1831
  
In my test, I got a ` INFO [2017-01-02 09:08:12,358] ({Exec Default 
Executor} RemoteInterpreterManagedProcess.java[onProcessComplete]:164) - 
Interpreter process exited 0` error when i try to run the paragraph.
Maybe this error occurs when couldn't download libraries of 
`SPARK_SUBMIT_OPTIONS` option.
Is this normal behavior?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1821: [ZEPPELIN-1875] permission dialog code is not stable

2017-01-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1821
  
Tested this branch and checked the verbose forbidden error messages(my 
bad..) are totally gone when I turned off Shiro. Thanks @cloverhearts! 
LGTM 👍 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1807: ZEPPELIN-1861 Support custom interpreter.sh script to ...

2017-01-02 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1807
  
I made a PR for editing those values in GUI. @felixcheung I think it would 
be better to make a new PR to describe interpreter-setting.json fully. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1716: [ ZEPPELIN-531 ] execute and stop note in job m...

2017-01-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1716


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1730: [ZEPPELIN-1736] Introduce trash & enable removi...

2017-01-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1730


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1817: remove usage of non-standard string method

2017-01-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1817


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1827: [ZEPPELIN-1878] added npm-debug.log on gitignor...

2017-01-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1827


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1830: ZEPPELIN-1867. Update document for pig interpreter and...

2017-01-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1830
  
@zjffdu Nice! 

In the past `Spark Tutorial` is the only tutorial note in Zeppelin included 
by default. But after this PR, 5 tutorial notes will be shown to Zeppelin new 
commers. Since some ppl can try this Pig tutorial before Spark one, more 
detailed description will be helpful to users than just saying like below 
https://cloud.githubusercontent.com/assets/10060731/21586047/1c62f9a0-d10f-11e6-9a41-a368c07dd9ce.png;>


e.g. short description about Pig / you need to install `hadoop` before 
trying to run this tutorial note, and etc etc..  

There is good example ([Mahout tutorial 
note](https://github.com/apache/zeppelin/blob/master/notebook/2BYEZ5EVK/note.json#L4))
 you can refer to. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---