[GitHub] zeppelin issue #1911: [ZEPPELIN-1972] Preserve context classloader

2017-01-24 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1911
  
Got it. How about wrapping it like `new ClassloaderInterpreter(new 
IgniteInterpreter(props))`? It's the same logic that RemoteInterpreter want to 
work. You should change this line 
https://github.com/apache/zeppelin/blob/master/ignite/src/test/java/org/apache/zeppelin/ignite/IgniteInterpreterTest.java#L45
 to `Interpreter`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1937: Search for interpreter-settings in several jars in fol...

2017-01-24 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1937
  
@DrIgor I know, I just ask you for making R-related PR on top of this PR. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1945: [ZEPPELIN-2003] Remove PostgresqlInterpreter

2017-01-24 Thread jongyoul
GitHub user jongyoul opened a pull request:

https://github.com/apache/zeppelin/pull/1945

[ZEPPELIN-2003] Remove PostgresqlInterpreter

### What is this PR for?
We don't have to maintain PostgresqlInterpreter because JDBCInterpreter 
covers all functions of PostgresqlInterpreter. It reduces maintenance costs.

### What type of PR is it?
[Feature]

### Todos
* [x] - Remove files and lines related to PostgresqlInterpreter

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2003

### How should this be tested?
N/A

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? Yes
* Does this needs documentation? Yes, but already documented in jdbc docs


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin ZEPPELIN-2003

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1945.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1945


commit 98a106e05c65f626deff6e1cf907803d9cd5e34c
Author: Jongyoul Lee 
Date:   2017-01-25T07:25:31Z

Removed whole packages about Postgresql

commit bfd70ef4c08144645abfc1d9fb17ffcddfd69da1
Author: Jongyoul Lee 
Date:   2017-01-25T07:32:20Z

Removed Postgresql from docs and configurations




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2012) Binary package is missing subfolders bin and conf after extraction

2017-01-24 Thread Christof Buchbender (JIRA)
Christof Buchbender created ZEPPELIN-2012:
-

 Summary: Binary package is missing subfolders bin and conf after 
extraction
 Key: ZEPPELIN-2012
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2012
 Project: Zeppelin
  Issue Type: Bug
  Components: build
Affects Versions: 0.6.2, 0.6.1
 Environment: Linux/Ubuntu 16.04, using nautilus to extract the 
downloaded binary package
Reporter: Christof Buchbender
Priority: Minor


First time user of zeppelin

After extraction the downloaded binary packages of Zeppelin no subfolders 
exist. To make zeppelin work the "/bin" and "/conf" directories have to be 
created and the correct files supplied to start zeppelin as described in the 
documentation.

Workaround:

Create the folders and move the correct files to these folders.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1942: [ZEPPELIN-1982] When using the 'Select * ...' statemen...

2017-01-24 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1942
  
@zjffdu Can you also verify it?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1944: [HOTFIX][MINOR] Change the scope of httpclient to runt...

2017-01-24 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1944
  
@Leemoonsoo Since initializing Helium, helium tried to load httpclient but 
it couldn't do and error occurs like this

```
Caused by: java.lang.NoClassDefFoundError: 
org/apache/http/client/methods/HttpUriRequest
at 
com.github.eirslett.maven.plugins.frontend.lib.FrontendPluginFactory.getNPMInstaller(FrontendPluginFactory.java:29)
at 
org.apache.zeppelin.helium.HeliumVisualizationFactory.installNodeAndNpm(HeliumVisualizationFactory.java:80)
at 
org.apache.zeppelin.helium.HeliumVisualizationFactory.(HeliumVisualizationFactory.java:74)
at 
org.apache.zeppelin.helium.HeliumVisualizationFactory.(HeliumVisualizationFactory.java:60)
at 
org.apache.zeppelin.server.ZeppelinServer.(ZeppelinServer.java:121)
... 29 more
Caused by: java.lang.ClassNotFoundException: 
org.apache.http.client.methods.HttpUriRequest
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1938: ZEPPELIN-2006. Livy interpreter doesn't work in anonym...

2017-01-24 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1938
  
Merging this if no more discussion.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1944: [HOTFIX][MINOR] Change the scope of httpclient to runt...

2017-01-24 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1944
  
Im always running ZeppelinServer from intellij without this change. Am I 
missing something ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1944: [HOTFIX][MINOR] Change the scope of httpclient ...

2017-01-24 Thread jongyoul
GitHub user jongyoul opened a pull request:

https://github.com/apache/zeppelin/pull/1944

[HOTFIX][MINOR] Change the scope of httpclient to runtime from test

### What is this PR for?
When IDE runs ZeppelinServer in debugging mode, it doesn't load httpclient 
because its scope is test but it needs zeppelin-zengine that zeppelin-server 
depends on. ZeppelinServer cannot run itself successfully while loading 
libraries.

### What type of PR is it?
[Bug Fix | Hot Fix]

### Todos
* [x] - Change the scope

### What is the Jira issue?
N/A

### How should this be tested?
Run ZeppelinServer in IntelliJ

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin 
hotfix/change-scope-of-zeppelin-server-pom

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1944.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1944


commit c86393d31c89aeab2a9509f5e00e1d3fa254dec4
Author: Jongyoul Lee 
Date:   2017-01-25T06:49:56Z

Change the scope of httpclient to runtime from test




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1943: [ZEPPELIN-2011] Add lib/interpreter to classpat...

2017-01-24 Thread minahlee
GitHub user minahlee opened a pull request:

https://github.com/apache/zeppelin/pull/1943

[ZEPPELIN-2011] Add lib/interpreter to classpath

### What is this PR for?
Interpreter installation fail with `NoClassDefFoundError` error when 
zeppelin is built as distribution package. This PR fixes it by adding 
`lib/interpreter` to classpath.

### What type of PR is it?
Bug Fix | Hot Fix

### What is the Jira issue?
[ZEPPELIN-2011](https://issues.apache.org/jira/browse/ZEPPELIN-2011)

### How should this be tested?
1. Build distribution package
```
mvn clean package -DskipTests -pl 
zeppelin-interpreter,zeppelin-zengine,:zeppelin-display_2.10,:zeppelin-spark-dependencies_2.10,:zeppelin-spark_2.10,zeppelin-web,zeppelin-server,zeppelin-distribution
 -am -Pbuild-distr
```
2. Change working directory
```
$ cd 
zeppelin-distribution/target/zeppelin-0.8.0-SNAPSHOT/zeppelin-0.8.0-SNAPSHOT
```
3. Run `bin/install-interpreter.sh` and see if error is gone.

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/minahlee/zeppelin ZEPPELIN-2011

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1943.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1943


commit af14a3f89a78c5c16d55dca39d692e33b1a8d5f6
Author: Mina Lee 
Date:   2017-01-25T05:58:25Z

Add lib/interpreter to classpath




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1942: [ZEPPELIN-1982] When using the 'Select * ...' s...

2017-01-24 Thread del680202
GitHub user del680202 opened a pull request:

https://github.com/apache/zeppelin/pull/1942

[ZEPPELIN-1982] When using the 'Select * ...' statement doesn't show …


### What is this PR for?
In this ticket 
[ZEPPELIN-212](https://issues.apache.org/jira/browse/ZEPPELIN-212),``InterpreterOutput.java``
 will filter out '\n'.
It causes ``tabledata.js`` couldn't recognize the comment in the 
paragraphResult. If column number of sql query exceed 2 columns and row number 
over ``maxResult`` will show nothing.
Therefore, I suppose to modify comment statement from '\n'  to 
``TABLE_COMMENT``for this issue.


### What type of PR is it?
Bug Fix

### Todos
* None

### What is the Jira issue?
[ZEPPELIN-1982](https://issues.apache.org/jira/browse/ZEPPELIN-1982)


### How should this be tested?
try  to execute ``%sql  SELECT * FROM bank`` on  tutorial

### Screenshots (if appropriate)
Before
![2017-01-25 14 49 
40](https://cloud.githubusercontent.com/assets/3747345/22279334/8b3e6642-e30d-11e6-9e20-d6da015f016b.png)

After
![Uploading スクリーンショット 2017-01-25 14.48.59.png…]()


### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/del680202/zeppelin bug-1982

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1942.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1942


commit ba6aab2c391ca72ca97e1ccfa79dc368b1ad96d2
Author: Chin Tzulin 
Date:   2017-01-25T05:34:28Z

[ZEPPELIN-1982] When using the 'Select * ...' statement doesn't show the 
response In %sql interpreter




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1938: ZEPPELIN-2006. Livy interpreter doesn't work in anonym...

2017-01-24 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/1938
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2011) interpreter installer doesn't work

2017-01-24 Thread Mina Lee (JIRA)
Mina Lee created ZEPPELIN-2011:
--

 Summary: interpreter installer doesn't work
 Key: ZEPPELIN-2011
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2011
 Project: Zeppelin
  Issue Type: Bug
Affects Versions: 0.7.0
Reporter: Mina Lee
 Fix For: 0.7.0


Run
{code}
./bin/install-interpreter.sh --name md --artifact 
org.apache.zeppelin:zeppelin-markdown:0.6.2
{code}
fails with below error
{code}
Exception in thread "main" java.lang.NoClassDefFoundError: 
org/sonatype/aether/RepositoryException
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
at java.lang.Class.getMethod0(Class.java:3018)
at java.lang.Class.getMethod(Class.java:1784)
at 
sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
Caused by: java.lang.ClassNotFoundException: 
org.sonatype.aether.RepositoryException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 7 more
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1941: [ZEPPELIN-2009] Cron job isn't executed after couple o...

2017-01-24 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/1941
  
@minahlee thanks for review, just fixed it in 
48fd94e03de3e4347ef41cdc5f464087108d5ce5


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2010) Need to mention what user needs to take advantage Helium online repo

2017-01-24 Thread Ahyoung Ryu (JIRA)
Ahyoung Ryu created ZEPPELIN-2010:
-

 Summary: Need to mention what user needs to take advantage Helium 
online repo
 Key: ZEPPELIN-2010
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2010
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Ahyoung Ryu
Assignee: Ahyoung Ryu
 Fix For: 0.7.1


There are is a requirement after ZEPPELIN-1973 (read npm published Helium 
package from https://s3.amazonaws.com/helium-package/helium.js).

>From now, user need to add {{"icon"}} field to {{package.json}} when 
https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html#1-create-a-npm-package

If not, the question mark icon will be shown :)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1936: [ZEPPELIN-2004] List all helium packages in Zeppelin G...

2017-01-24 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1936
  
Tested and it's working well as expected!
Then don't we need to update the below content about this change? 

> "Zeppelin needs to know what Visualization packages are available. 
Zeppelin searches Helium package file from local registry (by default helium/ 
directory) by default. "


https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html#1-load-helium-package-files-from-registry
 

and
> "Once Zeppelin loads Helium package files from local registry," 


https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html#2-enable-packages


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1941: [ZEPPELIN-2009] Cron job isn't executed after c...

2017-01-24 Thread khalidhuseynov
GitHub user khalidhuseynov reopened a pull request:

https://github.com/apache/zeppelin/pull/1941

[ZEPPELIN-2009] Cron job isn't executed after couple of times

### What is this PR for?
This is to solve the problem with cron job scheduling. basically after 
https://github.com/apache/zeppelin/commit/6177c819b1edb76cfaa8f6249dc9041771ce6da9
 all empty paragraphs are skipped when executing, but if the paragraph had 
status `READY` that status will be stayed same and then the note won't be 
considered as terminated in 
[here](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/Notebook.java#L866)
 resulting on keeping cron threads up running. So after all 10 threads in the 
threadpool are exhausted, new jobs are not scheduled. Here i change the status 
of paragraph to `FINISHED` when it's empty and skipping run.

### What type of PR is it?
Bug Fix

### Todos
* [x] - set status to `FINISHED`

### What is the Jira issue?
[ZEPPELIN-2009](https://issues.apache.org/jira/browse/ZEPPELIN-2009)

### How should this be tested?
try to schedule note using cron expression (e.g. `0/5 * * * * ?` every 5 
secs) before and after this PR

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/khalidhuseynov/incubator-zeppelin 
fix/cron-scheduling

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1941.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1941


commit 54e5ce9d7b37cf6fd5c067c0e1455c901a9a10a3
Author: Khalid Huseynov 
Date:   2017-01-25T01:45:55Z

set status FINISHED on empty paragraph

this is required since otherwise notebook wouldn't be isTerminated()




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build on Windows getting stuck

2017-01-24 Thread Andrii Pelekh
Hi all,

I'm trying to reproduce a defect from Jira ticket on Windows7 x64 but my
build getting stuck on the "npm-run-all clean" step. Please see log file
attached. I tried to build on another Windows PC and it got stuck too on
the same step. I have dual boot and everything works fine for me on Ubuntu.


Another thing to note is two node processes which I observe during the hang
up phase (see screenshot attached). One of the processes (yarn.js run
build) does not terminate even after I cancel the build.

Have anyone had anything similar?

Thanks,
Andrii


[GitHub] zeppelin pull request #1941: [ZEPPELIN-2009] Cron job isn't executed after c...

2017-01-24 Thread khalidhuseynov
Github user khalidhuseynov closed the pull request at:

https://github.com/apache/zeppelin/pull/1941


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1930: [ZEPPELIN-1886] implementation z.getZeppelinJobStatus

2017-01-24 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1930
  
Could you rebase/merge master and see if CI passes?

This branch has a lot of CI build failure which is fixed by 
https://github.com/apache/zeppelin/pull/1939


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1495: ZEPPELIN-1325: WIP - Python, advanced interpreter impl

2017-01-24 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1495
  
@bzz What the status of this PR ? Do you plan to put it in 0.8 ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1935: [gh-pages][ZEPPELIN-1973] List all available Helium pa...

2017-01-24 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1935
  
@Leemoonsoo Thanks for testing out! 
I saw new type of package "SPELL" was introduced by #1940. So I'd like to 
make the result filtered by Type (`VISUALIZATION` or `SPELL`) using radio 
button. Let me update again. It won't take too long :D


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1941: [ZEPPELIN-2009] Cron job isn't executed after couple o...

2017-01-24 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/1941
  
plz help review /cc @Leemoonsoo @minahlee @astroshim


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1941: [ZEPPELIN-2009] Cron job isn't executed after c...

2017-01-24 Thread khalidhuseynov
GitHub user khalidhuseynov opened a pull request:

https://github.com/apache/zeppelin/pull/1941

[ZEPPELIN-2009] Cron job isn't executed after couple of times

### What is this PR for?
This is to solve the problem with cron job scheduling. basically after 
https://github.com/apache/zeppelin/commit/6177c819b1edb76cfaa8f6249dc9041771ce6da9
 all empty paragraphs are skipped when executing, but if the paragraph had 
status `READY` that status will be stayed same and then the note won't be 
considered as terminated in 
[here](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/Notebook.java#L866)
 resulting on keeping cron threads up running. So after all 10 threads in the 
threadpool are exhausted, new jobs are not scheduled. Here i change the status 
of paragraph to `FINISHED` when it's empty and skipping run.

### What type of PR is it?
Bug Fix

### Todos
* [x] - set status to `FINISHED`

### What is the Jira issue?
[ZEPPELIN-2009](https://issues.apache.org/jira/browse/ZEPPELIN-2009)

### How should this be tested?
try to schedule note using cron expression (e.g. `0/5 * * * * ?` every 5 
secs) before and after this PR

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/khalidhuseynov/incubator-zeppelin 
fix/cron-scheduling

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1941.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1941


commit 54e5ce9d7b37cf6fd5c067c0e1455c901a9a10a3
Author: Khalid Huseynov 
Date:   2017-01-25T01:45:55Z

set status FINISHED on empty paragraph

this is required since otherwise notebook wouldn't be isTerminated()




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Re: Notebooks & Notes

2017-01-24 Thread Windy Qin
hi,
The collection of notes is a notebook . You can write different kinds of 
code in  a  notebook ,but one kind in a note. Do you  agree with me?



Best regards
 
From: Jun Kim
Date: 2017-01-25 09:06
To: users
CC: dev
Subject: Re: Notebooks & Notes
And the collection of notes is a notebook :)

But some codes inside Zeppelin may still use the term "notebook" as note. Plz 
modify it if u find it!
2017년 1월 25일 (수) 오전 9:58, Mohit Jaggi 님이 작성:
haha...the collection of paras is called a note :)

On Tue, Jan 24, 2017 at 4:54 PM,  wrote:
Hi
Just a quick thought. Instead of calling them 'paragraphs' in a notebook. Why 
not call them 'notes'?
They look like post-it notes already.
Just a thought.
Get Outlook for Android


-- 
Taejun Kim

Data Mining Lab.
School of Electrical and Computer Engineering
University of Seoul


[jira] [Created] (ZEPPELIN-2009) Cron jobs do not get scheduled and executed after certain number of executions

2017-01-24 Thread Khalid Huseynov (JIRA)
Khalid Huseynov created ZEPPELIN-2009:
-

 Summary: Cron jobs do not get scheduled and executed after certain 
number of executions
 Key: ZEPPELIN-2009
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2009
 Project: Zeppelin
  Issue Type: Bug
Reporter: Khalid Huseynov
Assignee: Khalid Huseynov
Priority: Critical


after setting cron job, it gets scheduled a limited number of times (up to 10 
in observations) and stops executing afterwards. for example if set it to 
execute every 5 seconds with 0/5 * * * * ? cron expression, it will be executed 
mostly 10 times and stop afterwards. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin pull request #1940: [ZEPPELIN-2008] Introduce Spell

2017-01-24 Thread 1ambda
GitHub user 1ambda opened a pull request:

https://github.com/apache/zeppelin/pull/1940

[ZEPPELIN-2008] Introduce Spell

### What is this PR for?

Implemented **Spell** to Helium categories. *Technically, it's the frontend 
interpreter* runs on browser not backend.

Spell can provide many benefits.

1. Anyone can install, remove using helium package registry by #1936 
2. Implementing spell is extremely easier rather than adding backend 
interpreter
3. Can use existing javsacript libraries. (e.g 
[flowchart.js](http://flowchart.js.org/), [sequence diagram 
js](https://github.com/bramp/js-sequence-diagrams), ...). This enable us to add 
many visualization tools. Assume that you can implement whatever you want to 
visualize in few lines of code like 
[flowchart-spell-example](https://github.com/apache/zeppelin/compare/master...1ambda:ZEPPELIN-2008/introduce-spell?expand=1#diff-364845b20d68e4d94688e44fef03da98)
4. The most important thing is, spell can be not only interpreter but also 
display system. Because it runs on browser. This enable us to combining 
existing backend interpreter with spell display like

```
// if we have markdown spell

%spark

val calculated = doSomething()
println(s"%markdown _${calculated})
```

I added some examples. Checkout `echo`, `markdown`, `translator`, 
`flowchart` spells.

### What type of PR is it?
[Feature]

### Todos
* [x] - Add `SPELL` as one of Helium categories.
* [x] - Implement framework code (`zeppelin-spell`)
* [x] - Make some examples (flowchart, google translator, markdown, echo)
* [x] - Support custom display system
* [x] - Fix some bugs in `HeliumBundleFactory`
* [x] - Save spell rendering result into `note.json` while broadcasting to 
other websocket clients

### What is the Jira issue?

[ZEPPELIN-2008](https://issues.apache.org/jira/browse/ZEPPELIN-2008)

### How should this be tested?

See the screenshots below.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - YES, but framework can be enhanced so i 
would like to defer to write document right now.


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/1ambda/zeppelin ZEPPELIN-2008/introduce-spell

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1940.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1940


commit de220b36d39a535f097f6d49820973738be079cc
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-17T10:40:12Z

feat: Support FRONTEND_INTERPRETER type in backend

commit 1c57cb626d9006cdbd59722022de0a798b345a03
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-17T10:41:10Z

feat: Support FRONTEND_INTERPRETER type in frontend

commit 62b2e880ddb02157b25236f1cd3afaad2ba3ac15
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-17T10:41:32Z

feat: Add frontend interpreter framework

commit 4a1e42d662cebbcf87242fb743b9bf6c8d5e8b8f
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-17T10:41:59Z

feat: Add flowchart, translator examples

commit 150ab44b2710f34b93d938038d1063ec10aecfd3
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-17T10:42:26Z

feat: Apply frontend interpreter to paragraph

commit 921b1774137f4cb7c58e90e4a609a7f85e9c400e
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-20T23:22:22Z

feat: Automated display type checking in result

commit 07d944209a26e9f375d5f16d8956cb54f0dc86b5
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-21T00:18:26Z

feat: Update examples to use single FrontIntpRes

commit 1cd8910be6dd48024e9845f50c3e2cec7f0e7ab2
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-23T17:52:40Z

feat: Support custom display

commit ccd57a60ab5b1b7fac30b7e23b4eb5e61bd664e0
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-23T17:54:36Z

example: Add echo, markdown

commit fc2780cd62ece92e18f3305a9fefaca3ca1da62c
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-23T20:09:27Z

style: Rename to Spell

commit ed328ce74fd9e60b9732d89259cc7d1af34293e5
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-23T20:22:26Z

style: Rename generator -> data

commit bf62f4af21d634a7eb7d6f77003e750cc4cdb1f2
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-23T20:48:39Z

feat: Enhance translator spell

commit 7814d7882462e9c52c1758d8e591ee222e2fd263
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-23T22:01:34Z

fix: NPM installation error

commit c270bfd5c3aa20d1a4b0fe9873d2a27e8195c0d9
Author: 1ambda <1am...@gmail.com>
Date:   2017-01-24T13:13:16Z

feat: Save spell result and propagate

commit 

Re: Notebooks & Notes

2017-01-24 Thread Jun Kim
And the collection of notes is a notebook :)

But some codes inside Zeppelin may still use the term "notebook" as note.
Plz modify it if u find it!
2017년 1월 25일 (수) 오전 9:58, Mohit Jaggi 님이 작성:

> haha...the collection of paras is called a note :)
>
> On Tue, Jan 24, 2017 at 4:54 PM,  wrote:
>
> Hi
>
> Just a quick thought. Instead of calling them 'paragraphs' in a notebook.
> Why not call them 'notes'?
>
> They look like post-it notes already.
>
> Just a thought.
>
> Get Outlook for Android 
>
>
> --
Taejun Kim

Data Mining Lab.
School of Electrical and Computer Engineering
University of Seoul


Notebooks & Notes

2017-01-24 Thread darren


Hi


Just a quick thought. Instead of calling them 'paragraphs' in a notebook. Why 
not call them 'notes'?


They look like post-it notes already.


Just a thought.




Get Outlook for Android







[jira] [Created] (ZEPPELIN-2008) Implement Frontend Interpreter

2017-01-24 Thread Hoon Park (JIRA)
Hoon Park created ZEPPELIN-2008:
---

 Summary: Implement Frontend Interpreter
 Key: ZEPPELIN-2008
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2008
 Project: Zeppelin
  Issue Type: Improvement
  Components: helium
Affects Versions: 0.8.0
Reporter: Hoon Park


Impelement Frontend Interpreter as a category of Helium. There are at least 3 
benefits.

1. Anyone can implement interpreter easily. 
2. Can use broad libraries in javascript (e.g Flowchart, Sequence Diagram, ...)
3. It's easy to remove, install since it's provided by helium.






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1935: [gh-pages][ZEPPELIN-1973] List all available Helium pa...

2017-01-24 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1935
  
Tested and works as expected.
LGTM



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1939: [ZEPPELIN-2007] Fix flaky test: ShellInterprete...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1939


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1939: [ZEPPELIN-2007] Fix flaky test: ShellInterpreterTest#t...

2017-01-24 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1939
  
I'm merging this to master as a hotfix.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1939: [ZEPPELIN-2007] Fix flaky test: ShellInterprete...

2017-01-24 Thread Leemoonsoo
GitHub user Leemoonsoo opened a pull request:

https://github.com/apache/zeppelin/pull/1939

[ZEPPELIN-2007] Fix flaky test: ShellInterpreterTest#testShellTimeout

### What is this PR for?
Fix flaky test ShellInterpreterTest#testShellTimeout 
https://issues.apache.org/jira/browse/ZEPPELIN-2007

this PR makes sure `testShellTimeout()` produce timeout error by increase 
gap between timeout and test value (from `61-60 = 1`  to `4-2 = 2`).

### What type of PR is it?
Hot Fix

### Todos
* [x] - Fix

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2007

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-2007

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1939.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1939


commit 57c6a9beed7f8831160c251703a36c29a5827e1e
Author: Lee moon soo 
Date:   2017-01-24T17:45:51Z

Make ShellInterpreterTest faster, more reliable




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1937: Search for interpreter-settings in several jars in fol...

2017-01-24 Thread DrIgor
Github user DrIgor commented on the issue:

https://github.com/apache/zeppelin/pull/1937
  
@jongyoul currently R interpreter uses static initialization and isn't 
loaded at all =)

I will create pull request with interpreter-settings.json for R 
interpreter. But it needs this PR to be merged first


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1911: [ZEPPELIN-1972] Preserve context classloader

2017-01-24 Thread DrIgor
Github user DrIgor commented on the issue:

https://github.com/apache/zeppelin/pull/1911
  
Yes, I tried ClassloaderInterpreter but it didn't fix original issue.


https://github.com/apache/zeppelin/blob/master/ignite/src/test/java/org/apache/zeppelin/ignite/IgniteInterpreterTest.java#L69
Here test creates unwrapped interpreter instance.

So we need wrap every IgniteInterpreter usage. Besides, wrapper restores 
classloader _after_ interpreter call and interpreter itself use broken 
classloader.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1938: ZEPPELIN-2006. Livy interpreter doesn't work in anonym...

2017-01-24 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1938
  
Got it, good catch. Test on local, works as expected, LGTM.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1938: ZEPPELIN-2006. Livy interpreter doesn't work in anonym...

2017-01-24 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1938
  
This is for kerberos enabled environment, correct ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1914: [ZEPPELIN-1983] Feedback about success/failure ...

2017-01-24 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1914


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1914: [ZEPPELIN-1983] Feedback about success/failure when in...

2017-01-24 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1914
  
Will merge it into master and branch-0.7


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1937: Search for interpreter-settings in several jars in fol...

2017-01-24 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1937
  
@DrIgor Did you test this PR with `-Pr` profile? this PR looks good to me 
but we need to test it. I think you can test it by running Zeppelin with r 
profile. How about you?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


How to use the roles in Zeppelin

2017-01-24 Thread 秦超峰
hi,
   How to use the roles in Zeppelin ?


[GitHub] zeppelin issue #1937: Search for interpreter-settings in several jars in fol...

2017-01-24 Thread DrIgor
Github user DrIgor commented on the issue:

https://github.com/apache/zeppelin/pull/1937
  
@jongyoul PR for loading several interpreter-setting


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1914: [ZEPPELIN-1983] Feedback about success/failure when in...

2017-01-24 Thread beriaanirudh
Github user beriaanirudh commented on the issue:

https://github.com/apache/zeppelin/pull/1914
  
Thanks for the review @jongyoul . I looked at the CI failure and it looks 
irrelevant to this change.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---