date:20170207

[jira] [Created] (ZEPPELIN-2079) Upgrade livy to 0.3 in livy interpreter

2017-02-07 Thread Jeff Zhang (JIRA)

Jeff Zhang created ZEPPELIN-2079:


 Summary: Upgrade livy to 0.3 in livy interpreter
 Key: ZEPPELIN-2079
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2079
 Project: Zeppelin
  Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang
 Fix For: 0.8.0






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] zeppelin issue #1952: [ZEPPELIN-753] TableData abstraction

2017-02-07 Thread Leemoonsoo

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1952
  
@1ambda further discussion about "how interpreter access data from other 
interpreter" can be done in https://issues.apache.org/jira/browse/ZEPPELIN-2019.

Merge this PR to master if no further discussions.





---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1971: When gear icon is clicked, scroll the page to t...

2017-02-07 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1971


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1980: [gh-pages][ZEPPELIN-2061] Add Medium blog section to t...

2017-02-07 Thread AhyoungRyu

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1980
  
@felixcheung Thanks for taking a look this. Actually I'm managing it now 
with some PMC members (@minahlee, @anthonycorbacho, @jongyoul and @bzz). But I 
can add the other Zeppelin PMC or committers as this story channel editors if 
they want :)  


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1970: ZEPPELIN-2045. Pass interpreter properties with...

2017-02-07 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1970


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1987: [ZEPPELIN-2086] Change interpreter.json & credentials....

2017-02-07 Thread AhyoungRyu

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1987
  
@Leemoonsoo Yeah right kkk I updated it :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1987: [ZEPPELIN-2086] Change interpreter.json & credentials....

2017-02-07 Thread Leemoonsoo

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1987
  
I think correct issue id is ZEPPELIN-2068.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1987: [ZEPPELIN-2086] Change interpreter.json & crede...

2017-02-07 Thread AhyoungRyu

GitHub user AhyoungRyu opened a pull request:

https://github.com/apache/zeppelin/pull/1987

[ZEPPELIN-2086] Change interpreter.json & credentials.json permission to 600

### What is this PR for?
As @Tagar reported in 
[ZEPPELIN-2086](https://issues.apache.org/jira/browse/ZEPPELIN-2086), 
`conf/interpreter.json` & `conf/credentials.json` can store passwords. For the 
sake of any security issues, we should set the permission of those files to 
`600` not default one `644`. 

### What type of PR is it?
Improvement

### What is the Jira issue?
[ZEPPELIN-2086](https://issues.apache.org/jira/browse/ZEPPELIN-2086)

### TODO

- [ ] Add test case

### How should this be tested?
1. rm both `conf/interpreter.json` & `conf/credentials.json`
2. apply this patch -> build 
```
$ mvn clean package -DskipTests -pl 'zeppelin-interpreter, zeppelin-server, 
zeppelin-zengine'
```

3. restart Zeppelin server 
4. check the permission of `conf/interpreter.json`. It should be 
```
-rw---   interpreter.json
```

5. To check the `credentials.json`, open 
`http://localhost:8080/#/credential` and create new credential set. Then new 
`credentials.json` will be created under `conf/`. 
 ```
-rw---   credentials.json
```

### Screenshots (if appropriate)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/AhyoungRyu/zeppelin ZEPPELIN-2086

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1987.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1987


commit 044d7d4783509921cade2ce4ceeccc1cb1cc02cd
Author: AhyoungRyu 
Date:   2017-02-08T04:36:21Z

Change interpreter.json & credentials.json permission to 600




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1986: [ZEPPELIN-2078] bug fix in get project name in ...

2017-02-07 Thread yiming187

GitHub user yiming187 opened a pull request:

https://github.com/apache/zeppelin/pull/1986

[ZEPPELIN-2078] bug fix in get project name in Kylin interpreter

### What is this PR for?

https://github.com/apache/zeppelin/blob/master/kylin/src/main/java/org/apache/zeppelin/kylin/KylinInterpreter.java
 line 103, the getProject's input should be sql, not const string 
KYLIN_QUERY_PROJECT. Otherwise no project name could be retrieved. And also the 
SQL should exclude the project part.

public HttpResponse prepareRequest(String sql) throws IOException {
String kylinProject = getProject(KYLIN_QUERY_PROJECT);


### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2078

### How should this be tested?
Has unit test.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/yiming187/zeppelin ZEPPELIN-2078

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1986.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1986


commit 681714a2d68dade9fb924f9413b4c31447bfa974
Author: Billy Liu 
Date:   2017-02-08T04:12:54Z

[ZEPPELIN-2078] bug fix in get project name in Kylin interpreter




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2078) Kylin interpreter could not pass the project name from command

2017-02-07 Thread Billy Liu (JIRA)

Billy Liu created ZEPPELIN-2078:
---

 Summary: Kylin interpreter could not pass the project name from 
command
 Key: ZEPPELIN-2078
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2078
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.7.0
Reporter: Billy Liu
Assignee: Billy Liu


https://github.com/apache/zeppelin/blob/master/kylin/src/main/java/org/apache/zeppelin/kylin/KylinInterpreter.java
 line 103, the getProject's input should be sql, not const string 
KYLIN_QUERY_PROJECT.

  public HttpResponse prepareRequest(String sql) throws IOException {
String kylinProject = getProject(KYLIN_QUERY_PROJECT);



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] zeppelin issue #1767: ZEPPELIN-1817 - Added documentation to Zeppelin's shir...

2017-02-07 Thread qinchaofeng

Github user qinchaofeng commented on the issue:

https://github.com/apache/zeppelin/pull/1767
  
@AhyoungRyu  thinks, and the question is  I set shiro.ini like this:


![image](https://cloud.githubusercontent.com/assets/17826176/22722126/e429511c-edef-11e6-8b6c-fb0dff957514.png)
and set to property zeppelin.anonymous.allowed to true in 
conf/zeppelin-site.xml 
I also need to login using username/password


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2077) Add docs link to the latest version of zeppelin

2017-02-07 Thread Jeff Zhang (JIRA)

Jeff Zhang created ZEPPELIN-2077:


 Summary: Add docs link to the latest version of zeppelin
 Key: ZEPPELIN-2077
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2077
 Project: Zeppelin
  Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jeff Zhang


Currently, the doc link of zeppelin always has the version number. This is not 
convenient for other site that want to link to the zeppelin doc. It is a good 
practise to always has the latest version link for zeppelin.

e.g. Here's the latest version doc link for spark
http://spark.apache.org/docs/latest/

\cc [~Ahyoung]



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] zeppelin issue #1952: [ZEPPELIN-753] TableData abstraction

2017-02-07 Thread Leemoonsoo

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1952
  
@1ambda Thanks for taking a look.

Regarding query directly over the TableData in the ResourcePool, it depends 
on each interpreter.
For example, SparkInterpreter can implement [DataSource 
API](https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSource.scala)
 to load data from ResourcePool. Then SparkInterpreter will able to query data 
created from other interpreter, when the data is abstracted by TableData and 
exist in the ResourcePool.

The same approaches can be applied to all other interpreter. So any 
interpreter that supports plugin data source layer, might implement 
ResourcePool as a data source and make query.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1767: ZEPPELIN-1817 - Added documentation to Zeppelin's shir...

2017-02-07 Thread AhyoungRyu

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1767
  
@qinchaofeng If you want to turn off shiro(login as `anonymous`), you 
should set `shiro.ini` like below
```
/** = anon
#/** = authc
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1767: ZEPPELIN-1817 - Added documentation to Zeppelin's shir...

2017-02-07 Thread qinchaofeng

Github user qinchaofeng commented on the issue:

https://github.com/apache/zeppelin/pull/1767
  
when I set to property zeppelin.anonymous.allowed to true in 
conf/zeppelin-site.xml  and set cfg in the shiro like this:

![image](https://cloud.githubusercontent.com/assets/17826176/22721945/b0187836-edee-11e6-98be-a71dd5c31de2.png)

I also need  login using username/password


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1976: [ZEPPELIN-2037] Restart button does not work

2017-02-07 Thread cloverhearts

Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1976
  
@jongyoul sure :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1984: [HOTFIX] Change the screenshot path in custom page doc...

2017-02-07 Thread soralee

Github user soralee commented on the issue:

https://github.com/apache/zeppelin/pull/1984
  
@AhyoungRyu Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1952: [ZEPPELIN-753] TableData abstraction

2017-02-07 Thread 1ambda

Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/1952
  
Sorry for late reply. I was taking a look also recent resource related 
commit to understand fully. 

1. This PR is well abstracted and shipped with enough unit test.
2. And easy to share table type interpreter results with other 
interpreters. The only thing interpreter develop should do is creating it's own 
table data class (e.g `JDBCTableData`, `DataFrameTableData` as Leemoonsoo 
mentioned.) to be inserted into pool using interpreter specific low-level 
result (e.g `JDBCResultSet`, ...)
3. This also enable us to create table data view for shared result in pools.

@Leemoonsoo Now i have a question.

- I can't imagine how one interpreter (e.g JDBC) is able to use shared 
table result from another interpreter (e.g spark.sql). I know we have APIs to 
get results from pool. But getting doesn't mean using (e.g querying) directly. 

Thanks!








---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1984: [HOTFIX] Change the screenshot path in custom page doc...

2017-02-07 Thread AhyoungRyu

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1984
  
@soralee No worries! Just merged and deployed to both 0.7.0 & 
0.8.0-SNAPSHOT docs page :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1984: [HOTFIX] Change the screenshot path in custom p...

2017-02-07 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1984


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1982: [ZEPPELIN-2069] Helium Package Configuration

2017-02-07 Thread 1ambda

GitHub user 1ambda reopened a pull request:

https://github.com/apache/zeppelin/pull/1982

[ZEPPELIN-2069] Helium Package Configuration

### What is this PR for?

Supporting helium package configurations. I attached screenshots.

 Implementation details.

In case of spell, spell developer can create config spec in their 
`package.json` and it will be part of `helium.json` which is consumed by 
Zeppelin.

```
  "config": {
"repeat": {
  "type": "number",
  "description": "How many times to repeat",
  "defaultValue": 1
}
  },
```

1. Persists conf per `package name@package version` since each version can 
require different configs even if they are the same package.
2. Saves key-value config only. Since config spec (e.g `type`, `desc`, 
`defaultValue`) can be provided. So it's not efficient save both of them. 
3. Extracts config related functions to `helium.service.js` since it can be 
used not only in `helium.controller.js` for view but also should be used in 
`paragraph.controller.js`, `result.controller.js` for executing spell. 

### What type of PR is it?
[Feature]

### Todos
* [x] - create config view in `/helium`
* [x] - persist config per `package@version`
* [x] - pass config to spell

### What is the Jira issue?

[ZEPPELIN-2069](https://issues.apache.org/jira/browse/ZEPPELIN-2069)

### How should this be tested?

- Build with examples `mvn clean package -Phelium-dev -Pexamples 
-DskipTests;`
- Open `/helium` page
- Update the `echo-spell` config
- Execute the spell like the screenshot below. (you don't need to refresh 
the page, since executing spell will fetch config from server)

### Screenshots (if appropriate)


![config](https://cloud.githubusercontent.com/assets/4968473/22678867/a66db8ae-ed40-11e6-910b-f81e50a62ba4.gif)

### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/1ambda/zeppelin 
ZEPPELIN-2069/helium-package-configuration

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1982.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1982


commit a42c7887fd9b2c0aa1063d3b1a4c5822f92a757c
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-06T07:34:32Z

feat: Support config, version field for helium pkg

commit 9582cb7f9055798f97dc3da53398f3ab0d17a46b
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-06T07:34:52Z

feat: Support config for helium pkg in backend

commit 05499a4d35e57b46b15de69664b2322fa292ef2b
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-06T07:37:48Z

chore: Add conf to example spells

commit dbd4bce99a6f762332d5516c5edd3d43263d
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-06T07:41:24Z

feat: Support helium conf in frontend

commit 2156c3c0866f1d84218b512cd92811d60263562e
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-07T02:07:28Z

refactor: Extact spell related code to helium

commit e44457c04b49b6381e786fe9441089160d6c7300
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-07T02:23:37Z

feat: Pass confs to spell interpret()

commit 3d9de1ec142a947e3dceca0f715f29323e23c024
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-07T04:18:15Z

feat: Add config to framework, examples

commit fdcf0ba584ff1e9351bbc14cc366e00daa76de51
Author: 1ambda <1am...@gmail.com>
Date:   2017-02-07T04:18:27Z

fix: Remove digest from para ctrl




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1982: [ZEPPELIN-2069] Helium Package Configuration

2017-02-07 Thread 1ambda

Github user 1ambda closed the pull request at:

https://github.com/apache/zeppelin/pull/1982


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1982: [ZEPPELIN-2069] Helium Package Configuration

2017-02-07 Thread 1ambda

Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/1982
  
@AhyoungRyu I totally agree! Now we have basic things, thus we need docs 
for it. I will work it on https://issues.apache.org/jira/browse/ZEPPELIN-2070


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1975: [ZEPPELIN-2046] The final output is a little in...

2017-02-07 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1975


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1952: [ZEPPELIN-753] TableData abstraction

2017-02-07 Thread Leemoonsoo

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1952
  
@1ambda do you have any comment?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2076) Problem resolving interpreter dependencies behind firewall

2017-02-07 Thread Dries De Maeyer (JIRA)

Dries De Maeyer created ZEPPELIN-2076:
-

 Summary: Problem resolving interpreter dependencies behind firewall
 Key: ZEPPELIN-2076
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2076
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.7.0
 Environment: RHEL 6.0
Reporter: Dries De Maeyer


My zeppelin is running behind a corporate firewall. 

When I create a spark interpreter which has external dependencies, the 
interpreter cannot be started due to the fact that it cannot resolve the 
dependencies. It will look for the dependencies in external repositories to 
check for newer versions. After n-times retrying the resolution of the newer 
dependencies (which will always timeout (see exception)) it will just copy the 
dependencies to the local-repo folder for the specific interpreter when they 
are in the local repository. This means however that restarting the zeppelin 
takes more than half an hour because he will retry resolving the dependencies. 


Current workaround is to download the external dependencies using maven 2 so 
that they can be copied into the local repo folder. Restarting the interpreter 
and manually copying the dependencies overrides the automatic resolution.

I tried
 - adding additional external repositories with proxy settings
 - adding the proxy settings to the zeppelin startup process (but these are 
probably not used by the interpreter itself)
 - a lot of waiting (which helps but is very unfortunate if you have to restart)

Beneath the exception logging as in the .log files:
DEBUG [2017-02-07 17:58:52,923] ({pool-50-thread-1} 
HttpConnection.java[open]:692) - Open connection to oss.sonatype.org:443
DEBUG [2017-02-07 17:59:55,932] ({pool-50-thread-1} 
HttpMethodDirector.java[executeWithRetry]:404) - Closing the connection.
 INFO [2017-02-07 17:59:55,932] ({pool-50-thread-1} 
HttpMethodDirector.java[executeWithRetry]:439) - I/O exception 
(java.net.ConnectException) caught when processing request: Connection timed 
out (Connection timed out)
DEBUG [2017-02-07 17:59:55,932] ({pool-50-thread-1} 
HttpMethodDirector.java[executeWithRetry]:443) - Connection timed out 
(Connection timed out)
java.net.ConnectException: Connection timed out (Connection timed out)
at java.net.PlainSocketImpl.socketConnect(Native Method)
at 
java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at 
java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at 
java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:668)
at sun.security.ssl.SSLSocketImpl.(SSLSocketImpl.java:472)
at 
sun.security.ssl.SSLSocketFactoryImpl.createSocket(SSLSocketFactoryImpl.java:153)
at 
org.apache.commons.httpclient.protocol.SSLProtocolSocketFactory.createSocket(SSLProtocolSocketFactory.java:82)
at 
org.apache.commons.httpclient.protocol.SSLProtocolSocketFactory.createSocket(SSLProtocolSocketFactory.java:127)
at 
org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)
at 
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)
at 
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)
at 
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
at 
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
at 
org.apache.maven.wagon.shared.http.AbstractHttpClientWagon.execute(AbstractHttpClientWagon.java:446)
at 
org.apache.maven.wagon.shared.http.AbstractHttpClientWagon.fillInputData(AbstractHttpClientWagon.java:561)
at 
org.apache.maven.wagon.StreamWagon.getInputStream(StreamWagon.java:116)
at org.apache.maven.wagon.StreamWagon.getIfNewer(StreamWagon.java:88)
at org.apache.maven.wagon.StreamWagon.get(StreamWagon.java:61)
at 
org.sonatype.aether.connector.wagon.WagonRepositoryConnector$GetTask.run(WagonRepositoryConnector.java:615)
at 
org.sonatype.aether.util.concurrency.RunnableErrorForwarder$1.run(RunnableErrorForwarder.java:60)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] zeppelin pull request #1944: [HOTFIX][MINOR] Change the scope of httpclient ...

2017-02-07 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1944


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1968: [ZEPPELIN-1551] Remove the "default" text again...

2017-02-07 Thread asfgit

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1968


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1985: [ZEPPELIN-2075] Can't stop infinite `while` sta...

2017-02-07 Thread astroshim

GitHub user astroshim opened a pull request:

https://github.com/apache/zeppelin/pull/1985

[ZEPPELIN-2075] Can't stop infinite `while` statement in pyspark 
Interpreter.

### What is this PR for?
If following code runs with Pyspark Interpreter, there is no way to cancel 
except Zeppelin Server restart.
```
%spark.pyspark
import time

while True:
time.sleep(1)
print("running..")
```

### What type of PR is it?
Bug Fix | Improvement


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2075


### How should this be tested?
Run above code with Pyspark Interpreter and try to cancel.


### Screenshots (if appropriate)
- before
![pyspark 
before](https://cloud.githubusercontent.com/assets/3348133/22696141/615c1206-ed90-11e6-9bbb-339ecdec73fc.gif)


- after
![pyspark 
after](https://cloud.githubusercontent.com/assets/3348133/22696168/70899172-ed90-11e6-99e1-342eb4094b2c.gif)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/astroshim/zeppelin ZEPPELIN-2075

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1985.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1985






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1984: [HOTFIX] Change the screenshot path in custom p...

2017-02-07 Thread soralee

GitHub user soralee reopened a pull request:

https://github.com/apache/zeppelin/pull/1984

[HOTFIX] Change the screenshot path in custom page document

### What is this PR for?
After merging [PR1804](https://github.com/apache/zeppelin/pull/1804), the 
following screenshot path is fault.

![image](https://cloud.githubusercontent.com/assets/8110458/22681668/cb9184c4-ed51-11e6-8984-e8811f81e9aa.png)

![image](https://cloud.githubusercontent.com/assets/8110458/22681769/627c22ea-ed52-11e6-9bf9-b1c2080d0a25.png)

I fixed to change from absolute path to relative path.

### What type of PR is it?
[Bug Fix | Hot Fix]

### What is the Jira issue?
* None

### How should this be tested?
1. Run website locally
2. Please check [Show note list in your custom 
homepage](http://localhost:4000/manual/notebookashomepage.html#show-note-list-in-your-custom-homepage)

![image](https://cloud.githubusercontent.com/assets/8110458/22681862/eceef222-ed52-11e6-9ff9-9a2560c54e45.png)

### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/soralee/zeppelin notelist_png_path

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1984.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1984






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1984: [HOTFIX] Change the screenshot path in custom p...

2017-02-07 Thread soralee

Github user soralee closed the pull request at:

https://github.com/apache/zeppelin/pull/1984


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: ZEPPELIN-1856

2017-02-07 Thread moon soo Lee

Yes, it looks like we can ignore latecomer OUTPUT_APPEND and OUTPUT_UPDATE,
as well.

Thanks!
moon

On Tue, Feb 7, 2017 at 8:57 PM Alexander Shoshin 
wrote:

> Thanks, I got it )
>
> Then I'm going to follow the way you suggested - to ignore an
> OUTPUT_UPDATE_ALL event after a job is finished, because we can't guarantee
> that all events will be delivered before 'interpret(..)' method ends - we
> don't know how many events we should receive from the concrete interpreter.
>
> Should we ignore latecomer OUTPUT_APPEND and OUTPUT_UPDATE events as well?
>
> Regards,
> Alexander
>
> -Original Message-
> From: moon soo Lee [mailto:m...@apache.org]
> Sent: Tuesday, February 07, 2017 8:28 AM
> To: dev@zeppelin.apache.org
> Subject: Re: ZEPPELIN-1856
>
> onOutputClear() method is connected with InterpreterOutput.clear() method.
> clear() method is designed for the use case inside of
> Interpreter.interpret() like,
>
> InterpreterOutput.write("something"); // notebook displays "something"
> InterpreterOutput.clear(); // notebook clears "something"
> InterpreterOutput.write("something else"); // notebook displays "something
> else"
>
> For example, it can be useful when some interpreter want to print progress
> information (like logs, etc) while it's running, and when it finishes,
> clear output and display result.
>
> Will there be a way to fix flaky test ZEPPELIN-1856 while keeping this
> ability?
>
> Thanks,
> moon
>
> On Mon, Feb 6, 2017 at 6:08 PM Alexander Shoshin <
> alexander_shos...@epam.com>
> wrote:
>
> > Hi moon,
> > Thanks for the answer.
> >
> > A agree that one of possible ways to solve the problem is to
> > synchronize OUTPUT_UPDATE_ALL event delivery and 'interpret()' result
> return.
> >
> > But I still don't understand why we need to clear 'Paragraph.results'
> > from 'onOutputClear()' method. I thought that the main goal of this
> > method is to clear results on UI through 'broadcastParagraph(..)'. And
> > if we also try to clear 'Paragraph.results' from this method we can
> > find that it is either already cleared (by 'InterpreterContext'
> > initialization in
> > 'Paragraph.jobRun()') or filled with 'interpret()' result. After
> > ignoring OUTPUT_UPDATE_ALL event in case of FINISHED status we will
> > come in situation where we always clear an empty 'Paragraph.results'.
> > Does it make sense?
> >
> > Regards,
> > Alexander
> >
> > -Original Message-
> > From: moon soo Lee [mailto:m...@apache.org]
> > Sent: Saturday, February 04, 2017 4:30 AM
> > To: dev@zeppelin.apache.org
> > Subject: Re: ZEPPELIN-1856
> >
> > Hi,
> >
> > Thanks for working on issue ZEPPELIN-1856.
> > I think removing 'note.clearParagraphOutput(paragraphId);' from
> > 'onOutputClear()' is not the best solution, because without the line
> > 'onOutputClear()' does not do anything useful.
> >
> > InterpreterContext is constructed before call
> > RemoteInterpreterServer.interpret(). So OUTPUT_UPDATE_ALL supposed to
> > arrive before RemoteInterpreterServer.interpret() returns. Apparently,
> > it looks like it doesn't. So i think we need to tackle this problem.
> >
> > OUTPUT_UPDATE_ALL event is delivered via
> > RemoteInterpreterEventClient/RemoteInterpreterEventPoller, while
> > RemoteInterpreterServer.interpret() does not, and
> > RemoteInterpreterEventClient/RemoteInterpreterEventPoller does not
> > guarantee message deliver before interpret() returns. That's origin of
> > problem i think.
> >
> > Therefore, proper way solving this problem is add some mechanism that
> > guarantee RemoteInterpreterEventClient/RemoteInterpreterEventPoller
> > deliver the OUTPUT_UPDATE_ALL event before interpret() returns. Or
> > simple workaround could be ignore OUTPUT_UPDATE_ALL event when
> > paragraph becomes FINISHED status (after interpret() returns).
> >
> > Thanks,
> > moon
> >
> > On Sat, Feb 4, 2017 at 12:02 AM Alexander Shoshin <
> > alexander_shos...@epam.com> wrote:
> >
> > > Hi,
> > >
> > > I'm working on issue
> > > https://issues.apache.org/jira/browse/ZEPPELIN-1856
> > > and I found that we receive a NullPointerException sometimes because
> > > a paragraph result is cleared twice when we run a job. First
> > > Paragraph.result is cleared just before running
> > > RemoteInterpreter.interpret(..) and this is ok. But then we receive
> > > an OUTPUT_UPDATE_ALL event from the RemoteInterpreterServer and set
> > > Paragraph.result to null again that may lead to a
> > > NullPointerException if Paragraph.result was already filled by
> > > RemoteInterpreter.interpret(..) responce.
> > >
> > > To resolve this problem we need to remove
> > > note.clearParagraphOutput(paragraphId) line from the onOutputClear()
> > > method in NotebookServer.java class:
> > >
> > > @Override
> > > public void onOutputClear(String noteId, String paragraphId) {
> > > Notebook notebook = notebook();
> > > final Note note = notebook.getNote(noteId);
> > > note.clearParagraphOutput(paragraphId);// this

[jira] [Created] (ZEPPELIN-2075) Can't stop infinite `while` statement in pyspark Interpreter.

2017-02-07 Thread Shim HyungSung (JIRA)

Shim HyungSung created ZEPPELIN-2075:


 Summary: Can't stop infinite `while` statement in pyspark 
Interpreter.
 Key: ZEPPELIN-2075
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2075
 Project: Zeppelin
  Issue Type: Bug
  Components: pySpark
Reporter: Shim HyungSung


If following code runs with Pyspark Interpreter, there is no way to cancel 
except Zeppelin Server restart.

{code}
%spark.pyspark
import time

while True:
time.sleep(1)
print("running..")
{code}




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] zeppelin pull request #1983: [ZEPPELIN-1808] disable shortcut key of window ...

2017-02-07 Thread soralee

Github user soralee closed the pull request at:

https://github.com/apache/zeppelin/pull/1983


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1983: [ZEPPELIN-1808] disable shortcut key of window ...

2017-02-07 Thread soralee

GitHub user soralee reopened a pull request:

https://github.com/apache/zeppelin/pull/1983

[ZEPPELIN-1808] disable shortcut key of window created by link this 
paragraph

### What is this PR for?
If using a `Link this paragraph`, new window works the keyboard shortcut. 
Keyboard shortcut should not work in "Link this paragraph" URL.

### What type of PR is it?
[ Improvement ]

### What is the Jira issue?
[ZEPPELIN-1808](https://issues.apache.org/jira/browse/ZEPPELIN-1808)

### How should this be tested?
1. Click `Link this paragraph` or Use `Ctrl+Alt(command)+w` in a paragraph.
2. Use some keyboard shortcut in new window which is created by `Link this 
paragraph`.
3. Check text and title shape of the paragraph.

### Screenshots (if appropriate)
[ Before ]
* When trying to use keyboard shortcut in new paragraph.

![1808_b](https://cloud.githubusercontent.com/assets/8110458/22680039/6020a24a-ed49-11e6-9d52-accfa4982252.gif)

* Text and title are misaligned

![1808_b](https://cloud.githubusercontent.com/assets/8110458/22680223/3ac4f090-ed4a-11e6-972d-e863ce81a187.png)


[ After ]

![image](https://cloud.githubusercontent.com/assets/8110458/22680134/dc18169e-ed49-11e6-9190-f5a9ae20c745.png)



### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/soralee/zeppelin ZEPPELIN-1808_dont_shortcut

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1983.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1983


commit dd563a2efddb0ceec4bd9593dc96a913ab0aa779
Author: soralee 
Date:   2017-02-06T17:15:14Z

[ZEPPELIN-1808] disable shortcut key of window created by link this 
paragraph




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

RE: ZEPPELIN-1856

2017-02-07 Thread Alexander Shoshin

Thanks, I got it ) 

Then I'm going to follow the way you suggested - to ignore an OUTPUT_UPDATE_ALL 
event after a job is finished, because we can't guarantee that all events will 
be delivered before 'interpret(..)' method ends - we don't know how many events 
we should receive from the concrete interpreter.

Should we ignore latecomer OUTPUT_APPEND and OUTPUT_UPDATE events as well?

Regards,
Alexander

-Original Message-
From: moon soo Lee [mailto:m...@apache.org] 
Sent: Tuesday, February 07, 2017 8:28 AM
To: dev@zeppelin.apache.org
Subject: Re: ZEPPELIN-1856

onOutputClear() method is connected with InterpreterOutput.clear() method.
clear() method is designed for the use case inside of
Interpreter.interpret() like,

InterpreterOutput.write("something"); // notebook displays "something"
InterpreterOutput.clear(); // notebook clears "something"
InterpreterOutput.write("something else"); // notebook displays "something else"

For example, it can be useful when some interpreter want to print progress 
information (like logs, etc) while it's running, and when it finishes, clear 
output and display result.

Will there be a way to fix flaky test ZEPPELIN-1856 while keeping this ability?

Thanks,
moon

On Mon, Feb 6, 2017 at 6:08 PM Alexander Shoshin 
wrote:

> Hi moon,
> Thanks for the answer.
>
> A agree that one of possible ways to solve the problem is to 
> synchronize OUTPUT_UPDATE_ALL event delivery and 'interpret()' result return.
>
> But I still don't understand why we need to clear 'Paragraph.results' 
> from 'onOutputClear()' method. I thought that the main goal of this 
> method is to clear results on UI through 'broadcastParagraph(..)'. And 
> if we also try to clear 'Paragraph.results' from this method we can 
> find that it is either already cleared (by 'InterpreterContext' 
> initialization in
> 'Paragraph.jobRun()') or filled with 'interpret()' result. After 
> ignoring OUTPUT_UPDATE_ALL event in case of FINISHED status we will 
> come in situation where we always clear an empty 'Paragraph.results'. 
> Does it make sense?
>
> Regards,
> Alexander
>
> -Original Message-
> From: moon soo Lee [mailto:m...@apache.org]
> Sent: Saturday, February 04, 2017 4:30 AM
> To: dev@zeppelin.apache.org
> Subject: Re: ZEPPELIN-1856
>
> Hi,
>
> Thanks for working on issue ZEPPELIN-1856.
> I think removing 'note.clearParagraphOutput(paragraphId);' from 
> 'onOutputClear()' is not the best solution, because without the line 
> 'onOutputClear()' does not do anything useful.
>
> InterpreterContext is constructed before call 
> RemoteInterpreterServer.interpret(). So OUTPUT_UPDATE_ALL supposed to 
> arrive before RemoteInterpreterServer.interpret() returns. Apparently, 
> it looks like it doesn't. So i think we need to tackle this problem.
>
> OUTPUT_UPDATE_ALL event is delivered via 
> RemoteInterpreterEventClient/RemoteInterpreterEventPoller, while
> RemoteInterpreterServer.interpret() does not, and 
> RemoteInterpreterEventClient/RemoteInterpreterEventPoller does not 
> guarantee message deliver before interpret() returns. That's origin of 
> problem i think.
>
> Therefore, proper way solving this problem is add some mechanism that 
> guarantee RemoteInterpreterEventClient/RemoteInterpreterEventPoller 
> deliver the OUTPUT_UPDATE_ALL event before interpret() returns. Or 
> simple workaround could be ignore OUTPUT_UPDATE_ALL event when 
> paragraph becomes FINISHED status (after interpret() returns).
>
> Thanks,
> moon
>
> On Sat, Feb 4, 2017 at 12:02 AM Alexander Shoshin < 
> alexander_shos...@epam.com> wrote:
>
> > Hi,
> >
> > I'm working on issue
> > https://issues.apache.org/jira/browse/ZEPPELIN-1856
> > and I found that we receive a NullPointerException sometimes because 
> > a paragraph result is cleared twice when we run a job. First 
> > Paragraph.result is cleared just before running
> > RemoteInterpreter.interpret(..) and this is ok. But then we receive 
> > an OUTPUT_UPDATE_ALL event from the RemoteInterpreterServer and set 
> > Paragraph.result to null again that may lead to a 
> > NullPointerException if Paragraph.result was already filled by
> > RemoteInterpreter.interpret(..) responce.
> >
> > To resolve this problem we need to remove
> > note.clearParagraphOutput(paragraphId) line from the onOutputClear() 
> > method in NotebookServer.java class:
> >
> > @Override
> > public void onOutputClear(String noteId, String paragraphId) {
> > Notebook notebook = notebook();
> > final Note note = notebook.getNote(noteId);
> > note.clearParagraphOutput(paragraphId);// this line seems to be
> > wrong
> > Paragraph paragraph = note.getParagraph(paragraphId);
> > broadcastParagraph(note, paragraph); }
> >
> > This method is called only when 
> > RemoteInterpreterServer.interpret(..)
> > initializes an InterpreterContext and sends an OUTPUT_UPDATE_ALL event.
> > Is it safe to remove this line or I miss something? It was added by 
> >

[jira] [Created] (ZEPPELIN-2074) Allow ResourcePool persist object

2017-02-07 Thread Lee moon soo (JIRA)

Lee moon soo created ZEPPELIN-2074:
--

 Summary: Allow ResourcePool persist object
 Key: ZEPPELIN-2074
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2074
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Lee moon soo


Add an ability to persist object in ResourcePool into note.json, selectively.

Might need a method, such as

{code}
class Resource {
   ...
   public void persist(boolean yesno)
   ...
}
{code}

can be used like

{code}
Resource myResource = pool.get(...);
myResource.persist(true);
...
{code}




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (ZEPPELIN-2073) Replace AngularObjectRegistry by ResourcePool

2017-02-07 Thread Lee moon soo (JIRA)

Lee moon soo created ZEPPELIN-2073:
--

 Summary: Replace AngularObjectRegistry by ResourcePool
 Key: ZEPPELIN-2073
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2073
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Lee moon soo
Priority: Minor


Zeppelin provides AngularObjectRegistry and ResourcePool to Interpreter through 
InterpreterContext. And they can be compared like

AngularObjectRegistry
 - Can get/put object
 - Can watch the object
 - Persisted in the note.json
 - Interpreter and Front-end can access AngularObjectRegistry

ResourcePool
 - Can get/put/list objects
 - Can call method and get return value of the object
 - Interpreter can access ResourcePool


ResourcePool can adds following features

 - Persist object in the note.json
 - Watch object change
 - Make front-end access resource pool.

Then AngularObjectRegistry can be replaced by ResourcePool.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] zeppelin issue #1968: [ZEPPELIN-1551] Remove the "default" text against inte...

2017-02-07 Thread namanmishra91

Github user namanmishra91 commented on the issue:

https://github.com/apache/zeppelin/pull/1968
  
The test failures don't seem to be related to my change.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2072) Homescreen doesn't work on shiro.

2017-02-07 Thread Sora Lee (JIRA)

Sora Lee created ZEPPELIN-2072:
--

 Summary: Homescreen doesn't work on shiro.
 Key: ZEPPELIN-2072
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2072
 Project: Zeppelin
  Issue Type: Bug
Reporter: Sora Lee


the homescreen is a setting notebook to use homepage. 
It is the zeppelin.notebook.homescreen variable in zeppelin-site.xml. 
But currently zeppelin.notebook.homescreen variable doesn't work on shiro.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: [jira] [Created] (ZEPPELIN-2071) Very slow parsing of large %html output

2017-02-07 Thread Windy Qin

yes,I also found the same question when I query data  from hive. And it's quick 
in 0.6.2.

[jira] [Created] (ZEPPELIN-2071) Very slow parsing of large %html output

2017-02-07 Thread Sven (JIRA)

Sven created ZEPPELIN-2071:
--

 Summary: Very slow parsing of large %html output
 Key: ZEPPELIN-2071
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2071
 Project: Zeppelin
  Issue Type: Bug
  Components: front-end, Interpreters
Affects Versions: 0.7.0
 Environment: Ubuntu 16.04, 12 GB RAM
Reporter: Sven


*The problem*: open a notebook and run the following cell, which creates a 
string of length 100k and outputs it via %html in order to execute some 
javascript on it (similar for other interpreters, e.g., %spark, %spark-python)


%python
print("%html ready")
s = "X" * 10
print("js='" + s + "'; alert(js.length)")


The execution of this cell takes more than 1 minute!
Since running the same html directly in a browser takes only milliseconds, I 
believe that a bug causes this huge performance drop (for example erroneous 
event polling from some queue or so, see below...).

*Why this is a major issue*: In contrast to Jupyter, Zeppelin allows for an 
almost seamless integration of spark, python, scala, etc. into the front-end's 
JavaScript context. This allows to easily visualize results rendered by 
JavaScript librarys such as Plotly, D3, Vis, Cytoscape, crossfilter, etc., by 
outputting the corresponding JavaScript incl. the stringified data via 
print("%html " + content + "").
Indeed, this works very well in practice with all these libraries.
However, it is a total dealbreaker if we cannot pass more than just some 
hundreds of bytes.

*Logfile*: Please see some relevant DEBUG log output attached (from 
logs/zeppelin-user-host.log). Just a guess because of the repeated IDLE 
messages: probably the long output string is polled in small portions, and some 
event handler falls into some idle-delay in between these portions?

{quote}
(...) thousands of more lines before...
INFO [2017-02-07 09:56:01,928] ({pool-2-thread-2} Paragraph.java[jobRun]:344) - 
run paragraph 20170206-210437_343934373 using null 
org.apache.zeppelin.interpreter.LazyOpenInterpreter@79f86c19
DEBUG [2017-02-07 09:56:01,928] ({pool-2-thread-2} Paragraph.java[jobRun]:380) 
- RUN : print("%html start...") # start html output
s = "X"*10 # create some string of length 100k
print("ready for transfer..."); # notify that done.
print("" + s + "'") # copy the string to javascript 
and compute its length - takes more than a minute!
print("done")
DEBUG [2017-02-07 09:56:01,928] ({pool-2-thread-2} 
InterpreterSetting.java[getInterpreterProcessKey]:143) - 
getInterpreterProcessKey: shared_process for InterpreterSetting Id: 2C7KPWF4Y, 
Name: python3
DEBUG [2017-02-07 09:56:01,928] ({pool-2-thread-2} 
InterpreterSetting.java[getInterpreterProcessKey]:143) - 
getInterpreterProcessKey: shared_process for InterpreterSetting Id: 2C7KPWF4Y, 
Name: python3
DEBUG [2017-02-07 09:56:01,928] ({pool-2-thread-2} 
RemoteInterpreter.java[interpret]:297) - st:
print("%html start...") # start html output
s = "X"*10 # create some string of length 100k
print("ready for transfer..."); # notify that done.
print("" + s + "'") # copy the string to javascript 
and compute its length - takes more than a minute!
print("done")
DEBUG [2017-02-07 09:56:01,930] ({Thread-39} 
NotebookServer.java[broadcast]:472) - SEND >> PARAGRAPH
DEBUG [2017-02-07 09:56:01,931] ({Thread-39} 
WebSocketRemoteEndpoint.java[sendString]:385) - sendString with 
HeapByteBuffer@2c27cd44[p=0,l=978,c=978,r=978]={<<<{"op":"PARAGRAPH"...us","roles":""}>>>}
DEBUG [2017-02-07 09:56:01,935] ({Finalizer} 
LoggingManagedHttpClientConnection.java[close]:79) - http-outgoing-4: Close 
connection
DEBUG [2017-02-07 09:56:01,935] ({Finalizer} 
PoolingHttpClientConnectionManager.java[shutdown]:357) - Connection manager 
shut down
DEBUG [2017-02-07 09:56:01,935] ({Finalizer} 
PoolingHttpClientConnectionManager.java[shutdown]:351) - Connection manager is 
shutting down
DEBUG [2017-02-07 09:56:01,935] ({Finalizer} 
LoggingManagedHttpClientConnection.java[close]:79) - http-outgoing-5: Close 
connection
DEBUG [2017-02-07 09:56:01,939] ({Thread-39} 
ExtensionStack.java[outgoingFrame]:288) - Queuing 
TEXT[len=978,fin=true,rsv=...,masked=false]
DEBUG [2017-02-07 09:56:01,939] ({Thread-39} ExtensionStack.java[process]:388) 
- Processing TEXT[len=978,fin=true,rsv=...,masked=false]
DEBUG [2017-02-07 09:56:01,939] ({Thread-39} 
AbstractWebSocketConnection.java[outgoingFrame]:564) - 
outgoingFrame(TEXT[len=978,fin=true,rsv=...,masked=false], 
org.eclipse.jetty.websocket.common.extensions.ExtensionStack$Flusher@7d2522f0[PROCESSING])
DEBUG [2017-02-07 09:56:01,940] ({Thread-39} FrameFlusher.java[enqueue]:378) - 
Flusher[queueSize=1,aggregateSize=0,failure=null] queued 
FrameEntry[TEXT[len=978,fin=true,rsv=...,masked=false],org.eclipse.jetty.websocket.common.extensions.ExtensionStack$Flusher@7d2522f0[PROCESSING],AUTO,null]
DEBUG [2017-02-07 09:56:01,940] ({Thread-39}

[GitHub] zeppelin issue #1981: [ZEPPELIN-2067] SparkInterpreter prints unnecessary ne...

2017-02-07 Thread Leemoonsoo

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1981
  
Thanks @felixcheung @prabhjyotsingh @zjffdu taking a look.
Merge to master if no more comment.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1976: [ZEPPELIN-2037] Restart button does not work

2017-02-07 Thread jongyoul

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1976
  
@cloverhearts Can you check it?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2070) Create docs for spell

2017-02-07 Thread Hoon Park (JIRA)

Hoon Park created ZEPPELIN-2070:
---

 Summary: Create docs for spell
 Key: ZEPPELIN-2070
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2070
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Hoon Park


Currently, spell doens't have docs at all. We need to create docs for it 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] zeppelin issue #1981: [ZEPPELIN-2067] SparkInterpreter prints unnecessary ne...

2017-02-07 Thread zjffdu

Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1981
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1982: [ZEPPELIN-2069] Helium Package Configuration

2017-02-07 Thread AhyoungRyu

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1982
  
Great!
How about adding some guide docs? Even if SPELL can be improved in the 
future, I believe the docs can help not only users but also the other PR 
reviewers to understand what SPELL is, how we can use SPELL type of pkgs. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

47 matches

Mail list logo