[GitHub] zeppelin issue #2521: [ZEPPELIN-2841] fix a problem in shell interpreter . W...

[vistep]

Github user vistep commented on the issue:

https://github.com/apache/zeppelin/pull/2521
  
Can we use a try-catch block to test if we need to set working directory 
when zeppelin opens a shell interpreter?


---

[GitHub] zeppelin issue #2558: sc.setLocalProperty(...) should be more deterministic

[ruseel]

Github user ruseel commented on the issue:

https://github.com/apache/zeppelin/pull/2558
  
@1ambda setup for forked repository `ruseel/zeppelin` is completed.


---

[jira] [Created] (ZEPPELIN-2902) You must install py4j Python module (pip install py4j) to use Zeppelin dynamic forms features

[cuiqingxin (JIRA)]

cuiqingxin created ZEPPELIN-2902:


 Summary: You must install py4j Python module (pip install py4j) to 
use Zeppelin dynamic forms features
 Key: ZEPPELIN-2902
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2902
 Project: Zeppelin
  Issue Type: Task
  Components: python-interpreter
Affects Versions: 0.8.0
 Environment: Linux 3.10.0-514.21.2.el7.x86_64 #1 SMP Tue Jun 20 
12:24:47 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

py4j:
/usr/anaconda3/lib/python3.6/site-packages/py4j
/usr/anaconda3/share/py4j
/app/program/python-3.6.2/lib/python3.6/site-packages/py4j
/app/program/python-3.6.2/share/py4j

python:
# python3.6 -V
Python 3.6.1 :: Anaconda 4.4.0 (64-bit)

python interpreter:
zeppelin.interpreter.localRepo: //data/MFA_Code/MFA-0.8.0/local-repo/2CP6K2KHJ
zeppelin.interpreter.output.limit:  1024
zeppelin.python:python3.6
Reporter: cuiqingxin
Priority: Minor
 Fix For: 0.8.0


My zeppelin python interpreter use Anaconda 4.4.0
when i use the code from 
https://zeppelin.apache.org/docs/0.7.0/interpreter/python.html
(
%python
### Input form
print (z.input("f1","defaultValue"))

### Select form
print (z.select("f1",[("o1","1"),("o2","2")],"2"))

### Checkbox form
print("".join(z.checkbox("f3", [("o1","1"), ("o2","2")],["1"])))
)
the rusult is :
You must install py4j Python module (pip install py4j) to use Zeppelin dynamic 
forms features

I had already installed py4j by pip install py4j,I use mach time to check but i 
cannot solve.The log have not error.I changed zeppelin.python to absolute path 
but cannot solve.
I cannot establish it cause by python,or by zeppelin.I need ask some body to 
help,thinks.
-
python-interpreter-log:
 INFO [2017-09-04 11:51:50,420] ({pool-2-thread-75} 
PythonInterpreter.java[sendCommandToPython]:200) - Sending : 
### Input form
print (z.input("f1","defaultValue"))

### Select form
#print (z.select("f2",[("o1","1"),("o2","2")],"2"))

### Checkbox form
# print ("".join(z.checkbox("f3", [("o1","1"), ("o2","2")],[...
 INFO [2017-09-04 11:51:50,422] ({pool-2-thread-75} 
SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1504497110420 
finished by scheduler org.apache.zeppelin.python.PythonInterpreter893862673





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] zeppelin issue #2564: [ZEPPELIN-2896] Replacing addHeader with setHeader met...

[krishna-pandey]

Github user krishna-pandey commented on the issue:

https://github.com/apache/zeppelin/pull/2564
  
@felixcheung IMHO, it happens coz we first hit the root Context Path and 
Jetty redirecting it later to the landing/welcome page i.e. index.html. These 
headers are duplicated only for such requests and not every request. 


---

[jira] [Created] (ZEPPELIN-2901) Interpreter 'file'(HDFS) does not

[KaiZheng (JIRA)]

KaiZheng created ZEPPELIN-2901:
--

 Summary: Interpreter 'file'(HDFS) does not 
 Key: ZEPPELIN-2901
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2901
 Project: Zeppelin
  Issue Type: New Feature
  Components: Interpreters
Affects Versions: 0.7.2
 Environment: zeppelin 0.7.2 
Reporter: KaiZheng
Priority: Minor
 Fix For: 0.7.2


interpreter hdfs not work
I changed the webhdfs url link,  but the command "hadoop fs -ls " shows the 
files on this host, not the remote machine(container)





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] zeppelin issue #2565: add zeppelin.livy.share_existing_session option

[zjffdu]

Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2565
  
@ruseel Livy session is shared across notes, as long as the notes belong to 
one user. Livy interpreter is designed for isolated across users. That means 
each user own one livy session, and he can share this session across his notes. 
 The multi-tenancy means users share the same hadoop cluster.   


---

[GitHub] zeppelin issue #2562: ZEPPELIN-2645. Adding way to register RemoteInterprete...

[zjffdu]

Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2562
  
@Leemoonsoo @jongyoul I implement the portRange in thrift callback server. 
But didn't do that for the port of `RemoteInterpreterServer`. I will left it 
when implementing cluster mode.  


---

[GitHub] zeppelin issue #2565: add zeppelin.livy.share_existing_session option

[ruseel]

Github user ruseel commented on the issue:

https://github.com/apache/zeppelin/pull/2565
  
> livy session is shared across notes, What kind of scenarios here do you 
mean?

I guessed that "Livy session is not shared across notes in 
zeppelin:master/BaseLivyIntepreter.java" after inspecting source code and 
exploratory session with my laptop setup. If I opened two notes in zeppelin, 
LivyServer shows there is two session in their web UI. 

Did I missed something? Is it true `livy session is shared across notes`. 
Or Did @zjffdu wanted to know about rationale of PR. :) 


 




---

Re: [VOTE] Release Apache Zeppelin 0.7.3 (RC1)

[Sanjay Dasgupta]

-1

I have a use-case that breaks when using this version (that worked with
0.7.2). My notebook has a couple of cells like this:

*Cell-1*:


%sh
# Remove the old parquet file
rm -rf files/data.parquet

*Cell-2*:


// Write out a new parquet file
dataDF.write.parquet("files/data.parquet")


The Scala code in the second cell fails with a "parquet file already
exists". Further exploration points to the fix for ZEPPELIN-2841
. The problem is that
the shell *rm* command (Cell-1) uses a relative file-path that is sensitive
to where zeppelin was started. The fix changes the shell interpreter's
working directory to be the user's home-directory, thus changing the
effective directory pointed to by the relative path.

The fix ZEPPELIN-2841  is
harmful because it destroys the meaning of all relative file-paths used
with the shell interpreter. It also changes the effective working
directories of different interpreters (or cells) in the same notebook. The
code in the fix should have been made selective to take effect only when
needed (in Docker) and not in other cases.

On Mon, Sep 4, 2017 at 7:29 PM, Prabhjyot Singh 
wrote:

> Download
> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.
> 7.3-rc1/zeppelin-0.7.3-bin-all.tgz
> tested Spark, JDBC (with Hive and Phoenix), Shell and MD interpreter. Works
> well.
>
> +1
>
> On 4 September 2017 at 13:09, Mina Lee  wrote:
>
> > I propose the following RC to be released for the Apache Zeppelin 0.7.3
> > release.
> >
> > The commit id is 7ac76aec4a1fa6501323e03a990274a4ad7e3773 which is
> > corresponds to the tag v0.7.3-rc1:
> > https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;h=refs/tags/v0.7.
> > 3-rc1
> >
> > The release archives (tgz), signature, and checksums are here
> > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.3-rc1/
> >
> > The release candidate consists of the following source distribution
> archive
> > zeppelin-0.7.3.tgz
> >
> > In addition, the following supplementary binary distributions are
> provided
> > for user convenience at the same location
> > zeppelin-0.7.3-bin-all.tgz
> > zeppelin-0.7.3-bin-netinst.tgz
> >
> > The maven artifacts are here
> > https://repository.apache.org/content/repositories/
> orgapachezeppelin-1044
> >
> > You can find the KEYS file here:
> > https://dist.apache.org/repos/dist/release/zeppelin/KEYS
> >
> > Release notes available at
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?versi
> > on=12341035=12316221
> >
> > Vote will be open for next 72 hours (close at 01:00 7/Sep PDT).
> >
> > [ ] +1 approve
> > [ ] 0 no opinion
> > [ ] -1 disapprove (and reason why)
> >
>
>
>
> --
>
> Warm Regards,
>
> Prabhjyot Singh
>

[jira] [Created] (ZEPPELIN-2900) GetUserList.getUserList leaks JdbcRealm connections

[Luis Angel Vicente Sanchez (JIRA)]

Luis Angel Vicente Sanchez created ZEPPELIN-2900:


 Summary: GetUserList.getUserList leaks JdbcRealm connections
 Key: ZEPPELIN-2900
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2900
 Project: Zeppelin
  Issue Type: Bug
Reporter: Luis Angel Vicente Sanchez
Priority: Critical


[GetUserList.java#241|https://github.com/apache/zeppelin/blob/d6203c51ed9eef5e616090326d3dd6dddf21216a/zeppelin-server/src/main/java/org/apache/zeppelin/rest/GetUserList.java#L241]
 is not closing the connections that it borrows from the datasource, preventing 
them to be returned to the connection pool (if one is used)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] zeppelin issue #2484: [ZEPPELIN-2711] basic metrics for paragraphs & noteboo...

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/2484
  
Can you address with LICENSE issue moon mentioned?


---

[GitHub] zeppelin issue #2565: add zeppelin.livy.share_existing_session option

[ruseel]

Github user ruseel commented on the issue:

https://github.com/apache/zeppelin/pull/2565
  
What I want to accomplish eventually is providing a single spark cluster to 
four people and interactive query they issued  is run under a single pool, with 
a fair scheduler. 


---

[GitHub] zeppelin issue #2565: add zeppelin.livy.share_existing_session option

[ruseel]

Github user ruseel commented on the issue:

https://github.com/apache/zeppelin/pull/2565
  
I am trying to use livy as shown in https://youtu.be/gtql7z_kj3Y Zeppelin 
and livy bring multi tenancy to interactive data analysis 20:02. 

Share livy session between multiple user. 


---

[GitHub] zeppelin issue #2528: ZEPPELIN-2834 Show Interpreter list as expand collapse...

[malayhm]

Github user malayhm commented on the issue:

https://github.com/apache/zeppelin/pull/2528
  
@1ambda @prabhjyotsingh @Leemoonsoo Can we merge this to master if there 
are no discussions?


---

[GitHub] zeppelin issue #2564: [ZEPPELIN-2896] Replacing addHeader with setHeader met...

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/2564
  
LGTM


---

[jira] [Created] (ZEPPELIN-2899) Create interpreter launch script for SparkInterpreter

[Jeff Zhang (JIRA)]

Jeff Zhang created ZEPPELIN-2899:


 Summary: Create interpreter launch script for SparkInterpreter
 Key: ZEPPELIN-2899
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2899
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Jeff Zhang


For now, we use interpreter.sh for launching all the interpreters. So there's 
many logics coupled in this script, this ticket is trying to create a dedicated 
script for spark interpreter. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (ZEPPELIN-2898) Support yarn-cluster mode for SparkInterpreter

[Jeff Zhang (JIRA)]

Jeff Zhang created ZEPPELIN-2898:


 Summary: Support yarn-cluster mode for SparkInterpreter
 Key: ZEPPELIN-2898
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2898
 Project: Zeppelin
  Issue Type: New Feature
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: [VOTE] Release Apache Zeppelin 0.7.3 (RC1)

[Prabhjyot Singh]

Download
https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.3-rc1/zeppelin-0.7.3-bin-all.tgz
tested Spark, JDBC (with Hive and Phoenix), Shell and MD interpreter. Works
well.

+1

On 4 September 2017 at 13:09, Mina Lee  wrote:

> I propose the following RC to be released for the Apache Zeppelin 0.7.3
> release.
>
> The commit id is 7ac76aec4a1fa6501323e03a990274a4ad7e3773 which is
> corresponds to the tag v0.7.3-rc1:
> https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;h=refs/tags/v0.7.
> 3-rc1
>
> The release archives (tgz), signature, and checksums are here
> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.3-rc1/
>
> The release candidate consists of the following source distribution archive
> zeppelin-0.7.3.tgz
>
> In addition, the following supplementary binary distributions are provided
> for user convenience at the same location
> zeppelin-0.7.3-bin-all.tgz
> zeppelin-0.7.3-bin-netinst.tgz
>
> The maven artifacts are here
> https://repository.apache.org/content/repositories/orgapachezeppelin-1044
>
> You can find the KEYS file here:
> https://dist.apache.org/repos/dist/release/zeppelin/KEYS
>
> Release notes available at
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?versi
> on=12341035=12316221
>
> Vote will be open for next 72 hours (close at 01:00 7/Sep PDT).
>
> [ ] +1 approve
> [ ] 0 no opinion
> [ ] -1 disapprove (and reason why)
>



-- 

Warm Regards,

Prabhjyot Singh

[GitHub] zeppelin issue #2565: add zeppelin.livy.share_existing_session option

[zjffdu]

Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2565
  
@ruseel @swkimme livy session is shared across notes, What kind of 
scenarios here do you mean ?


---

[GitHub] zeppelin issue #2565: add zeppelin.livy.share_existing_session option

[swkimme]

Github user swkimme commented on the issue:

https://github.com/apache/zeppelin/pull/2565
  
@jerryshao may I ask you to review this PR?


---

[GitHub] zeppelin pull request #2565: add zeppelin.livy.share_existing_session option

[ruseel]

GitHub user ruseel opened a pull request:

https://github.com/apache/zeppelin/pull/2565

add zeppelin.livy.share_existing_session option

If you want to share livy session, There is no option now.
After this commit, setting zeppelin.livy.share_existing_session to true
make LivyInterpreter use an existing livy session
(first session returned by /sessions)

### What is this PR for?
add zeppelin.livy.share_existing_session option. 
zeppelin.livy.share_existing_session is true, list exsiting livy session 
and select first session. 
by doing so, we can share livy session between zeppelin livy interpreters. 

### What type of PR is it?
Feature

### Todos

### What is the Jira issue?

### How should this be tested?

* setup livy server 
* run zeppelin server
* setup zeppelin livy interpreter(change 
zeppelin.livy.share_existing_session to true) 
* make new note 
* make another note 
* audit logs/zeppelin-interpreter-*.log

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No 
* Is there breaking changes for older versions? No
* Does this needs documentation? Yes


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ruseel/zeppelin livy-share-existing-session

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2565.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2565


commit 366fff1b6f7154a10467fdac22af3512e45a490e
Author: stephen 
Date:   2017-09-04T10:16:28Z

zeppelin.livy.share_existing_session

If you want to share livy session, There is no option now.
After this commit, setting zeppelin.livy.share_existing_session to true
make LivyInterpreter use an existing livy session
(first session returned by /sessions)




---

[GitHub] zeppelin issue #2564: [ZEPPELIN-2896] Replacing addHeader with setHeader met...

[krishna-pandey]

Github user krishna-pandey commented on the issue:

https://github.com/apache/zeppelin/pull/2564
  
@1ambda, @Leemoonsoo, @felixcheung, @jongyoul, @prabhjyotsingh Please help 
review this.


---

[GitHub] zeppelin pull request #2564: [ZEPPELIN-2896] Replacing addHeader with setHea...

[krishna-pandey]

GitHub user krishna-pandey opened a pull request:

https://github.com/apache/zeppelin/pull/2564

[ZEPPELIN-2896] Replacing addHeader with setHeader method in CorsFilter.java

### What is this PR for?
HTTP Response Headers were being added multiple times. Replacing addHeader 
method with setHeader overrides the Response Header value with new/existing 
value instead of adding another duplicate response Header.

### What type of PR is it?
[Bug Fix]

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2896

### How should this be tested?
Open the Zeppelin URL in Chrome Browser. Select "More Tools" -> "Developer 
Tools" from the right-side menu. Under Network Section, select the request with 
name "localhost" and check for "Response Headers". You should see response 
headers appearing only once.

![screen shot 2017-09-04 at 3 21 32 
pm](https://user-images.githubusercontent.com/6433184/30021436-feb7a6e4-9184-11e7-9161-f9f8350b7df2.png)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/krishna-pandey/zeppelin ZEPPELIN-2896

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2564.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2564


commit 89a3fdcd3994070f872ca755587a0f10f76c6917
Author: krishna-pandey 
Date:   2017-09-04T09:39:59Z

replacing addHeader with setHeader




---

[jira] [Created] (ZEPPELIN-2897) Query Regarding Zeppelin UI

[Vatsal Pande (JIRA)]

Vatsal Pande created ZEPPELIN-2897:
--

 Summary: Query Regarding Zeppelin UI
 Key: ZEPPELIN-2897
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2897
 Project: Zeppelin
  Issue Type: Task
Reporter: Vatsal Pande


I have a requirement where user will click on a hyperlink from front end and on 
clicking of it, it should take us to Zeppelin UI pre-filled with a specific 
query and with kylin interpreter already pre configured with prefilled query. I 
am unable to find it in documentation

If anyone has any suggestions or pointers, that will be highly appreciated.

Thanks, 
Vatsal



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[VOTE] Release Apache Zeppelin 0.7.3 (RC1)

[Mina Lee]

I propose the following RC to be released for the Apache Zeppelin 0.7.3
release.

The commit id is 7ac76aec4a1fa6501323e03a990274a4ad7e3773 which is
corresponds to the tag v0.7.3-rc1:
https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;h=refs/tags/v0.7.
3-rc1

The release archives (tgz), signature, and checksums are here
https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.3-rc1/

The release candidate consists of the following source distribution archive
zeppelin-0.7.3.tgz

In addition, the following supplementary binary distributions are provided
for user convenience at the same location
zeppelin-0.7.3-bin-all.tgz
zeppelin-0.7.3-bin-netinst.tgz

The maven artifacts are here
https://repository.apache.org/content/repositories/orgapachezeppelin-1044

You can find the KEYS file here:
https://dist.apache.org/repos/dist/release/zeppelin/KEYS

Release notes available at
https://issues.apache.org/jira/secure/ReleaseNote.jspa?versi
on=12341035=12316221

Vote will be open for next 72 hours (close at 01:00 7/Sep PDT).

[ ] +1 approve
[ ] 0 no opinion
[ ] -1 disapprove (and reason why)

[GitHub] zeppelin issue #2492: [ZEPPELIN-2775] Strict-Transport-Security and X-XSS-Pr...

[1ambda]

Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/2492
  
Thanks. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #2492: [ZEPPELIN-2775] Strict-Transport-Security and X-XSS-Pr...

[krishna-pandey]

Github user krishna-pandey commented on the issue:

https://github.com/apache/zeppelin/pull/2492
  
@1ambda I am able to reproduce the issue, seems like the value is getting 
repeated. It turns out that all Headers are being set multiple times. I have 
created an issue (ZEPPELIN-2896) for that.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2896) HTTP Response headers are being set multiple times

[Krishna Pandey (JIRA)]

Krishna Pandey created ZEPPELIN-2896:


 Summary: HTTP Response headers are being set multiple times
 Key: ZEPPELIN-2896
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2896
 Project: Zeppelin
  Issue Type: Bug
  Components: zeppelin-server
Affects Versions: 0.7.2
Reporter: Krishna Pandey
Priority: Critical


HTTP Response Headers are being set multiple times. Refer screenshot attached.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)