[jira] [Created] (ZEPPELIN-2508) [TABLE] Persist column type and sort config

2017-05-04 Thread Hoon Park (JIRA)
Hoon Park created ZEPPELIN-2508:
---

 Summary: [TABLE] Persist column type and sort config
 Key: ZEPPELIN-2508
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2508
 Project: Zeppelin
  Issue Type: Bug
  Components: front-end
Reporter: Hoon Park


Should persist column type (text, numeric, date) and sort (increasing, 
decreasing, none)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ZEPPELIN-2507) [TABLE] dropdown button for table column name should not be {{display: block}}

2017-05-04 Thread Hoon Park (JIRA)
Hoon Park created ZEPPELIN-2507:
---

 Summary: [TABLE] dropdown button for table column name should not 
be {{display: block}}
 Key: ZEPPELIN-2507
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2507
 Project: Zeppelin
  Issue Type: Bug
Reporter: Hoon Park
 Attachments: screenshot-1.png

dropdown button for table column name should not be {{display: block}}.

I attached a screenshot.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ZEPPELIN-2506) "Interpreter null not found" when a note is not bound to any interpreters

2017-05-04 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created ZEPPELIN-2506:
---

 Summary: "Interpreter null not found" when a note is not bound to 
any interpreters
 Key: ZEPPELIN-2506
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2506
 Project: Zeppelin
  Issue Type: Bug
Affects Versions: 0.7.1, 0.7.2, 0.8.0
Reporter: Ruslan Dautkhanov


When we setup a new user or upgrade a note, interpreter.json file is copied 
from a template file. So "interpreterBindings" is empty or irrelevant to notes 
that an upgraded user has. It causes following exception:

{noformat}
org.apache.zeppelin.interpreter.InterpreterException: 
paragraph_1491878547585_-790720711's Interpreter null not found
at org.apache.zeppelin.notebook.Note.run(Note.java:625)
at 
org.apache.zeppelin.socket.NotebookServer.persistAndExecuteSingleParagraph(NotebookServer.java:1781)
at 
org.apache.zeppelin.socket.NotebookServer.runParagraph(NotebookServer.java:1741)
at 
org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:288)
{noformat}

It would be better to show error message *that the note is not bound to any 
notes, and not let execute any paragraphs until this is fixed*.

If a paragraph has an explicit interpreter type defined, then this error is 
slightly different but this does not change the matter 

{noformat}
paragraph_1491878547585_-790720711's Interpreter pyspark not found
org.apache.zeppelin.interpreter.InterpreterException: 
paragraph_1491878547585_-790720711's Interpreter pyspark not found
at org.apache.zeppelin.notebook.Note.run(Note.java:625)
at 
org.apache.zeppelin.socket.NotebookServer.persistAndExecuteSingleParagraph(NotebookServer.java:1781)
at 
org.apache.zeppelin.socket.NotebookServer.runParagraph(NotebookServer.java:1741)
at 
org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:288)
at 
org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:59)
at 
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
at 
org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69)
at 
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65)
at 
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
at 
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161)
at 
org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309)
at 
org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214)
at 
org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220)
at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258)
at 
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632)
at 
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480)
at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ZEPPELIN-2503) The title of linked paragraphs is misaligned and not bold

2017-05-04 Thread Danish Khan (JIRA)
Danish Khan created ZEPPELIN-2503:
-

 Summary: The title of linked paragraphs is misaligned and not bold
 Key: ZEPPELIN-2503
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2503
 Project: Zeppelin
  Issue Type: Bug
  Components: GUI
Affects Versions: 0.7.2
Reporter: Danish Khan


The title of a paragraph appears fine in editable notebook. (Note it is bold) 
https://ibb.co/eCFcD5

However, when these paragraphs are linked, and opened separately in the iFrame, 
the title is misaligned and unpronounced.
https://ibb.co/j2vimQ

Expected behavior: The linked paragraph title should be properly aligned, and 
should be bold, so it's pronounced just as in editable notebook. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Re: Add a dependency in pom.xml of zeppelin-sever.

2017-05-04 Thread Jeff Zhang
That should be fine, we could discuss it in your PR.



Kang Minwoo 于2017年5月5日周五 上午10:51写道:

> I use it for Implementation OAuth2
>
> Best Regard,
> Minwoo Kang
>
> _
> From: Jianfeng (Jeff) Zhang >
> Sent: 목요일, 5월 4, 2017 10:08 오후
> Subject: Re: Add a dependency in pom.xml of zeppelin-sever.
> To: >
>
>
>
> Can you describe for what purpose ?
>
>
> Best Regard,
> Jeff Zhang
>
>
>
>
>
> On 5/4/17, 8:11 PM, "Kang Minwoo" > wrote:
>
> >Hello
> >
> >Can I add a dependency in pom.xml of zeppelin-sever?
> >Is there any rule?
> >
> >Best regards,
> >Minwoo Kang
> >
> >Best regards,
> >Minwoo Kang
>
>
>
>


Re: Add a dependency in pom.xml of zeppelin-sever.

2017-05-04 Thread Kang Minwoo
I use it for Implementation OAuth2

Best Regard,
Minwoo Kang

_
From: Jianfeng (Jeff) Zhang 
>
Sent: 목요일, 5월 4, 2017 10:08 오후
Subject: Re: Add a dependency in pom.xml of zeppelin-sever.
To: >



Can you describe for what purpose ?


Best Regard,
Jeff Zhang





On 5/4/17, 8:11 PM, "Kang Minwoo" 
> wrote:

>Hello
>
>Can I add a dependency in pom.xml of zeppelin-sever?
>Is there any rule?
>
>Best regards,
>Minwoo Kang
>
>Best regards,
>Minwoo Kang





[GitHub] zeppelin pull request #2322: [ZEPPELIN-2502] RemoteInterpreterServer hang fo...

2017-05-04 Thread andreaTP
GitHub user andreaTP opened a pull request:

https://github.com/apache/zeppelin/pull/2322

[ZEPPELIN-2502] RemoteInterpreterServer hang forever during shutdown

### What is this PR for?
There is the chance to have a RemoteServerInterpreter hang forever during 
shutdown

### What type of PR is it?
[Bug Fix]

### What is the Jira issue?
[ZEPPELIN-2502] 

### How should this be tested?
Unit test provided for the fix.

### Questions:
* Is there breaking changes for older versions?
* Does this needs documentation?


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/nokia/zeppelin processHang

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2322.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2322






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2502) RemoteInterpreterServer hang forever during shutdown

2017-05-04 Thread Andrea Peruffo (JIRA)
Andrea Peruffo created ZEPPELIN-2502:


 Summary: RemoteInterpreterServer hang forever during shutdown
 Key: ZEPPELIN-2502
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2502
 Project: Zeppelin
  Issue Type: Bug
  Components: zeppelin-interpreter
Affects Versions: 0.7.1, 0.7.0, 0.7.2, 0.8.0
Reporter: Andrea Peruffo


TL;DR;

there is the opportunity that RemoteServerInterpreter does never terminate 
during shutdown causing zombies JVMs around.

a proper Unit test is provided here:
https://github.com/nokia/zeppelin/blob/35161ba8595782275a1f597f9267a92c226a6cc9/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterServerTest.java#L92

VERSION:

bug detected on 0.7.0 but applicable on master

DETAILED:

I was digging a problem with zombie JVM process caused by the interaction of 
long running Spark jobs in the cluster and Spark interpreter restarts done via 
UI.
I managed to reproduce a scenario where a SparkSubmit process never ends, and 
analyzing the stack trace I ended up finding potential conditions where I can 
have zombies in RemoteInterpreter.

I'm still not 100% sure this will solve but it is anyhow a fix to a bug that 
can manifest itself sooner or later.

My stack trace of the hanging process was:
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.31-b07 mixed mode):
"Attach Listener" #118 daemon prio=9 os_prio=0 tid=0x7fb03c001000 
nid=0x104e waiting on condition [0x]
   java.lang.Thread.State: RUNNABLE
   Locked ownable synchronizers:
- None
"pool-2-thread-6" #114 prio=5 os_prio=0 tid=0x7fb00c004000 nid=0xe52 
waiting on condition [0x7faf963c1000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0xc00da470> (a 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
   Locked ownable synchronizers:
- None
"pool-2-thread-5" #108 prio=5 os_prio=0 tid=0x7fb01403d000 nid=0xd8d 
waiting on condition [0x7faf966c4000]
   java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for  <0xc00da470> (a 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
   Locked ownable synchronizers:
- None
"pool-2-thread-4" #107 prio=5 os_prio=0 tid=0x7fb01403c000 nid=0xd8c in 
Object.wait() [0x7faf967c5000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
at 
org.apache.zeppelin.scheduler.FIFOScheduler.run(FIFOScheduler.java:112)
- locked <0xdc206700> (a java.util.LinkedList)
- locked <0xdc206700> (a java.util.LinkedList)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 

[GitHub] zeppelin issue #2288: [ZEPPELIN-2452] block update paragraph event on revisi...

2017-05-04 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/2288
  
I think this and #2289 are required in `branch-0.7` as well, isn't it?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2321: [ZEPPELIN-2498] add more info and config for Ld...

2017-05-04 Thread khalidhuseynov
GitHub user khalidhuseynov opened a pull request:

https://github.com/apache/zeppelin/pull/2321

[ZEPPELIN-2498] add more info and config for Ldap authentication 

### What is this PR for?
This is to add some necessary configs for ldap authentication.


### What type of PR is it?
Improvement |Documentation

### Todos
* [x] - add system user and security manager info
* [ ] - address feedback

### What is the Jira issue?
[ZEPPELIN-2498](https://issues.apache.org/jira/browse/ZEPPELIN-2498)

### How should this be tested?
1. copy `conf/shiro.ini.template` into `conf/shiro.ini`
2. fill out the fields for `LdapGroupRealm` in `shiro.ini` with info from 
your ldap server
3. login with your own ldap credentials

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/khalidhuseynov/zeppelin fix/ZEPPELIN-2498

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2321.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2321






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2292: [HOTFIX] Remove adduser while creating note

2017-05-04 Thread jongyoul
GitHub user jongyoul reopened a pull request:

https://github.com/apache/zeppelin/pull/2292

[HOTFIX] Remove adduser while creating note

### What is this PR for?
Adding user paragraph while creating paragraph makes default paragraph and 
user paragraph have same reference. It breaks personalized mode works well. 

### What type of PR is it?
[Bug Fix | Hot Fix]

### Todos
* [x] - Remove `addUser` from `createParagraph`
* [x] - Add test case for it

### What is the Jira issue?
N/A

### How should this be tested?
N/A

### Screenshots (if appropriate)
N/A

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin 
hotfix/remove-wrong-adduser-and-add-testcase

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2292.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2292


commit 6ed521a4ba78e736edd0d491e57fa655fc831955
Author: Jongyoul Lee 
Date:   2017-04-26T17:01:23Z

Removed adduser while creating note
Added test to guarantee paragraph.getUserParagraph is different from 
paragraph itself




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2292: [HOTFIX] Remove adduser while creating note

2017-05-04 Thread jongyoul
Github user jongyoul closed the pull request at:

https://github.com/apache/zeppelin/pull/2292


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2318: [ZEPPELIN-2492] Use single Dockerfile for each ...

2017-05-04 Thread 1ambda
Github user 1ambda closed the pull request at:

https://github.com/apache/zeppelin/pull/2318


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2318: [ZEPPELIN-2492] Use single Dockerfile for each ...

2017-05-04 Thread 1ambda
GitHub user 1ambda reopened a pull request:

https://github.com/apache/zeppelin/pull/2318

[ZEPPELIN-2492] Use single Dockerfile for each tag

### What is this PR for?

Use single `Dockerfile` for each release since [apache infra uses tag 
pushes](https://issues.apache.org/jira/browse/INFRA-12781) to build an image. 

- https://issues.apache.org/jira/browse/INFRA-12781

After release process finishes, dockerhub will build using the pushed tag.

### What type of PR is it?
[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?

[ZEPPELIN-2492](https://issues.apache.org/jira/browse/ZEPPELIN-2492)

### How should this be tested?

1. `./dev/change_zeppelin_version.sh 0.8.0-SNAPSHOT 0.7.1`
2. Check that version is properly set: `vi 
scrtips/docker/zeppelin/bin/Dockerfile`
3. Build docker image `cd scripts/docker/zeppelin/bin; docker build -t 
zeppelin:0.7.1 ./`
4. Run the image: `docker run -p 8080:8080  --rm --name zeppelin 
zeppelin:0.7.1`

### Screenshots (if appropriate)

NONE

### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/1ambda/zeppelin 
ZEPPELIN-2492/use-single-dockerfile-for-each-tag

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2318.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2318


commit 5826c8ccb71cd737df3dc9f680c421ab681529d5
Author: 1ambda <1am...@gmail.com>
Date:   2017-05-04T07:26:55Z

fix: Use single dockerfile for tag push

commit 483bec35eb2dc043d27f36aa175f1234d1ed0756
Author: 1ambda <1am...@gmail.com>
Date:   2017-05-04T07:29:13Z

docs: Update README for Dockerfile




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2271: [ZEPPELIN-2414] Memory leak under scoped mode of Spark...

2017-05-04 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/2271
  
You can close/reopen the issue to trigger Jenkins


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2125: [ZEPPELIN-2222] Add Network Visualization

2017-05-04 Thread 1ambda
Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/2125
  
1. Regarding to `continuous-integration/appveyor/pr — AppVeyor build 
failed`, you should rebase. Since master has `.appvepor.yml` file. 

2. In case of Jenkins, you are failing to profile 3 (selenium test)

- [raw 
log](https://s3.amazonaws.com/archive.travis-ci.org/jobs/227364420/log.txt?X-Amz-Expires=30=20170504T121444Z=AWS4-HMAC-SHA256=AKIAJRYRXRSVGNKPKO5A/20170504/us-east-1/s3/aws4_request=host=1a7a934aff18da242587c547c957ace22807c6a84edcc70be96d48465c161611)

```
Tests in error: 
  
AuthenticationIT.testGroupPermission:190->AbstractZeppelinIT.pollingWait:94 
» Timeout
  InterpreterIT.testShowDescriptionOnInterpreterCreate:69 » 
ElementNotVisible El...
```

They might be flaky tests. You can simply pass them by clicking `restart` 
button in travis. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Add a dependency in pom.xml of zeppelin-sever.

2017-05-04 Thread Kang Minwoo
Hello

Can I add a dependency in pom.xml of zeppelin-sever?
Is there any rule?

Best regards,
Minwoo Kang

Best regards,
Minwoo Kang


[GitHub] zeppelin pull request #2288: [ZEPPELIN-2452] block update paragraph event on...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2288


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2289: [ZEPPELIN-2452] Can not handle message in revis...

2017-05-04 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2289


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2499) Improve documentation for mapping LDAP/AD groups into Zeppelin roles

2017-05-04 Thread Khalid Huseynov (JIRA)
Khalid Huseynov created ZEPPELIN-2499:
-

 Summary: Improve documentation for mapping LDAP/AD groups into 
Zeppelin roles
 Key: ZEPPELIN-2499
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2499
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Khalid Huseynov


I think current documentation in 
https://zeppelin.apache.org/docs/0.7.0/security/shiroauthentication.html#groups-and-permissions-optional
 for mapping groups and permissions isn't clear enough. Need to add more 
connection to Zeppelin roles (e.g. readers, writers)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ZEPPELIN-2498) Improve LDAP authentication related conf and documentation

2017-05-04 Thread Khalid Huseynov (JIRA)
Khalid Huseynov created ZEPPELIN-2498:
-

 Summary: Improve LDAP authentication related conf and documentation
 Key: ZEPPELIN-2498
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2498
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Khalid Huseynov


current documentation and conf/shiro.ini content isn't complete enough for 
straightforward usage of LDAP authentication.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ZEPPELIN-2497) [Umbrella] Improve authentication/auhorization and other security related documentation

2017-05-04 Thread Khalid Huseynov (JIRA)
Khalid Huseynov created ZEPPELIN-2497:
-

 Summary: [Umbrella] Improve authentication/auhorization and other 
security related documentation
 Key: ZEPPELIN-2497
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2497
 Project: Zeppelin
  Issue Type: Task
Reporter: Khalid Huseynov
Assignee: Khalid Huseynov


Current documentation for 
[authentication|https://zeppelin.apache.org/docs/0.7.0/security/shiroauthentication.html]
 and 
[authorisation|https://zeppelin.apache.org/docs/0.7.0/security/notebook_authorization.html]
 with different realms isn't complete and clear enough for straightforward use. 
So I think more setup parameters and documentation should be added



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (ZEPPELIN-2496) Error listing a HDFS directory with a large number of files

2017-05-04 Thread Victor Ferrer (JIRA)
Victor Ferrer created ZEPPELIN-2496:
---

 Summary: Error listing a HDFS directory with a large number of 
files
 Key: ZEPPELIN-2496
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2496
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.7.1
 Environment: Centos 7 - CDH 5
Reporter: Victor Ferrer


Hi,

I have noticed an incorrect behavior while using the HDFS (%file) interpreter.
For instance, when I list this directory, I get the correct result:

{noformat}
%file
ls -l /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=1
{noformat}

{noformat}
-rw-r--r--  3hdfs   supergroup  893762672017-05-03 
12:29GMT 
/mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=1/part-r-0-ac4e728a-332e-40ca-b42b-daaf783fe227.snappy.parquet
-rw-r--r--  3hdfs   supergroup  885856752017-05-03 
12:29GMT 
/mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=1/part-r-1-ac4e728a-332e-40ca-b42b-daaf783fe227.snappy.parquet
{noformat}

However, when I switch to a bigger directory, I get an error stating that the 
directory could not be found:

{noformat}
%file
ls -l /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2
{noformat}

{noformat}
Could not find file or directory:   
/mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2
{noformat}

If I dig in the logs, I get this error message:

{noformat}
ERROR [2017-05-04 12:05:44,910] ({pool-2-thread-14} 
HDFSFileInterpreter.java[listAll]:227) - listall: listDir 
/mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2
com.google.gson.JsonSyntaxException: java.io.EOFException: End of input at line 
1 column 311752
at com.google.gson.Gson.fromJson(Gson.java:800)
at com.google.gson.Gson.fromJson(Gson.java:757)
at com.google.gson.Gson.fromJson(Gson.java:706)
at com.google.gson.Gson.fromJson(Gson.java:678)
at 
org.apache.zeppelin.file.HDFSFileInterpreter.listAll(HDFSFileInterpreter.java:212)
at 
org.apache.zeppelin.file.FileInterpreter.interpret(FileInterpreter.java:130)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:95)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:490)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at 
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.EOFException: End of input at line 1 column 311752
at 
com.google.gson.stream.JsonReader.nextNonWhitespace(JsonReader.java:954)
at com.google.gson.stream.JsonReader.nextInArray(JsonReader.java:677)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:376)
at com.google.gson.stream.JsonReader.hasNext(JsonReader.java:349)
at 
com.google.gson.internal.bind.ArrayTypeAdapter.read(ArrayTypeAdapter.java:71)
at 
com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
at 
com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
at 
com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
at 
com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
at com.google.gson.Gson.fromJson(Gson.java:791)
... 16 more
ERROR [2017-05-04 12:05:44,911] ({pool-2-thread-14} 
FileInterpreter.java[interpret]:133) - Error listing files in path 
/mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2
org.apache.zeppelin.interpreter.InterpreterException: Could not find file or 
directory: /mediation2/kpis/ran/cell3g/temporalAgg=ROP/year=2017/month=5/day=2
at 
org.apache.zeppelin.file.HDFSFileInterpreter.listAll(HDFSFileInterpreter.java:228)
at 
org.apache.zeppelin.file.FileInterpreter.interpret(FileInterpreter.java:130)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:95)
at 

[jira] [Created] (ZEPPELIN-2495) Support Oauth2

2017-05-04 Thread Minwoo Kang (JIRA)
Minwoo Kang created ZEPPELIN-2495:
-

 Summary: Support Oauth2
 Key: ZEPPELIN-2495
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2495
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Minwoo Kang
Assignee: Minwoo Kang


This issue is Supporting Oauth2. Many enterprises use Oauth2 for authorization. 
If Oauth2 were supported, It is easy to integrate In-house system.

If you have any idea to this issue, please leave a message.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] zeppelin issue #2125: [ZEPPELIN-2222] Add Network Visualization

2017-05-04 Thread conker84
Github user conker84 commented on the issue:

https://github.com/apache/zeppelin/pull/2125
  
i tried but it still fails...


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2182: [HOLD][ZEPPELIN-2248] Fix javax.ws.rs and cxf version ...

2017-05-04 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/2182
  
@sohaibiftikhar Sorry for confusing you. I didn't know #932 set the CI. 
Please test it with that PR


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]

2017-05-04 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/932
  
@echarles Sorry, I haven't checked it correctly. Thanks for checking it 
again. I'll test it


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]

2017-05-04 Thread echarles
Github user echarles commented on the issue:

https://github.com/apache/zeppelin/pull/932
  
Jenkins build is now green. @jongyoul  @bzz Any other inputs/questions on 
this PR ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2182: [HOLD][ZEPPELIN-2248] Fix javax.ws.rs and cxf version ...

2017-05-04 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/2182
  
@sohaibiftikhar #932 didn't adopt CI then you'd better test this build and 
fix some minor issues from it. Thanks!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2320: [MINOR] Move remoteinterpreter into zengine

2017-05-04 Thread jongyoul
GitHub user jongyoul opened a pull request:

https://github.com/apache/zeppelin/pull/2320

[MINOR] Move remoteinterpreter into zengine

### What is this PR for?
RemoteInterpreter is only used in the server side then zeppelin-interpreter 
doesn't have to include this class. Moving this class helps to reduce 
interpreter binary size and change RemoteInterpreter without adding more 
dependencies if we want


### What type of PR is it?
[Refactoring]

### Todos
* [x] - Move RemoteInterpreter and related files out of 
zeppelin-interpreter module

### What is the Jira issue?
N/A

### How should this be tested?
N/A

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin 
minor/move-remoteinterpreter-into-zengine

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2320.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2320


commit 7e8721592d13c782d9028b6c52f4360980eb7d02
Author: Jongyoul Lee 
Date:   2017-05-03T16:39:21Z

move some files of remote packages from zeppelin-interpreter to 
zeppelin-zengine

commit b7e0b9436a55a2251af637b976222b7333556296
Author: Jongyoul Lee 
Date:   2017-05-04T08:15:45Z

moved some files related remote interpreter and fix some minor things

commit 0a881c1b3869e5005a99f55eae177caf5a85ee13
Author: Jongyoul Lee 
Date:   2017-05-04T08:20:28Z

Removed unused package imported
Removed unnecessary classes imported




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2319: [ZEPPELIN-2437] Executions of notebooks are blo...

2017-05-04 Thread hammertank
GitHub user hammertank opened a pull request:

https://github.com/apache/zeppelin/pull/2319

[ZEPPELIN-2437] Executions of notebooks are blocked after running 50 
different notebooks under SparkInterpreter scoped mode

### What is this PR for?
Removes Scheduler when RemoteInterpreterServer close an interpreter.

### What type of PR is it?
[Bug Fix]

### Todos
* [x] - Removes Scheduler when calling RemoteInterpreterServer.close()

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2437

### How should this be tested?
RemoteInterpreterServerTest#testClose(TBD)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/hammertank/zeppelin ZEPPELIN-2437

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2319.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2319


commit d5a3ffa94e56d45534caedf71e7adfd7b70c8bf4
Author: Jeff Zhang 
Date:   2017-03-22T07:19:42Z

[HOTFIX][ZEPPELIN-2294]. Interpreter fail exception is not propagated to 
frontend

### What is this PR for?

This PR would address the issue of Interpreter fail exception is not 
propagated to frontend. This is due to the bug fix of restarting button issue.  
Make referenceCount as number of sessions attached to this process. Open and 
close all the interpreters in one session together. I don't think there's 
scenario for close a single interpreter for now.

### What type of PR is it?
[Bug Fix | Improvement]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2294

### How should this be tested?
I don't have time to write test, just verify zombie process issue manually 
in the following scenario
* Per User + Isolated
* Per Note + Isolated
* Per User + Scoped
* Per Note + Scoped

### Screenshots (if appropriate)
Before

![2017-03-22_1538](https://cloud.githubusercontent.com/assets/164491/24198052/227d42e6-0f3f-11e7-9918-bf9827e44f92.png)

After

![2017-03-22_1523](https://cloud.githubusercontent.com/assets/164491/24198062/31043cc0-0f3f-11e7-8ab3-87938e3918ce.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang 

Closes #2175 from zjffdu/ZEPPELIN-2294 and squashes the following commits:

a3f8aa0b [Jeff Zhang] [ZEPPELIN-2294]. Interpreter fail exception is not 
propagated to frontend

(cherry picked from commit 0aea2416dc60fb6e2e181ee1c593d9d2c575bcb7)
Signed-off-by: Jongyoul Lee 

(cherry picked from commit ddf2378)

commit 4a4aea3686d2e0445f066127db9f95c300cece7e
Author: z0621 
Date:   2017-05-04T07:12:04Z

Remove Scheduler when Interpreter is closed




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2494) API Display Type

2017-05-04 Thread Eric Charles (JIRA)
Eric Charles created ZEPPELIN-2494:
--

 Summary: API Display Type
 Key: ZEPPELIN-2494
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2494
 Project: Zeppelin
  Issue Type: New Feature
  Components: zeppelin-zengine
Reporter: Eric Charles


A recurring request goes around automation where users are willing to use the 
notebook in a scheduled tool. This means also that the output of the notes have 
to be processed by some software.
To indicate an output to be processed by a tool, we should produced structured 
content, in other words JSON.
The current output (DisplayType) are TEXT, HTML, TABLE... but nothing is 
forseen for JSON.
I propose to add a type API (because %json is already taken by a spell, and 
anyway API better indicates the intent).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] zeppelin pull request #2318: [ZEPPELIN-2492] Use single Dockerfile for each ...

2017-05-04 Thread 1ambda
GitHub user 1ambda opened a pull request:

https://github.com/apache/zeppelin/pull/2318

[ZEPPELIN-2492] Use single Dockerfile for each tag

### What is this PR for?

Use single `Dockerfile` for each release since [apache infra uses tag 
pushes](https://issues.apache.org/jira/browse/INFRA-12781) to build an image. 

- https://issues.apache.org/jira/browse/INFRA-12781

After release process finishes, dockerhub will build using the pushed tag.

### What type of PR is it?
[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?

[ZEPPELIN-2492](https://issues.apache.org/jira/browse/ZEPPELIN-2492)

### How should this be tested?

1. `./dev/change_zeppelin_version.sh 0.8.0-SNAPSHOT 0.7.1`
2. Check that version is properly set: `vi 
scrtips/docker/zeppelin/bin/Dockerfile`
3. Build docker image `cd scripts/docker/zeppelin/bin; docker build -t 
zeppelin:0.7.1 ./`
4. Run the image: `docker run -p 8080:8080  --rm --name zeppelin 
zeppelin:0.7.1`

### Screenshots (if appropriate)

NONE

### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/1ambda/zeppelin 
ZEPPELIN-2492/use-single-dockerfile-for-each-tag

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2318.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2318


commit 5826c8ccb71cd737df3dc9f680c421ab681529d5
Author: 1ambda <1am...@gmail.com>
Date:   2017-05-04T07:26:55Z

fix: Use single dockerfile for tag push

commit 483bec35eb2dc043d27f36aa175f1234d1ed0756
Author: 1ambda <1am...@gmail.com>
Date:   2017-05-04T07:29:13Z

docs: Update README for Dockerfile




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2271: [ZEPPELIN-2414] Memory leak under scoped mode of Spark...

2017-05-04 Thread hammertank
Github user hammertank commented on the issue:

https://github.com/apache/zeppelin/pull/2271
  
@Leemoonsoo re-commit as required. Please review again. 
Jenkins did not get the final travis-ci results successfully. Is there a 
way to trigger Jenkins to fetch again without a push?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2274: [ZEPPELIN-2388] Improve the keyboard shortcuts dialog

2017-05-04 Thread 1ambda
Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/2274
  
need to be rebased to make CI green.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---