[GitHub] zeppelin issue #1430: [ZEPPELIN-868] Notebook import fails when notebook is ...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1430
  
@vensant I don't really get why the error is being triggered this way.
We are talking about the file size, but we show the error when the 
Websocket connection is cut.

One example is to go on that import window, and to stop Zeppelin-server


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1433: [ZEPPELIN-1451] Bug fix of Embedding %html within %tab...

[astroshim]

Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1433
  
@Leemoonsoo Thank you for pointing out the problem. Let me check.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1290: [ZEPPELIN-708]shift positions automatically to ...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1290
  
@mwkang If you rebase again, the Error 2. Should be fixed.
Error 1. should just be a random one


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1472) Create new LdapRealm based on Apache Knox LdapRealm Class

[Greg Senia (JIRA)]

Greg Senia created ZEPPELIN-1472:


 Summary: Create new LdapRealm based on Apache Knox LdapRealm Class
 Key: ZEPPELIN-1472
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1472
 Project: Zeppelin
  Issue Type: Improvement
Affects Versions: 0.6.1
Reporter: Greg Senia
 Fix For: 0.7.0


In our environment we attempted to use the ActiveDirectoryGroupRealm and the 
LdapGroupRealm but unfortunately those implementations against Shiro do not 
support ADLDAP Global Catalog. Also searching on "userPrincipalName" is risky 
in an AD environment since the explicit UPN vs Implicit UPN can be different. 
And the LDAP userPrincipalName attribute is the explicit UPN which can be 
defined by the directory administrator to any value and it can be duplicated.. 
SamAccountName is unique per domain and Microsoft states best practice is to 
not allow duplicate samAccountName's per the forest. I have attached a 
semi-working modified KnoxLdapRealm which works against samAccountName and 
global catalog for auth.

http://windowsitpro.com/active-directory/q-does-samaccountname-object-have-be-unique-active-directory-domain-or-entire-fores

https://jorgequestforknowledge.wordpress.com/2010/10/12/user-principal-names-in-ad-part-1/



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Blocking message pending 10000 for blocking while executing the paragraph

[Sachin Janani]

Sorry I forgot to add the stack trace:
ERROR [2016-09-22 03:57:45,567] ({Thread-482}
NotebookServer.java[broadcast]:320) - socket error
java.io.IOException: java.util.concurrent.TimeoutException: Idle timeout
expired: 30/30 ms
at
org.eclipse.jetty.util.SharedBlockingCallback$Blocker.block(SharedBlockingCallback.java:234)
at
org.eclipse.jetty.websocket.common.BlockingWriteCallback$WriteBlocker.block(BlockingWriteCallback.java:83)
at
org.eclipse.jetty.websocket.common.WebSocketRemoteEndpoint.blockingWrite(WebSocketRemoteEndpoint.java:107)
at
org.eclipse.jetty.websocket.common.WebSocketRemoteEndpoint.sendString(WebSocketRemoteEndpoint.java:387)
at
org.apache.zeppelin.socket.NotebookSocket.send(NotebookSocket.java:69)
at
org.apache.zeppelin.socket.NotebookServer.broadcast(NotebookServer.java:318)
at
org.apache.zeppelin.socket.NotebookServer.broadcastNote(NotebookServer.java:399)
at
org.apache.zeppelin.socket.NotebookServer$ParagraphListenerImpl.afterStatusChange(NotebookServer.java:1158)
at org.apache.zeppelin.scheduler.Job.setStatus(Job.java:150)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.afterStatusChange(RemoteScheduler.java:408)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.getStatus(RemoteScheduler.java:272)
at
org.apache.zeppelin.scheduler.RemoteScheduler$JobStatusPoller.run(RemoteScheduler.java:211)
Caused by: java.util.concurrent.TimeoutException: Idle timeout expired:
30/30 ms
at
org.eclipse.jetty.io.IdleTimeout.checkIdleTimeout(IdleTimeout.java:161)
at org.eclipse.jetty.io.IdleTimeout$1.run(IdleTimeout.java:50)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

On Thu, Sep 22, 2016 at 9:35 AM, Sachin Janani 
wrote:

> Hi All,
> I was working on zeppelin and my zeppelin server was running for more than
> 24 hours.I am getting "Blocking message pending 1 for blocking " error
> intermittently when running the paragraph,but after waiting for some time
> these error disappears is this a known issue?
>
>
> Regards,
> Sachin Janani
>

Blocking message pending 10000 for blocking while executing the paragraph

[Sachin Janani]

Hi All,
I was working on zeppelin and my zeppelin server was running for more than
24 hours.I am getting "Blocking message pending 1 for blocking " error
intermittently when running the paragraph,but after waiting for some time
these error disappears is this a known issue?


Regards,
Sachin Janani

[GitHub] zeppelin pull request #544: [WIP] Multi-Language UI for ZeppelinWebApp

[corneadoug]

Github user corneadoug closed the pull request at:

https://github.com/apache/zeppelin/pull/544


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1443: [ZEPPELIN-1462] Zeppelin-Web Good Practices #3

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1443
  
Changes done.
Merging if there is no other discussions


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1434: [MINOR] Hide "Currently there are no properties...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1434


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1384: [ZEPPELIN-1387] Support table syntax in markdow...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1384


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1433: [ZEPPELIN-1451] Bug fix of Embedding %html within %tab...

[Leemoonsoo]

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1433
  
@astroshim Currently only the last display system directive (%text, %html, 
...) in the output is effective. Which is behavior of both InterpreterResult 
(static output) and InterpreterOutput (streaming output). 

This patch fixes problem but break current behavior. That's why following 
test is failing on CI.

```
Results :

Failed tests: 
  InterpreterOutputTest.testType:92 expected: but was:

Tests run: 68, Failures: 1, Errors: 0, Skipped: 0

[INFO] 

[INFO] Reactor Summary:
[INFO] 
[INFO] Zeppelin ... SUCCESS [  
7.135 s]
[INFO] Zeppelin: Interpreter .. FAILURE [02:08 
min]
```

@astroshim What do you think? will there a easy way to fix the problem 
without changing current behavior? (pass unittest without changing test)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1440: ZEPPELIN-1427. Scala z.show() doesn't work on v.0.6.1

[Leemoonsoo]

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1440
  
Tested and it works well!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1438: [HOTFIX][ZEPPELIN-1458] Fix compiling error on ...

[minahlee]

Github user minahlee closed the pull request at:

https://github.com/apache/zeppelin/pull/1438


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1471) Expose default SparkSession as a variable for spark 2.0 build

[nirav patel (JIRA)]

nirav patel created ZEPPELIN-1471:
-

 Summary: Expose default SparkSession as a variable for spark 2.0 
build
 Key: ZEPPELIN-1471
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1471
 Project: Zeppelin
  Issue Type: Improvement
  Components: Core
Affects Versions: 0.6.2
Reporter: nirav patel


I see that zeppelin 0.6.1 claims to support spark 2.0 however I don't see how 
to access sparkSession variable directly. I can create it from existing spark 
context but I think it would be nice to have One sparkSession variable 
available as an global env



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin pull request #1447: [ZEPPELIN-1293] Re-create Livy session if it's ...

[spektom]

GitHub user spektom opened a pull request:

https://github.com/apache/zeppelin/pull/1447

[ZEPPELIN-1293] Re-create Livy session if it's lost

### What is this PR for?
This patch restarts Livy session when it's lost.

### What type of PR is it?
Improvement/Bug Fix

### Todos

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1293

### How should this be tested?
 * Configure `livy.server.session.timeout` parameter in Livy
 * Start new Livy session through Zeppelin
 * Wait for Livy session to expire
 * See that new Livy session is started when running something in Zeppelin

### Questions:
* Does the licenses files need update?  - No
* Is there breaking changes for older versions?  - No
* Does this needs documentation?  - No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/spektom/zeppelin ZEPPELIN-1293

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1447.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1447


commit acdecbe3b1a91f630d17f4c25c6657cb3fc8d751
Author: Michael Spector 
Date:   2016-09-21T17:36:18Z

[ZEPPELIN-1293] Re-create Livy session if it's lost




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: feedback loop UI

[Alexander Bezzubov]

This sounds very interesting indeed.

Could you please explain a bit more what do you meen?

I think some work in similar direction has been done by Jeremy and few
other members of IBM group.



--
Alex

On Wed, Sep 21, 2016, 09:20 shivani firodiya 
wrote:

> Yes, I would be happy to be a part of it
>
> Shivani
>
> On Wed, Sep 21, 2016 at 8:45 PM, Satish Abburi 
> wrote:
>
> >
> > All, we are exploring the options to develop UI for feedback loop to
> model
> > output. Would like to know the feasibility of doing this by extending
> > Zeppelin.
> >
> > Appreciate any input.
> >
> > Thanks,
> > Satish
> >
>

[GitHub] zeppelin issue #1438: [HOTFIX][ZEPPELIN-1458] Fix compiling error on branch-...

[minahlee]

Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1438
  
Merge if there is no more discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1470) Freezing (Hang) 현상에 대한 확인이 필요합니다.

[SanAh Kang (JIRA)]

SanAh Kang created ZEPPELIN-1470:


 Summary: Freezing (Hang) 현상에 대한 확인이 필요합니다.
 Key: ZEPPELIN-1470
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1470
 Project: Zeppelin
  Issue Type: Bug
Affects Versions: 0.6.1
 Environment: Ubuntu x64, 8core, 16GB, SSD, run only zeppelin. Use 
JDBC, Angular, MD, Spark Interpreters
Reporter: SanAh Kang
Priority: Critical


시스템은 jdbc interpreter를 통해 SQL Server, MySQL의 데이터를 핸들링 하는 넉넉한 사양의 서버 환경입니다.
(installed interpreters: jdbc, spark, md, angular )

Zeppelin 0.6.1 하나의 서비스만 구동되는 독립 시스템이며 RDBMS로의 대용량 쿼리가 빈번합니다.

이 시스템에서 장시간 zeppelin이 구동되다 전체적인 시스템이 정상 작동 불가 수준으로 느리거나 멈추는 현상이 발생합니다.

zeppelin-daemon.sh 를 restart 하는 것으로 문제는 해결되나 Memory leak에 의한 Hang으로 추측되는 현상이라 
확인은 필요할 것 같습니다.

JDBC Driver측 이슈로 추측되며 몇몇 사용자들이 같은 증상을 경험했다고 합니다.

[~Ahyoung] [~moon]
확인 부탁드려요!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: feedback loop UI

[shivani firodiya]

Yes, I would be happy to be a part of it

Shivani

On Wed, Sep 21, 2016 at 8:45 PM, Satish Abburi 
wrote:

>
> All, we are exploring the options to develop UI for feedback loop to model
> output. Would like to know the feasibility of doing this by extending
> Zeppelin.
>
> Appreciate any input.
>
> Thanks,
> Satish
>

feedback loop UI

[Satish Abburi]

All, we are exploring the options to develop UI for feedback loop to model 
output. Would like to know the feasibility of doing this by extending Zeppelin.

Appreciate any input.

Thanks,
Satish

[GitHub] zeppelin issue #1438: [HOTFIX][ZEPPELIN-1458] Fix compiling error on branch-...

[Leemoonsoo]

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1438
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1399: [ZEPPELIN-1182] Zeppelin should have Startup an...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1399


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1404: ZEPPELIN-1411. UDF with pyspark not working - o...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1404


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1469) notebook isolate 옵션이 추가되면 좋겠습니다.

[SanAh Kang (JIRA)]

SanAh Kang created ZEPPELIN-1469:


 Summary: notebook isolate 옵션이 추가되면 좋겠습니다.
 Key: ZEPPELIN-1469
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1469
 Project: Zeppelin
  Issue Type: New Feature
Reporter: SanAh Kang
Priority: Minor


Zeppelin의 기본 컨셉과 상반되는 형태이긴 하나, notebook을 여럿과 공유하지 않고 자신의 local에만 결과가 보이는 
Isolate 옵션이 지원되면 좋겠습니다.

여럿이 paragraph의 결과 값을 함께 보며 연구하는 것도 중요하지만, 각각의 작업자가 서로 다른 값으로 각자 데이터를 분석하는 독립성도 
옵션으로 제공하면 더 좋을 것 같아요.

interpreter isolate가 확대되어 notebook isolate가 되는 느낌이랄까요?
현재는 notebook을 clone떠서 여러개 만들고 각자 하나 씩 붙잡고 분석하는데
이를 shared notebook, private notebook 2개만 딸랑 만들어서 봤으면 합니다.

아무튼, [~Ahyoung] 보시오!




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ZEPPELIN-1468) For each of the para graphs I hope you can be independent permissions.

[SanAh Kang (JIRA)]

SanAh Kang created ZEPPELIN-1468:


 Summary: For each of the para graphs I hope you can be independent 
permissions.
 Key: ZEPPELIN-1468
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1468
 Project: Zeppelin
  Issue Type: New Feature
  Components: front-end, Homepage
Affects Versions: 0.6.1
Reporter: SanAh Kang
Priority: Trivial


For each of the para graphs I hope you can be independent permissions.
*In korean. sorry, i can speak poor english. ::)

[~Ahyoung] 보시오!

현재 Shiro 인증을 사용한 notebook permission 설정 시 Reader는 notebook 안의 paragraph 변수에 값을 
넣는 것이 불가능합니다.
*반드시 Writer 권한이 필요 함

각각의 paragraph에 독립적인 권한 설정이 가능하면 좋겠어요. :)





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin issue #1433: [ZEPPELIN-1451] Bug fix of Embedding %html within %tab...

[astroshim]

Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1433
  
@corneadoug Thank you for your review. I just re-based.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Custom interpreter in 0.6.1

[Aurélien Hébert]

Hi Mina,
Thanks for the reply.

I finally found the source of the error, it was due to an error in the
build configuration (the interpreter was not linked to the right class
name) when using the new method to register the interpreter.
Thanks for trying to reproduce it.

I will consider sharing our interpreter (at least in the future) as for now
it is only available on our Github repository, I would like to know more
about the requirement to share it ?
It doesn't have to be an interpreter pushed in zeppelin repository but
possible to install it as a third party interpreter once zeppelin is
deployed.

However, now our interpreter is used to requests data (located in a store)
using a custom language (WarpScript). In order to use it easily, I am
currently using an ace-editor js file. To deploy my zeppelin server, I am
adding this mode-js file in the bower_components folder then I change the
paragraph controller as describe in the documentation. And to conclude I
rebuild the zeppelin-web war and deploy it on my server. As it not really
quit the best fit for production, I would like to know if there is a proper
way to complete that process ?

Regards,
Aurelien

---
Aurélien Hébert
Developer at Cityzen Data

On Wed, Sep 21, 2016 at 1:48 PM, Mina Lee  wrote:

> Hi Aurélien,
>
> If you have used interpeter-setting.json for 0.6.0, I believe there is not
> much of changes you need to make for 0.6.1.
>
> interpreterGroup information is read either from interpreter-setting.json
> under interpreter/{customInterpreterGroupName}
> or interpreter-setting.json included in your jar package.
> interpreterGroup is list of className and name of your interpreter
> which corresponds to those fields in interpreter-setting.json.
> So if you put className and name correctly in interpreter-setting.json, it
> should have non empty interpreterGroup in response.
>
> I tried different things to reproduce the error but I couldn't...
> I would be happy to help you if you can share more detail to reproduce this
> problem. Or feel free to contact me private if you want to share your
> custom interpreter.
>
> Regards,
> Mina
>
> On Mon, Sep 19, 2016 at 11:31 AM Aurélien Hébert <
> aurelien.heb...@cityzendata.com> wrote:
>
> > Hello,
> >
> > I developed an interpreter for the Zeppelin version 0.6.0. I am now
> > updating it to work on the 0.6.1 release. But unfortunately I am
> > experimenting an issue.
> >
> > When clicking on the create button, I found a list of interpreter with
> > mine, I add it and save it. Then no interpreter is created.
> > When checking on the network requests made I have the following result:
> >
> > {"status":"CREATED","message":"","body":{"id":"2BYP7ANTF","
> name":"test","group":"myInterpreter","properties":{"prop1":"default"},"
> interpreterGroup":[],"dependencies":[],"option":{"
> remote":true,"perNoteSession":false,"perNoteProcess":false,"
> isExistingProcess":false}}}
> >
> > The field interpreterGroup corresponds here to an empty field, what
> should
> > I modify/look for to fill it with the good values ?
> >
> > I put my jar with the dependencies in interpreter/myInterpreter, and
> chande
> > zeppelin-site.xml.
> > The interpreter is defined using the interpreter-setting.json.
> >
> > Thanks
> >
> > ---
> > Aurélien Hébert
> > Developer at Cityzen Data
> >
>

[jira] [Created] (ZEPPELIN-1466) Load jar doesn't work in %dep interpreter in 0.6.1 version

[Vitaliy Zinchenko (JIRA)]

Vitaliy Zinchenko created ZEPPELIN-1466:
---

 Summary: Load jar doesn't work in %dep interpreter in 0.6.1 version
 Key: ZEPPELIN-1466
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1466
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Reporter: Vitaliy Zinchenko
Priority: Blocker


Loading of jars doesn't work in %dep interpreter in version 0.6.1

  %dep
  z.load("/path/to.jar")

Logs don't contain any errors or any clue about the cause of this issue.

Here is the mailing thread z.load("/path/to.jar") 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Custom interpreter in 0.6.1

[Mina Lee]

Hi Aurélien,

If you have used interpeter-setting.json for 0.6.0, I believe there is not
much of changes you need to make for 0.6.1.

interpreterGroup information is read either from interpreter-setting.json
under interpreter/{customInterpreterGroupName}
or interpreter-setting.json included in your jar package.
interpreterGroup is list of className and name of your interpreter
which corresponds to those fields in interpreter-setting.json.
So if you put className and name correctly in interpreter-setting.json, it
should have non empty interpreterGroup in response.

I tried different things to reproduce the error but I couldn't...
I would be happy to help you if you can share more detail to reproduce this
problem. Or feel free to contact me private if you want to share your
custom interpreter.

Regards,
Mina

On Mon, Sep 19, 2016 at 11:31 AM Aurélien Hébert <
aurelien.heb...@cityzendata.com> wrote:

> Hello,
>
> I developed an interpreter for the Zeppelin version 0.6.0. I am now
> updating it to work on the 0.6.1 release. But unfortunately I am
> experimenting an issue.
>
> When clicking on the create button, I found a list of interpreter with
> mine, I add it and save it. Then no interpreter is created.
> When checking on the network requests made I have the following result:
>
> {"status":"CREATED","message":"","body":{"id":"2BYP7ANTF","name":"test","group":"myInterpreter","properties":{"prop1":"default"},"interpreterGroup":[],"dependencies":[],"option":{"remote":true,"perNoteSession":false,"perNoteProcess":false,"isExistingProcess":false}}}
>
> The field interpreterGroup corresponds here to an empty field, what should
> I modify/look for to fill it with the good values ?
>
> I put my jar with the dependencies in interpreter/myInterpreter, and chande
> zeppelin-site.xml.
> The interpreter is defined using the interpreter-setting.json.
>
> Thanks
>
> ---
> Aurélien Hébert
> Developer at Cityzen Data
>

[GitHub] zeppelin pull request #1446: ZEPPELIN-1263. Should specify zeppelin's spark ...

[zjffdu]

GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/1446

ZEPPELIN-1263. Should specify zeppelin's spark configuration through --conf 
arguments of spark-submit

### What is this PR for?

For now we spark configuration at runtime rather than pass them through 
`--conf`, it would cause several issues.
* Some configuration has to be set through --conf, otherwise we need to 
duplicate code in SparkSubmit.scala (spark.yarn.keytab, spark.yarn.principal)
* Some configuration would conflict with spark-defaults.conf. If you 
specify spark.master as yarn-client in spark-defaults.conf but specify 
spark.master as local in zeppelin side, you will see the spark interpreter fail 
to start due to this inconsistency. 
* As ZEPPELIN-1460 described, it is hard to figure what is the effective 
configuration. 
* We can not use yarn-cluster mode although it is not supported now, but I 
think it is necessary to do that as zeppelin needs to support multiple users.

So this PR would pass all the spark related configuration to spark-submit 
through `--conf`, so that it is easy to know and guarantee that configuration 
on zeppelin interpreter setting take precedence over spark-defaults.conf.  And 
it is also good for maintenance that upstream change (any change about 
configuration in spark) would not affect us. 


### What type of PR is it?
[Improvement]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1263

### How should this be tested?
Tested spark 1.6 spark 2.0 on both yarn-client mode and embedded mode. 

### Screenshots (if appropriate)

![image](https://cloud.githubusercontent.com/assets/164491/18702212/3e7b54d0-8013-11e6-95f7-502b3cf89d67.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

…

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-1263

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1446.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1446


commit e36dfc1eb7cf06df4acb717a9701bf36f7a0afd5
Author: Jeff Zhang 
Date:   2016-08-03T04:50:04Z

ZEPPELIN-1263. Should specify zeppelin's spark configuration through --conf 
arguments of spark-submit




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1441: [ ZEPPELIN-967 ] Implement search bar in job manager

[cloverhearts]

Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1441
  
@corneadoug Thank you!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1302: [ZEPPELIN-1306] Interpreter restarts on a note.

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1302
  
@astroshim Can you rebase so that we can check the CI?
I will merge after it's green


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1433: [ZEPPELIN-1451] Bug fix of Embedding %html within %tab...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1433
  
@astroshim Tested, nice fix. LGTM
Can you rebase to have a green CI?
@Leemoonsoo @jongyoul @felixcheung Can one of you guys take a quick look at 
the code?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1408: [ZEPPELIN-808] Changed Permissions on Notebooks do not...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1408
  
Tested with the new instructions.
But, while I do get the error message, it is still running the query

![stillwriting](https://cloud.githubusercontent.com/assets/710411/18701659/cabb149e-8018-11e6-8275-1c0c06ea62d6.gif)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1434: [MINOR] Hide "Currently there are no properties ~" msg...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1434
  
@AhyoungRyu Test, Nice Improvements
Can you just rebase to have a green CI?
After that, Merging if there is no more discussions


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1431: [ZEPPELIN-1446] Fix broken layout of `Create new inter...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1431
  
Tested LGTM
@astroshim Can you just rebase? That should make the CI green


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---