Re: Extending SparkInterpreter functionality

2018-02-01 Thread Jeff Zhang
>>> Same spark versions but multiple clusters. So based on logged in user, we may want to route to different spark cluster or even let user choose the spark he wants to connect to. If you use standalone, you can set `master` in interpreter setting for different standalone cluster. If using yarn,

Re: Extending SparkInterpreter functionality

2018-02-01 Thread Jeff Zhang
1) Spark UI which works differently on EMR than standalone, so that logic will be in an interpreter specific to emr. Could you create a ticket for that, and please add details of that ? I don't know exactly what the difference between EMR and standalone, we can expose api to allow customization

[GitHub] zeppelin issue #2757: [ZEPPELIN-3198] UI should not show Version/GIT Control...

2018-02-01 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/2757 @felixcheung @zjffdu can you please help review this? ---

[GitHub] zeppelin pull request #2709: ZEPPELIN-3111. Refactor SparkInterpreter

2018-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2709 ---

[GitHub] zeppelin pull request #2758: ZEPPELIN-3157. Fixed Checkstyle errors in hbase...

2018-02-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/2758 ---

[GitHub] zeppelin pull request #2760: [WIP] ZEPPELIN-3196. Plugin framework for Zeppe...

2018-02-01 Thread zjffdu
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/2760 [WIP] ZEPPELIN-3196. Plugin framework for Zeppelin Engine ### What is this PR for? A few sentences describing the overall goals of the pull request's commits. First time? Check out the

Re: Extending SparkInterpreter functionality

2018-02-01 Thread Jeff Zhang
Hi Jhon, Do you mind to share what kind of custom function you want to add to spark interpreter ? One idea in my mind is that we could add extension point to the existing SparkInterpreter, and user can enhance SparkInterpreter via these extension point. That means we just open some interfaces and

Extending SparkInterpreter functionality

2018-02-01 Thread Jhon Anderson Cardenas Diaz
Hello! I'm a software developer and as part of a project I require to extend the functionality of SparkInterpreter without modifying it. I need instead create a new interpreter that extends it or wrap its functionality. I also need the spark sub-interpreters to use my new custom interpreter, but

[GitHub] zeppelin pull request #2759: ZEPPELIN-3202. Added missing test dependencies ...

2018-02-01 Thread HorizonNet
GitHub user HorizonNet opened a pull request: https://github.com/apache/zeppelin/pull/2759 ZEPPELIN-3202. Added missing test dependencies in the scio module ### What is this PR for? Added missing test dependencies for the **scio** module to prevent test failures when

[jira] [Created] (ZEPPELIN-3202) Missing test dependencies in scio

2018-02-01 Thread Jan Hentschel (JIRA)
Jan Hentschel created ZEPPELIN-3202: --- Summary: Missing test dependencies in scio Key: ZEPPELIN-3202 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3202 Project: Zeppelin Issue Type:

[jira] [Created] (ZEPPELIN-3201) Detached Zeppelin processes after server shutdown

2018-02-01 Thread Jasper Knulst (JIRA)
Jasper Knulst created ZEPPELIN-3201: --- Summary: Detached Zeppelin processes after server shutdown Key: ZEPPELIN-3201 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3201 Project: Zeppelin

[GitHub] zeppelin issue #2757: [ZEPPELIN-3198] UI should not show Version/GIT Control...

2018-02-01 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/2757 Yes, I believe that is exactly what I'm trying to do over here, for example in S3NotebookRepo, since none of checkpoint, get, revisionHistory, or setNoteRevision is implemented

[GitHub] zeppelin issue #2757: [ZEPPELIN-3198] UI should not show Version/GIT Control...

2018-02-01 Thread jhonderson
Github user jhonderson commented on the issue: https://github.com/apache/zeppelin/pull/2757 The methods for the versioning of the notes are defined at interface level in NotebookRepo.java: - Revision checkpoint(String noteId, String checkpointMsg, AuthenticationInfo) -

[GitHub] zeppelin issue #2758: ZEPPELIN-3157. Fixed Checkstyle errors in hbase module

2018-02-01 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2758 Thanks @HorizonNet LGTM ---

[GitHub] zeppelin issue #2700: [ZEPPELIN-3092] GitHub Integration

2018-02-01 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/2700 It is awsome if there's such button. But I don't know how to make such button. BTW usually I would force push a dummy commit to trigger the build. And I believe we should also fix these flaky test

[GitHub] zeppelin issue #2700: [ZEPPELIN-3092] GitHub Integration

2018-02-01 Thread mohamagdy
Github user mohamagdy commented on the issue: https://github.com/apache/zeppelin/pull/2700 @zjffdu all good. I closed and reopened the pull request. I would suggest making the process of rerunning Jenkins easier than closing and reopening the pull request. This also triggers

[GitHub] zeppelin pull request #2758: ZEPPELIN-3157. Fixed Checkstyle errors in hbase...

2018-02-01 Thread HorizonNet
GitHub user HorizonNet opened a pull request: https://github.com/apache/zeppelin/pull/2758 ZEPPELIN-3157. Fixed Checkstyle errors in hbase module ### What is this PR for? Fixed Checkstyle issues in the **hbase** module. ### What type of PR is it? Improvement

[GitHub] zeppelin pull request #2757: [ZEPPELIN-3198] UI should not show Version/GIT ...

2018-02-01 Thread prabhjyotsingh
GitHub user prabhjyotsingh opened a pull request: https://github.com/apache/zeppelin/pull/2757 [ZEPPELIN-3198] UI should not show Version/GIT Control if the same if not supported ### What is this PR for? Currently, UI shows an option for version/GIT Control even when it is not

[GitHub] zeppelin issue #2752: [ZEPPELIN-3195] Remove the limit on the number of run ...

2018-02-01 Thread mebelousov
Github user mebelousov commented on the issue: https://github.com/apache/zeppelin/pull/2752 @felixcheung Where I could document about ZEPPELIN_INTERPRETER_MAX_POOL_SIZE? There is no such cases in documentation. Also I cannot imagine than Zeppelin administrator will go