[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3092 @selvinsource I have removed property `zeppelin.interpreters`, could you do rebase ? ---

[GitHub] zeppelin issue #3095: ZEPPELIN-3652. Remove reflection in SparkInterpreter

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3095 Will merge if no more comment ---

[GitHub] zeppelin pull request #3091: ZEPPELIN-3643. Put Shiro related thing in one p...

2018-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/3091 ---

[GitHub] zeppelin pull request #3097: ZEPPELIN-3662. Remove method register in Interp...

2018-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/3097 ---

[GitHub] zeppelin pull request #3096: ZEPPELIN-3661. Remove property zeppelin.interpr...

2018-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/3096 ---

[jira] [Created] (ZEPPELIN-3663) Unable to use R Interpreter in Zeppelin 0.7.3

2018-07-25 Thread Oludare Famuyiwa (JIRA)
Oludare Famuyiwa created ZEPPELIN-3663: -- Summary: Unable to use R Interpreter in Zeppelin 0.7.3 Key: ZEPPELIN-3663 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3663 Project: Zeppelin

[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-25 Thread selvinsource
Github user selvinsource commented on the issue: https://github.com/apache/zeppelin/pull/3092 @zjffdu I made the requested changes except zeppelin.interpreter.group.order, should I just remove the whole property? I can't see where it's used to be honest. ---

Re: Parallel Execution of Spark Jobs

2018-07-25 Thread Ankit Jain
Jeff, what you said seems to be in conflict with what is detailed here - https://medium.com/@leemoonsoo/apache-zeppelin-interpreter-mode-explained- bae0525d0555 "In *Scoped* mode, Zeppelin still runs single interpreter JVM process but multiple *Interpreter Group* serve each Note." In practice as

[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3092 There's no exact plan for 0.9.0, my rough plan is to release 0.9.0 in the next half year of 2018. ---

[GitHub] zeppelin issue #3090: [ZEPPELIN-3645] Add LSP Protocol completion support

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3090 Is there any session concept in LSP ? so that multiple LSP request could belong to the same session ---

[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-25 Thread selvinsource
Github user selvinsource commented on the issue: https://github.com/apache/zeppelin/pull/3092 @zjffdu as soon as this PR is merged in the master I will update the upstream master and start working on Jet interpreter, I have created a Jira ticket already (with a dependency on the Java

[GitHub] zeppelin issue #3090: [ZEPPELIN-3645] Add LSP Protocol completion support

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3090 Then it looks like LSP can only work in paragraph level. This seems not workable for users. Let's assume we also want to make PySpark support LSP. Then I guess if I type `sc.`, I will get nothing

[GitHub] zeppelin pull request #3094: [ZEPPELIN-3656] Fix for completion with Livy in...

2018-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/zeppelin/pull/3094 ---

[GitHub] zeppelin issue #3094: [ZEPPELIN-3656] Fix for completion with Livy interpret...

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3094 Don't worry, I will do the cherry-pick ---

[GitHub] zeppelin issue #3090: [ZEPPELIN-3645] Add LSP Protocol completion support

2018-07-25 Thread oxygen311
Github user oxygen311 commented on the issue: https://github.com/apache/zeppelin/pull/3090 1. LSP is usable and powerful solution: - LSP can understand imports in the start of paragraph; - We can use already made solution for every language and don't write new one; - LSP

[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-25 Thread selvinsource
Github user selvinsource commented on the issue: https://github.com/apache/zeppelin/pull/3092 @zjffdu thanks for reviewing the PR. Let me give you a bit of background before I answer your question on using another java interpreter. First of all, I found lately

[GitHub] zeppelin issue #3096: ZEPPELIN-3661. Remove property zeppelin.interpreters

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3096 Will merge it if no more comments ---

[GitHub] zeppelin issue #3094: [ZEPPELIN-3656] Fix for completion with Livy interpret...

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3094 @alexjbush Not sure what's wrong with jenkins. Maybe you can try it later. Regarding 0.8.1, I plan to release it round one month later. Because there's other issues needs to be fixed. ---

[GitHub] zeppelin issue #3094: [ZEPPELIN-3656] Fix for completion with Livy interpret...

2018-07-25 Thread alexjbush
Github user alexjbush commented on the issue: https://github.com/apache/zeppelin/pull/3094 @zjffdu I've added a test and it builds in Travis: [https://travis-ci.org/alexjbush/zeppelin/builds/407942421](https://travis-ci.org/alexjbush/zeppelin/builds/407942421) Seems like it's

[GitHub] zeppelin issue #3090: [ZEPPELIN-3645] Add LSP Protocol completion support

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3090 1. Do you have any examples to show how much better LSP is compared to the current approach ? 2. Does the auto completion works across paragraphs ? e.g. I create string variable `a` in p1, can

[GitHub] zeppelin issue #3091: ZEPPELIN-3643. Put Shiro related thing in one place

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3091 Will merge if no more comments ---

[GitHub] zeppelin issue #3090: [ZEPPELIN-3645] Add LSP Protocol completion support

2018-07-25 Thread oxygen311
Github user oxygen311 commented on the issue: https://github.com/apache/zeppelin/pull/3090 @zjffdu If LSP has no complete for `sc.`, iPython complete will be shown. LSP does not support sessions, but it can keep connection. ---

[GitHub] zeppelin pull request #3093: [ZEPPELIN-3655] Add missing roles information t...

2018-07-25 Thread oxygen311
Github user oxygen311 closed the pull request at: https://github.com/apache/zeppelin/pull/3093 ---

[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3092 Thanks @selvinsource Very glad that you willing to improve the current java interpreter when JShell is available in Java 11. It make sense to use the current java repl that Beam use, and improve

[GitHub] zeppelin pull request #3094: [ZEPPELIN-3656] Fix for completion with Livy in...

2018-07-25 Thread alexjbush
GitHub user alexjbush reopened a pull request: https://github.com/apache/zeppelin/pull/3094 [ZEPPELIN-3656] Fix for completion with Livy interpreter ### What is this PR for? Fix for NullPointerException when using code completion in the Livy Interpreter when Shared Interpreter

[GitHub] zeppelin issue #3094: [ZEPPELIN-3656] Fix for completion with Livy interpret...

2018-07-25 Thread alexjbush
Github user alexjbush commented on the issue: https://github.com/apache/zeppelin/pull/3094 @zjffdu Yes, but can this fix go into both master and branch-0.8 branches? Who will do this cherry picking for branch-0.8? ---

[jira] [Created] (ZEPPELIN-3662) Remove method register in Interpreter

2018-07-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3662: Summary: Remove method register in Interpreter Key: ZEPPELIN-3662 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3662 Project: Zeppelin Issue Type:

[GitHub] zeppelin pull request #3094: [ZEPPELIN-3656] Fix for completion with Livy in...

2018-07-25 Thread alexjbush
GitHub user alexjbush reopened a pull request: https://github.com/apache/zeppelin/pull/3094 [ZEPPELIN-3656] Fix for completion with Livy interpreter ### What is this PR for? Fix for NullPointerException when using code completion in the Livy Interpreter when Shared Interpreter

[GitHub] zeppelin pull request #3094: [ZEPPELIN-3656] Fix for completion with Livy in...

2018-07-25 Thread alexjbush
GitHub user alexjbush reopened a pull request: https://github.com/apache/zeppelin/pull/3094 [ZEPPELIN-3656] Fix for completion with Livy interpreter ### What is this PR for? Fix for NullPointerException when using code completion in the Livy Interpreter when Shared Interpreter

[GitHub] zeppelin pull request #3094: [ZEPPELIN-3656] Fix for completion with Livy in...

2018-07-25 Thread alexjbush
Github user alexjbush closed the pull request at: https://github.com/apache/zeppelin/pull/3094 ---

[GitHub] zeppelin pull request #3097: ZEPPELIN-3662. Remove method register in Interp...

2018-07-25 Thread zjffdu
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/3097 ZEPPELIN-3662. Remove method register in Interpreter ### What is this PR for? This PR is to remove method register in Interpreter.java, this method is never used any more, could be removed.

[GitHub] zeppelin pull request #3093: [ZEPPELIN-3655] Add missing roles information t...

2018-07-25 Thread oxygen311
GitHub user oxygen311 reopened a pull request: https://github.com/apache/zeppelin/pull/3093 [ZEPPELIN-3655] Add missing roles information to api/notebook/job/ method ### What is this PR for? Fix bugs with private access interpreter launched with REST by adding missing roles

[GitHub] zeppelin pull request #3096: ZEPPELIN-3661. Remove property zeppelin.interpr...

2018-07-25 Thread zjffdu
GitHub user zjffdu opened a pull request: https://github.com/apache/zeppelin/pull/3096 ZEPPELIN-3661. Remove property zeppelin.interpreters ### What is this PR for? This PR is to remove property `zeppelin.interpreters` which is not used anymore. ### What type of

***UNCHECKED*** [GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-25 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3092 Thanks @selvinsource for the contribution. Have you thought about other implementation of java interpreter. like https://github.com/albertlatacz/java-repl and JShell of Java 9 ---

***UNCHECKED*** [jira] [Created] (ZEPPELIN-3661) Remove property zeppelin.interpreters

2018-07-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3661: Summary: Remove property zeppelin.interpreters Key: ZEPPELIN-3661 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3661 Project: Zeppelin Issue Type:

[jira] [Created] (ZEPPELIN-3660) Update version in interpreter-list

2018-07-25 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3660: Summary: Update version in interpreter-list Key: ZEPPELIN-3660 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3660 Project: Zeppelin Issue Type:

Re: Parallel Execution of Spark Jobs

2018-07-25 Thread Ankit Jain
Aah that makes sense - so only all jobs from one user will block in FIFOScheduler. By moving to ParallelScheduler, only gain achieved is jobs from same user can also be run in parallel but may have dependency resolution issues. Just to confirm I have it right - If "Run all" notebook is not a