zeppelin git commit: ZEPPELIN-2324. Add property zeppelin.spark.enableSupportedVersionCheck for trying new spark version

2017-04-03 Thread zjffdu
ges for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2197 from zjffdu/ZEPPELIN-2324 and squashes the following commits: f821839 [Jeff Zhang] address comments 4193ee3 [Jeff Zhang] ZEPPELIN-2324. Add property zeppelin.spark.unSupportedVer

zeppelin git commit: ZEPPELIN-2224. Throw more meaningful exception when kerberos is enabled in livy interpreter

2017-04-06 Thread zjffdu
a:99) ``` ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2104 from zjffdu/ZEPPELIN-2224 and squashes the following commits: 67feb4c [Jeff Zhang] cod

zeppelin git commit: ZEPPELIN-2377. Hive Support can not be enabled in spark master

2017-04-16 Thread zjffdu
ter, spark 2.1.0 and spark 1.6.2 ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2237 from zjffdu/ZEPPELIN-2377 and

zeppelin git commit: [ZEPPELIN-2355] Livy cancel enhancements

2017-04-16 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master e5922b6bb -> 861f1d88f [ZEPPELIN-2355] Livy cancel enhancements ### What is this PR for? The Cancel functionality for the Livy interpreter has few issues. One issue is because a variable is not published correctly. Second issue is

zeppelin git commit: ZEPPELIN-2407. Livy Interpreter always return plain text result

2017-04-16 Thread zjffdu
eff Zhang <zjf...@apache.org> Closes #2254 from zjffdu/ZEPPELIN-2407 and squashes the following commits: ba59a77 [Jeff Zhang] ZEPPELIN-2407. Livy Interpreter always return plain text result Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.org/

zeppelin git commit: ZEPPELIN-2150. NoSuchMethodError: org.apache.spark.ui.SparkUI.appUIAddress() for the spark master

2017-04-08 Thread zjffdu
150 Manually verify it on spark 1.6.2, spark 2.1.0 and spark master * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2231 from zjffdu/ZEPPELIN-2150 and squashes the

zeppelin git commit: ZEPPELIN-2150. NoSuchMethodError: org.apache.spark.ui.SparkUI.appUIAddress() for the spark master

2017-04-08 Thread zjffdu
ges for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2231 from zjffdu/ZEPPELIN-2150 and squashes the following commits: 499b623 [Jeff Zhang] return null when sparkUIUrl is not avaialbe e285278 [Jeff Zhang] ZEPPELIN-2150. NoSuchMe

zeppelin git commit: ZEPPELIN-2390. Improve returnType for z.checkbox

2017-04-18 Thread zjffdu
oes the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2241 from zjffdu/ZEPPELIN-2390 and squashes the following commits: 75e3afc [Jeff Zhang] ZEPPELIN-2390. Improve returnType for z

zeppelin git commit: ZEPPELIN-2386. Add parameter for check running current paragraph in ZeppelinContext

2017-04-18 Thread zjffdu
ing changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2240 from zjffdu/ZEPPELIN-2386 and squashes the following commits: 03995a3 [Jeff Zhang] ZEPPELIN-2386. Add parameter to check running current paragraph in ZeppelinContext

zeppelin git commit: [ZEPPELIN-2768]. Bump up Spark version to 2.2.0

2017-07-14 Thread zjffdu
vis is updated * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2486 from zjffdu/ZEPPELIN-2768 and squashes the following commits: 5adc2e5 [Jeff Zhang] [ZEPPELIN-2768]

zeppelin git commit: [ZEPPELIN-2716] Change the default value of zeppelin.livy.displayAppInfo to true

2017-07-11 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master ad3138385 -> 985b86e4d [ZEPPELIN-2716] Change the default value of zeppelin.livy.displayAppInfo to true ### What is this PR for? Since it is quite useful to expose the application info for user to monitor and debug, so here propose to

zeppelin git commit: [ZEPPELIN-2716] Change the default value of zeppelin.livy.displayAppInfo to true

2017-07-11 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/branch-0.7 3355b8f25 -> 5636f9355 [ZEPPELIN-2716] Change the default value of zeppelin.livy.displayAppInfo to true Since it is quite useful to expose the application info for user to monitor and debug, so here propose to enable

zeppelin git commit: [ZEPPELIN-2758]. NumberFormatException on importing notebook

2017-07-19 Thread zjffdu
ted ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2485 from zjffdu/ZEPPELIN-2758 and squashes the following commits: 74f8

zeppelin git commit: ZEPPELIN-1263. Should specify zeppelin's spark configuration through --conf arguments of spark-submit

2017-07-22 Thread zjffdu
ate? No - Is there breaking changes for older versions? No - Does this needs documentation? No … Author: Jeff Zhang <zjf...@apache.org> Closes #1446 from zjffdu/ZEPPELIN-1263 and squashes the following commits: f57d7bb [Jeff Zhang] address comments 151e991 [Jeff Zhang] ZEPPELIN-1263. Should specify zeppeli

zeppelin git commit: ZEPPELIN-2811. Specify precise explicitly for travis build

2017-07-26 Thread zjffdu
oes the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2504 from zjffdu/ZEPPELIN-2811 and squashes the following commits: 7e0aa0a [Jeff Zhang] ZEPPELIN-2811. Specif

zeppelin git commit: [HOTFIX] Followup of ZEPPELIN-1263

2017-07-24 Thread zjffdu
sue? * https://issues.apache.org/jira/browse/ZEPPELIN-1263 ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2501 from zjffdu/HOTFIX_1236 and

zeppelin git commit: [ZEPPELIN-2688]. Upgrade ace to 1.2.7

2017-06-29 Thread zjffdu
he.org> Closes #2435 from zjffdu/ZEPPELIN-2688 and squashes the following commits: 99b2554 [Jeff Zhang] [ZEPPELIN-2688]. Upgrade ace to 1.2.7 Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/19eb80a2 Tree: http:

zeppelin git commit: ZEPPELIN-2615. Upgrade pig to 0.17.0 to support spark engine

2017-06-29 Thread zjffdu
dos * [ ] - Task ### What is the Jira issue? * https://github.com/zjffdu/zeppelin/tree/ZEPPELIN-2615 ### How should this be tested? Unit test is added and also manually test spark yarn-client mode in pig tutorial note. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need upd

zeppelin git commit: ZEPPELIN-2615. Upgrade pig to 0.17.0 to support spark engine

2017-06-29 Thread zjffdu
dos * [ ] - Task ### What is the Jira issue? * https://github.com/zjffdu/zeppelin/tree/ZEPPELIN-2615 ### How should this be tested? Unit test is added and also manually test spark yarn-client mode in pig tutorial note. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need upd

[1/2] zeppelin git commit: ZEPPELIN-2397. Add toJson and fromJson method for serializable objects

2017-07-04 Thread zjffdu
if (paragraphs != null ? !paragraphs.equals(note.paragraphs) : note.paragraphs != null) { + return false; +} +//TODO(zjffdu) exclude name because FolderView.index use Note as key and consider different name +//as same note +//if (name != null ? !name.equals(note.name) : note.name != nu

[2/2] zeppelin git commit: ZEPPELIN-2397. Add toJson and fromJson method for serializable objects

2017-07-04 Thread zjffdu
: Jeff Zhang <zjf...@apache.org> Closes #2272 from zjffdu/ZEPPELIN-2397 and squashes the following commits: 4fb12fe [Jeff Zhang] ZEPPELIN-2397. Add toJson and fromJson method for serializable objects Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://g

zeppelin git commit: ZEPPELIN-2445. Display which line of python code raise exception

2017-04-26 Thread zjffdu
ets/164491/25366943/6f0200c2-29a5-11e7-8fe6-80794e7c7d86.png) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2280 from zjffdu/ZEPPELIN-2445 and

zeppelin git commit: [HOTFIX] Add livy build in .travis

2017-04-27 Thread zjffdu
hat is the Jira issue? * No jira created ### How should this be tested? CI pass ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2279 from zjffdu/ho

zeppelin git commit: [HOTFIX] Add livy build in .travis

2017-04-27 Thread zjffdu
ate? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2279 from zjffdu/hotfix_livy and squashes the following commits: 674c987 [Jeff Zhang] [HOTFIX] Add livy build in .travis (cherry picked fr

zeppelin git commit: ZEPPELIN-2261. Support to connect with livy through https

2017-04-27 Thread zjffdu
les need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2139 from zjffdu/ZEPPELIN-2261 and squashes the following commits: 52fc204 [Jeff Zhang] address comment 53230c3 [Jeff Zhang] [ZEPPELIN-2261]

zeppelin git commit: ZEPPELIN-1595. Make ZeppelinContext extensible

2017-04-27 Thread zjffdu
for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #1574 from zjffdu/ZEPPELIN-1595 and squashes the following commits: 754c1e0 [Jeff Zhang] ZEPPELIN-1595. Make ZeppelinContext extensible Project: http://git-wip-us.apache.org/repos/asf/zeppe

zeppelin git commit: ZEPPELIN-2151. Add integration test for livy cancel api

2017-04-27 Thread zjffdu
hor: Jeff Zhang <zjf...@apache.org> Closes #2056 from zjffdu/ZEPPELIN-2151 and squashes the following commits: b7ca7b3 [Jeff Zhang] ZEPPELIN-2151. Add integration test for livy cancel api (cherry picked from commit 152147122b9797baef20a382eb880eadcf7cdc0f) Signed-off-by: Jeff Zhang <zjf..

zeppelin git commit: ZEPPELIN-2486. AngularElem's onChange is only invoked once

2017-05-03 Thread zjffdu
gif) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2312 from zjffdu/ZEPPELIN-2486 and squashes the following commits: 4039d6b [Jeff Zhang] ZEPP

zeppelin git commit: [HOTFIX] Set interpreter context in zeppelin context from SparkSqlInterpreter

2017-05-11 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 28ef8aa90 -> e5e3a88cd [HOTFIX] Set interpreter context in zeppelin context from SparkSqlInterpreter ### What is this PR for? When running `%sql` paragraphs sometimes a NullPointer is thrown instead of presenting the result. This was

zeppelin git commit: [ZEPPELIN-2589]Let zeppelin show more than one line of error log returned by livy.

2017-06-09 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 43926485c -> 380cfbfe3 [ZEPPELIN-2589]Let zeppelin show more than one line of error log returned by livy. ### What is this PR for? Let zeppelin show more than one line of error log returned by livy. ### What type of PR is it?

zeppelin git commit: [ZEPPELIN-2564] - LivySparkSQLInterpreter throws NullPointerException when getProgress is called

2017-05-18 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/branch-0.7 5aff67be6 -> 9cccd8677 [ZEPPELIN-2564] - LivySparkSQLInterpreter throws NullPointerException when getProgress is called ### What is this PR for? When using %livy.sql interpreter following error is logged into interpreter log:

zeppelin git commit: [ZEPPELIN-2564] - LivySparkSQLInterpreter throws NullPointerException when getProgress is called

2017-05-18 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 2f03469bc -> 05af3bf4b [ZEPPELIN-2564] - LivySparkSQLInterpreter throws NullPointerException when getProgress is called ### What is this PR for? When using %livy.sql interpreter following error is logged into interpreter log: `ERROR

zeppelin git commit: [ZEPPELIN-2584]. Livy doesn't work under kerberos and ssl

2017-06-01 Thread zjffdu
ots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: root <r...@ctr-e133-1493418528701-48413-01-04.hwx.site> Closes #2367 from zjffdu/ZEPPELIN-2584 and squashes the

zeppelin git commit: [ZEPPELIN-2584]. Livy doesn't work under kerberos and ssl

2017-06-01 Thread zjffdu
ion? No Author: root <r...@ctr-e133-1493418528701-48413-01-04.hwx.site> Closes #2367 from zjffdu/ZEPPELIN-2584 and squashes the following commits: 18b23dc [root] [ZEPPELIN-2584]. Livy doesn't work under kerberos and ssl (cherry picked from commit e3ba23a9aa4909c7a8d3231e4d363771e0245b53) S

zeppelin git commit: [HOTFIX]. Minor doc fix for back-end-angular.md

2017-05-02 Thread zjffdu
2307 from zjffdu/doc_hotfix and squashes the following commits: 133fe72 [Jeff Zhang] [HOTFIX]. Minor doc fix for back-end-angular.md Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/2a06292c Tree: http://git-wip-us.apache.

zeppelin git commit: [HOTFIX]. Minor doc fix for back-end-angular.md

2017-05-02 Thread zjffdu
ses #2307 from zjffdu/doc_hotfix and squashes the following commits: 133fe72 [Jeff Zhang] [HOTFIX]. Minor doc fix for back-end-angular.md (cherry picked from commit 2a06292c1fcc64ea4e503a29212a179f93699b07) Signed-off-by: Jeff Zhang <zjf...@apache.org> Project: http://git-wip-us.apach

zeppelin git commit: [ZEPPELIN-2465] Minor code fixes for the livy package

2017-05-01 Thread zjffdu
sult getResultFromStatementInfo(StatementInfo stmtInfo, - boolean displayAppInfo) { -if (stmtInfo.output != null && stmtInfo.output.isError()) { - return new InterpreterResult(InterpreterResult.Code.ERR

zeppelin git commit: [ZEPPELIN-2465] Minor code fixes for the livy package

2017-05-01 Thread zjffdu
if (stmtInfo.output != null && stmtInfo.output.isError()) { - return new InterpreterResult(InterpreterResult.Code.ERROR, stmtInfo.output.evalue); -} else if (stmtInfo.isCancelled()) { - // corner case, output might be null if it is cancelled. - return new InterpreterResult(Inte

zeppelin git commit: [ZEPPELIN-2928] Hotfix on maven set version functionality

2017-09-15 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 3f591c232 -> 9c1fca182 [ZEPPELIN-2928] Hotfix on maven set version functionality ### What is this PR for? Hotfix on a recent commit that removed the version soft-coded variable and introduced hard-coded references to version tag. ###

[2/2] zeppelin git commit: ZEPPELIN-2898. Support Yarn-Cluster for Spark Interpreter

2017-09-18 Thread zjffdu
be specified for yarn-cluster mode ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? https://github.com/zjffdu/zeppelin/tree/ZEPPELIN-2898 ### How should this be tested? System test is added in `SparkInterpreterIT`. ### Questions: * Does the licenses files

[1/2] zeppelin git commit: ZEPPELIN-2898. Support Yarn-Cluster for Spark Interpreter

2017-09-18 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master d25639caa -> 5d7151097 http://git-wip-us.apache.org/repos/asf/zeppelin/blob/5d715109/zeppelin-zengine/src/test/java/org/apache/zeppelin/notebook/repo/VFSNotebookRepoTest.java

zeppelin git commit: ZEPPELIN-2943 Streaming output will be closed in 30 seconds for IPythonInterpreter

2017-09-19 Thread zjffdu
ser-images.githubusercontent.com/164491/30589783-789a99c6-9d01-11e7-88a3-c36d49321541.gif) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2593 from zjffdu/ZEPP

zeppelin git commit: ZEPPELIN-2933. Code Refactoring of ZEPPELIN-1515 follow up

2017-09-14 Thread zjffdu
ing changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2588 from zjffdu/ZEPPELIN-2933 and squashes the following commits: 45d1e9b [Jeff Zhang] ZEPPELIN-2993. Code Refactoring of ZEPPELIN-1515 follow up Project: http:

zeppelin git commit: [HOTFIX] fix interpreter.cmd script

2017-10-16 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 152538b7e -> dfa1250f9 [HOTFIX] fix interpreter.cmd script ### What is this PR for? interpreter.cmd works incorrect after https://github.com/apache/zeppelin/pull/2562 ### What type of PR is it? Bug Fix ### Questions: * Does the

zeppelin git commit: ZEPPELIN-2990. Matplotlib sometimes fails in IPythonInterpreter

2017-10-15 Thread zjffdu
ate? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2622 from zjffdu/ZEPPELIN-2990 and squashes the following commits: 55e6f88 [Jeff Zhang] fix unit test 1e57afe [Jeff Zhang] ZEPPELIN-2990. Matplotlib someti

[2/4] zeppelin git commit: ZEPPELIN-2685. Improvement on Interpreter class

2017-10-13 Thread zjffdu
lin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java @@ -18,7 +18,6 @@ package org.apache.zeppelin.interpreter; import com.google.common.annotations.VisibleForTesting; -import com.google.common.base.Joiner; import com.google.common.base.Preconditions; import com.goog

[3/4] zeppelin git commit: ZEPPELIN-2685. Improvement on Interpreter class

2017-10-13 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/9812e26b/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java -- diff --git a/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java

[1/4] zeppelin git commit: ZEPPELIN-2685. Improvement on Interpreter class

2017-10-13 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master ed8755d3f -> 9812e26bc http://git-wip-us.apache.org/repos/asf/zeppelin/blob/9812e26b/zeppelin-zengine/src/test/java/org/apache/zeppelin/interpreter/EchoInterpreter.java

[4/4] zeppelin git commit: ZEPPELIN-2685. Improvement on Interpreter class

2017-10-13 Thread zjffdu
is covered. `ShellScriptLauncherTest` & `SparkInterpreterLauncherTest` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Clos

zeppelin git commit: ZEPPELIN-2953 Allow custom http header for livy interpreter

2017-10-12 Thread zjffdu
ate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2600 from zjffdu/ZEPPELIN-2953 and squashes the following commits: 720d8d0 [Jeff Zhang] ZEPPELIN-2

[2/2] zeppelin git commit: ZEPPELIN-2982. Copy interpreter-setting.json to interpreter dir

2017-10-12 Thread zjffdu
? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2613 from zjffdu/ZEPPELIN-2982 and squashes the following commits: d32 [Jeff Zhang] update doc 8f643a7 [Jeff Zhang] ZEPPELIN-2982. Copy interpreter-setting.json to interpreter dir Project: http://g

[1/2] zeppelin git commit: ZEPPELIN-2982. Copy interpreter-setting.json to interpreter dir

2017-10-12 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 862871f67 -> 4a3057fa8 http://git-wip-us.apache.org/repos/asf/zeppelin/blob/4a3057fa/shell/pom.xml -- diff --git a/shell/pom.xml b/shell/pom.xml index 58d8900..0157d86

zeppelin git commit: [MINOR][Code Refactoring] Configuration name change for keytab and principal used for FileSystemNotebookRepo

2017-10-11 Thread zjffdu
; Closes #2620 from zjffdu/minor_refactoring and squashes the following commits: c68ce76 [Jeff Zhang] [MINOR][Code Refactoring] Configuration name change for keytab and principal used for FileSystemNotebookRepo Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http:

zeppelin git commit: ZEPPELIN-2645. Adding way to register RemoteInterpreterServer's port into InterpreterProcess

2017-09-06 Thread zjffdu
; Closes #2562 from zjffdu/ZEPPELIN-2645 and squashes the following commits: 82bd8d0 [Jongyoul Lee] ZEPPELIN-2645. Adding way to register RemoteInterpreterServer's port into InterpreterProcess Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.org/

zeppelin git commit: ZEPPELIN-2893. Pass non spark.* of spark interpreter properties to spark app driver

2017-09-06 Thread zjffdu
nit test is added ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2561 from zjffdu/ZEPPELIN-2893 and squashes the following commits: 1342527 [J

zeppelin git commit: ZEPPELIN-2893. Pass non spark.* of spark interpreter properties to spark app driver

2017-09-06 Thread zjffdu
ted? Unit test is added ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2561 from zjffdu/ZEPPELIN-2893 and squashes the following commits: 1342527 [J

zeppelin git commit: ZEPPELIN-2377. Hive Support can not be enabled in spark master

2017-09-07 Thread zjffdu
ter, spark 2.1.0 and spark 1.6.2 ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2237 from zjffdu/ZEPPELIN-2377 and

zeppelin git commit: [ZEPPELIN-2641] Change encoding to UTF-8 when sending request to Livy

2017-09-27 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 0d13c0b56 -> f7c47af9b [ZEPPELIN-2641] Change encoding to UTF-8 when sending request to Livy ### What is this PR for? Change encoding of the request sent from Zeppelin to Livy to UTF-8. In this way, Zeppelin can support many more

zeppelin git commit: [ZEPPELIN-2641] Change encoding to UTF-8 when sending request to Livy

2017-09-27 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/branch-0.7 8a2b46a25 -> 75df4aacc [ZEPPELIN-2641] Change encoding to UTF-8 when sending request to Livy Change encoding of the request sent from Zeppelin to Livy to UTF-8. In this way, Zeppelin can support many more language than using

[2/3] zeppelin git commit: [ZEPPELIN-2753] Basic Implementation of IPython Interpreter

2017-08-27 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/32517c9d/python/src/main/resources/grpc/python/ipython_pb2.py -- diff --git a/python/src/main/resources/grpc/python/ipython_pb2.py

[3/3] zeppelin git commit: [ZEPPELIN-2753] Basic Implementation of IPython Interpreter

2017-08-27 Thread zjffdu
org> Closes #2474 from zjffdu/ZEPPELIN-2753 and squashes the following commits: e869f31 [Jeff Zhang] address comments b0b5c95 [Jeff Zhang] [ZEPPELIN-2753] Basic Implementation of IPython Interpreter Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.org

[1/3] zeppelin git commit: [ZEPPELIN-2753] Basic Implementation of IPython Interpreter

2017-08-27 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 26a39df08 -> 32517c9d9 http://git-wip-us.apache.org/repos/asf/zeppelin/blob/32517c9d/spark/src/main/resources/python/zeppelin_ipyspark.py -- diff --git

[02/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/8d4902e7/zeppelin-zengine/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterTest.java -- diff --git

[04/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
zeppelin-0.7.0, zeppelin stores multiple results of the paragraph // see ZEPPELIN-212 - Object results; + volatile Object results; // For backward compatibility of note.json format after ZEPPELIN-212 - Object result; + volatile Object result; private Map<String, ParagraphRuntimeInfo> runt

[03/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/8d4902e7/zeppelin-zengine/src/test/java/org/apache/zeppelin/interpreter/InterpreterSettingTest.java -- diff --git

[05/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/8d4902e7/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java -- diff --git

[08/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/8d4902e7/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/AbstractInterpreterTest.java -- diff --git

[01/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 32517c9d9 -> 8d4902e71 http://git-wip-us.apache.org/repos/asf/zeppelin/blob/8d4902e7/zeppelin-zengine/src/test/java/org/apache/zeppelin/notebook/NotebookTest.java --

[06/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/8d4902e7/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java -- diff --git

[11/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2422 from zjffdu/interpreter_refactor and squashes the following commits: 4724c98 [Jeff Zhang] [ZEPPELIN-2627] Interpreter Com

[07/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/8d4902e7/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteAngularObjectTest.java -- diff --git

[09/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
or " + className); + return Job.Status.UNKNOWN.name(); +} +RemoteInterpreterProcess interpreterProcess = getOrCreateInterpreterProcess(); +return interpreterProcess.callRemoteFunction( +new RemoteInterpreterProcess.RemoteFunction() { + @Override + public Stri

[10/11] zeppelin git commit: [ZEPPELIN-2627] Interpreter refactor

2017-08-27 Thread zjffdu
interpreter setting template name where it is created from + private String group; + + //TODO(zjffdu) make the interpreter.json consistent with interpreter-setting.json + /** + * properties can be either Properties or Map<String, InterpreterProperty> + * properties should be: + *

[07/11] zeppelin git commit: Revert "[ZEPPELIN-2627] Interpreter refactor"

2017-08-28 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/2a379102/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteAngularObjectTest.java -- diff --git

[06/11] zeppelin git commit: Revert "[ZEPPELIN-2627] Interpreter refactor"

2017-08-28 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/2a379102/zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java -- diff --git

[10/11] zeppelin git commit: Revert "[ZEPPELIN-2627] Interpreter refactor"

2017-08-28 Thread zjffdu
iginal interpreter setting template name where it is created from - private String group; - - //TODO(zjffdu) make the interpreter.json consistent with interpreter-setting.json - /** - * properties can be either Properties or Map<String, InterpreterProperty> - * properties should be:

[08/11] zeppelin git commit: Revert "[ZEPPELIN-2627] Interpreter refactor"

2017-08-28 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/2a379102/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/AbstractInterpreterTest.java -- diff --git

[02/11] zeppelin git commit: Revert "[ZEPPELIN-2627] Interpreter refactor"

2017-08-28 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/2a379102/zeppelin-zengine/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterTest.java -- diff --git

[05/11] zeppelin git commit: Revert "[ZEPPELIN-2627] Interpreter refactor"

2017-08-28 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/2a379102/zeppelin-zengine/src/main/java/org/apache/zeppelin/interpreter/InterpreterSetting.java -- diff --git

zeppelin git commit: ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client jar)

2017-08-23 Thread zjffdu
ate? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2455 from zjffdu/ZEPPELIN-1515 and squashes the following commits: b3e83ab [Jeff Zhang] ZEPPELIN-1515. Notebook: HDFS as a backend storage (Read &

[8/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
diff --git a/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/InterpreterTest.java b/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/InterpreterTest.java index 305268c..31c9225 100644 --- a/zeppelin-interpreter/src

[5/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
tion(e); -} finally { - interpreterProcess.releaseClient(client, broken); + public String getStatus(final String jobId) { + if (!isOpened) { + LOGGER.warn("getStatus is called when RemoteInterpreter is not opened for " + className); + return Job.Status.UNK

[1/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 69d58f373 -> d6203c51e http://git-wip-us.apache.org/repos/asf/zeppelin/blob/d6203c51/zeppelin-zengine/src/test/java/org/apache/zeppelin/notebook/NotebookTest.java --

[4/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
eturn job.getStatus(); + } + lastStatus = status; + listener.afterStatusChange(job, null, status); + return status; +} + } + + //TODO(zjffdu) need to refactor the schdule module which is too complicated + private class JobRunner implements Runnable, JobListener { +private final Logger lo

[9/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
? No Is there breaking changes for older versions? No Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2554 from zjffdu/ZEPPELIN-2627-2 and squashes the following commits: fa0d435 [Jeff Zhang] minor update 74bcb91 [Jeff Zhang] [ZEPPELIN-2627] Interpreter Com

[2/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/d6203c51/zeppelin-zengine/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterTest.java -- diff --git

[7/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
java.nio.file.Path; -import java.nio.file.Paths; -import java.util.ArrayList; -import java.util.Collections; -import java.util.HashMap; import java.util.List; -import java.util.Map; -import java.util.Properties; /** + * //TODO(zjffdu) considering to move to InterpreterSettingManager + * * Manage interpreters

[6/9] zeppelin git commit: [ZEPPELIN-2627] Interpreter Component Refactoring

2017-09-02 Thread zjffdu
java.nio.file.attribute.PosixFilePermission.OWNER_WRITE; /** - * TBD + * InterpreterSettingManager is the component which manage all the interpreter settings. + * (load/create/update/remove/get) + * Besides that InterpreterSettingManager also manage the interpreter setting binding. + * TODO(zjffdu) We could move it into another separated

zeppelin git commit: ZEPPELIN-2942. Remove non-remote interpreter approach

2017-10-09 Thread zjffdu
eff Zhang <zjf...@apache.org> Closes #2597 from zjffdu/ZEPPELIN-2942 and squashes the following commits: 42fe419 [Jeff Zhang] ZEPPELIN-2942. Remove non-remote interpreter approach Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.org/repos/asf/zeppel

zeppelin git commit: ZEPPELIN-2998. Fix bug in restarting interpreter in scoped mode

2017-10-17 Thread zjffdu
der versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2626 from zjffdu/ZEPPELIN-2998 and squashes the following commits: cc11fb6 [Jeff Zhang] ZEPPELIN-2998. Fix bug in restarting interpreter in scoped mode Project: http://git-wip-us.apache.

zeppelin git commit: ZEPPELIN-2988. Zeppelin does not start new Livy session if yarn livy session application is killed

2017-10-17 Thread zjffdu
der versions? * Does this needs documentation? Author: Jeff Zhang <zjf...@apache.org> Closes #2625 from zjffdu/ZEPPELIN-2988 and squashes the following commits: 0e4d281 [Jeff Zhang] ZEPPELIN-2988. Zeppelin does not start new Livy session if yarn livy session application is killed Project: h

zeppelin git commit: ZEPPELIN-3040. Allow to specify portRange for interpreter process thrift service

2017-11-12 Thread zjffdu
lt;zjf...@apache.org> Closes #2666 from zjffdu/ZEPPELIN-3040-0.7 and squashes the following commits: cd1ca62 [Jeff Zhang] ZEPPELIN-3040. Allow to specify portRange for interpreter process thrift service Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo Commit: http://git-wip-us.apache.

zeppelin git commit: ZEPPELIN-3040. Allow to specify portRange for interpreter process thrift service

2017-11-12 Thread zjffdu
lt;zjf...@apache.org> Closes #2661 from zjffdu/ZEPPELIN-3040 and squashes the following commits: a87c425 [Jeff Zhang] address comments 7e885bd [Jeff Zhang] ZEPPELIN-3040. Allow to specify portRange for interpreter process thrift service Project: http://git-wip-us.apache.org/repos/asf/zeppelin/re

zeppelin git commit: [ZEPPELIN-3049] Add the notebook id and user name to the paragraph running log

2017-11-14 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 382479fd5 -> 951544a74 [ZEPPELIN-3049] Add the notebook id and user name to the paragraph running log ### What is this PR for? Add the notebook id and user name to the paragraph running log so that Zeppelin administrators can check who

zeppelin git commit: [ZEPPELIN-3014] NPE bug fix and Error message enhancement with Kylin Interpreter

2017-12-13 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 3505625c2 -> 549bce673 [ZEPPELIN-3014] NPE bug fix and Error message enhancement with Kylin Interpreter ### What is this PR for? A few sentences describing the overall goals of the pull request's commits. First time? Check out the

zeppelin git commit: [HOTFIX]: Fix IPythonInterpreter unit test

2017-12-13 Thread zjffdu
ate? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2703 from zjffdu/ipython_version and squashes the following commits: b4c7b42 [Jeff Zhang] HotFix: Fix IPythonInterpreter unit test Project: http:

[2/2] zeppelin git commit: ZEPPELIN-3051. Support Interpreter Process Recovery

2017-12-14 Thread zjffdu
king changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjf...@apache.org> Closes #2668 from zjffdu/ZEPPELIN-3051 and squashes the following commits: a4c9b9c [Jeff Zhang] address comments 575b7b9 [Jeff Zhang] fix the pid of interpreter process id 02b118f [

[1/2] zeppelin git commit: ZEPPELIN-3051. Support Interpreter Process Recovery

2017-12-14 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master 13f8e6cc6 -> 4c8f20ae3 http://git-wip-us.apache.org/repos/asf/zeppelin/blob/4c8f20ae/zeppelin-zengine/src/test/java/org/apache/zeppelin/interpreter/launcher/ShellScriptLauncherTest.java

zeppelin git commit: [FIX] fix autocomplete

2017-12-12 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master a82e3ec3a -> 4a679fc05 [FIX] fix autocomplete ### What is this PR for? After refactoring of Interpreter autocomplete (from server side) not works without first Run of interpreter. This PR fix it. ### What type of PR is it? [Fix] ###

zeppelin git commit: [Bug Fix] fix exceptions in jdbc interpreter

2017-11-01 Thread zjffdu
Repository: zeppelin Updated Branches: refs/heads/master afd2bca46 -> 13f6dc7de [Bug Fix] fix exceptions in jdbc interpreter ### What is this PR for? Now used class Throwables to convert stack trace into String. This class from guava which is dependency of hadoop-common. hadoop-common is

  1   2   3   4   5   6   7   8   9   10   >