GitHub user zjffdu reopened a pull request:
https://github.com/apache/zeppelin/pull/2422
[WIP] [ZEPPELIN-2627] Interpreter refactor
### What is this PR for?
I didn't intended to make such large change at the beginning, but found
many things are coupled together that I have to make such large change. Several
suggestions for you how to review and read it.
* I move the interpreter package from zeppelin-zengine to
zeppelin-interpreter, this is needed for this refactoring.
* The overall change is the same as I described in the design doc. I would
suggest you to read the unit test first. These unit test is very readable and
easy to understand what the code is doing now. `InterpreterFactoryTest`,
`InterpreterGroupTest`, `InterpreterSettingTest`,
`InterpreterSettingManagerTest`, `RemoteInterpreterTest`.
* Remove the referent counting logic. Now I will kill the interpreter
process as long as all the sessions in the same interpreter group is closed. (I
plan to add another kind of policy for the interpreter process lifecycle
control, ZEPPELIN-2197)
* The `RemoteFunction` I introduced is for reducing code duplicates when we
use RPC.
* The changes in Job.java and RemoteScheduler is for fixing the race issue
bug. This bug cause the flaky test we see often in
`ZeppelinSparkClusterTest.pySparkTest`
### What type of PR is it?
[Bug Fix | Refactoring]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2627
### How should this be tested?
Unit test is added
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zjffdu/zeppelin interpreter_refactor
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/2422.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2422
----
commit ca60c5f3b33420ae48f2128daa4f4492301f083b
Author: Jeff Zhang <[email protected]>
Date: 2017-05-23T07:52:15Z
[ZEPPELIN-2627] Interpreter Component Refactoring
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
