GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/7052
[WIP] [SPARK-8673] [launcher] API and infrastructure for communicating with
child apps.
This change adds an API that encapsulates information about an app
launched using the library. It also creates a socket-based communication
layer for apps that are launched as child processes; the launching
application listens for connections from launched apps, and once
communication is established, the channel can be used to send updates
to the launching app, or to send commands to the child app.
The change also includes hooks for local, standalone/client and yarn
masters.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-8673
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7052.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7052
----
commit 4fac6cf195384cad76c93e4c4c2b2b9272abdef0
Author: Marcelo Vanzin <[email protected]>
Date: 2015-06-26T23:29:07Z
[SPARK-8673] [launcher] API and infrastructure for communicating with child
apps.
This change adds an API that encapsulates information about an app
launched using the library. It also creates a socket-based communication
layer for apps that are launched as child processes; the launching
application listens for connections from launched apps, and once
communication is established, the channel can be used to send updates
to the launching app, or to send commands to the child app.
commit 5627320e47c5d5b349828fabeaf111c1f1548733
Author: Marcelo Vanzin <[email protected]>
Date: 2015-06-26T23:31:28Z
[SPARK-8673] [core] Add support for launcher lib handles.
This change adds a generic backend to communicate with launcher lib
handles, and hooks it up to the local and standalone client backends.
commit ef19561a8669f63e571a1864aa93148927491833
Author: Marcelo Vanzin <[email protected]>
Date: 2015-06-26T23:32:28Z
[SPARK-8673] [yarn] Add support for launch lib handles.
This change uses the code added in the core/ module to connect
back to launcher lib handles, for both client and cluster modes
(basically the same code in the case of YARN).
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
