Saisai Shao created SPARK-10288:
-----------------------------------
Summary: Add a rest client for Spark on Yarn
Key: SPARK-10288
URL: https://issues.apache.org/jira/browse/SPARK-10288
Project: Spark
Issue Type: New Feature
Components: YARN
Reporter: Saisai Shao
This is a proposal to add rest client for Spark on Yarn. Currently Spark
standalone and Mesos mode can support rest way of submitting applications, for
Spark on Yarn, it still uses program way to do it. Since RM now (from 2.6)
supports rest way of submitting application, so it would be better Spark on
Yarn also support this way.
Here is the design doc
(https://docs.google.com/document/d/1m_P-4olXrp0tJ3kEOLZh1rwrjTfAat7P3fAVPR5GTmg/edit?usp=sharing).
Currently I'm working on it, working branch is
(https://github.com/jerryshao/apache-spark/tree/yarn-rest-support), the major
part is already finished.
Any comment is greatly appreciated, thanks a lot.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
