This is an automated email from the ASF dual-hosted git repository.
yaniv pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.
from e42a9b1 Merge pull request #31 from roadan/AMATERASU-47
add cb3bb3a spark runners providers added
add 27f80c6 fixed mesos classpath
add 7f96b9b added callback address to spark scala
add 137eaa2 broke mesos cmd to multiline
add 590caa6 parameterized spark version in SparkSetupProvider.scala
new 68b6198 Merge pull request #32 from roadan/AMATERASU-35
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../spark/dispatcher/SparkSetupProvider.scala | 40 +++++++------
.../runners/providers/PySparkRunnerProvider.scala | 46 +++++++++++++++
.../providers/SparkScalaRunnerProvider.scala | 62 ++++++++++++++++++++
.../leader/mesos/schedulers/JobScheduler.scala | 68 +++++++++-------------
.../amaterasu/leader/yarn/ApplicationMaster.scala | 26 ++-------
leader/src/main/scripts/ama-start-mesos.sh | 9 ++-
.../sdk/frameworks/FrameworkSetupProvider.java | 4 +-
.../RunnerSetupProvider.java} | 11 ++--
8 files changed, 177 insertions(+), 89 deletions(-)
create mode 100644
frameworks/spark/dispatcher/src/main/scala/org/apache/amaterasu/frameworks/spark/dispatcher/runners/providers/PySparkRunnerProvider.scala
create mode 100644
frameworks/spark/dispatcher/src/main/scala/org/apache/amaterasu/frameworks/spark/dispatcher/runners/providers/SparkScalaRunnerProvider.scala
copy sdk/src/main/java/org/apache/amaterasu/sdk/{AmaterasuRunner.java =>
frameworks/RunnerSetupProvider.java} (73%)
