This is an automated email from the ASF dual-hosted git repository.
eyalb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.
from 0f0b0ae Merge pull request #2 from kirupagaran/AMATERASU-13
add 6b9cd28 dynamically resolving spark driver host
add 0699a60 framework files are distributed to containers
add 98f31e4 fixed container resources
add 9fc6574 fixed spark.yarn.jars
add 394d079 framework files are distributed to containers
add b27ec27 fixed container resources
add 7ef35e4 fixed spark.yarn.jars
add 42b4e01 Merge branch 'AMATERASU-17' of
github.com:roadan/incubator-amaterasu into AMATERASU-17
new 2fb1762 Merge pull request #5 from roadan/AMATERASU-17
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../common/configuration/ClusterConfig.scala | 4 +-
.../apache/amaterasu/common/utils/FileUtils.scala | 12 ++++++
.../common/executors/ProvidersFactory.scala | 5 ++-
.../runners/spark/SparkRunnersProvider.scala | 5 ++-
.../executor/mesos/executors/ActionsExecutor.scala | 5 ++-
.../executor/yarn/executors/ActionsExecutor.scala | 7 +++-
.../runners/spark/SparkRunnerHelper.scala | 19 +++++----
leader/build.gradle | 8 +++-
.../org/apache/amaterasu/leader/yarn/Client.java | 27 ++++++++++++-
.../apache/amaterasu/leader/dsl/JobParser.scala | 13 ++++++-
.../amaterasu/leader/execution/JobManager.scala | 38 +++++-------------
.../frameworks/FrameworkProvidersFactory.scala | 45 ++++++++++++++++++++++
.../frameworks/spark/SparkSetupProvider.scala | 35 +++++++++++++++++
.../amaterasu/leader/yarn/ApplicationMaster.scala | 45 +++++++++++++++++-----
leader/src/main/scripts/ama-start-yarn.sh | 6 +--
leader/src/main/scripts/log4j.properties | 4 +-
.../amaterasu/sdk/FrameworkSetupProvider.java | 17 ++++++++
.../org/apache/amaterasu/sdk/RunnersProvider.java | 3 +-
18 files changed, 234 insertions(+), 64 deletions(-)
create mode 100644
common/src/main/scala/org/apache/amaterasu/common/utils/FileUtils.scala
create mode 100644
leader/src/main/scala/org/apache/amaterasu/leader/execution/frameworks/FrameworkProvidersFactory.scala
create mode 100644
leader/src/main/scala/org/apache/amaterasu/leader/frameworks/spark/SparkSetupProvider.scala
create mode 100644
sdk/src/main/java/org/apache/amaterasu/sdk/FrameworkSetupProvider.java
--
To stop receiving notification emails like this one, please contact
ey...@apache.org.
