This is an automated email from the ASF dual-hosted git repository.
yaniv pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.
from c664db1 Merge pull request #19 from amezng/amaterasu-21
add 80c7ea4 added file wildcard
add 9d1707f changed version to rc1
add 7b1d649 fixed build order issue
add 14acb59 added tests to travis
add 5b4e8eb fixed merge issue
add a913fc0 fixed framework distribution in clean env
add e7da2b7 added task to copy the leagal files
add 9c6df23 fixed missing license in files
add ca609a1 fixed a spark path issue due to a bad merge
add c347b01 debug msgs
add 7ef7b48 removed debug msgs
add 7cb88c8 fixed missing licenses, Apache Rat runs successfuly
add c3f1512 fixed missing licenses, Apache Rat runs successfuly
add 318c212 fixed pyspark stest
add 4fc833a added 3rd party licenses
add 0a49638 AMATERASU-26 Pipeline tasks runs as "yarn" user instead of
inheriting the user
add 3bbd6c3 Merge pull request #18 from
arunma/version-0.2.0-incubating-rc3
add 0f0a88b PySpark fixes for YARN and Mesos includes a hack for executor
tests to run
add 37f5782 fixing review comments
add b2f574a apparently we need the previous config
add ec6525a Merge pull request #20 from
nadav-har-tzvi/version-0.2.0-incubating-rc3
add 6c9c2ea Merge branch 'master' into version-0.2.0-incubating-rc3
new a3f3240 Merge pull request #23 from
apache/version-0.2.0-incubating-rc3
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 15 +++
.travis.yml | 23 +++-
LICENSE | 48 ++++----
ama-key | 51 --------
ama-key.pub | 1 -
build.gradle | 20 ++-
.../common/configuration/ClusterConfig.scala | 22 ++--
.../common/dataobjects/ActionDataHelper.scala | 16 +++
.../apache/amaterasu/common/utils/FileUtils.scala | 16 +++
executor/build.gradle | 1 +
executor/src/main/resources/runtime.py | 16 +++
executor/src/main/resources/spark_intp.py | 21 +++-
.../runners/spark/PySpark/PySparkRunner.scala | 135 ++++++++-------------
.../runners/spark/SparkRunnersProvider.scala | 28 +++--
.../executor/yarn/executors/ActionsExecutor.scala | 16 +++
.../runners/spark/SparkRunnerHelper.scala | 6 +-
executor/src/test/resources/amaterasu.properties | 1 +
.../src/test/resources/pyspark-with-amacontext.py | 37 ++++++
executor/src/test/resources/runtime.py | 34 +++++-
executor/src/test/resources/simple-pyspark.py | 16 +++
executor/src/test/resources/simple-python-err.py | 16 +++
executor/src/test/resources/simple-python.py | 16 +++
executor/src/test/resources/simple-spark.scala | 17 ++-
executor/src/test/resources/spark_intp.py | 64 +++++++---
executor/src/test/resources/step-2.scala | 16 +++
.../amaterasu/spark/SparkScalaRunnerTests.scala | 2 +-
leader/build.gradle | 9 +-
.../org/apache/amaterasu/leader/yarn/Client.java | 14 ++-
.../frameworks/FrameworkProvidersFactory.scala | 16 +++
.../frameworks/spark/SparkSetupProvider.scala | 35 ++++--
.../amaterasu/leader/mesos/MesosJobLauncher.scala | 16 +++
.../leader/mesos/schedulers/JobScheduler.scala | 28 +++--
.../leader/utilities/ActiveReportListener.scala | 16 +++
.../apache/amaterasu/leader/utilities/Args.scala | 17 ++-
.../leader/utilities/BaseJobLauncher.scala | 16 +++
.../leader/utilities/MemoryFormatParser.scala | 16 +++
.../amaterasu/leader/yarn/ApplicationMaster.scala | 65 +++++-----
.../leader/yarn/YarnRMCallbackHandler.scala | 2 +-
leader/src/main/scripts/ama-start-yarn.sh | 24 +++-
leader/src/main/scripts/amaterasu.properties | 16 ++-
leader/src/main/scripts/log4j.properties | 15 +++
.../sdk/frameworks/FrameworkSetupProvider.java | 16 +++
.../configuration/DriverConfiguration.java | 16 +++
43 files changed, 718 insertions(+), 273 deletions(-)
delete mode 100644 ama-key
delete mode 100644 ama-key.pub
--
To stop receiving notification emails like this one, please contact
[email protected].
