This is an automated email from the ASF dual-hosted git repository.
nadavha pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.
from 991d4af Merge pull request #53 from arunma/AMA-52-Revised
new 82590fe parsing spark options and cmd line arguments
new 95a2ccd memory parser moved to kotlin
new 3723695 tests fixed
new deb64dd removed .zip files
new 9182a3f removed .zip files
new 882ca4d Merge pull request #51 from roadan/AMATERASU-30
The 777 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 3 ++
common/build.gradle | 4 ++
.../common/configuration/ConfigManager.kt | 2 +-
.../amaterasu}/common/configuration/GenericSpec.kt | 2 +-
.../apache/amaterasu}/common/configuration/Job.kt | 2 +-
.../python/dispatcher/PythonSetupProvider.kt | 7 ++-
.../dist/amaterasu_pandas-0.2.0-incubating-rc4.zip | Bin 8304 -> 0 bytes
.../dist/amaterasu_python-0.2.0-incubating-rc4.zip | Bin 6167 -> 0 bytes
.../spark/dispatcher/SparkSetupProvider.kt | 48 +++++++------------
.../runners/providers/PySparkRunnerProvider.kt | 19 +++++---
.../runners/providers/SparkCommandLineHelper.kt | 15 +++---
.../providers/SparkSubmitScalaRunnerProvider.kt | 12 ++++-
.../amaterasu_pyspark-0.2.0-incubating-rc4.zip | Bin 14488 -> 14488 bytes
frameworks/spark/pyspark_runtime/tests/env.yml | 2 +-
leader-common/build.gradle | 7 +--
.../frameworls/FrameworkProvidersFactory.kt | 1 +
.../leader/common/utilities/MemoryFormatParser.kt} | 23 ++++-----
.../common/configuration/ConfigManagerTests.kt | 53 ++++++++++++++-------
.../test/resources/spark_repo/env/test/spark.yml | 5 +-
.../amaterasu/leader/yarn/ApplicationMaster.kt | 8 ++--
.../leader/mesos/schedulers/JobScheduler.scala | 21 ++++----
.../sdk/frameworks/FrameworkSetupProvider.kt | 4 +-
.../dist/amaterasu-sdk-0.2.0-incubating-rc4.zip | Bin 15020 -> 0 bytes
23 files changed, 133 insertions(+), 105 deletions(-)
rename {leader-common/src/main/kotlin/org/apache/amaterasu/leader =>
common/src/main/kotlin/org/apache/amaterasu}/common/configuration/ConfigManager.kt
(97%)
rename {leader-common/src/main/kotlin/org/apache/amaterasu/leader =>
common/src/main/kotlin/org/apache/amaterasu}/common/configuration/GenericSpec.kt
(94%)
rename {leader-common/src/main/kotlin/org/apache/amaterasu/leader =>
common/src/main/kotlin/org/apache/amaterasu}/common/configuration/Job.kt (95%)
delete mode 100644
frameworks/python/pandas_runtime/dist/amaterasu_pandas-0.2.0-incubating-rc4.zip
delete mode 100644
frameworks/python/python_runtime/dist/amaterasu_python-0.2.0-incubating-rc4.zip
copy
leader-yarn/src/main/kotlin/org/apache/amaterasu/leader/yarn/ClientArgsParser.kt
=>
frameworks/spark/dispatcher/src/main/kotlin/org/apache/amaterasu/frameworks/spark/dispatcher/runners/providers/SparkCommandLineHelper.kt
(66%)
rename
leader-common/src/main/{scala/org/apache/amaterasu/leader/common/utilities/MemoryFormatParser.scala
=> kotlin/org/apache/amaterasu/leader/common/utilities/MemoryFormatParser.kt}
(70%)
delete mode 100644 sdk_python/dist/amaterasu-sdk-0.2.0-incubating-rc4.zip
