nadav-har-tzvi commented on a change in pull request #20: PySpark fixes for
YARN and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191065376
##
File path:
executor/src/main/scala/org/apache/spark/repl/amaterasu/runners/spark/SparkRunnerHelper.scala
nadav-har-tzvi commented on a change in pull request #20: PySpark fixes for
YARN and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191065242
##
File path: executor/src/main/resources/spark_intp.py
##
@@ -21,20 +21,10 @@
import os
import
nadav-har-tzvi commented on a change in pull request #20: PySpark fixes for
YARN and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191065225
##
File path:
common/src/main/scala/org/apache/amaterasu/common/configuration/ClusterConfig.scala
##
nadav-har-tzvi commented on a change in pull request #20: PySpark fixes for
YARN and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191065217
##
File path:
I agree with Yaniv that Frameworks should be plugins.
Think about it like this, in the future, hopefully, you will be able to do
something like "sudo yum install amaterasu"
After install the "core" amaterasu using yum, you will be able to use the
new CLI like this: "ama frameworks add " to add a
Hi Arun,
You are correct Spark is the first framework, and in my mind,
frameworks should be treated as plugins. Also, we need to consider that not
all frameworks will run under the JVM.
Last, each framework has two modules, a runner (used by both the executor
and the leader) and runtime, to be
nadav-har-tzvi commented on issue #17: Amaterasu CLI for V0.2.1
URL:
https://github.com/apache/incubator-amaterasu/pull/17#issuecomment-389258985
Also, this feature requires manual testing in addition to the automated
tests.
Please, clone my
arunma opened a new pull request #21: AMATERASU-28 Miniconda version pulling
away from code
URL: https://github.com/apache/incubator-amaterasu/pull/21
This is an automated message from the Apache Git Service.
To respond to
[
https://issues.apache.org/jira/browse/AMATERASU-28?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun Manivannan updated AMATERASU-28:
-
Summary: Pull Miniconda version away from compiled code (was: Pull
Miniconda version
Arun Manivannan created AMATERASU-28:
Summary: Pull Miniconda version away from compilable code
Key: AMATERASU-28
URL: https://issues.apache.org/jira/browse/AMATERASU-28
Project: AMATERASU
eyalbenivri closed pull request #19: AMATERASU-21 Fix Spark scala tests
URL: https://github.com/apache/incubator-amaterasu/pull/19
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a
[
https://issues.apache.org/jira/browse/AMATERASU-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491564#comment-16491564
]
ASF GitHub Bot commented on AMATERASU-21:
-
eyalbenivri closed pull request #19: AMATERASU-21 Fix
eyalbenivri commented on a change in pull request #20: PySpark fixes for YARN
and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191042876
##
File path:
eyalbenivri commented on a change in pull request #20: PySpark fixes for YARN
and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191042836
##
File path:
common/src/main/scala/org/apache/amaterasu/common/configuration/ClusterConfig.scala
##
eyalbenivri commented on a change in pull request #20: PySpark fixes for YARN
and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191042874
##
File path:
eyalbenivri commented on a change in pull request #20: PySpark fixes for YARN
and Mesos
URL: https://github.com/apache/incubator-amaterasu/pull/20#discussion_r191042917
##
File path:
executor/src/main/scala/org/apache/spark/repl/amaterasu/runners/spark/SparkRunnerHelper.scala
eyalbenivri closed pull request #18: AMATERASU-26 Pipeline tasks runs as "yarn"
user instead of inheriting…
URL: https://github.com/apache/incubator-amaterasu/pull/18
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the
[
https://issues.apache.org/jira/browse/AMATERASU-26?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491558#comment-16491558
]
ASF GitHub Bot commented on AMATERASU-26:
-
eyalbenivri closed pull request #18: AMATERASU-26
18 matches
Mail list logo
