dependabot[bot] opened a new pull request #62: Bump pyspark from 2.2.1 to 2.2.2
in /frameworks/spark/pyspark_runtime
URL: https://github.com/apache/incubator-amaterasu/pull/62
Bumps [pyspark](https://github.com/apache/spark) from 2.2.1 to 2.2.2.
Commits
-
Humbedooh merged pull request #61: Create RETIRED.txt
URL: https://github.com/apache/incubator-amaterasu/pull/61
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
justinmclean opened a new pull request #61: Create RETIRED.txt
URL: https://github.com/apache/incubator-amaterasu/pull/61
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
roadan merged pull request #60: CryptoUtil + AwsKms client for
encryption/decryption
URL: https://github.com/apache/incubator-amaterasu/pull/60
This is an automated message from the Apache Git Service.
To respond to the
yarivt commented on a change in pull request #60: CryptoUtil + AwsKms client
for encryption/decryption
URL: https://github.com/apache/incubator-amaterasu/pull/60#discussion_r301415075
##
File path:
common/src/main/kotlin/org/apache/amaterasu/common/crypto/AwsKmsCryptoProvider.kt
roadan commented on a change in pull request #60: CryptoUtil + AwsKms client
for encryption/decryption
URL: https://github.com/apache/incubator-amaterasu/pull/60#discussion_r301401320
##
File path:
common/src/main/kotlin/org/apache/amaterasu/common/crypto/AwsKmsCryptoProvider.kt
roadan merged pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
yarivt opened a new pull request #60: CryptoUtil + AwsKms client for
encryption/decryption
URL: https://github.com/apache/incubator-amaterasu/pull/60
This is an automated message from the Apache Git Service.
To respond to
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297494062
##
File path: docs/docs/frameworks.md
##
@@ -41,13 +41,145 @@ Amaterasu supports different processing frameworks
nadav-har-tzvi commented on a change in pull request #58: documentation for
pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r299124932
##
File path: docs/docs/frameworks.md
##
@@ -41,13 +41,145 @@ Amaterasu supports different processing
roadan opened a new pull request #59: Amaterasu 83
URL: https://github.com/apache/incubator-amaterasu/pull/59
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
anonymousGiraffe commented on issue #56: Ama cli docker
URL:
https://github.com/apache/incubator-amaterasu/pull/56#issuecomment-506189265
> > > In addition to the comments above you have 4 .zip files that shouldn't
be there so please delete them?
> > > Also what happened to
roadan commented on issue #56: Ama cli docker
URL:
https://github.com/apache/incubator-amaterasu/pull/56#issuecomment-506185719
> > In addition to the comments above you have 4 .zip files that shouldn't
be there so please delete them?
> > Also what happened to ApplicationMaster.kt and
anonymousGiraffe commented on issue #56: Ama cli docker
URL:
https://github.com/apache/incubator-amaterasu/pull/56#issuecomment-506143267
> In addition to the comments above you have 4 .zip files that shouldn't be
there so please delete them?
> Also what happened to
anonymousGiraffe commented on a change in pull request #56: Ama cli docker
URL: https://github.com/apache/incubator-amaterasu/pull/56#discussion_r297963577
##
File path: ama-cli/settings.gradle
##
@@ -13,25 +13,4 @@
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
anonymousGiraffe commented on a change in pull request #56: Ama cli docker
URL: https://github.com/apache/incubator-amaterasu/pull/56#discussion_r297961700
##
File path:
ama-cli/src/main/kotlin/org/apache/amaterasu/ama/cli/container/ContainerHandler.kt
##
@@ -0,0 +1,67 @@
anonymousGiraffe commented on a change in pull request #56: Ama cli docker
URL: https://github.com/apache/incubator-amaterasu/pull/56#discussion_r297961493
##
File path:
ama-cli/src/main/kotlin/org/apache/amaterasu/ama/cli/container/ContainerHandler.kt
##
@@ -0,0 +1,67 @@
anonymousGiraffe commented on a change in pull request #56: Ama cli docker
URL: https://github.com/apache/incubator-amaterasu/pull/56#discussion_r297961360
##
File path: ama-cli/settings.gradle
##
@@ -13,25 +13,4 @@
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297455991
##
File path: docs/docs/config.md
##
@@ -77,4 +77,46 @@ All frameworks have their own configuration, Apache
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297493086
##
File path: docs/docs/frameworks.md
##
@@ -41,13 +41,145 @@ Amaterasu supports different processing frameworks
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297473059
##
File path: docs/docs/config.md
##
@@ -77,4 +77,46 @@ All frameworks have their own configuration, Apache
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297514373
##
File path: docs/docs/frameworks.md
##
@@ -41,13 +41,145 @@ Amaterasu supports different processing frameworks
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297494062
##
File path: docs/docs/frameworks.md
##
@@ -41,13 +41,145 @@ Amaterasu supports different processing frameworks
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297495190
##
File path: docs/docs/frameworks.md
##
@@ -41,13 +41,145 @@ Amaterasu supports different processing frameworks
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297493499
##
File path: docs/docs/frameworks.md
##
@@ -41,13 +41,145 @@ Amaterasu supports different processing frameworks
roadan commented on a change in pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r297455776
##
File path: docs/docs/config.md
##
@@ -77,4 +77,46 @@ All frameworks have their own configuration, Apache
nadav-har-tzvi opened a new pull request #58: documentation for pyspark sdk
URL: https://github.com/apache/incubator-amaterasu/pull/58
This is an automated message from the Apache Git Service.
To respond to the message,
nadav-har-tzvi merged pull request #57: Amaterasu 36 mesos
URL: https://github.com/apache/incubator-amaterasu/pull/57
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
roadan commented on a change in pull request #56: Ama cli docker
URL: https://github.com/apache/incubator-amaterasu/pull/56#discussion_r295650122
##
File path: ama-cli/settings.gradle
##
@@ -13,25 +13,4 @@
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
roadan commented on a change in pull request #56: Ama cli docker
URL: https://github.com/apache/incubator-amaterasu/pull/56#discussion_r295650979
##
File path:
ama-cli/src/main/kotlin/org/apache/amaterasu/ama/cli/container/ContainerHandler.kt
##
@@ -0,0 +1,67 @@
+package
roadan opened a new pull request #57: Amaterasu 36 mesos
URL: https://github.com/apache/incubator-amaterasu/pull/57
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
anonymousGiraffe opened a new pull request #55: Adding module for ama cli
URL: https://github.com/apache/incubator-amaterasu/pull/55
base cli interface that will create a docker iamge
This is an automated message from the
roadan opened a new pull request #54: fixed spark runtim build
URL: https://github.com/apache/incubator-amaterasu/pull/54
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
roadan merged pull request #52: Amaterasu 79
URL: https://github.com/apache/incubator-amaterasu/pull/52
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
roadan commented on issue #53: [AMATERASU-52] Read configuration from
datasets.yaml for File, Hive a…
URL:
https://github.com/apache/incubator-amaterasu/pull/53#issuecomment-498167672
Looking good, once @nadav-har-tzvi adds the python documentation, could you
please add the JVM one?
roadan merged pull request #53: [AMATERASU-52] Read configuration from
datasets.yaml for File, Hive a…
URL: https://github.com/apache/incubator-amaterasu/pull/53
This is an automated message from the Apache Git Service.
To
arunma closed pull request #46: [AMATERASU-52] Implement AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/46
This is an automated message from the Apache Git Service.
To respond to the message,
roadan opened a new pull request #52: Amaterasu 79
URL: https://github.com/apache/incubator-amaterasu/pull/52
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
roadan opened a new pull request #51: Amaterasu 30
URL: https://github.com/apache/incubator-amaterasu/pull/51
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
roadan merged pull request #44: Amaterasu 45
URL: https://github.com/apache/incubator-amaterasu/pull/44
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
roadan merged pull request #49: Amaterasu 69
URL: https://github.com/apache/incubator-amaterasu/pull/49
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
roadan opened a new pull request #48: Amaterasu 62
URL: https://github.com/apache/incubator-amaterasu/pull/48
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
nadav-har-tzvi commented on a change in pull request #46: [AMATERASU-52]
Implement AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/46#discussion_r263699521
##
File path:
roadan merged pull request #47: hide the data structure implementation
URL: https://github.com/apache/incubator-amaterasu/pull/47
This is an automated message from the Apache Git Service.
To respond to the message, please
roadan commented on a change in pull request #46: [AMATERASU-52] Implement
AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/46#discussion_r262024253
##
File path:
nadav-har-tzvi commented on a change in pull request #46: [AMATERASU-52]
Implement AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/46#discussion_r262017512
##
File path:
nadav-har-tzvi merged pull request #45: Amaterasu 25
URL: https://github.com/apache/incubator-amaterasu/pull/45
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and
roadan commented on a change in pull request #46: [AMATERASU-52] Implement
AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/46#discussion_r261947046
##
File path:
roadan commented on a change in pull request #44: Amaterasu 45
URL: https://github.com/apache/incubator-amaterasu/pull/44#discussion_r261847640
##
File path:
roadan commented on a change in pull request #44: Amaterasu 45
URL: https://github.com/apache/incubator-amaterasu/pull/44#discussion_r261847641
##
File path:
arunma opened a new pull request #46: [AMATERASU-52] Implement
AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/46
This is an automated message from the Apache Git Service.
To respond to the
arunma closed pull request #39: [AMATERASU-52] Implement AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/39
This is an automated message from the Apache Git Service.
To respond to the message,
arunma commented on issue #39: [AMATERASU-52] Implement AmaContext.datastores
URL:
https://github.com/apache/incubator-amaterasu/pull/39#issuecomment-468663979
Opening a fresh one.
This is an automated message from the
roadan opened a new pull request #45: Amaterasu 25
URL: https://github.com/apache/incubator-amaterasu/pull/45
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use
nadav-har-tzvi commented on issue #33: checking the existence of znode for
resuming job
URL:
https://github.com/apache/incubator-amaterasu/pull/33#issuecomment-465621582
Can someone provide an update on this? Is it still relevant?
nadav-har-tzvi commented on issue #44: Amaterasu 45 rebase
URL:
https://github.com/apache/incubator-amaterasu/pull/44#issuecomment-465256452
I want to make this a discussion thread regarding this feature. Also I want
@arunma to review this and comment. Thanks.
roadan commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r257860597
##
File path: common/build.gradle
##
@@ -46,15 +46,21 @@ dependencies {
compile group: 'org.slf4j', name: 'slf4j-simple',
roadan commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r257857450
##
File path:
common/src/main/scala/org/apache/amaterasu/common/execution/actions/Notifier.scala
##
@@ -14,43 +14,43 @@
* See
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r25039
##
File path:
frameworks/spark/dispatcher/src/main/scala/org/apache/amaterasu/frameworks/spark/dispatcher/SparkSetupProvider.scala
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r257834629
##
File path:
leader/src/main/scala/org/apache/amaterasu/leader/yarn/ApplicationMaster.scala
##
@@ -205,20 +206,20 @@
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r257630745
##
File path:
common/src/main/kotlin/org/apache/amaterasu/common/utils/ArtifactUtil.kt
##
@@ -0,0 +1,59 @@
+/*
+ *
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r257779002
##
File path:
leader-common/src/main/scala/org/apache/amaterasu/leader/common/utilities/DataLoader.scala
##
@@ -48,7
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r257778629
##
File path:
leader-common/src/main/scala/org/apache/amaterasu/leader/common/utilities/ActiveReportListener.scala
##
@@
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r257631154
##
File path:
common/src/main/scala/org/apache/amaterasu/common/execution/actions/Notifier.scala
##
@@ -14,43 +14,43 @@
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r25961
##
File path: frameworks/spark/runner/build.gradle
##
@@ -24,7 +24,7 @@ plugins {
shadowJar {
zip64 true
}
-
+2
nadav-har-tzvi commented on a change in pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42#discussion_r25454
##
File path:
anonymousGiraffe opened a new pull request #43: fix debuging unitest
URL: https://github.com/apache/incubator-amaterasu/pull/43
* please download spec plugin to intelij as well
* fix Gradle issues
This is an automated
roadan opened a new pull request #42: Amaterasu 8
URL: https://github.com/apache/incubator-amaterasu/pull/42
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use
roadan opened a new pull request #41: Amaterasu 48
URL: https://github.com/apache/incubator-amaterasu/pull/41
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use
roadan commented on a change in pull request #39: [AMATERASU-52] Implement
AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/39#discussion_r247366504
##
File path:
arunma opened a new pull request #39: [AMATERASU-52] Implement
AmaContext.datastores
URL: https://github.com/apache/incubator-amaterasu/pull/39
This is an automated message from the Apache Git Service.
To respond to the
roadan closed pull request #38: Integration with RTD
URL: https://github.com/apache/incubator-amaterasu/pull/38
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request
roadan opened a new pull request #35: Adding getActionResources and
getActionDependencies
URL: https://github.com/apache/incubator-amaterasu/pull/35
This is an automated message from the Apache Git Service.
To respond to
nadav-har-tzvi closed pull request #34: Amaterasu 49 - mesos implementation
URL: https://github.com/apache/incubator-amaterasu/pull/34
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a
roadan opened a new pull request #34: Amaterasu 49
URL: https://github.com/apache/incubator-amaterasu/pull/34
Currently, this is only on Mesos, not to disrupt @eyalbenivri ongoing work
on YARN
This is an automated message
roadan closed pull request #32: Amaterasu 35
URL: https://github.com/apache/incubator-amaterasu/pull/32
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a
roadan commented on issue #32: Amaterasu 35
URL:
https://github.com/apache/incubator-amaterasu/pull/32#issuecomment-409433038
@nadav-har-tzvi I've fixed both remaks
This is an automated message from the Apache Git Service.
nadav-har-tzvi commented on a change in pull request #32: Amaterasu 35
URL: https://github.com/apache/incubator-amaterasu/pull/32#discussion_r206435485
##
File path:
nadav-har-tzvi commented on a change in pull request #32: Amaterasu 35
URL: https://github.com/apache/incubator-amaterasu/pull/32#discussion_r206435900
##
File path:
nadav-har-tzvi commented on a change in pull request #32: Amaterasu 35
URL: https://github.com/apache/incubator-amaterasu/pull/32#discussion_r206432807
##
File path:
frameworks/spark/dispatcher/src/main/scala/org/apache/amaterasu/frameworks/spark/dispatcher/SparkSetupProvider.scala
roadan opened a new pull request #32: Amaterasu 35
URL: https://github.com/apache/incubator-amaterasu/pull/32
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use
eyalbenivri closed pull request #31: Amaterasu 47
URL: https://github.com/apache/incubator-amaterasu/pull/31
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from
eyalbenivri commented on issue #31: Amaterasu 47
URL:
https://github.com/apache/incubator-amaterasu/pull/31#issuecomment-407399403
Merged, after CR and verification on another env.
This is an automated message from the
roadan opened a new pull request #31: Amaterasu 47
URL: https://github.com/apache/incubator-amaterasu/pull/31
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use
arunma opened a new pull request #30: AMATERASU-24 Refactor Spark out of
Amaterasu executor to it's own pro…
URL: https://github.com/apache/incubator-amaterasu/pull/30
…ject (Master)
This is an automated message from the
roadan opened a new pull request #28: Version 0.2.0 incubating rc4
URL: https://github.com/apache/incubator-amaterasu/pull/28
This is an automated message from the Apache Git Service.
To respond to the message, please log on
roadan commented on issue #27: AMATERASU-24 Refactor Spark out of Amaterasu
executor to it's own project
URL:
https://github.com/apache/incubator-amaterasu/pull/27#issuecomment-401573891
Tested on YARN and Mesos
This is an
roadan closed pull request #21: AMATERASU-28 Miniconda version pulling away
from code
URL: https://github.com/apache/incubator-amaterasu/pull/21
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As
roadan closed pull request #24: AMATERASU-24 Refactor Spark out of Amaterasu
executor to it's own pro…
URL: https://github.com/apache/incubator-amaterasu/pull/24
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake
arunma opened a new pull request #27: AMATERASU-24 Refactor Spark out of
Amaterasu executor to it's own project
URL: https://github.com/apache/incubator-amaterasu/pull/27
This is an automated message from the Apache Git
roadan opened a new pull request #26: Amaterasu 23
URL: https://github.com/apache/incubator-amaterasu/pull/26
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use
roadan opened a new pull request #25: Amaterasu 33
URL: https://github.com/apache/incubator-amaterasu/pull/25
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use
arunma commented on issue #24: AMATERASU-24 Refactor Spark out of Amaterasu
executor to it's own pro…
URL:
https://github.com/apache/incubator-amaterasu/pull/24#issuecomment-395939568
@roadan @eyalbenivri @nadav-har-tzvi The kicking off the executor needs some
work but appreciate if you
arunma opened a new pull request #24: AMATERASU-24 Refactor Spark out of
Amaterasu executor to it's own pro…
URL: https://github.com/apache/incubator-amaterasu/pull/24
…ject
This is an automated message from the Apache Git
arunma closed pull request #22: AMATERASU-24 Refactor Spark out of Amaterasu
executor to it's own pro…
URL: https://github.com/apache/incubator-amaterasu/pull/22
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake
roadan closed pull request #23: Version 0.2.0 incubating rc3
URL: https://github.com/apache/incubator-amaterasu/pull/23
This is an automated message from the Apache Git Service.
To respond to the message, please log on
roadan opened a new pull request #23: Version 0.2.0 incubating rc3
URL: https://github.com/apache/incubator-amaterasu/pull/23
This is an automated message from the Apache Git Service.
To respond to the message, please log on
roadan closed pull request #23: Version 0.2.0 incubating rc3
URL: https://github.com/apache/incubator-amaterasu/pull/23
This is an automated message from the Apache Git Service.
To respond to the message, please log on
roadan opened a new pull request #23: Version 0.2.0 incubating rc3
URL: https://github.com/apache/incubator-amaterasu/pull/23
This is an automated message from the Apache Git Service.
To respond to the message, please log on
arunma opened a new pull request #22: AMATERASU-24 Refactor Spark out of
Amaterasu executor to it's own pro…
URL: https://github.com/apache/incubator-amaterasu/pull/22
…ject
This is an automated message from the Apache Git
1 - 100 of 139 matches
Mail list logo
