Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22641
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97117/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22641
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22623#discussion_r223447961
--- Diff:
core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala ---
@@ -74,20 +74,26 @@ trait TestPrematureExit {
@volatile var
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22672
The original change in #22631 made the test time go down from about 2:30 to
0:17. See build 96945:
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222810125
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -415,9 +421,63 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r223421728
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala ---
@@ -503,6 +505,92 @@ class TaskSchedulerImplSuite extends
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222785940
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -117,6 +117,12 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222811152
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -415,9 +421,63 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222816923
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -414,9 +425,48 @@ private[spark] class TaskSchedulerImpl(
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22295
**[Test build #97124 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97124/testReport)**
for PR 22295 at commit
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222810004
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -415,9 +421,63 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222814235
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -415,9 +421,63 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222811527
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -415,9 +421,63 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222816658
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -415,9 +421,63 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222785870
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala ---
@@ -117,6 +117,12 @@ private[spark] class TaskSchedulerImpl(
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222783407
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -597,6 +597,17 @@ package object config {
.checkValue(v =>
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r223421506
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala ---
@@ -503,6 +505,92 @@ class TaskSchedulerImplSuite extends
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r222813512
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -597,6 +597,17 @@ package object config {
.checkValue(v =>
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22673
@darabos . Thank you for trying to make a contribution. However, we had
better discuss on that JIRA first before making a PR. Especially, for
SPARK-20144 which is discussed already, it does.
Github user tgravescs commented on a diff in the pull request:
https://github.com/apache/spark/pull/22288#discussion_r223451952
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -597,6 +597,17 @@ package object config {
.checkValue(v =>
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22598
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/22628
pulled into master, thanks @redsanket
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22598
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97115/
Test PASSed.
---
Github user tdas commented on the issue:
https://github.com/apache/spark/pull/22627
@holdenk yeah, i intend to backport this to 2.4
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/21102#discussion_r223460909
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala
---
@@ -3965,6 +4034,248 @@ object
Github user ifilonenko commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223461492
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala
---
@@ -0,0 +1,161
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22624
Given the lack of reviews let me ping some people: @skonto @jerryshao
---
-
To unsubscribe, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22295
**[Test build #97124 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97124/testReport)**
for PR 22295 at commit
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97124/
Test PASSed.
---
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22295
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22614#discussion_r223461273
--- Diff:
sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveShim.scala ---
@@ -746,34 +746,45 @@ private[client] class Shim_v0_13 extends
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22614#discussion_r223459567
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -544,6 +544,15 @@ object SQLConf {
.booleanConf
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22614
**[Test build #97119 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97119/testReport)**
for PR 22614 at commit
Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21688
test this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail:
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/21809
**[Test build #97120 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97120/testReport)**
for PR 21809 at commit
Github user mallman commented on a diff in the pull request:
https://github.com/apache/spark/pull/22614#discussion_r223424625
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/client/HiveClientSuite.scala
---
@@ -79,12 +82,30 @@ class HiveClientSuite(version: String)
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22029
Merged build finished. Test FAILed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22029
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97110/
Test FAILed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22029
**[Test build #97110 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97110/testReport)**
for PR 22029 at commit
Github user zsxwing commented on the issue:
https://github.com/apache/spark/pull/22649
Thanks for fixing this. I'm just curious why it didn't fail before my
change from `Long` to `java.lang.Long`?
---
-
To
Github user srowen commented on the issue:
https://github.com/apache/spark/pull/22649
The pull request builder runs Scala 2.11, and this only becomes ambiguous
in 2.12 (long story). For now 2.12 is still a secondary build. I suspect we'll
switch it to be the primary scala version
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22674
**[Test build #97122 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97122/testReport)**
for PR 22674 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223435325
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala
---
@@ -199,6 +200,37 @@ class ClientSuite extends
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223442688
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnAllocatorSuite.scala
---
@@ -87,6 +88,20 @@ class YarnAllocatorSuite
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223433617
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ResourceRequestHelper.scala
---
@@ -0,0 +1,148 @@
+/*
+ * Licensed to
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223439326
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223441224
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223437860
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223437109
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223438072
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223436337
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223440106
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestTestHelper.scala
---
@@ -0,0 +1,90 @@
+/*
+ * Licensed
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223438810
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223434738
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala
---
@@ -288,9 +296,14 @@ private[yarn] class
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223436523
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22674
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223433078
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ResourceRequestHelper.scala
---
@@ -0,0 +1,148 @@
+/*
+ * Licensed to
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22674
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223435056
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala
---
@@ -35,7 +36,7 @@ import
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223436057
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientSuite.scala
---
@@ -433,4 +465,36 @@ class ClientSuite extends
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22674#discussion_r223443736
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/util/QueryExecutionListener.scala
---
@@ -75,95 +76,70 @@ trait QueryExecutionListener {
*/
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22674#discussion_r223443327
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/ui/SQLListener.scala ---
@@ -39,7 +39,14 @@ case class SparkListenerSQLExecutionStart(
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223436285
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestHelperSuite.scala
---
@@ -0,0 +1,255 @@
+/*
+ *
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223440836
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/YarnAllocatorSuite.scala
---
@@ -134,6 +163,29 @@ class YarnAllocatorSuite
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223439004
--- Diff:
resource-managers/yarn/src/test/scala/org/apache/spark/deploy/yarn/ResourceRequestTestHelper.scala
---
@@ -0,0 +1,90 @@
+/*
+ * Licensed
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22672
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/20761#discussion_r223433455
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/ResourceRequestHelper.scala
---
@@ -0,0 +1,148 @@
+/*
+ * Licensed to
Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/22657
Then we don't need any randomness here, just pick one timezone(like PST?)
and test it.
---
-
To unsubscribe, e-mail:
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22630
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/97111/
Test PASSed.
---
Github user SparkQA commented on the issue:
https://github.com/apache/spark/pull/22630
**[Test build #97111 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/97111/testReport)**
for PR 22630 at commit
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/22614#discussion_r223462348
--- Diff:
sql/hive/src/test/scala/org/apache/spark/sql/hive/client/HiveClientSuite.scala
---
@@ -79,12 +82,30 @@ class HiveClientSuite(version: String)
Github user gatorsmile commented on the issue:
https://github.com/apache/spark/pull/22614
As @tejasapatil suggested above, this fallback is not suggested to be on in
a prod setting. It could also impact the system health (e.g., the other
concurrent queries that are querying the same
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22627
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the issue:
https://github.com/apache/spark/pull/22627
Merged build finished. Test PASSed.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
Github user vanzin commented on the issue:
https://github.com/apache/spark/pull/22614
> a better and safer solution by introducing exponential backoff with
retries
I'm confused about that suggestion. What is being retried? The user query?
The HMS call? What is changing in
Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/22305
I think there is a typo in your example in the description
```
@pandas_udf('double', PandasUDFType.GROUPED_AGG)
def avg(v):
return v.mean()
return avg
```
I think
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223512056
--- Diff: docs/running-on-kubernetes.md ---
@@ -820,4 +820,37 @@ specific to Spark on Kubernetes.
This sets the major Python version of the docker
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223518787
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopKerberosLogin.scala
---
@@ -0,0 +1,75 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223512267
--- Diff: docs/running-on-kubernetes.md ---
@@ -820,4 +820,37 @@ specific to Spark on Kubernetes.
This sets the major Python version of the docker
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223519651
--- Diff:
resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesExecutorBuilderSuite.scala
---
@@ -19,14 +19,18
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223517312
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopBootstrapUtil.scala
---
@@ -0,0 +1,238 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223517875
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopBootstrapUtil.scala
---
@@ -0,0 +1,238 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223518149
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopBootstrapUtil.scala
---
@@ -0,0 +1,238 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223515400
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala
---
@@ -0,0 +1,156 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223517824
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopBootstrapUtil.scala
---
@@ -0,0 +1,238 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223512232
--- Diff: docs/running-on-kubernetes.md ---
@@ -820,4 +820,37 @@ specific to Spark on Kubernetes.
This sets the major Python version of the docker
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223515755
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala
---
@@ -0,0 +1,156 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223516199
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfExecutorFeatureStep.scala
---
@@ -0,0 +1,58 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223514310
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/HadoopConfExecutorFeatureStep.scala
---
@@ -0,0 +1,52 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223511748
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala ---
@@ -646,8 +646,9 @@ private[spark] class SparkSubmit extends Logging {
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223515261
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala
---
@@ -0,0 +1,156 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223517953
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopBootstrapUtil.scala
---
@@ -0,0 +1,238 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223513908
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/Constants.scala
---
@@ -81,4 +83,35 @@ private[spark] object
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223519417
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/KubernetesExecutorBuilder.scala
---
@@ -51,7 +67,25 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223513489
--- Diff: examples/src/main/scala/org/apache/spark/examples/HdfsTest.scala
---
@@ -41,6 +41,8 @@ object HdfsTest {
val end =
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223515094
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala
---
@@ -0,0 +1,156 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223516515
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopBootstrapUtil.scala
---
@@ -0,0 +1,238 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223518860
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/hadooputils/HadoopKerberosLogin.scala
---
@@ -0,0 +1,75 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223514752
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/features/KerberosConfDriverFeatureStep.scala
---
@@ -0,0 +1,156 @@
Github user vanzin commented on a diff in the pull request:
https://github.com/apache/spark/pull/21669#discussion_r223520296
--- Diff: docs/security.md ---
@@ -722,7 +722,85 @@ with encryption, at least.
The Kerberos login will be periodically renewed using the provided
201 - 300 of 566 matches
Mail list logo
