Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r179174442
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/CacheRecoveryIntegrationSuite.scala
---
@@ -0,0 +1,149 @@
+/*
+ * Licensed to the Apache
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r179191524
--- Diff:
core/src/test/scala/org/apache/spark/CacheRecoveryManagerSuite.scala ---
@@ -0,0 +1,201 @@
+/*
+ * Licensed to the Apache Software
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r179179616
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/CacheRecoveryIntegrationSuite.scala
---
@@ -0,0 +1,149 @@
+/*
+ * Licensed to the Apache
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20640#discussion_r179013270
--- Diff:
resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala
---
@@ -108,6
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20640#discussion_r179012299
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -648,14 +645,8
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20640#discussion_r179012891
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -571,7 +568,7
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r178967925
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,201 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r178966943
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,201 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r178967087
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,201 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r178964472
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -250,6 +255,44 @@ class BlockManagerMasterEndpoint
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r178968393
--- Diff: core/src/main/scala/org/apache/spark/CacheRecoveryManager.scala
---
@@ -0,0 +1,201 @@
+/*
+ * Licensed to the Apache Software Foundation
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r178959007
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -246,6 +251,38 @@ class BlockManagerMasterEndpoint
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20888
ah ok, yes when run in isolation, the stage will be 0, so your change makes
sense. But that is not what is making it flaky in a full test run
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20888
> if I execute the test on my machine alone it never pass.
you mean it never fails on your machine, right? its only flaky when you
run everything on jenk
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20888
hmm you're right, I was looking at a different branch in my editor and
didn't pay attention that it was reset in the code I linked to on master, oops.
I still dont' understand your proposed
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20888
I think you're right about killing the wrong stage, but I don't think its
exactly what you've outlined. The original code doesn't try to kill a stage
with ID == 0 -- instead its just waiting until
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20604
@vanzin @sitalkedia @jiangxb1987 I was looking at this code again, and I'd
appreciate your thoughts on how this relates to
[SPARK-21834](https://issues.apache.org/jira/browse/SPARK-21834)
https
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20657
@jerryshao I know you said you wanted to take a deeper look, but its been a
while. otherwise I'll merge in the next day or two
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20853
Jenkins, ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20770
took a quick look, agree with shivaram's observations, you've got to handle
`shuffleIdToMapStage` which will not be so easy
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20742
lgtm
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20742#discussion_r175171592
--- Diff: docs/security.md ---
@@ -3,47 +3,291 @@ layout: global
displayTitle: Spark Security
title: Security
---
+* This will become
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20742#discussion_r175173523
--- Diff: docs/security.md ---
@@ -182,54 +582,70 @@ configure those ports.
-### HTTP Security Headers
-Apache Spark can
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20742#discussion_r175170426
--- Diff: docs/security.md ---
@@ -3,47 +3,291 @@ layout: global
displayTitle: Spark Security
title: Security
---
+* This will become
Github user squito commented on the issue:
https://github.com/apache/spark/pull/19041
Thanks @brad-kaiser -- want to re-iterate my comment from Feb 2nd, I think
that is really the most important part to address before getting into the
details of the current implementation
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/19041#discussion_r175164254
--- Diff:
core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala
---
@@ -246,6 +251,38 @@ class BlockManagerMasterEndpoint
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20685
lgtm
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20685
I agree with @cloud-fan .
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20657
btw I took a look at the code in `MesosHadoopDelegationTokenManager`, there
seems to be a lot of duplication that could probably be factored out, and I
wonder if the things that are different really
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172954706
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
---
@@ -93,11 +93,24 @@ private[spark] class Client
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172963955
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/AMCredentialRenewer.scala
---
@@ -18,221 +18,156 @@ package
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20685
it'll also help with disk corruption ... from the stack traces in
SPARK-4105 you can't really tell what the source of the problem is. it'll be
pretty hard to determine what the source of corruption
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172581601
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala
---
@@ -144,7 +145,8 @@ class SparkHadoopUtil extends Logging {
private
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172579936
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -520,4 +520,16 @@ package object config {
.checkValue(v =>
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20685#discussion_r172579121
--- Diff:
core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala
---
@@ -352,6 +352,63 @@ class
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20740
lgtm
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172319244
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/AMCredentialRenewer.scala
---
@@ -18,221 +18,156 @@ package
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172322650
--- Diff:
core/src/main/scala/org/apache/spark/internal/config/package.scala ---
@@ -520,4 +520,16 @@ package object config {
.checkValue(v =>
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172323592
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/security/AMCredentialRenewer.scala
---
@@ -18,221 +18,156 @@ package
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172325576
--- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala
---
@@ -144,7 +145,8 @@ class SparkHadoopUtil extends Logging {
private
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20657#discussion_r172321966
--- Diff:
resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala
---
@@ -1009,7 +987,7 @@ private[spark] class Client
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20685#discussion_r172226910
--- Diff:
core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala
---
@@ -352,6 +352,63 @@ class
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20685#discussion_r172232973
--- Diff:
core/src/test/scala/org/apache/spark/storage/ShuffleBlockFetcherIteratorSuite.scala
---
@@ -352,6 +352,63 @@ class
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r170383918
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationClient.scala ---
@@ -55,18 +55,18 @@ private[spark] trait ExecutorAllocationClient
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20645
I agree it would be nicer to have this be a more general feature. I would
prefer an approach which didn't require a different configuration name, just as
its more to document & for users to
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20652
lgtm
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
sure @skonto, great to have somebody more knowledgable on mesos taking a
closer look at this.
sorry @IgorBerman I promised a quick fix here, but have realized this is
more complicated than
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
cc @attilapiros , you may be interested b/c of how this relates to
SPARK-16630
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
ok hmm ... so actually this change would lose some important functionality
then. unfortunately I don't have a clear picture yet of how to solve
SPARK-16630 along with the other blacklisting
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
@susanxhuynh good point about changing default behavior. I'd rather have
the change so we have more unified behavior between mesos and other cluster
managers. But I have never run spark on mesos
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
thanks @IgorBerman, description looks fine to me now, maybe I saw it wrong
before.
your test sounds pretty good to me ... you could turn on debug logging
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20604
Jenkins, retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20604
known flaky test: https://issues.apache.org/jira/browse/SPARK-23458
---
-
To unsubscribe, e-mail: reviews-unsubscr
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20635
thanks @ivoson , merged!
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user squito commented on the issue:
https://github.com/apache/spark/pull/17619
for anyone watching this: @IgorBerman submitted an updated version of this
here https://github.com/apache/spark/pull/20640 which I plan to merge unless
there are any objections
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
lgtm
@IgorBerman can you cleanup the PR description a little? headers got
duplicated. And I'd reword a bit to something like
> This updates the Mesos scheduler to integr
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/17619#discussion_r169458952
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -484,7 +481,6
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r169438419
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -455,7 +461,12 @@ private[spark] class ExecutorAllocationManager
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r169437530
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -1643,7 +1646,10 @@ class SparkContext(config: SparkConf) extends
Logging
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20604#discussion_r169436456
--- Diff:
core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala ---
@@ -334,6 +336,10 @@ private[spark] class ExecutorAllocationManager
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20640#discussion_r169413261
--- Diff:
resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala
---
@@ -108,6
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
thanks for updating. can you also update the PR description?
yeah its fine to just update this one. You can't in general update others'
prs, unless they give you push permissions
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20640#discussion_r169391079
--- Diff:
resource-managers/mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala
---
@@ -108,6
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
I understand if you want to do something like this for yourself to unblock,
but I think I'm -1 on merging this because of adding more configs just for a
stopgap.
but I think we agree
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
@IgorBerman I actually think that
https://github.com/apache/spark/pull/17619 is the right approach. As @timout
pointed out on that one, this functionality doesn't need to be covered in mesos
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20640
Jenkins, ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20635
Jenkins, Ok to test
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20635
lgtm assuming tests pass
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20604
@tgravescs @vanzin @zsxwing could you take a look? thanks
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20424
still lgtm, thanks
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito closed the pull request at:
https://github.com/apache/spark/pull/20623
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20601
ack I merged to master but screwed up on 2.3 -- fixing that here:
https://github.com/apache/spark/pull/20623
GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/20623
[SPARK-23413][UI] Fix sorting tasks by Host / Executor ID at the Stagâ¦
â¦e page
## What changes were proposed in this pull request?
Fixing exception got at sorting tasks by Host
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20601
Everything that might have changed from this has passed, the failures are
known flaky tests:
https://issues.apache.org/jira/browse/SPARK-23369
https://issues.apache.org/jira/browse
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/17619#discussion_r168509141
--- Diff:
resource-managers/mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackend.scala
---
@@ -484,7 +481,6
Github user squito commented on the issue:
https://github.com/apache/spark/pull/17208
hmm I think you're right @zsxwing that we should be updating `isZombie`
before `sched.dagScheduler.taskEnded` and `sched.dagScheduler.taskSetFailed` is
called, just to keep state consistent. I
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20601#discussion_r168313710
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala ---
@@ -963,33 +965,60 @@ private[ui] class TaskPagedTable(
private object
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20601#discussion_r168211371
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala ---
@@ -963,33 +965,60 @@ private[ui] class TaskPagedTable(
private object
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20596
Have you seen a case where you actually have an off-heap buffer passed in,
though the desire storage is on-heap? Eg. if its comes from the block transfer
service than I think it will always
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20474
merged to master
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/20604
[WIP][SPARK-23365][CORE] Do not adjust num executors when killing idle
executors.
The ExecutorAllocationManager should not adjust the target number of
executors when killing idle executors
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20532
I agree with @jiangxb1987 ... we already have issues with event logs being
too big, as it the driver gets backlogged even writing them out, and then the
history server takes a long time to parse
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20601#discussion_r167991914
--- Diff: core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala ---
@@ -963,33 +965,60 @@ private[ui] class TaskPagedTable(
private object
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20424
ah got it. sounds good to me, I will defer to @HyukjinKwon 's judgement.
I think this change looks fine
---
-
To unsubscribe
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20474
lgtm
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
Github user squito commented on the issue:
https://github.com/apache/spark/pull/19788
Jenkins, retest this please
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20424
lgtm
@bersprockets you mentioned wanting to try the other route as well -- whats
the status on that? shoudl we still wait on this one
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20474#discussion_r167917613
--- Diff:
core/src/main/scala/org/apache/spark/status/api/v1/OneApplicationResource.scala
---
@@ -51,6 +51,29 @@ private[v1] class
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20474#discussion_r167917733
--- Diff: docs/monitoring.md ---
@@ -347,6 +347,10 @@ can be identified by their `[attempt-id]`. In the API
listed below, when running
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20244
merged to master / 2.3 / 2.2
I hit a merge conflict trying to merge to 2.1 -- feel free to open another
PR for that version
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20408
merged to master, thanks everyone
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20532
I can see why you want this sometimes, but I'm trying to figure out if its
really valuable for users in general. You could always add a custom listener
to log this info. It would go into separate
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20244#discussion_r167138603
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ---
@@ -2399,6 +2424,121 @@ class DAGSchedulerSuite extends SparkFunSuite
Github user squito commented on the issue:
https://github.com/apache/spark/pull/20408
just a quick note -- I realized I was confused about one part of the inner
workings of the history server which I want to confirm before I merge this, but
got sick and now have a bit of a backlog
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20244#discussion_r166458357
--- Diff:
core/src/test/scala/org/apache/spark/scheduler/DAGSchedulerSuite.scala ---
@@ -2399,6 +2424,121 @@ class DAGSchedulerSuite extends SparkFunSuite
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20451#discussion_r166087229
--- Diff:
resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/OptionRequirements.scala
---
@@ -0,0 +1,40
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/20493#discussion_r166068708
--- Diff:
core/src/test/scala/org/apache/spark/status/AppStatusUtilsSuite.scala ---
@@ -0,0 +1,89 @@
+/*
+ * Licensed to the Apache Software
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/17422#discussion_r165772194
--- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala ---
@@ -429,15 +429,42 @@ private[spark] class Executor(
case t
Github user squito commented on a diff in the pull request:
https://github.com/apache/spark/pull/17422#discussion_r165772055
--- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala ---
@@ -212,9 +212,19 @@ case object TaskResultLost extends TaskFailedReason
Github user squito commented on the issue:
https://github.com/apache/spark/pull/17422
@advancedxy this has been quiet for a long time, so I suggest you just take
it over. I actually think this is so close to complete that very little would
need to be done, and credit would most
701 - 800 of 3519 matches
Mail list logo
