[
https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30689.
---
Fix Version/s: 3.0.0
Assignee: Thomas Graves
Resolution: Fixed
> Allow custo
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-30511:
-
Assignee: Zebing Lin
> Spark marks intentionally killed speculative tasks as pending le
[
https://issues.apache.org/jira/browse/SPARK-30511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30511.
---
Fix Version/s: 3.0.0
Resolution: Fixed
> Spark marks intentionally killed speculative
[
https://issues.apache.org/jira/browse/SPARK-30638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30638.
---
Fix Version/s: 3.0.0
Assignee: Thomas Graves
Resolution: Fixed
> add resourc
[
https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-30689:
--
Description:
Many people/companies will not be moving to Hadoop 3.1 or greater, where it
supp
[
https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-30689:
--
Description:
Many people/companies will not be moving to Hadoop 3.1 or greater, where it
supp
[
https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-30689:
--
Issue Type: Improvement (was: Bug)
> Allow custom resource scheduling to work with YARN versi
Thomas Graves created SPARK-30689:
-
Summary: Allow custom resource scheduling to work with Hadoop
versions that don't support it
Key: SPARK-30689
URL: https://issues.apache.org/jira/browse/SPARK-30689
[
https://issues.apache.org/jira/browse/SPARK-30689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-30689:
--
Summary: Allow custom resource scheduling to work with YARN versions that
don't support custom
[
https://issues.apache.org/jira/browse/SPARK-30638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-30638:
--
Description: Add the allocates resources to parameters to the PluginContext
so that any plugin
[
https://issues.apache.org/jira/browse/SPARK-30512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-30512:
--
Fix Version/s: 2.4.5
> Use a dedicated boss event group loop in the netty pipeline for externa
[
https://issues.apache.org/jira/browse/SPARK-30512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-30512:
-
Assignee: Chandni Singh
> Use a dedicated boss event group loop in the netty pipeline f
[
https://issues.apache.org/jira/browse/SPARK-30512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30512.
---
Fix Version/s: 3.0.0
Resolution: Fixed
this could be pulled back into branch-2.X as w
[
https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025285#comment-17025285
]
Thomas Graves commented on YARN-8200:
-
After messing with this a bit more I removed th
[
https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025156#comment-17025156
]
Thomas Graves commented on YARN-8200:
-
Hey [~jhung] ,
I am trying out the gpu schedul
Thomas Graves created SPARK-30638:
-
Summary: add resources as parameter to the PluginContext
Key: SPARK-30638
URL: https://issues.apache.org/jira/browse/SPARK-30638
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-28403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022527#comment-17022527
]
Thomas Graves commented on SPARK-28403:
---
so after looking at the pr for this, this
Thomas Graves created SPARK-30623:
-
Summary: Spark external shuffle allow disable of separate event
loop group
Key: SPARK-30623
URL: https://issues.apache.org/jira/browse/SPARK-30623
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021532#comment-17021532
]
Thomas Graves commented on SPARK-27213:
---
did anyone try this on the latest 2.4.x r
[
https://issues.apache.org/jira/browse/SPARK-29699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021404#comment-17021404
]
Thomas Graves commented on SPARK-29699:
---
this seems to be in the context of featur
[
https://issues.apache.org/jira/browse/SPARK-27082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021284#comment-17021284
]
Thomas Graves commented on SPARK-27082:
---
I ran into this case while testing, I thi
[
https://issues.apache.org/jira/browse/SPARK-27784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020563#comment-17020563
]
Thomas Graves commented on SPARK-27784:
---
[~rdblue] can you confirm this doesn't ex
[
https://issues.apache.org/jira/browse/SPARK-27282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020560#comment-17020560
]
Thomas Graves commented on SPARK-27282:
---
[~sofia] can you confirm this isn't fixed
[
https://issues.apache.org/jira/browse/SPARK-29306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-29306.
---
Fix Version/s: 3.0.0
Resolution: Fixed
> Executors need to track what ResourceProfile
Thomas Graves created SPARK-30529:
-
Summary: Improve error messages when Executor dies before
registering with driver
Key: SPARK-30529
URL: https://issues.apache.org/jira/browse/SPARK-30529
Project: S
[
https://issues.apache.org/jira/browse/SPARK-30448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-30448:
-
Assignee: Thomas Graves
> accelerator aware scheduling enforce cores as limiting resour
[
https://issues.apache.org/jira/browse/SPARK-30448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30448.
---
Fix Version/s: 3.0.0
Resolution: Fixed
> accelerator aware scheduling enforce cores a
[
https://issues.apache.org/jira/browse/SPARK-30446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30446.
---
Resolution: Duplicate
this is superceded by SPARK-30448
> Accelerator aware scheduling chec
[
https://issues.apache.org/jira/browse/SPARK-30049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010698#comment-17010698
]
Thomas Graves commented on SPARK-30049:
---
that Pr doesn't seem to be in yet. I'm no
[
https://issues.apache.org/jira/browse/SPARK-30295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010697#comment-17010697
]
Thomas Graves commented on SPARK-30295:
---
So what do you mean by unnecessary depend
[
https://issues.apache.org/jira/browse/SPARK-30417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010146#comment-17010146
]
Thomas Graves commented on SPARK-30417:
---
The only way for standalone mode would be
Thomas Graves created SPARK-30451:
-
Summary: Stage level Sched:
ExecutorResourceRequests/TaskResourceRequests should have functions to remove
requests
Key: SPARK-30451
URL: https://issues.apache.org/jira/browse/S
[
https://issues.apache.org/jira/browse/SPARK-30448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009989#comment-17009989
]
Thomas Graves commented on SPARK-30448:
---
Note this actually overlaps with
https:/
[
https://issues.apache.org/jira/browse/SPARK-30448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009901#comment-17009901
]
Thomas Graves commented on SPARK-30448:
---
note there are other calculations through
[
https://issues.apache.org/jira/browse/SPARK-30446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009896#comment-17009896
]
Thomas Graves commented on SPARK-30446:
---
working on this
> Accelerator aware sche
Thomas Graves created SPARK-30448:
-
Summary: accelerator aware scheduling enforce cores as limiting
resource
Key: SPARK-30448
URL: https://issues.apache.org/jira/browse/SPARK-30448
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009830#comment-17009830
]
Thomas Graves commented on SPARK-30446:
---
Yeah so running on standalone if you set
[
https://issues.apache.org/jira/browse/SPARK-30446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009742#comment-17009742
]
Thomas Graves commented on SPARK-30446:
---
I think there may also be issues in it wi
Thomas Graves created SPARK-30446:
-
Summary: Accelerator aware scheduling checkResourcesPerTask
doesn't cover all cases
Key: SPARK-30446
URL: https://issues.apache.org/jira/browse/SPARK-30446
Project:
Thomas Graves created SPARK-30445:
-
Summary: Accelerator aware scheduling handle setting configs to 0
better
Key: SPARK-30445
URL: https://issues.apache.org/jira/browse/SPARK-30445
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007694#comment-17007694
]
Thomas Graves commented on SPARK-30417:
---
[~yuchen.huo] is this something you could
Thomas Graves created SPARK-30417:
-
Summary: SPARK-29976 calculation of slots wrong for Standalone Mode
Key: SPARK-30417
URL: https://issues.apache.org/jira/browse/SPARK-30417
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27495:
--
Target Version/s: 3.0.0
> SPIP: Support Stage level resource configuration and scheduling
> --
Thomas Graves created SPARK-30391:
-
Summary: ExecutorAllocationManager requestTotalExecutors in
removeExecutors may not be needed
Key: SPARK-30391
URL: https://issues.apache.org/jira/browse/SPARK-30391
Thomas Graves created SPARK-30322:
-
Summary: Add stage level scheduling docs
Key: SPARK-30322
URL: https://issues.apache.org/jira/browse/SPARK-30322
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-30300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30300.
---
Fix Version/s: 3.0.0
Assignee: Niranjan Artal
Resolution: Fixed
> Update cor
Thomas Graves created SPARK-30299:
-
Summary: Dynamic allocation with Standalone mode calculates to
many executors needed
Key: SPARK-30299
URL: https://issues.apache.org/jira/browse/SPARK-30299
Project
[
https://issues.apache.org/jira/browse/SPARK-30209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-30209:
-
Assignee: Niranjan Artal
> Display stageId, attemptId, taskId with SQL max metric in UI
[
https://issues.apache.org/jira/browse/SPARK-30209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-30209.
---
Fix Version/s: 3.0.0
Resolution: Fixed
> Display stageId, attemptId, taskId with SQL
[
https://issues.apache.org/jira/browse/SPARK-29976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-29976.
---
Fix Version/s: 3.0.0
Assignee: Yuchen Huo
Resolution: Fixed
> Allow speculat
[
https://issues.apache.org/jira/browse/SPARK-18886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987037#comment-16987037
]
Thomas Graves commented on SPARK-18886:
---
Note there is discussion on this subject
[
https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-29415.
---
Fix Version/s: 3.0.0
Resolution: Fixed
> Stage Level Sched: Add base ResourceProfile
[
https://issues.apache.org/jira/browse/SPARK-29149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29149:
-
Assignee: Thomas Graves
> Update YARN cluster manager For Stage Level Scheduling
>
[
https://issues.apache.org/jira/browse/SPARK-29762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972755#comment-16972755
]
Thomas Graves commented on SPARK-29762:
---
But like you mention, if we were to suppo
[
https://issues.apache.org/jira/browse/SPARK-29762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972750#comment-16972750
]
Thomas Graves commented on SPARK-29762:
---
Ok, in the scenario above you would need
[
https://issues.apache.org/jira/browse/SPARK-29762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972661#comment-16972661
]
Thomas Graves commented on SPARK-29762:
---
The code that gets the task requirements
[
https://issues.apache.org/jira/browse/SPARK-29762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971798#comment-16971798
]
Thomas Graves commented on SPARK-29762:
---
this is actually more complex then you mi
[
https://issues.apache.org/jira/browse/SPARK-29763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29763:
-
Assignee: Thomas Graves
> Stage UI Page not showing all accumulators in Task Table
> --
Thomas Graves created SPARK-29763:
-
Summary: Stage UI Page not showing all accumulators in Task Table
Key: SPARK-29763
URL: https://issues.apache.org/jira/browse/SPARK-29763
Project: Spark
Is
[
https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-29151.
---
Fix Version/s: 3.0.0
Resolution: Fixed
> Support fraction resources for task resource
[
https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29151:
-
Assignee: Alessandro Bellina
> Support fraction resources for task resource scheduling
Thomas Graves created SPARK-29762:
-
Summary: GPU Scheduling - default task resource amount to 1
Key: SPARK-29762
URL: https://issues.apache.org/jira/browse/SPARK-29762
Project: Spark
Issue Ty
[
https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964360#comment-16964360
]
Thomas Graves edited comment on SPARK-29415 at 10/31/19 8:03 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964360#comment-16964360
]
Thomas Graves edited comment on SPARK-29415 at 10/31/19 7:59 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964360#comment-16964360
]
Thomas Graves commented on SPARK-29415:
---
More details:
TaskResourceRequest - this
Thomas Graves created SPARK-29641:
-
Summary: Stage Level Sched: Add python api's and test
Key: SPARK-29641
URL: https://issues.apache.org/jira/browse/SPARK-29641
Project: Spark
Issue Type: St
[
https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957974#comment-16957974
]
Thomas Graves commented on SPARK-29415:
---
>From a high level design point, this is
[
https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956362#comment-16956362
]
Thomas Graves commented on SPARK-29329:
---
from the linked issue above it sounds lik
[
https://issues.apache.org/jira/browse/SPARK-26154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-26154:
--
Affects Version/s: 3.0.0
> Stream-stream joins - left outer join gives inconsistent output
> -
[
https://issues.apache.org/jira/browse/SPARK-29465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16952617#comment-16952617
]
Thomas Graves commented on SPARK-29465:
---
So I'd be fine with a range of ports. I s
[
https://issues.apache.org/jira/browse/SPARK-29465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16952603#comment-16952603
]
Thomas Graves commented on SPARK-29465:
---
Note the problem I see with just using th
[
https://issues.apache.org/jira/browse/SPARK-29465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16952542#comment-16952542
]
Thomas Graves commented on SPARK-29465:
---
Thanks for copying me, yes agree this wou
[
https://issues.apache.org/jira/browse/SPARK-29148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29148:
-
Assignee: Thomas Graves
> Modify dynamic allocation manager for stage level scheduling
[
https://issues.apache.org/jira/browse/SPARK-29415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29415:
-
Assignee: Thomas Graves
> Stage Level Sched: Add base ResourceProfile and Request class
[
https://issues.apache.org/jira/browse/SPARK-29306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29306:
-
Assignee: Thomas Graves
> Executors need to track what ResourceProfile they are created
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949460#comment-16949460
]
Thomas Graves commented on SPARK-29396:
---
While I do like the idea, do we have som
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29396:
-
Assignee: (was: Thomas Graves)
> Extend Spark plugin interface to driver
>
[
https://issues.apache.org/jira/browse/SPARK-29396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves reassigned SPARK-29396:
-
Assignee: Thomas Graves
> Extend Spark plugin interface to driver
> ---
[
https://issues.apache.org/jira/browse/SPARK-28859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948652#comment-16948652
]
Thomas Graves commented on SPARK-28859:
---
I wouldn't expect users to specify the si
Thomas Graves created SPARK-29417:
-
Summary: Resource Scheduling - add TaskContext.resource java api
Key: SPARK-29417
URL: https://issues.apache.org/jira/browse/SPARK-29417
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-28859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947908#comment-16947908
]
Thomas Graves commented on SPARK-28859:
---
The comment came from the pr you linked t
Thomas Graves created SPARK-29415:
-
Summary: Stage Level Sched: Add base ResourceProfile and Request
classes
Key: SPARK-29415
URL: https://issues.apache.org/jira/browse/SPARK-29415
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943839#comment-16943839
]
Thomas Graves commented on SPARK-29329:
---
filed issue with scala-maven-plugin, we w
[
https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942790#comment-16942790
]
Thomas Graves commented on SPARK-29329:
---
there are few comments on SPARK-28759 in
[
https://issues.apache.org/jira/browse/SPARK-29329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-29329:
--
Description:
It looks like since we Upgraded scala-maven-plugin to 4.2.0
https://issues.apach
[
https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942787#comment-16942787
]
Thomas Graves commented on SPARK-28759:
---
I rolled back this commit and the increme
Thomas Graves created SPARK-29329:
-
Summary: maven incremental builds not working
Key: SPARK-29329
URL: https://issues.apache.org/jira/browse/SPARK-29329
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942308#comment-16942308
]
Thomas Graves edited comment on SPARK-28759 at 10/1/19 9:05 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942308#comment-16942308
]
Thomas Graves commented on SPARK-28759:
---
[~dongjoon] [~hyukjin.kwon] Did either o
Thomas Graves created SPARK-29306:
-
Summary: Executors need to track what ResourceProfile they are
created with
Key: SPARK-29306
URL: https://issues.apache.org/jira/browse/SPARK-29306
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-27396.
---
Assignee: Robert Joseph Evans
Resolution: Fixed
> SPIP: Public APIs for extended Colum
[
https://issues.apache.org/jira/browse/SPARK-27396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16940974#comment-16940974
]
Thomas Graves commented on SPARK-27396:
---
The main objectives have actually already
Thomas Graves created SPARK-29303:
-
Summary: UI updates for stage level scheduling
Key: SPARK-29303
URL: https://issues.apache.org/jira/browse/SPARK-29303
Project: Spark
Issue Type: Story
[
https://issues.apache.org/jira/browse/SPARK-29206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935968#comment-16935968
]
Thomas Graves commented on SPARK-29206:
---
that is definitely not the behavior I was
[
https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-29151:
--
Summary: Support fraction resources for task resource scheduling (was:
Support fraction resou
[
https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-29151:
--
Description:
The current resource scheduling code for GPU/FPGA, etc only supports amounts as
[
https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934419#comment-16934419
]
Thomas Graves commented on SPARK-29151:
---
To keep this simple for a design, I think
[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27495:
--
Epic Name: Stage Level Scheduling
> SPIP: Support Stage level resource configuration and sched
[
https://issues.apache.org/jira/browse/SPARK-27495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-27495:
--
Labels: SPIP (was: )
> SPIP: Support Stage level resource configuration and scheduling
>
Thomas Graves created SPARK-29154:
-
Summary: Update Spark scheduler for stage level scheduling
Key: SPARK-29154
URL: https://issues.apache.org/jira/browse/SPARK-29154
Project: Spark
Issue Typ
301 - 400 of 3514 matches
Mail list logo