[
https://issues.apache.org/jira/browse/SPARK-29151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves resolved SPARK-29151.
-----------------------------------
Fix Version/s: 3.0.0
Resolution: Fixed
> Support fraction resources for task resource scheduling
> -------------------------------------------------------
>
> Key: SPARK-29151
> URL: https://issues.apache.org/jira/browse/SPARK-29151
> Project: Spark
> Issue Type: Story
> Components: Scheduler
> Affects Versions: 3.0.0
> Reporter: Thomas Graves
> Assignee: Alessandro Bellina
> Priority: Major
> Fix For: 3.0.0
>
>
> The current resource scheduling code for GPU/FPGA, etc only supports amounts
> as integers, so you can only schedule whole resources. There are cases where
> you may want to share the resources and schedule multiple tasks to run on the
> same resources (GPU). It would be nice to support fractional resources for
> the task level settings. Somehow say we want a task to have 1/4 of a GPU for
> instance. I think we only want to support fractional when the resources
> amount is < 1. Otherwise you run into issues where someone asks for 2 1/8
> GPU, which doesn't really make sense to me and makes assigning addresses very
> complicated.
> Need to think about implementation details, for instance using a float can be
> troublesome here due to floating point math precision issues.
> Another thing to consider, depending on implementation is limiting the
> precision - go down to tenths, hundreths, thousandths, etc.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
