Thomas Graves created SPARK-30446:
-------------------------------------
Summary: Accelerator aware scheduling checkResourcesPerTask
doesn't cover all cases
Key: SPARK-30446
URL: https://issues.apache.org/jira/browse/SPARK-30446
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 3.0.0
Reporter: Thomas Graves
with accelerator aware scheduling SparkContext.checkResourcesPerTask
Tries to make sure that users have configured things properly and warn or error
if not.
It doesn't properly handle all cases like warning if cpu resources are being
wasted. We should test this better and handle those.
I fixed these in the stage level scheduling but not sure the timeline on
getting that in so we may want to fix this separately as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
