[
https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-27959:
--------------------------------------
Assignee: Thomas Graves
> Change YARN resource configs to use .amount
> -------------------------------------------
>
> Key: SPARK-27959
> URL: https://issues.apache.org/jira/browse/SPARK-27959
> Project: Spark
> Issue Type: Story
> Components: YARN
> Affects Versions: 3.0.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Major
>
> we are adding in generic resource support into spark where we have suffix for
> the amount of the resource so that we could support other configs.
> Spark on yarn already had added configs to request resources via the configs
> spark.yarn.\{executor/driver/am}.resource=<some amount>, where the <some
> amont> is value and unit together. We should change those configs to have a
> .amount suffix on them to match the spark configs and to allow future configs
> to be more easily added. YARN itself already supports tags and attributes so
> if we want the user to be able to pass those from spark at some point having
> a suffix makes sense.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
