[
https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623901#comment-16623901
]
Wangda Tan commented on YARN-8811:
----------------------------------
Thanks [~cheersyang], [~sunilg] for the design doc.
In general the plan looks good, I have some suggestions regarding to resource
type related changes:
The name "IGNORABLE" is ambiguous, user will be configured about is it
ignorable by main scheduler / nm or app, etc. And from the name it looks like
"no one cares about the resource type".
Instead, I prefer to have a String[] tags added to each ResourceInformation:
* All resource types configured inside resource-types.xml have a tag =
"default".
* All existing methods inside Resource work as-is. And returns "default" tag
only.
* A new method will be added to Resource to get/set ResourceInformation by tags.
* For resource types like volume, admin doesn't need, and shouldn't configure
inside resource-types.xml
* Volume still uses the same COUNTABLE resource type.
* If we want to support per-node disk information report to RM, NM should have
a plugin extends {{...resourceplugin.ResourcePlugin}}.
Above suggestion should require minimum changes to scheduler, minimum overhead
for scheduler to make decisions. (Except we may need to copy the extra volume
information). And in the future if new plugins need to be added to scheduler /
node manager to handle different resource tags, developers can easily do that.
> Support Container Storage Interface (CSI) in YARN
> -------------------------------------------------
>
> Key: YARN-8811
> URL: https://issues.apache.org/jira/browse/YARN-8811
> Project: Hadoop YARN
> Issue Type: New Feature
> Reporter: Weiwei Yang
> Assignee: Weiwei Yang
> Priority: Major
> Attachments: Support Container Storage Interface(CSI) in YARN_design
> doc_20180921.pdf
>
>
> The Container Storage Interface (CSI) is a vendor neutral interface to bridge
> Container Orchestrators and Storage Providers. With the adoption of CSI in
> YARN, it will be easier to integrate 3rd party storage systems, and provide
> the ability to attach persistent volumes for stateful applications.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
