[ 
https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16632927#comment-16632927
 ] 

Weiwei Yang commented on YARN-8811:
-----------------------------------

Hi [~eyang]

For volume mounts, user will only need to provide the destination mount, see 
the "mountPoint" attribute in following example,
{code:java}
yarn.io/nfs-volume {
  size : 100,
  unit: Gi,
  ResourceType: countable,
  tags : [“externalVolume”], 
  attributes : {
    driver: “nfs-csi-driver”,
    mountPoint: “/mnt/amt”,
    accessMode: “readonly”,
    volumeId: "xxx"
  }
}
{code}
this mount point will be created in the docker container. YARN will generate an 
unique source mount on local disk, for example 
{{/hadoop-data/yarn/local/usercache/wwei/filecache/container_1536560680767_0001_01_000005_volume-xyz_mount}}.
 So in this example, it looks like following

{code}
Destination: /mnt/amt
Source: 
/hadoop-data/yarn/local/usercache/wwei/filecache/container_1536560680767_0001_01_000005_volume-xyz_mount
{code}

bq. Can we define a way to pass storage specific options such as noatime, 
nosuid flags similar to 4th column in /etc/fstab

We are not going to expose those mount options in volume resource, what can be 
specified in volume attributes are limited to the options supported by CSI 
drivers, per CSI spec. This is because CSI driver covers the complexity of 
creating/publishing/mounting volumes for YARN.

Hope that makes sense. Thanks


> Support Container Storage Interface (CSI) in YARN
> -------------------------------------------------
>
>                 Key: YARN-8811
>                 URL: https://issues.apache.org/jira/browse/YARN-8811
>             Project: Hadoop YARN
>          Issue Type: New Feature
>            Reporter: Weiwei Yang
>            Assignee: Weiwei Yang
>            Priority: Major
>         Attachments: Support Container Storage Interface(CSI) in YARN_design 
> doc_20180921.pdf, Support Container Storage Interface(CSI) in YARN_design 
> doc_20180928.pdf
>
>
> The Container Storage Interface (CSI) is a vendor neutral interface to bridge 
> Container Orchestrators and Storage Providers. With the adoption of CSI in 
> YARN, it will be easier to integrate 3rd party storage systems, and provide 
> the ability to attach persistent volumes for stateful applications.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to