[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219555#comment-15219555 ] Anindya Sinha commented on MESOS-3421: -- The design document has been updated as noted in MESOS-4390 based on the feedback received, and further discussions. Here is the link: https://docs.google.com/document/d/18O4SH3H4BQriW6CTrg3TlQTiVC-rBRsMePhz99Y_bss/edit?usp=sharing > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Epic > Components: isolation, volumes >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179595#comment-15179595 ] Adam B commented on MESOS-3421: --- Sounds good. I've gotten busy with other work lately. I'll reassign shepherdship to you. Interested to see what you come up with. > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Epic > Components: isolation, volumes >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179152#comment-15179152 ] Yan Xu commented on MESOS-3421: --- [~adam-mesos] Hi Adam, mind if I take the shepherdship? We've made some changes to the initial design after a few rounds of discussions with [~jvanremoortere] and [~bmahler] and reached some consensus which we'll be sure to share with the community. > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Epic > Components: isolation, volumes >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15138095#comment-15138095 ] Adam B commented on MESOS-3421: --- cc: [~greggomann], who expressed interest in reviewing the design (MESOS-4390) and initial patches (see MESOS-4431) > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Epic > Components: isolation, volumes >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15101579#comment-15101579 ] Adam B commented on MESOS-3421: --- Upgraded this to an Epic and broke the design doc out into its own task. > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Epic > Components: isolation, volumes >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091246#comment-15091246 ] Anindya Sinha commented on MESOS-3421: -- Created the following 2 JIRAs as extensions to shared resources support: MESOS-4324 Allow access to shared persistent volumes as read only or read write by tasks MESOS-4325 Offer shareable resources to frameworks only if it is opted in > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Improvement > Components: general >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086080#comment-15086080 ] Anindya Sinha commented on MESOS-3421: -- Can someone volunteer to shepherd this? > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Improvement > Components: general >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086131#comment-15086131 ] Jie Yu commented on MESOS-3421: --- [~anindya.sinha] So based on the discussion with [~bmahler] and I last time, the consensus was to introduce ShareInfo in Resource and put reference count there so that Resource arithmetics can be properly done. Is that still true for MVP? I would love to shepherd, but I am worried that I don't have enough cycles for that. I'll chat with other committers this week see if they're willing to shepherd this ticket. Sorry about the long delay. > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Improvement > Components: general >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MESOS-3421) Support sharing of resources across task instances
[ https://issues.apache.org/jira/browse/MESOS-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086224#comment-15086224 ] Anindya Sinha commented on MESOS-3421: -- > So based on the discussion with Benjamin Mahler and I last time, the > consensus was to introduce ShareInfo in Resource and put reference count > there so that Resource arithmetics can be properly done. Is that still true > for MVP? Yes, that is correct. > Support sharing of resources across task instances > -- > > Key: MESOS-3421 > URL: https://issues.apache.org/jira/browse/MESOS-3421 > Project: Mesos > Issue Type: Improvement > Components: general >Affects Versions: 0.23.0 >Reporter: Anindya Sinha >Assignee: Anindya Sinha > Labels: external-volumes, persistent-volumes > > A service that needs persistent volume needs to have access to the same > persistent volume (RW) from multiple task(s) instances on the same agent > node. Currently, a persistent volume once offered to the framework(s) can be > scheduled to a task and until that tasks terminates, that persistent volume > cannot be used by another task. > Explore providing the capability of sharing persistent volumes across task > instances scheduled on a single agent node. > Based on discussion within the community, we would allow sharing of resources > in general, and add support to enable shareability for persistent volumes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
