[
https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927354#comment-15927354
]
Konstantinos Karanasos commented on YARN-6345:
----------------------------------------------
Hi [~vinodkv], thanks for the comments.
bq. We should add allocation-tags instead of container-tags. HBaseMaster can
run in multiple containers over its life-cycle. Yes, today allocation =
container. But that is changing very quickly - ref YARN-4726. Further, the
placement request usually is "place me close to HBaseMaster", not "place me
close to this container-id" - a subtle but important difference.
I agree. The way I phrased it was probably not very clear. The container tags
are not scoped to specific containers. So, you can have an "hbase" tag or an
"hbase-master" tag or even a "latency-critical" tag. Then multiple containers
can share the same tags, and by using a tag you can refer to multiple
containers at once. I used the notion of "container tags" in the sense that we
can attach tags to containers, not in the sense of scope. But I am happy to
change the name, if it is confusing.
bq. API design: We should not add it to existing ResourceRequest object.
I hear your concern. I am only a bit worried about changing significantly the
API. Let me think a bit about it in more detail.
> Add container tags to resource requests
> ---------------------------------------
>
> Key: YARN-6345
> URL: https://issues.apache.org/jira/browse/YARN-6345
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Reporter: Konstantinos Karanasos
>
> This JIRA introduces the notion of container tags.
> When an application submits container requests, it is allowed to attach to
> them a set of string tags. The corresponding resource requests will also
> carry these tags.
> For example, a container that will be used for running an HBase Master can be
> marked with the tag "hb-m". Another one belonging to a ZooKeeper application,
> can be marked as "zk".
> Through container tags, we will be able to express constraints that refer to
> containers with the given tags.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
