[
https://issues.apache.org/jira/browse/TWILL-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13897735#comment-13897735
]
Terence Yim commented on TWILL-40:
----------------------------------
It goes more complicated than that. Just couple points I can think of now.
1. A given TwillRunnable could have multiple instances running and that may not
match with the number of static hosts list being specified. Also, the number of
instances allows to be changed dynamically and we have to define the placement
behavior under different conditions.
2. The hosts list should be hint only, as it's possible that the given host is
temporarily down or out of containers. The fallback behavior needs to be
defined.
> Add a way to specify a hostname or hdfs path in WeaveSpecification
> ------------------------------------------------------------------
>
> Key: TWILL-40
> URL: https://issues.apache.org/jira/browse/TWILL-40
> Project: Apache Twill
> Issue Type: New Feature
> Environment: *
> Reporter: Fabian Murariu
> Priority: Minor
>
> I would like to be able to tell YARN through Weave API on what hosts to
> allocate the containers or by specifying the hdfs path and Weave can deduce
> the hosts via InputSplits.
> Please let me know if there is already a way to do this. If there is not
> I would like to add it myself. I could use some pointers just to get around
> quicker.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
