[
https://issues.apache.org/jira/browse/TWILL-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13897637#comment-13897637
]
Fabian Murariu commented on TWILL-40:
-------------------------------------
The client API would have 2 new methods in ResourceSpecification .withPath and
.withHosts. I plan to look into withHosts first since it is the easy one since
it doesn't affect the counters and it can be used together with the other
options.
withPath("hdfs://somewhere/far/beyond") is a little tricky since the inputSplit
will return a few hostnames and I'm not sure about the implications on expected
host counters and all that.
> Add a way to specify a hostname or hdfs path in WeaveSpecification
> ------------------------------------------------------------------
>
> Key: TWILL-40
> URL: https://issues.apache.org/jira/browse/TWILL-40
> Project: Apache Twill
> Issue Type: New Feature
> Environment: *
> Reporter: Fabian Murariu
> Priority: Minor
>
> I would like to be able to tell YARN through Weave API on what hosts to
> allocate the containers or by specifying the hdfs path and Weave can deduce
> the hosts via InputSplits.
> Please let me know if there is already a way to do this. If there is not
> I would like to add it myself. I could use some pointers just to get around
> quicker.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)