[ 
https://issues.apache.org/jira/browse/TWILL-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13897637#comment-13897637
 ] 

Fabian Murariu commented on TWILL-40:
-------------------------------------

The client API would have 2 new methods in ResourceSpecification .withPath and 
.withHosts. I plan to look into withHosts first since it is the easy one since 
it doesn't affect the counters and it can be used together with the other 
options. 

withPath("hdfs://somewhere/far/beyond") is a little tricky since the inputSplit 
will return a few hostnames and I'm not sure about the implications on expected 
host counters and all that.

> Add a way to specify a hostname or hdfs path in WeaveSpecification
> ------------------------------------------------------------------
>
>                 Key: TWILL-40
>                 URL: https://issues.apache.org/jira/browse/TWILL-40
>             Project: Apache Twill
>          Issue Type: New Feature
>         Environment: *
>            Reporter: Fabian Murariu
>            Priority: Minor
>
> I would like to be able to tell YARN through Weave API on what hosts to
> allocate the containers or by specifying the hdfs path and Weave can deduce
> the hosts via InputSplits.
> Please let me know if there is already a way to do this. If there is not
> I would like to add it myself. I could use some pointers just to get around 
> quicker.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to