Apologies for missing this completely.

ZK is not a good place to publish a lot of data (specifically dynamic data). I 
think that's one of reason why only the REST endpoint is published to ZK which 
is then used to fetch the export data.

There are discussions going on in the YARN world to create hooks to update DNS 
dynamically based on registry. That would be the most reliable way, I guess.

https://issues.apache.org/jira/browse/YARN-913

-Gour


From: Jatin Kumar <jku...@rocketfuelinc.com<mailto:jku...@rocketfuelinc.com>>
Date: Tuesday, June 9, 2015 at 1:20 AM
To: Gour Saha <gs...@hortonworks.com<mailto:gs...@hortonworks.com>>
Cc: dev 
<dev@slider.incubator.apache.org<mailto:dev@slider.incubator.apache.org>>
Subject: Accessing the application export information from ZooKeeper

Hello Gour & Team,

Thanks for giving a good tool to exploit Yarn resources!

We know that Slider publishes AM RPC details to ZK which can then be used to 
fetch the export information directly from AM over RPC but I am not very sure 
if there is any piece of configuration which can be used to make slider publish 
the export information (ip:port of user app) to ZooKeeper.

If there is not a direct way then one of the many possible ways is that 
provider itself publishes information (ip:port) to ZK. Can you please suggest 
if that would be a reliable way to keep ZK up to date?

--
Thanks,
Jatin

Reply via email to