[
https://issues.apache.org/jira/browse/S4-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13502853#comment-13502853
]
Matthieu Morel commented on S4-25:
----------------------------------
Thanks for the feedback Daniel.
I pushed some related updates in commit ba7b94b .
The -Xmx parameter, which is used for setting the "maximum" memory of the
process, can now only be specified through a specific parameter (-s4NodeMemory).
I also asked on yarn-dev whether there is a recommended way to properly kill
applications.
(see
http://mail-archives.apache.org/mod_mbox/hadoop-yarn-dev/201211.mbox/%3CE446FDC3-C0A3-4DA8-8281-A8CD15CC8D52%40yahoo-inc.com%3E
)
> Write S4 Application Master to deploy S4 in Yarn
> ------------------------------------------------
>
> Key: S4-25
> URL: https://issues.apache.org/jira/browse/S4-25
> Project: Apache S4
> Issue Type: New Feature
> Reporter: J Mohamed Zahoor
> Fix For: 0.6
>
> Attachments: S4-ApplicationMaster.diff, S4-Client.diff,
> S4-Constants.diff, S4-YARN-1.patch
>
>
> On the lines of s4PigWrapper, write a s4 application master to host s4 piper
> inside Hadoop Yarn. This could be useful not only for reading data stored in
> hadoop ( to build or train a model)... But we could make use of the resource
> manager to deploy s4 instances in remote machine and monitor them. In short,
> we could make use of most of the resource management , scheduling and other
> good stuff in Yarn.
> - Yarn is useful to deploy and launch s4 instances.
> - It still requires deploying node managers on each box which means it will
> be useful if one is running more than one s4 process on a node.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
