I put my scripts in a tar file and send it to Rayson
yesterday so that he can put it in a common place to download.
Prakashan
On 05/29/2012 07:18 AM, Jesse Becker wrote:
On Mon, May 28, 2012 at 12:00:24PM -0400, Prakashan
Korambath wrote:
This is how we run hadoop using Grid Engine (for that matter
any scheduler with appropriate alteration)
http://www.ats.ucla.edu/clusters/hoffman2/hadoop/default.htm
Basically, run either a prolog or call a script inside the
submission command file itself to parse the output of
PE_HOSTFILE to create hadoop *.site.xml, masters and slaves
files at run time. This methodology is suitable for any
scheduler as it is not dependent on them. If there is
interest I can post the prologue script. Thanks.
Please do.
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users