On Mon, May 28, 2012 at 12:00:24PM -0400, Prakashan Korambath wrote:
This is how we run hadoop using Grid Engine (for that matter any scheduler with appropriate alteration) http://www.ats.ucla.edu/clusters/hoffman2/hadoop/default.htm Basically, run either a prolog or call a script inside the submission command file itself to parse the output of PE_HOSTFILE to create hadoop *.site.xml, masters and slaves files at run time. This methodology is suitable for any scheduler as it is not dependent on them. If there is interest I can post the prologue script. Thanks.
Please do. -- Jesse Becker NHGRI Linux support (Digicon Contractor) Specialization is for insects. -- R.A.Heinlein _______________________________________________ users mailing list [email protected] https://gridengine.org/mailman/listinfo/users
