Re: Hadoop + MPI

2011-11-28 Thread Milind.Bhandarkar
Great ! Works for me ! Thanks Ralph. - Milind --- Milind Bhandarkar Greenplum Labs, EMC (Disclaimer: Opinions expressed in this email are those of the author, and do not necessarily represent the views of any organization, past or present, the author might be affiliated with.) On 11/23/11

Re: Hadoop + MPI

2011-11-23 Thread Ralph Castain
FWIW: I can commit the OMPI part of your patch for you. The CCLA is intended to ensure that people realize the need to protect OMPI from infection due to code based on other licenses such as GPL. For people only offering a single patch, it often is too big a burden to get corporate approval of

Re: Hadoop + MPI

2011-11-23 Thread Arun Murthy
Awesome, thanks to both you guys! It's very exciting to see this progress! Arun Sent from my iPhone On Nov 23, 2011, at 5:14 PM, Ralph Castain r...@open-mpi.org wrote: FWIW: I can commit the OMPI part of your patch for you. The CCLA is intended to ensure that people realize the need to

Re: Hadoop + MPI

2011-11-21 Thread Arun C Murthy
Hi Ralph, Welcome! We'd absolutely love to have OpenMPI integrated with Hadoop! In fact, there already has been a bunch of discussions running OpenMPI on what we call MR2 (aka YARN), documented here: https://issues.apache.org/jira/browse/MAPREDUCE-2911. YARN is our effort to re-imagine

Re: Hadoop + MPI

2011-11-21 Thread Ralph Castain
On Nov 21, 2011, at 4:43 PM, Arun C Murthy wrote: Hi Ralph, Welcome! We'd absolutely love to have OpenMPI integrated with Hadoop! In fact, there already has been a bunch of discussions running OpenMPI on what we call MR2 (aka YARN), documented here:

Re: Hadoop + MPI

2011-11-21 Thread Mahadev Konar
Milind, Great news. Any chance you can upload a patch as it is? I am sure, others can help cleaning it up. I am willing to help smoothen it out and am sure Ralph can provide feedback as well. thanks mahadev On Mon, Nov 21, 2011 at 3:47 PM, milind.bhandar...@emc.com wrote: Hi Ralph, I spoke

Re: Hadoop + MPI

2011-11-21 Thread Ralph Castain
Hi Milind Glad to hear of the progress - I recall our earlier conversation. I gather you have completed step 1 (wireup) - have you given any thought to the other two steps? Anything I can do to help? Ralph On Nov 21, 2011, at 4:47 PM, milind.bhandar...@emc.com wrote: Hi Ralph, I spoke

Re: Hadoop + MPI

2011-11-21 Thread Milind.Bhandarkar
Ralph, Yes, I have completed the first step, although I would really like that code to be part of the MPI Application Master (Chris Douglas suggested a way to do this at ApacheCon). Regarding the remaining steps, I have been following discussions on the open mpi mailing lists, and reading code

Re: Hadoop + MPI

2011-11-21 Thread Ralph Castain
On Nov 21, 2011, at 5:04 PM, milind.bhandar...@emc.com wrote: Ralph, Yes, I have completed the first step, although I would really like that code to be part of the MPI Application Master (Chris Douglas suggested a way to do this at ApacheCon). Regarding the remaining steps, I have been