Hamster: Hadoop And Mpi on the same cluSTER
-------------------------------------------
Key: MAPREDUCE-2911
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2911
Project: Hadoop Map/Reduce
Issue Type: New Feature
Components: mrv2
Affects Versions: 0.23.0
Environment: All Unix-Environments
Reporter: Milind Bhandarkar
Assignee: Milind Bhandarkar
Fix For: 0.23.0
MPI is commonly used for many machine-learning applications. OpenMPI
(http://www.open-mpi.org/) is a popular BSD-licensed version of MPI. In the
past, running MPI application on a Hadoop cluster was achieved using Hadoop
Streaming (http://videolectures.net/nipsworkshops2010_ye_gbd/), but it was
kludgy. After the resource-manager separation from JobTracker in Hadoop, we
have all the tools needed to make MPI a first-class citizen on a Hadoop
cluster. I am currently working on the patch to make MPI an application-master.
Initial version of this patch will be available soon (hopefully before
September 10.) This jira will track the development of Hamster: The application
master for MPI.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
