[
https://issues.apache.org/jira/browse/MAPREDUCE-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519945#comment-14519945
]
Hamza Zafar commented on MAPREDUCE-2911:
----------------------------------------
Hi Guys,
We have written a Hadoop YARN runtime for MPJ Express [1]. MPJ Express is an
open source java based MPI primarily maintained at NUST HPC lab [2]. The code
can be downloaded from the MPJ Express website [3]. Currently the MPI
processes use the MPJ Express's Ethernet based device driver.
Thanks
--Hamza
[1] http://mpjexpress.org/
[2] http://hpc.seecs.nust.edu.pk/
[3] http://mpjexpress.org/news_5.html
> Hamster: Hadoop And Mpi on the same cluSTER
> -------------------------------------------
>
> Key: MAPREDUCE-2911
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2911
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: All Unix-Environments
> Reporter: Milind Bhandarkar
> Original Estimate: 336h
> Remaining Estimate: 336h
>
> MPI is commonly used for many machine-learning applications. OpenMPI
> (http://www.open-mpi.org/) is a popular BSD-licensed version of MPI. In the
> past, running MPI application on a Hadoop cluster was achieved using Hadoop
> Streaming (http://videolectures.net/nipsworkshops2010_ye_gbd/), but it was
> kludgy. After the resource-manager separation from JobTracker in Hadoop, we
> have all the tools needed to make MPI a first-class citizen on a Hadoop
> cluster. I am currently working on the patch to make MPI an
> application-master. Initial version of this patch will be available soon
> (hopefully before September 10.) This jira will track the development of
> Hamster: The application master for MPI.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
