Port to YARN: GIRAPH and HAMA

2011-09-11 Thread Vinod Kumar Vavilapalli
Crosspost to hama-dev and giraph-dev. It was only in my morning time that I was looking at HAMA-431, the port of Hama to YARN. And one of the tweets reminded me of JIRA issue GIRAPH-13 which is about porting Giraph to YARN. I was also looking at the Girpah proposal for entry into Apache Incubator

Re: Port to YARN: GIRAPH and HAMA

2011-09-14 Thread Vinod Kumar Vavilapalli
Avery, Some replies inline to the issues you outlined. >1) Giraph runs completely as a MapReduce job on Hadoop today. This needs to be maintained to support our current users, who will not likely move to MRv2 for at least a year. I think what you need is to support Giraph's graph API for your u

Giraph-13: Porting Giraph to YARN

2011-09-18 Thread Vinod Kumar Vavilapalli
Hi all, I finished an excursion into Giraph's code and now I kinda know what it takes to port Giraph over to run on top of YARN. When the base Hadoop clusters are replaced by YARN clusters, Giraph will have two options: - *Giraph still works over mapreduce APIs*: Even after moving to YARN clust

[jira] [Commented] (GIRAPH-37) Implement Netty-backed rpc solution

2011-09-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107417#comment-13107417 ] Vinod Kumar Vavilapalli commented on GIRAPH-37: --- Have you thought a