Giraph-13: Porting Giraph to YARN

2011-09-18 Thread Vinod Kumar Vavilapalli
Hi all, I finished an excursion into Giraph's code and now I kinda know what it takes to port Giraph over to run on top of YARN. When the base Hadoop clusters are replaced by YARN clusters, Giraph will have two options: - *Giraph still works over mapreduce APIs*: Even after moving to YARN

[jira] [Commented] (GIRAPH-37) Implement Netty-backed rpc solution

2011-09-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107417#comment-13107417 ] Vinod Kumar Vavilapalli commented on GIRAPH-37: --- Have you thought about

[jira] [Commented] (GIRAPH-37) Implement Netty-backed rpc solution

2011-09-18 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107429#comment-13107429 ] Avery Ching commented on GIRAPH-37: --- I don't know what Jakob has planned for security,

[jira] [Updated] (GIRAPH-32) Implement benchmarks to evaluate the performance of message passing

2011-09-18 Thread Hyunsik Choi (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyunsik Choi updated GIRAPH-32: --- Attachment: GIRAPH-32_2.patch Good idea! According to which InputFormat we use, we could choose the

[jira] [Commented] (GIRAPH-37) Implement Netty-backed rpc solution

2011-09-18 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107455#comment-13107455 ] Jakob Homan commented on GIRAPH-37: --- I'll take a look at Finagle. Security probably

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

2011-09-18 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107513#comment-13107513 ] Christian Kunz commented on GIRAPH-38: -- I intend to follow the procedure outlined in

[jira] [Created] (GIRAPH-38) Change of website in team-list.html

2011-09-18 Thread Christian Kunz (JIRA)
Change of website in team-list.html --- Key: GIRAPH-38 URL: https://issues.apache.org/jira/browse/GIRAPH-38 Project: Giraph Issue Type: Improvement Components: site Reporter: Christian

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

2011-09-18 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107527#comment-13107527 ] Avery Ching commented on GIRAPH-38: --- You'll also need to change the check in the pom.xml

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

2011-09-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107528#comment-13107528 ] Hudson commented on GIRAPH-38: -- Integrated in Giraph-trunk-Commit #8 (See

Re: Giraph-13: Porting Giraph to YARN

2011-09-18 Thread Avery Ching
Hi Vinod, Thank you for your thoughts. It would be great if your comments were put on GIRAPH-13 so they aren't lost. You and Jakob should sync up to see how to proceed on this. Avery On 9/18/11 7:37 AM, Vinod Kumar Vavilapalli wrote: Hi all, I finished an excursion into Giraph's code

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

2011-09-18 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107535#comment-13107535 ] Christian Kunz commented on GIRAPH-38: -- Right, that's the actual source. Thanks for

Re: [jira] [Commented] (GIRAPH-37) Implement Netty-backed rpc solution

2011-09-18 Thread Dmitriy Ryaboy
Note that finagle is not thrift specific. It's rpc protocol agnostic. We can make a finagle-hadooprpc connector. Granted, the thrift implementation is pretty hardened. Actually the fact that finagle is independent of rpc frework may be another reason to use it -- flip between hadooprpc and thrift