[jira] [Commented] (GIRAPH-96) Support for Graphs with Huge adjacency lists

2011-11-17 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13152203#comment-13152203 ] Avery Ching commented on GIRAPH-96: --- The general issue of overloading our memory

[jira] [Commented] (GIRAPH-84) Simplify boolean expressions in BspRecordReader

2011-11-17 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-84?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13152488#comment-13152488 ] Avery Ching commented on GIRAPH-84: --- ternary is fine with me. I think we use

[jira] [Commented] (GIRAPH-68) Implement a Graph Generator

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13151405#comment-13151405 ] Avery Ching commented on GIRAPH-68: --- Looks good Hyunsik, a few comments. Probably want

Re: Review Request: GIRAPH-89: Remove debugging system.out from LongDoubleFloatDoubleVertex

2011-11-16 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2859/#review3304 --- Ship it! - Avery On 2011-11-16 20:20:09, shaunak wrote:

[jira] [Created] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Created) (JIRA)
Project: Giraph Issue Type: Improvement Reporter: Avery Ching Current vertex implementation uses a HashMap for storing the edges, which is quite memory heavy for large graphs. The default settings in Giraph need to be improved for large graphs and heaps of 20G

[jira] [Updated] (GIRAPH-86) Simplify boolean expressions in ZooKeeperExt::createExt

2011-11-16 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-86?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-86: -- Attachment: pom.diff See if this helps you...if so, please add to your patch

[jira] [Updated] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-91: -- Attachment: GIRAPH-91.diff Sure, sorry about that. Large-memory improvements (Memory

[jira] [Commented] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13151603#comment-13151603 ] Avery Ching commented on GIRAPH-91: --- By the way, rb allows you to download the diff

[jira] [Commented] (GIRAPH-92) Need outputformat for just vertex ID and value

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13151736#comment-13151736 ] Avery Ching commented on GIRAPH-92: --- I agree this could be useful. Couple of format

[jira] [Commented] (GIRAPH-78) Be smarter about multiple instances of the same vertex

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13151782#comment-13151782 ] Avery Ching commented on GIRAPH-78: --- Actually the more I think about it, this might

[jira] [Created] (GIRAPH-93) Hive input / output format

2011-11-16 Thread Avery Ching (Created) (JIRA)
Hive input / output format -- Key: GIRAPH-93 URL: https://issues.apache.org/jira/browse/GIRAPH-93 Project: Giraph Issue Type: New Feature Reporter: Avery Ching Assignee: Avery Ching It would

[jira] [Commented] (GIRAPH-91) Large-memory improvements (Memory reduced vertex implementation, fast failure, added settings)

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13151844#comment-13151844 ] Avery Ching commented on GIRAPH-91: --- Arun, we can certainly try other data structure

[jira] [Commented] (GIRAPH-93) Hive input / output format

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13151848#comment-13151848 ] Avery Ching commented on GIRAPH-93: --- I think RCFile initially, then other formats in Hive

[jira] [Commented] (GIRAPH-93) Hive input / output format

2011-11-16 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13151866#comment-13151866 ] Avery Ching commented on GIRAPH-93: --- Specifically, we have a lot of data stored in Hive

[jira] [Commented] (GIRAPH-74) GIRAPH-36 missed a couple of liners when passing from Vertex to BasicVertex

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13150663#comment-13150663 ] Avery Ching commented on GIRAPH-74: --- Claudio, are you synced to svn? The commit

[jira] [Commented] (GIRAPH-61) Worker's early failure will cause the whole system fail

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-61?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13150668#comment-13150668 ] Avery Ching commented on GIRAPH-61: --- Currently, the master knows whenever an active

[jira] [Commented] (GIRAPH-78) Be smarter about multiple instances of the same vertex

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-78?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13150673#comment-13150673 ] Avery Ching commented on GIRAPH-78: --- +1, this would be a great memory optimization

Re: Did GIRAPH-11 break vertex reactivation?

2011-11-15 Thread Avery Ching
Yes, I think I broke it. Sorry. Let me get you a diff to test quickly. Avery On 11/15/11 12:42 PM, Sebastian Schelter wrote: Hi, I updated to the latest trunk (after the GIRAPH-11 commit) and wanted to continue to work on GIRAPH-51 where I use a small toy graph to test

Re: Did GIRAPH-11 break vertex reactivation?

2011-11-15 Thread Avery Ching
This should fix it. It passed local unittests. Let me know. Avery On 11/15/11 1:03 PM, Avery Ching wrote: Yes, I think I broke it. Sorry. Let me get you a diff to test quickly. Avery On 11/15/11 12:42 PM, Sebastian Schelter wrote: Hi, I updated to the latest trunk (after the GIRAPH-11

[jira] [Commented] (GIRAPH-45) Improve the way to keep outgoing messages

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13150864#comment-13150864 ] Avery Ching commented on GIRAPH-45: --- It's going to be a bit complicated to store

[jira] [Commented] (GIRAPH-83) Is Vertex correct yet?

2011-11-15 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13150867#comment-13150867 ] Avery Ching commented on GIRAPH-83: --- While you can decouple everything from vertex, I

[jira] [Commented] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-11-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13149876#comment-13149876 ] Avery Ching commented on GIRAPH-80: --- Since public abstract void compute(IteratorM

[jira] [Commented] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-11-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13149891#comment-13149891 ] Avery Ching commented on GIRAPH-80: --- Seems reasonable to me. Having the option

Re: Review Request: GIRAPH-11 : Improve the graph distribution of Giraph

2011-11-14 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2788/#review3211 --- On 2011-11-14 22:24:27, Avery Ching wrote: --- This is an automatically generated e-mail

Re: Review Request: GIRAPH-11 : Improve the graph distribution of Giraph

2011-11-13 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/2788/ --- (Updated 2011-11-14 06:56:19.251685) Review request for giraph. Changes

Re: better way to update site?

2011-11-11 Thread Avery Ching
+1. Having the pre-generated files in svn is good enough for me. Avery On 11/11/11 1:36 PM, Jakob Homan wrote: As Avery documented in GIRAPH-36

Re: Newbie wanting to get involved with Giraph development

2011-11-10 Thread Avery Ching
Claudio gave great advice. The only thing I'd like to add is that you also might want to consider using reviewboard for throwing up patches (https://reviews.apache.org/) as it helps to get line-by-line comments and suggestions. Definitely email the mailing lists if you have questions and

[jira] [Commented] (GIRAPH-73) A little refactoring

2011-11-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-73?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13147913#comment-13147913 ] Avery Ching commented on GIRAPH-73: --- Hi Sebastian, Thanks for the refactoring

[jira] [Commented] (GIRAPH-74) GIRAPH-36 missed a couple of liners when passing from Vertex to BasicVertex

2011-11-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13147975#comment-13147975 ] Avery Ching commented on GIRAPH-74: --- Well, if you vote to halt, your compute() is never

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-09 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Attachment: GIRAPH-11.diff Here's the diff for those of you who don't like reviewboard

[jira] [Commented] (GIRAPH-11) Improve the graph distribution of Giraph

2011-11-09 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13147226#comment-13147226 ] Avery Ching commented on GIRAPH-11: --- I started it so long ago that the merge was brutal

[jira] [Updated] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-08 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-47: -- Attachment: GIRAPH-47.final Here's the final diff. Sorry about forgetting to attach

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13145694#comment-13145694 ] Avery Ching commented on GIRAPH-47: --- Sorry, Claudio, my bad. I still had remnants

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13145868#comment-13145868 ] Avery Ching commented on GIRAPH-47: --- +1 Thanks Claudio. I'm going to commit on your

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13145879#comment-13145879 ] Avery Ching commented on GIRAPH-47: --- I filed issue https://issues.apache.org/jira/browse

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-11-05 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13144735#comment-13144735 ] Avery Ching commented on GIRAPH-47: --- I agree with the proxy approach of WorkerContext so

[jira] [Commented] (GIRAPH-72) Running multiple Giraph jobs on the same cluster can lead to port collisions

2011-11-03 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-72?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13142870#comment-13142870 ] Avery Ching commented on GIRAPH-72: --- Ah, you can set the base rpc port by the way, sorry

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-11-02 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13141965#comment-13141965 ] Avery Ching commented on GIRAPH-36: --- +1. Jake, just re-ran with your new patch. Passed

[jira] [Updated] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-11-02 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-36: -- Attachment: GIRAPH-36.diff.warnings Revised version of Jake's patch, addressing the warnings in src

Re: Review Request: GIRAPH-64 Create VertexRunner to make it easier to run users' computations

2011-11-02 Thread Avery Ching
the whole diff? Seems like it's missing stuff. Only has GraphMapper.java changes and pom.xml... - Jake On November 3rd, 2011, 2:29 a.m., Avery Ching wrote: Review request for giraph and Jake Mannix. By Avery Ching. *Updated 2011-11-03 02:29:54* Description This is filed on behalf of Jakob

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-11-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13140974#comment-13140974 ] Avery Ching commented on GIRAPH-36: --- Regarding 1) I think it would be safer for use

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-11-01 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13141573#comment-13141573 ] Avery Ching commented on GIRAPH-36: --- Since this is a somewhat large change, can you also

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-10-31 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13140279#comment-13140279 ] Avery Ching commented on GIRAPH-36: --- Jake, Your suggestion on 1) will work, but couldn't

Re: [jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-10-31 Thread Avery Ching
I'd also like to hear the use case. Currently we don't dump messages in the vertex output format, but maybe there is a similar case to do so? Avery On 10/31/11 11:46 AM, Jake Mannix wrote: Well I guess that gives us one reason to keep it in the API. What's the reasoning? Are there static

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-10-30 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13139871#comment-13139871 ] Avery Ching commented on GIRAPH-36: --- Tried out your stuff Jake. Unittests passed for me

[jira] [Updated] (GIRAPH-66) Add presentations section to website

2011-10-26 Thread Avery Ching (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-66?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-66: -- Attachment: 2011.10.14.hortonworks.pptx Here's the most recent presentation I gave @HortonWorks on 10

[jira] [Commented] (GIRAPH-66) Add presentations section to website

2011-10-26 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13136402#comment-13136402 ] Avery Ching commented on GIRAPH-66: --- Actually, let me add it to slideshare and do

[jira] [Commented] (GIRAPH-66) Add presentations section to website

2011-10-26 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13136428#comment-13136428 ] Avery Ching commented on GIRAPH-66: --- +1 on your patch. I totally misunderstood what

[jira] [Commented] (GIRAPH-53) Unable to read additional data from server session, likely server has closed socket

2011-10-24 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-53?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13134723#comment-13134723 ] Avery Ching commented on GIRAPH-53: --- No, the map tasks are held for the duration

[jira] [Commented] (GIRAPH-58) Update site with Arun Suresh's updated Id and Email

2011-10-17 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-58?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13129063#comment-13129063 ] Avery Ching commented on GIRAPH-58: --- +1. Looks good to me. =) You'll need to follow

[jira] [Commented] (GIRAPH-53) Unable to read additional data from server session, likely server has closed socket

2011-10-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-53?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13127626#comment-13127626 ] Avery Ching commented on GIRAPH-53: --- Thanks for reporting the issue. A few questions: 1

[jira] [Commented] (GIRAPH-53) Unable to read additional data from server session, likely server has closed socket

2011-10-14 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-53?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13127702#comment-13127702 ] Avery Ching commented on GIRAPH-53: --- Also, I wonder if it's related to the counter issues

[jira] [Commented] (GIRAPH-52) There should be a scheme to limit the counter

2011-10-13 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-52?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13127169#comment-13127169 ] Avery Ching commented on GIRAPH-52: --- Here's a related issue https://issues.apache.org

[jira] [Commented] (GIRAPH-47) Export Worker's Context/State to vertices through pre/post/Application/Superstep

2011-10-11 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-47?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13125217#comment-13125217 ] Avery Ching commented on GIRAPH-47: --- I was thinking about the later approach that you

[jira] [Commented] (GIRAPH-48) All tests failing under non-secure build

2011-10-10 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123935#comment-13123935 ] Avery Ching commented on GIRAPH-48: --- Yeah, Eclipse automatically does that. The main

[jira] [Commented] (GIRAPH-49) Create automated multi-build test

2011-10-07 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13123304#comment-13123304 ] Avery Ching commented on GIRAPH-49: --- This would be nice. Not sure about fb, since it's

Re: [jira] [Commented] (GIRAPH-10) Aggregators are not exported

2011-09-30 Thread Avery Ching
at 9:49 PM, Avery Ching (Commented) (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/GIRAPH-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13117569#comment-13117569 ] Avery Ching commented on GIRAPH-10

[jira] [Commented] (GIRAPH-10) Aggregators are not exported

2011-09-29 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-10?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13117569#comment-13117569 ] Avery Ching commented on GIRAPH-10: --- This is definitely an open question here. Here's

Re: Unit tests on real hadoop cluster

2011-09-29 Thread Avery Ching
Actually, to be fair, I've only executed the distributed unittests on my own local Hadoop instance. I just ran the Hadoop unittests against trunk on my local machine to check mvn test -Dprop.mapred.job.tracker=localhost:50300 snip Results : Tests run: 27, Failures: 0, Errors: 0, Skipped: 0

[jira] [Commented] (GIRAPH-43) GiraphJob: Counter Limit is not set

2011-09-29 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-43?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13117891#comment-13117891 ] Avery Ching commented on GIRAPH-43: --- Yeah, this kind of sucks. One thing we could do

[jira] [Commented] (GIRAPH-12) Investigate communication improvements

2011-09-28 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13116259#comment-13116259 ] Avery Ching commented on GIRAPH-12: --- I wonder if Runtime methods measure the stack sizes

[jira] [Commented] (GIRAPH-12) Investigate communication improvements

2011-09-28 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13117011#comment-13117011 ] Avery Ching commented on GIRAPH-12: --- If the default stack size is 1 MB, then for instance

[jira] [Commented] (GIRAPH-12) Investigate communication improvements

2011-09-26 Thread Avery Ching (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13115239#comment-13115239 ] Avery Ching commented on GIRAPH-12: --- Are hadoop metrics better than simply using Runtime

[jira] [Issue Comment Edited] (GIRAPH-12) Investigate communication improvements

2011-09-21 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13109715#comment-13109715 ] Avery Ching edited comment on GIRAPH-12 at 9/21/11 5:56 PM

[jira] [Created] (GIRAPH-40) Adding checkstyle enforcement of Giraph code conventions

2011-09-19 Thread Avery Ching (JIRA)
Reporter: Avery Ching Priority: Minor Now that we have some code conventions (see GIRAPH-21), we should enforce them with a maven checkstyle plugin. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (GIRAPH-38) Change of website in team-list.html

2011-09-18 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-38?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107527#comment-13107527 ] Avery Ching commented on GIRAPH-38: --- You'll also need to change the check in the pom.xml

[jira] [Commented] (GIRAPH-32) Implement benchmarks to evaluate the performance of message passing

2011-09-17 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-32?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107188#comment-13107188 ] Avery Ching commented on GIRAPH-32: --- +1, only minor comment

[jira] [Commented] (GIRAPH-12) Investigate communication improvements

2011-09-17 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107189#comment-13107189 ] Avery Ching commented on GIRAPH-12: --- I am assigned? Huh?? Investigate communication

[jira] [Commented] (GIRAPH-35) Modifying the site to indicated that Jake Mannix and Dmitriy Ryaboy are now Giraph committers

2011-09-17 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-35?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107195#comment-13107195 ] Avery Ching commented on GIRAPH-35: --- Just to document what I did, after the pom.xml

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-09-17 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107286#comment-13107286 ] Avery Ching commented on GIRAPH-36: --- The reason for the current VertexReader API

[jira] [Updated] (GIRAPH-11) Improve the graph distribution of Giraph

2011-09-17 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-11: -- Affects Version/s: 0.70.0 Improve the graph distribution of Giraph

[jira] [Commented] (GIRAPH-36) Ensure that subclassing BasicVertex is possible by user apps

2011-09-17 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13107350#comment-13107350 ] Avery Ching commented on GIRAPH-36: --- There is an out-of-core part as well though

Review Request: GIRAPH-34 Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-16 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1932/ --- Review request for giraph. Summary --- The problem shows up when messages

[jira] [Commented] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-16 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13106684#comment-13106684 ] Avery Ching commented on GIRAPH-34: --- I've figured it out! Can someone please review

[jira] [Commented] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-16 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13106739#comment-13106739 ] Avery Ching commented on GIRAPH-34: --- Suppose for example, they send their vertex value

Re: Review Request: GIRAPH-34 Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-16 Thread Avery Ching
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/1932/ --- (Updated 2011-09-16 20:09:21.003725) Review request for giraph. Changes

[jira] [Commented] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-16 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13106779#comment-13106779 ] Avery Ching commented on GIRAPH-34: --- Making the message immutable, is that more than

[jira] [Commented] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-16 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13106798#comment-13106798 ] Avery Ching commented on GIRAPH-34: --- Jake your thoughts on the current diff? My next

[jira] [Resolved] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-16 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching resolved GIRAPH-34. --- Resolution: Fixed I've committed with +1's from Dmitriy and Jake. We can think about a better way

[jira] [Commented] (GIRAPH-11) Improve the graph distribution of Giraph

2011-09-16 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-11?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13106839#comment-13106839 ] Avery Ching commented on GIRAPH-11: --- Hi Severin, as far as getting started, feel free

Re: Vertex serialization

2011-09-15 Thread Avery Ching
It should probably be ints instead of longs for now. I think I was thinking of day when it might be possible to have more than Integer.MAX_VALUE edges or messages. But that would break this current implementation anyway. Avery On 9/15/11 4:49 AM, Claudio Martella wrote: Hello, I've

[jira] [Created] (GIRAPH-35) Modifying the site to indicated that Jake Mannix and Dmitriy Ryaboy are now Giraph committers

2011-09-15 Thread Avery Ching (JIRA)
Project: Giraph Issue Type: Task Reporter: Avery Ching Assignee: Avery Ching Attachments: GIRAPH-35.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (GIRAPH-35) Modifying the site to indicated that Jake Mannix and Dmitriy Ryaboy are now Giraph committers

2011-09-15 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-35?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-35: -- Attachment: GIRAPH-35.patch Modifying the site to indicated that Jake Mannix and Dmitriy Ryaboy

[jira] [Commented] (GIRAPH-35) Modifying the site to indicated that Jake Mannix and Dmitriy Ryaboy are now Giraph committers

2011-09-15 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-35?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13105794#comment-13105794 ] Avery Ching commented on GIRAPH-35: --- Temporary link to the newly generated site. I'll

[jira] [Commented] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-15 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13105853#comment-13105853 ] Avery Ching commented on GIRAPH-34: --- In the meantime, using StaticBalancer will prevent

[jira] [Updated] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-15 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-34: -- Attachment: GIRAPH-34.patch Try running the unittests against an actual Hadoop instance (i.e. if you

[jira] [Issue Comment Edited] (GIRAPH-34) Failure of Vertex reflection for putVertexList from GIRAPH-27

2011-09-15 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13105876#comment-13105876 ] Avery Ching edited comment on GIRAPH-34 at 9/16/11 5:53 AM: Try

Re: Port to YARN: GIRAPH and HAMA

2011-09-14 Thread Avery Ching
Vinod, thanks for your comments. I've replied inline. Avery On 9/14/11 11:09 AM, Vinod Kumar Vavilapalli wrote: Avery, Some replies inline to the issues you outlined. 1) Giraph runs completely as a MapReduce job on Hadoop today. This needs to be maintained to support our current users,

[jira] [Commented] (GIRAPH-12) Investigate communication improvements

2011-09-13 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-12?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103422#comment-13103422 ] Avery Ching commented on GIRAPH-12: --- Hyunsik, just to update, I grabbed your patch

Re: Port to YARN: GIRAPH and HAMA

2011-09-13 Thread Avery Ching
Maybe it's possible, hard to say what will happen in a year. However, at the same time, porting an application from any of the projects to the another should be shouldn't be too difficult since the Pregel API is relatively simple. However, as I mentioned in my original post, I imagine that

[jira] [Commented] (GIRAPH-31) Hide the SortedMapI, EdgeI,E in Vertex from client visibility (impl. detail), replace with appropriate accessor methods

2011-09-13 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-31?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103944#comment-13103944 ] Avery Ching commented on GIRAPH-31: --- How about I wait until tonight (say after 7 pm

[jira] [Commented] (GIRAPH-27) Mutable static global state in Vertex.java should be refactored

2011-09-12 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-27?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102986#comment-13102986 ] Avery Ching commented on GIRAPH-27: --- Oh, it's very annoying. This problem has bitten me

[jira] [Commented] (GIRAPH-28) Introduce new primitive-specific MutableVertex subclasses

2011-09-12 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103338#comment-13103338 ] Avery Ching commented on GIRAPH-28: --- Jake, I agree with all 3 of your points. The only

[jira] [Commented] (GIRAPH-28) Introduce new primitive-specific MutableVertex subclasses

2011-09-12 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103343#comment-13103343 ] Avery Ching commented on GIRAPH-28: --- Would we guarantee that iterator() would always

[jira] [Commented] (GIRAPH-28) Introduce new primitive-specific MutableVertex subclasses

2011-09-12 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13103350#comment-13103350 ] Avery Ching commented on GIRAPH-28: --- boolean hasEdge(I targetVertexId) is fine

[jira] [Commented] (GIRAPH-28) Introduce new primitive-specific MutableVertex subclasses

2011-09-11 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102409#comment-13102409 ] Avery Ching commented on GIRAPH-28: --- Thank you for providing an interesting set

[jira] [Commented] (GIRAPH-28) Introduce new primitive-specific MutableVertex subclasses

2011-09-11 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102426#comment-13102426 ] Avery Ching commented on GIRAPH-28: --- Thanks for isolating to the edge data only

[jira] [Commented] (GIRAPH-28) Introduce new primitive-specific MutableVertex subclasses

2011-09-11 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102437#comment-13102437 ] Avery Ching commented on GIRAPH-28: --- I certainly agree that providing interfaces

[jira] [Commented] (GIRAPH-29) Implement TextVertexInputFormat for text-format graph data

2011-09-10 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13102142#comment-13102142 ] Avery Ching commented on GIRAPH-29: --- No problem, the real issue is that there is little

[jira] [Updated] (GIRAPH-30) NPE in ZooKeeperManager if base directory cannot be created

2011-09-10 Thread Avery Ching (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-30?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Avery Ching updated GIRAPH-30: -- Attachment: GIRAPH-30.2.patch NPE in ZooKeeperManager if base directory cannot be created

<    1   2   3   4   >