[jira] [Updated] (GIRAPH-191) Random Walks on Graphs

2012-05-18 Thread Sebastian Schelter (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-191: -- Component/s: examples Affects Version/s: 0.2.0 Summary: Random

[jira] [Updated] (GIRAPH-191) Random Walks on Graphs

2012-05-18 Thread Sebastian Schelter (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-191: -- Attachment: GIRAPH-191-1.patch Random Walks on Graphs

[jira] [Commented] (GIRAPH-191) Random Walks on Graphs

2012-05-18 Thread Sebastian Schelter (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13279089#comment-13279089 ] Sebastian Schelter commented on GIRAPH-191: --- I tested PageRank in the test

Re: Review Request: GIRAPH-20 Move temporary test files from the project directory

2012-05-10 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5077/#review7756 --- On 2012-05-09 11:37:47, Sebastian Schelter wrote

[jira] [Commented] (GIRAPH-141) mulitgraph support in giraph

2012-05-10 Thread Sebastian Schelter (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272209#comment-13272209 ] Sebastian Schelter commented on GIRAPH-141: --- No need to excuse. Maybe we simply

Re: Review Request: GIRAPH-20 Move temporary test files from the project directory

2012-05-10 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5077/ --- (Updated 2012-05-10 09:32:10.140325) Review request for giraph. Changes

Review Request: GIRAPH-20 Move temporary test files from the project directory

2012-05-09 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/5077/ --- Review request for giraph. Summary --- All temporary files that the tests

Re: Review Request: Implemented a netty client/server protocol a a faster alternative to Hadoop RPC (3x improvement)

2012-05-09 Thread Sebastian Schelter
I agree that we should try to not give out the map, there should a method to get a single entry, a method to get an Iterable for all entries and a method to clear it. --sebastian On 09.05.2012 18:28, Avery Ching wrote: On 2012-05-09 10:10:46, Sebastian Schelter wrote: http://svn.apache.org

Re: [DISCUSS] Giraph graduation resolution

2012-05-07 Thread Sebastian Schelter
+1 from me too. On 07.05.2012 12:12, Claudio Martella wrote: +1 from me as well On Mon, May 7, 2012 at 12:11 AM, Eugene Koontz ekoo...@hiro-tan.org wrote: +1 for me on the resolution text. -Eugene

Out-of-core messaging

2012-05-03 Thread Sebastian Schelter
Hi, I'd like to ask whether someone is currently working on out-of-core messaging for Giraph (e.g. by spilling messages to disk in case of memory pressure). I ran some experiments with Giraph on a small 6-machine cluster and got really nice results for smaller datasets such as the wikipedia

Re: Out-of-core messaging

2012-05-03 Thread Sebastian Schelter
on the solution, so hopefully I should be able to let you know better in a couple of weeks. On Thu, May 3, 2012 at 3:44 PM, Sebastian Schelter s...@apache.org wrote: Hi, I'd like to ask whether someone is currently working on out-of-core messaging for Giraph (e.g. by spilling messages

Re: Please welcome our newest committer and PMC member, Eugene!

2012-05-01 Thread Sebastian Schelter
Welcome Eugene! On 02.05.2012 03:28, Eugene Koontz wrote: Thank you Hyunsik and Jakob! I'm really looking forward to working with you all! -Eugene On 5/1/12 5:18 PM, Hyunsik Choi wrote: Congrats and welcome Eugene! I'm looking forward to your contribution. -- Hyunsik Choi On Wed,

[jira] [Commented] (GIRAPH-170) Workflow for loading RDF graph data into Giraph

2012-04-19 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13257702#comment-13257702 ] Sebastian Schelter commented on GIRAPH-170: --- ??Independent of the number

[jira] [Updated] (GIRAPH-156) Users should be able to set simple 'custom arguments' via org.apache.giraph.GiraphRunner

2012-03-18 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-156: -- Attachment: GIRAPH-156-2.patch Users should be able to set simple 'custom

[jira] [Commented] (GIRAPH-157) Vertex to perform graph coloring on simple, connected, undirected graphs and related test.

2012-03-18 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13232211#comment-13232211 ] Sebastian Schelter commented on GIRAPH-157: --- Hello Eli, I'm not sure how your

[jira] [Updated] (GIRAPH-156) Users should be able to set simple 'custom arguments' via org.apache.giraph.GiraphRunner

2012-03-16 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-156: -- Attachment: GIRAPH-156-1.patch had a missing whitespace in the last patch

[jira] [Created] (GIRAPH-156) Users should be able to set simple 'custom arguments' via org.apache.giraph.GiraphRunner

2012-03-15 Thread Sebastian Schelter (Created) (JIRA)
Project: Giraph Issue Type: Improvement Components: conf and scripts Affects Versions: 0.1.0 Reporter: Sebastian Schelter Assignee: Sebastian Schelter Some vertices need custom arguments to run. The SimpleShortestPathsVertex for example needs to know

Re: How to contribute page

2012-03-14 Thread Sebastian Schelter
I added the 'Be involved' part from Mahout's [1] 'How to contribute' page. Maybe we could even copy a little more from there :) Best, Sebastian [1] https://cwiki.apache.org/MAHOUT/how-to-contribute.html On 14.03.2012 17:39, Avery Ching wrote: Yes, that is thanks to Sebastian. We should

Re: Graph clustering via LinLog force directed layout

2012-03-06 Thread Sebastian Schelter
Hi Timmy, Sounds like a really cool idea to use giraph for layouting graphs, what is the complexity of that algorithm you plan to implement? --sebastian On 06.03.2012 22:29, Avery Ching wrote: Hi Timmy, I don't know much about force directed layout, but it certainly sounds like a very

[jira] [Commented] (GIRAPH-150) PageRankBenchmark accesses wrong conf after GiraphJob is created

2012-02-20 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13211991#comment-13211991 ] Sebastian Schelter commented on GIRAPH-150: --- haven't tested it, but looks

[jira] [Updated] (GIRAPH-120) Add Sebastian Schelter to site

2012-02-01 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-120: -- Attachment: GIRAPH-120.patch Add Sebastian Schelter to site

Re: on the semantics of the combiner

2012-01-13 Thread Sebastian Schelter
+1 on Iterable = messages.size() also from me. On 13.01.2012 19:51, Avery Ching wrote: +1 I'm fine with this. If we agree to return an Iterable, then we should make sure to either throw if the size of the Iterable messages.size() to at the very least LOG.warn(This combiner is likely to

Fwd: Call for Submission Berlin Buzzwords 2012all for Submission Berlin Buzzwords - http://berlinbuzzwords.de

2012-01-11 Thread Sebastian Schelter
Forwarding Simon's call for Berlin Buzzwords. Does anybody plan to give a talk about Giraph at Buzzwords? I'll definitely be at the conference as I'm living in Berlin. We should also try to organize a Giraph meeting in the evening maybe together with the Mahout people. Best, Sebastian

Re: some giraph code

2012-01-09 Thread Sebastian Schelter
of the specific sub-group you're talking to aware of whats up; or (b) send a summary of the discussion here. It's important to demonstrate that discussion within Apache Giraph is happening *on the mailing lists* here. Cheers, Chris On Jan 6, 2012, at 8:25 AM, Sebastian Schelter wrote: I have

[jira] [Created] (GIRAPH-120) Add Sebastian Schelter to site

2012-01-07 Thread Sebastian Schelter (Created) (JIRA)
Add Sebastian Schelter to site -- Key: GIRAPH-120 URL: https://issues.apache.org/jira/browse/GIRAPH-120 Project: Giraph Issue Type: Task Reporter: Sebastian Schelter Assignee: Sebastian

Re: some giraph code

2012-01-06 Thread Sebastian Schelter
I have already been in email contact with Eugenia, because a colleague of mine is currently at UCI. I'll cc this mail to her :) --sebastian On 06.01.2012 14:20, Claudio Martella wrote: Hello guys, today I stumbled upon this:

Re: some giraph code

2012-01-06 Thread Sebastian Schelter
talking to aware of whats up; or (b) send a summary of the discussion here. It's important to demonstrate that discussion within Apache Giraph is happening *on the mailing lists* here. Cheers, Chris On Jan 6, 2012, at 8:25 AM, Sebastian Schelter wrote: I have already been in email contact

Re: Time to roll a release?

2012-01-05 Thread Sebastian Schelter
+1 from me too, as Jake already said: release early, release often. On 04.01.2012 23:07, Mattmann, Chris A (388J) wrote: Super +1, thanks for pushing this Jakob. Cheers, Chris On Jan 4, 2012, at 3:15 PM, Jakob Homan wrote: I think there's been enough work done since Giraph entered

[jira] [Updated] (GIRAPH-117) DefaultWorkerContext should preserve the method signatures of WorkerContext

2012-01-02 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-117: -- Attachment: GIRAPH-117.patch DefaultWorkerContext should preserve the method

Re: Review Request: Make EdgeListVertex the default vertex implementation, fix bugs related to EdgeListVertex.

2012-01-02 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3349/#review4170 --- Ship it! Ok, I understood this wrong. I'm fine with the changes

Re: Unable to load vertices

2011-12-23 Thread Sebastian Schelter
you're running a different hadoop locally and on your test. Is there any chance you're not using hadoop non_secure locally but you're in your distributed mode? On Fri, Dec 23, 2011 at 10:49 AM, Sebastian Schelter s...@apache.org wrote: Hi, I'm currently implementing an algorithm for diameter

Re: Unable to load vertices

2011-12-23 Thread Sebastian Schelter
non_secure locally but you're in your distributed mode? On Fri, Dec 23, 2011 at 10:49 AM, Sebastian Schelter s...@apache.org wrote: Hi, I'm currently implementing an algorithm for diameter and radius estimation. It already works when I run it on toy data via InternalVertexRunner in a unit test

Re: Unable to load vertices

2011-12-23 Thread Sebastian Schelter
, Avery Ching wrote: What MutableVertex implementation are you using? Sounds like the issue only happens during the RPC to send the vertex to another worker. Maybe a bug in the Writable implementation? Avery On 12/23/11 3:14 AM, Sebastian Schelter wrote: Hmm, the job works if I use a single

[jira] [Updated] (GIRAPH-114) Inconsistent message map handling in BasicRPCCommunications.LargeMessageFlushExecutor

2011-12-21 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-114: -- Attachment: GIRAPH-114.patch Inconsistent message map handling

[jira] [Created] (GIRAPH-114) Inconsistent message map handling in BasicRPCCommunications.LargeMessageFlushExecutor

2011-12-21 Thread Sebastian Schelter (Created) (JIRA)
: Giraph Issue Type: Bug Affects Versions: 0.70.0 Reporter: Sebastian Schelter Priority: Critical Attachments: GIRAPH-114.patch I'm currently implementing a simple algorithm to identify all the connected components of a graph. The algorithm ran well

[jira] [Updated] (GIRAPH-109) GiraphRunner should provide support for combiners

2011-12-21 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-109: -- Attachment: GIRAPH-109.patch Patch that allows specifying VertexCombiner

[jira] [Created] (GIRAPH-109) GiraphRunner should provide support for combiners

2011-12-20 Thread Sebastian Schelter (Created) (JIRA)
Reporter: Sebastian Schelter Currently there's no way to tell GiraphRunner that you want to use a Combiner. A simple option should be added, similar to the way in- and outputformats are specified. -- This message is automatically generated by JIRA. If you think it was sent

Re: Review Request: GIRAPH-112: Use elements() properly in LongDoubleFloatDoubleVertex

2011-12-20 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3287/#review4036 --- Ship it! I ran into the same issue yesterday and the solution

Re: Review Request: GIRAPH-106: Change prepareSuperstep() to make setMessages(IterableM messages) package-private

2011-12-19 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3255/#review3972 --- Ship it! nice and simple! - Sebastian On 2011-12-19 08:25:55,

[jira] [Commented] (GIRAPH-105) BspServiceMaster.checkWorkers() should return empty lists instead of null

2011-12-18 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13171795#comment-13171795 ] Sebastian Schelter commented on GIRAPH-105: --- Makes sense. Main issue is to make

[jira] [Updated] (GIRAPH-105) BspServiceMaster.checkWorkers() should return empty lists instead of null

2011-12-18 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-105: -- Attachment: GIRAPH-105-2.patch updated patch to reflect aching's suggestions, ran

Re: Review Request: GIRAPH-80 Refactor vertices to not expose the internal datastructure for holding messages

2011-12-17 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3203/ --- (Updated 2011-12-17 09:36:06.229668) Review request for giraph. Summary

[jira] [Updated] (GIRAPH-105) BspServiceMaster.checkWorkers() should return empty lists instead of null

2011-12-17 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-105: -- Attachment: GIRAPH-105.patch BspServiceMaster.checkWorkers() should return empty

Re: Running tests in pseudo-distributed mode

2011-12-17 Thread Sebastian Schelter
AM, Sebastian Schelter wrote: A small hint for everyone who wants to run giraph's unit tests on a pseudo-distributed single node hadoop cluster: You have to adjust the configuration to allow 4 concurrent map tasks per node (default in hadoop-0.20.203 is 2), otherwise the tests will fail! You

Review Request: Refactor vertices to not expose the internal datastructure for holding messages

2011-12-15 Thread Sebastian Schelter
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3203/ --- Review request for giraph. Summary --- refactoring that gives BasicVertex

[jira] [Commented] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-12-15 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13170192#comment-13170192 ] Sebastian Schelter commented on GIRAPH-80: -- It should apply to current trunk, do

[jira] [Commented] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-12-15 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13170299#comment-13170299 ] Sebastian Schelter commented on GIRAPH-80: -- No problem. I can rework them to fit

[jira] [Updated] (GIRAPH-51) Provide unit testing tool for Giraph algorithms

2011-11-24 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-51?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-51: - Attachment: GIRAPH-51-3.patch fixed the javadoc errors in the patch

[jira] [Updated] (GIRAPH-51) Provide unit testing tool for Giraph algorithms

2011-11-16 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-51?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-51: - Attachment: GIRAPH-51-2.patch Hi Jakob, I moved InternalVertexRunner to the src as you

[jira] [Commented] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-11-15 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-80?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13150367#comment-13150367 ] Sebastian Schelter commented on GIRAPH-80: -- sendMsg() is used for sending out

Did GIRAPH-11 break vertex reactivation?

2011-11-15 Thread Sebastian Schelter
Hi, I updated to the latest trunk (after the GIRAPH-11 commit) and wanted to continue to work on GIRAPH-51 where I use a small toy graph to test SimpleShortestPathVertex. Unfortunately my code did not work anymore and I guess I tracked it down to the fact that vertex that voted to halt are not

Re: Did GIRAPH-11 break vertex reactivation?

2011-11-15 Thread Sebastian Schelter
:42 PM, Sebastian Schelter wrote: Hi, I updated to the latest trunk (after the GIRAPH-11 commit) and wanted to continue to work on GIRAPH-51 where I use a small toy graph to test SimpleShortestPathVertex. Unfortunately my code did not work anymore and I guess I tracked it down to the fact

[jira] [Created] (GIRAPH-80) Don't expose the list holding the messages in BasicVertex

2011-11-14 Thread Sebastian Schelter (Created) (JIRA)
Versions: 0.70.0 Reporter: Sebastian Schelter I'm currently trying to implement my own memory efficient vertex (similar to LongDoubleFloatDoubleVertex) and ran into problems with getMsgList() This method returns a list pointing to the messages of the vertex and it is modified externally

[jira] [Updated] (GIRAPH-51) Provide unit testing tool for Giraph algorithms

2011-11-11 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-51?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-51: - Attachment: GIRAPH-51.patch Hi, I'm currently trying to find a way to easily unit test

[jira] [Updated] (GIRAPH-73) A little refactoring

2011-11-10 Thread Sebastian Schelter (Updated) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-73?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sebastian Schelter updated GIRAPH-73: - Attachment: GIRAPH-73.patch A little refactoring

[jira] [Commented] (GIRAPH-51) Provide unit testing tool for Giraph algorithms

2011-10-10 Thread Sebastian Schelter (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-51?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13124553#comment-13124553 ] Sebastian Schelter commented on GIRAPH-51: -- It would be great to have something

[jira] [Commented] (GIRAPH-21) Revise CODE_CONVENTIONS

2011-09-14 Thread Sebastian Schelter (JIRA)
[ https://issues.apache.org/jira/browse/GIRAPH-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13104363#comment-13104363 ] Sebastian Schelter commented on GIRAPH-21: -- I'm currently reading a lot of giraph