[jira] [Reopened] (HAMA-859) Leverage commons cli2 to parse the input argument for NeuralNetwork Example

2014-02-02 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon reopened HAMA-859: - {code} edward@edward-VirtualBox:~/workspace/hama-trunk$ bin/start-bspd.sh localhost: starting

Re: Confusion about superstep count information

2014-01-29 Thread Edward J. Yoon
: - Current supersteps number: 2 - The total number of supersteps: 2 - SUPERSTEPS=2 Can anyone help me clarify what's the exact semantic of them? I'm running that using trunk in local mode, any clarification would be appreciated. Thanks in advance, Tommaso -- Best Regards, Edward J. Yoon

Comparison between 0.6.3 and TRUNK

2014-01-27 Thread Edward J. Yoon
: java.lang.OutOfMemoryError: Java heap space Hama-TRUNK (DiskVerticesInfo): java.lang.OutOfMemoryError: Java heap space -- Best Regards, Edward J. Yoon @eddieyoon

[jira] [Created] (HAMA-862) Error partitioning the input path

2014-01-27 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-862: --- Summary: Error partitioning the input path Key: HAMA-862 URL: https://issues.apache.org/jira/browse/HAMA-862 Project: Hama Issue Type: Bug

[jira] [Commented] (HAMA-838) Add custom aggregators

2014-01-27 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13882741#comment-13882741 ] Edward J. Yoon commented on HAMA-838: - Maybe I am wrong. But I was really hard to check

[jira] [Commented] (HAMA-859) Leverage commons cli2 to parse the input argument for NeuralNetwork Example

2014-01-27 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13882751#comment-13882751 ] Edward J. Yoon commented on HAMA-859: - +1 Leverage commons cli2 to parse the input

[jira] [Commented] (HAMA-860) Make aggregators start from the first superstep

2014-01-26 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13882487#comment-13882487 ] Edward J. Yoon commented on HAMA-860: - +1 Please feel free to commit it! Make

[jira] [Created] (HAMA-861) Add statistical report for random data generator tools

2014-01-26 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-861: --- Summary: Add statistical report for random data generator tools Key: HAMA-861 URL: https://issues.apache.org/jira/browse/HAMA-861 Project: Hama Issue Type

[jira] [Commented] (HAMA-861) Add statistical report for random data generator tools

2014-01-26 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13882540#comment-13882540 ] Edward J. Yoon commented on HAMA-861: - Total bytes, number of output files, rows

[jira] [Commented] (HAMA-859) Leverage commons cli2 to parse the input argument for NeuralNetwork Example

2014-01-24 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13881649#comment-13881649 ] Edward J. Yoon commented on HAMA-859: - The redesigned CLI2 is rooted

Re: Bug in Aggregator

2014-01-23 Thread Edward J. Yoon
the users can use it. I said that I will handle the documentation on the wiki for the aggregators, I have it on schedule for this weekend. Cheers, Anastasis On 23 Ιαν 2014, at 2:30 π.μ., Edward J. Yoon edwardy...@apache.org wrote: I found a bug in aggregator. In parseMessages, you calls

[jira] [Updated] (HAMA-838) Add custom aggregators

2014-01-23 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-838: Attachment: patch.txt This patch adds aggregate(int index, M value) and getAggregatedValue(int index

[jira] [Updated] (HAMA-838) Add custom aggregators

2014-01-23 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-838: Attachment: patch_v02.txt attach patch_v02.txt Add custom aggregators

[jira] [Commented] (HAMA-838) Add custom aggregators

2014-01-23 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13879903#comment-13879903 ] Edward J. Yoon commented on HAMA-838: - I've committed my changes (before leaving

Re: Bug in Aggregator

2014-01-23 Thread Edward J. Yoon
..) The AbsDiffAggregator is a complicate case. I don't see any convenient way to support it with a simple interface like vertex.aggregate(name, value); I don't see a way to interact it with On 23 Ιαν 2014, at 12:14 μ.μ., Edward J. Yoon edwardy...@apache.org wrote: Yes, basically I agree with you. User

Bug in Aggregator

2014-01-22 Thread Edward J. Yoon
the last value. Like our old code, getAggregationRunner().aggregateVertex(lastValue, vertex); You should aggregates all values. -- Best Regards, Edward J. Yoon @eddieyoon

Re: svn commit: r1556691 - in /hama/trunk: ./ examples/src/main/java/org/apache/hama/examples/ examples/src/test/java/org/apache/hama/examples/ graph/src/main/java/org/apache/hama/graph/ graph/src/tes

2014-01-22 Thread Edward J. Yoon
); -- Best Regards, Edward J. Yoon @eddieyoon

[jira] [Created] (HAMA-857) Graph Combiners is wrongly implemented

2014-01-21 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-857: --- Summary: Graph Combiners is wrongly implemented Key: HAMA-857 URL: https://issues.apache.org/jira/browse/HAMA-857 Project: Hama Issue Type: Bug

[jira] [Resolved] (HAMA-819) Make number of RPC Server threads configurable

2014-01-21 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-819. - Resolution: Fixed Assignee: Edward J. Yoon Fixed. Make number of RPC Server threads

[jira] [Updated] (HAMA-857) Graph Combiners is wrongly implemented

2014-01-21 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-857: Attachment: combine.patch This patch combines the messages before sending to another peers

[jira] [Updated] (HAMA-857) Graph Combiners is wrongly implemented

2014-01-21 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-857: Attachment: HAMA-857_v02.patch I'v added TOTAL_MESSAGES_COMBINED counter. Graph Combiners

[jira] [Assigned] (HAMA-857) Graph Combiners is wrongly implemented

2014-01-21 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon reassigned HAMA-857: --- Assignee: Edward J. Yoon Graph Combiners is wrongly implemented

[jira] [Updated] (HAMA-857) Graph Combiners is wrongly implemented

2014-01-21 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-857: Status: Patch Available (was: Open) With this, SSSP example's performance will be improved. Graph

[jira] [Created] (HAMA-858) Implement SortedDiskQueue

2014-01-21 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-858: --- Summary: Implement SortedDiskQueue Key: HAMA-858 URL: https://issues.apache.org/jira/browse/HAMA-858 Project: Hama Issue Type: Bug Affects Versions: 0.6.3

[jira] [Updated] (HAMA-858) Implement SortedDiskQueue

2014-01-21 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-858: Component/s: graph bsp core Implement SortedDiskQueue

New logo on website

2014-01-20 Thread Edward J. Yoon
Hi, http://people.apache.org/~edwardyoon/site/index.html Do you like this new logo? If no objections arise, I'd like to commit this! -- Best Regards, Edward J. Yoon @eddieyoon

[jira] [Created] (HAMA-855) Handling Address binding exceptions

2014-01-20 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-855: --- Summary: Handling Address binding exceptions Key: HAMA-855 URL: https://issues.apache.org/jira/browse/HAMA-855 Project: Hama Issue Type: Bug

[jira] [Resolved] (HAMA-837) Add sort behaviour to runtime partitioner

2014-01-20 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-837. - Resolution: Fixed Fixed. Add sort behaviour to runtime partitioner

[jira] [Resolved] (HAMA-845) The size() of Spilling Queue returns always numMessagesWritten

2014-01-20 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-845. - Resolution: Fixed Fixed. The size() of Spilling Queue returns always numMessagesWritten

[jira] [Created] (HAMA-856) Bundle Serialization

2014-01-20 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-856: --- Summary: Bundle Serialization Key: HAMA-856 URL: https://issues.apache.org/jira/browse/HAMA-856 Project: Hama Issue Type: Bug Reporter: Edward J

[jira] [Updated] (HAMA-853) Outgoing message manager

2014-01-19 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-853: Attachment: HAMA-853_v02.patch This patch adds OutgoingMessageManager and removes some old codes

[jira] [Commented] (HAMA-854) BSP peers need messaging mechanism.

2014-01-19 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13876215#comment-13876215 ] Edward J. Yoon commented on HAMA-854: - Currently, we already have a pluggable

[jira] [Commented] (HAMA-854) BSP peers need messaging mechanism.

2014-01-19 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13876219#comment-13876219 ] Edward J. Yoon commented on HAMA-854: - And FYI, Netty vs zeromq for storm - http

Re: [jira] [Commented] (HAMA-853) Outgoing message manager

2014-01-18 Thread Edward J. Yoon
/browse/HAMA-853 Project: Hama Issue Type: Improvement Components: bsp core Affects Versions: 0.6.3 Reporter: Edward J. Yoon Assignee: Edward J. Yoon Fix For: 0.7.0 Attachments: outgoingmanager.patch As we discussed

[jira] [Assigned] (HAMA-853) Outgoing message manager

2014-01-17 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon reassigned HAMA-853: --- Assignee: Edward J. Yoon Outgoing message manager

[jira] [Updated] (HAMA-853) Outgoing message manager

2014-01-17 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-853: Attachment: outgoingmanager.patch I roughly wrote the code. Please review. Outgoing message

Re: outgoingQueue and messages bundling

2014-01-15 Thread Edward J. Yoon
in bundle object directly, and should consider about byte array bundle, or disk-based bundle. We can add something like OutgoingMessageManager. Does it make sense? On Wed, Jan 15, 2014 at 2:32 PM, Edward J. Yoon edwardy...@apache.org wrote: As I described here, http://wiki.apache.org/hama/Architecture

Re: loading vertices into RAM

2014-01-15 Thread Edward J. Yoon
with 0.6.3 as well if I recall correctly. Tommaso 2014/1/15 Edward J. Yoon edwardy...@apache.org There are few implementations. - ListVerticesinfo: loads vertices into array list. - MapVerticesinfo: loads vertices into tree map. - DiskVerticesInfo: loads vertices into a local file. You can

[jira] [Created] (HAMA-851) Add ByteArrayVerticesInfo

2014-01-14 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-851: --- Summary: Add ByteArrayVerticesInfo Key: HAMA-851 URL: https://issues.apache.org/jira/browse/HAMA-851 Project: Hama Issue Type: New Feature Affects

[jira] [Updated] (HAMA-851) Add ByteArrayVerticesInfo

2014-01-14 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-851: Fix Version/s: (was: 0.7.0) Add ByteArrayVerticesInfo

outgoingQueue and messages bundling

2014-01-14 Thread Edward J. Yoon
in memory usage. Why should we do like that? Please let me know if i missing something important. -- Best Regards, Edward J. Yoon @eddieyoon

[jira] [Created] (HAMA-845) The size() of Spilling Queue returns always numMessagesWritten

2014-01-13 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-845: --- Summary: The size() of Spilling Queue returns always numMessagesWritten Key: HAMA-845 URL: https://issues.apache.org/jira/browse/HAMA-845 Project: Hama Issue

[jira] [Commented] (HAMA-845) The size() of Spilling Queue returns always numMessagesWritten

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13869359#comment-13869359 ] Edward J. Yoon commented on HAMA-845: - I'll commit directly without patch upload

[jira] [Commented] (HAMA-845) The size() of Spilling Queue returns always numMessagesWritten

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13869358#comment-13869358 ] Edward J. Yoon commented on HAMA-845: - Unit test also should be changed like: {code

[jira] [Updated] (HAMA-845) The size() of Spilling Queue returns always numMessagesWritten

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-845: Affects Version/s: 0.6.3 The size() of Spilling Queue returns always numMessagesWritten

[jira] [Updated] (HAMA-845) The size() of Spilling Queue returns always numMessagesWritten

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-845: Component/s: bsp core The size() of Spilling Queue returns always numMessagesWritten

[jira] [Assigned] (HAMA-845) The size() of Spilling Queue returns always numMessagesWritten

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon reassigned HAMA-845: --- Assignee: Edward J. Yoon The size() of Spilling Queue returns always numMessagesWritten

[jira] [Commented] (HAMA-673) Integrate new service layers

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13869369#comment-13869369 ] Edward J. Yoon commented on HAMA-673: - As I mentioned above, Current YARN module

[jira] [Created] (HAMA-846) Renaming of HadoopMessageManager** classes

2014-01-13 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-846: --- Summary: Renaming of HadoopMessageManager** classes Key: HAMA-846 URL: https://issues.apache.org/jira/browse/HAMA-846 Project: Hama Issue Type: Improvement

[jira] [Created] (HAMA-847) Vertex should provide Counters

2014-01-13 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-847: --- Summary: Vertex should provide Counters Key: HAMA-847 URL: https://issues.apache.org/jira/browse/HAMA-847 Project: Hama Issue Type: Improvement

[jira] [Updated] (HAMA-843) Message communication overhead between master aggregation and vertex computation supersteps

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-843: Resolution: Fixed Status: Resolved (was: Patch Available) I've committed this! Message

[jira] [Updated] (HAMA-673) Integrate new service layers

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-673: Attachment: yarn-hama-diagram.pptx See attached flow diagram. And, I'll create a issue for you

[jira] [Resolved] (HAMA-673) Integrate new service layers

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-673. - Resolution: Won't Fix I'll create a new ticket for YARN module. Integrate new service layers

[jira] [Created] (HAMA-848) Refactor YARN module for hadoop 2.x stable version

2014-01-13 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-848: --- Summary: Refactor YARN module for hadoop 2.x stable version Key: HAMA-848 URL: https://issues.apache.org/jira/browse/HAMA-848 Project: Hama Issue Type

[jira] [Commented] (HAMA-673) Integrate new service layers

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13870220#comment-13870220 ] Edward J. Yoon commented on HAMA-673: - If you want to work on YARN integration, please

[jira] [Created] (HAMA-849) No need to use sorted queue for outgoingQueue

2014-01-13 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-849: --- Summary: No need to use sorted queue for outgoingQueue Key: HAMA-849 URL: https://issues.apache.org/jira/browse/HAMA-849 Project: Hama Issue Type

[jira] [Created] (HAMA-850) Add ByteArrayQueue

2014-01-13 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-850: --- Summary: Add ByteArrayQueue Key: HAMA-850 URL: https://issues.apache.org/jira/browse/HAMA-850 Project: Hama Issue Type: New Feature Components: bsp

[jira] [Updated] (HAMA-849) No need to use sorted queue for outgoingQueue

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-849: Status: Patch Available (was: Open) No need to use sorted queue for outgoingQueue

[jira] [Updated] (HAMA-849) No need to use sorted queue for outgoingQueue

2014-01-13 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-849: Attachment: HAMA-849.patch attach my patch. No need to use sorted queue for outgoingQueue

Re: how to run Eclipse project in Pseudo Distributed Mode?

2014-01-12 Thread Edward J. Yoon
? Thanks. -- Best Regards, Edward J. Yoon @eddieyoon

[jira] [Commented] (HAMA-673) Integrate new service layers

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13869206#comment-13869206 ] Edward J. Yoon commented on HAMA-673: - Current YARN module was implemented based

[jira] [Commented] (HAMA-842) Add persistent queue option to JobConf

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13869223#comment-13869223 ] Edward J. Yoon commented on HAMA-842: - BTW, I think we have to rename the Queue

[jira] [Updated] (HAMA-842) Add persistent queue option to JobConf

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-842: Attachment: HAMA-842_v02.patch attach my patch. Add persistent queue option to JobConf

[jira] [Created] (HAMA-844) Renaming queue implementations consistently

2014-01-12 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-844: --- Summary: Renaming queue implementations consistently Key: HAMA-844 URL: https://issues.apache.org/jira/browse/HAMA-844 Project: Hama Issue Type: Bug

[jira] [Resolved] (HAMA-842) Add persistent queue option to JobConf

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-842. - Resolution: Fixed I've commit this. Add persistent queue option to JobConf

[jira] [Commented] (HAMA-844) Renaming queue implementations consistently

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13869260#comment-13869260 ] Edward J. Yoon commented on HAMA-844: - I'd like to rename like

Re: how to run Eclipse project in Pseudo Distributed Mode?

2014-01-12 Thread Edward J. Yoon
in Eclipse? Do anyone tell me in detail? On Mon, Jan 13, 2014 at 8:17 AM, Edward J. Yoon edwardy...@apache.orgwrote: There are two ways to configure the Hama properties. HamaConfiguration conf = new HamaConfiguration(Path of hama-site.xml); or, conf.set(bsp.master.address, host1

[jira] [Updated] (HAMA-843) Message communication overhead between master aggregation and vertex computation supersteps

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-843: Attachment: HAMA-843.patch Attach my patch. This will improve the PageRank performance dramatically

Re: FYI, Comparison and Evaluation of Open Source Implementations of Pregel and Related Systems

2014-01-12 Thread Edward J. Yoon
time with HAMA-816. On Mon, Jan 13, 2014 at 1:14 AM, Tommaso Teofili tommaso.teof...@gmail.com wrote: by the way: is there anyone aware of what kind of failures were related to PageRank failures highlighted in the mentioned slides (or know who can we ask)? Tommaso 2014/1/10 Edward J. Yoon

[jira] [Commented] (HAMA-843) Message communication overhead between master aggregation and vertex computation supersteps

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13869331#comment-13869331 ] Edward J. Yoon commented on HAMA-843: - Here's PageRank performance test on 8 thousand

[jira] [Updated] (HAMA-843) Message communication overhead between master aggregation and vertex computation supersteps

2014-01-12 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-843: Status: Patch Available (was: Open) Message communication overhead between master aggregation

[jira] [Updated] (HAMA-842) Add persistent queue option to JobConf

2014-01-10 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-842: Attachment: HAMA-842_v01.patch Attach my progress. I'll update for DiskQueue and Sorted Spilling

Re: FYI, Comparison and Evaluation of Open Source Implementations of Pregel and Related Systems

2014-01-10 Thread Edward J. Yoon
/browse/HAMA 3. http://wiki.apache.org/hama/HowToContribute On Fri, Jan 10, 2014 at 5:06 PM, song bai baison...@gmail.com wrote: Dear Edward J. Yoon I have read and modify most of source code of hama-0.6.0, for example, 1. add combiner when the peer sends messages to other peers; 2. the messages

[jira] [Commented] (HAMA-839) Support NullWritable in Hama Pipes

2014-01-10 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867628#comment-13867628 ] Edward J. Yoon commented on HAMA-839: - I can review tonight or tomorrow morning

[jira] [Commented] (HAMA-839) Support NullWritable in Hama Pipes

2014-01-10 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867745#comment-13867745 ] Edward J. Yoon commented on HAMA-839: - +1 Support NullWritable in Hama Pipes

About HAMA-734 and queue behaviours

2014-01-09 Thread Edward J. Yoon
queue. If there are no feedbacks, I'll close the HAMA-734 as a invalid and start to work on Queue implementations. -- Best Regards, Edward J. Yoon @eddieyoon

[jira] [Commented] (HAMA-834) Fix KMeans example

2014-01-09 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866515#comment-13866515 ] Edward J. Yoon commented on HAMA-834: - Nice, +1 Fix KMeans example

FYI, Comparison and Evaluation of Open Source Implementations of Pregel and Related Systems

2014-01-09 Thread Edward J. Yoon
Just FYI, https://cs.uwaterloo.ca/~kdaudjee/courses/cs848/slides/proj/F13/JPV.pdf -- Best Regards, Edward J. Yoon @eddieyoon

[jira] [Created] (HAMA-842) Add persistent queue option to JobConf

2014-01-09 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-842: --- Summary: Add persistent queue option to JobConf Key: HAMA-842 URL: https://issues.apache.org/jira/browse/HAMA-842 Project: Hama Issue Type: New Feature

[jira] [Commented] (HAMA-842) Add persistent queue option to JobConf

2014-01-09 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13867552#comment-13867552 ] Edward J. Yoon commented on HAMA-842: - To reduce the number of additions, we have

[jira] [Resolved] (HAMA-734) Hama Message Manager should be able to delegate the ownership of internal message queue on request for future superstep

2014-01-09 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-734. - Resolution: Invalid Hama Message Manager should be able to delegate the ownership of internal

[jira] [Created] (HAMA-843) Message communication overhead between master aggregation and vertex computation supersteps

2014-01-09 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-843: --- Summary: Message communication overhead between master aggregation and vertex computation supersteps Key: HAMA-843 URL: https://issues.apache.org/jira/browse/HAMA-843

[jira] [Created] (HAMA-840) Improve the dynamic graph example

2014-01-08 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-840: --- Summary: Improve the dynamic graph example Key: HAMA-840 URL: https://issues.apache.org/jira/browse/HAMA-840 Project: Hama Issue Type: Improvement Affects

[jira] [Created] (HAMA-841) Documentation about verticesInfo implementations

2014-01-08 Thread Edward J. Yoon (JIRA)
Edward J. Yoon created HAMA-841: --- Summary: Documentation about verticesInfo implementations Key: HAMA-841 URL: https://issues.apache.org/jira/browse/HAMA-841 Project: Hama Issue Type: Task

[jira] [Updated] (HAMA-734) Hama Message Manager should be able to delegate the ownership of internal message queue on request for future superstep

2014-01-08 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-734: Component/s: bsp core Hama Message Manager should be able to delegate the ownership of internal

[jira] [Updated] (HAMA-734) Hama Message Manager should be able to delegate the ownership of internal message queue on request for future superstep

2014-01-08 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-734: Priority: Critical (was: Major) Hama Message Manager should be able to delegate the ownership

[jira] [Commented] (HAMA-838) Add custom aggregators

2014-01-08 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866154#comment-13866154 ] Edward J. Yoon commented on HAMA-838: - I've refactored pagerank example's compute() code

[jira] [Updated] (HAMA-838) Add custom aggregators

2014-01-08 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-838: Status: In Progress (was: Patch Available) I just committed this. Thanks for your nice patch

[jira] [Resolved] (HAMA-838) Add custom aggregators

2014-01-08 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-838. - Resolution: Fixed Add custom aggregators -- Key: HAMA-838

[jira] [Commented] (HAMA-838) Add custom aggregators

2014-01-08 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13866166#comment-13866166 ] Edward J. Yoon commented on HAMA-838: - {quote} As I can see in Apache Giraph

[jira] [Commented] (HAMA-837) Add sort behaviour to runtime partitioner

2014-01-07 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13865054#comment-13865054 ] Edward J. Yoon commented on HAMA-837: - Found a bug in SemiClustering. In below case

Summary of recent changes

2014-01-07 Thread Edward J. Yoon
and random access by vertex ID. But this implementation might be inefficient in memory usage. 4) Fixed trivial bugs. My next steps are: - Message Serialization. - Refactoring Queues and implement TODO things. - (Graph package) Performance Improvement. Thanks. -- Best Regards, Edward J. Yoon

[jira] [Resolved] (HAMA-783) Efficient InMemory Storage for Vertices

2014-01-07 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon resolved HAMA-783. - Resolution: Fixed This issue has been fixed. To choose the default one, I'll attach

[jira] [Commented] (HAMA-783) Efficient InMemory Storage for Vertices

2014-01-06 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13862845#comment-13862845 ] Edward J. Yoon commented on HAMA-783: - Once HAMA-837 is done, we can enable

[jira] [Commented] (HAMA-783) Efficient InMemory Storage for Vertices

2014-01-06 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13862846#comment-13862846 ] Edward J. Yoon commented on HAMA-783: - {quote}Putting this function to Partitioning

[jira] [Updated] (HAMA-837) Add sort behaviour to runtime partitioner

2014-01-06 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-837: Attachment: HAMA-837_v01.patch Attach my progress. Add sort behaviour to runtime partitioner

Re: Aggregators and voteToHalt()

2014-01-06 Thread Edward J. Yoon
as it is? Cheers, Anastasis -- Best Regards, Edward J. Yoon @eddieyoon

Re: Aggregators and voteToHalt()

2014-01-06 Thread Edward J. Yoon
to delete the previous aggregators entirely? I thought we are keeping the old way and also add the new aggregators on top. On 6 Ιαν 2014, at 3:05 μ.μ., Edward J. Yoon edwardy...@apache.org wrote: We don't need to think about it if we introduce new aggregators interface - HAMA-838 - and get rid

Re: Aggregators and voteToHalt()

2014-01-06 Thread Edward J. Yoon
the default one should be the current behavior as it doesn't make sense (to me) to aggregate data for halted vertices (and as far as I know in line with Pregel design). My 2 cents, Tommaso 2014/1/6 Edward J. Yoon edwardy...@apache.org Oh, we are going to delete the previous aggregators entirely

[jira] [Updated] (HAMA-837) Add sort behaviour to runtime partitioner

2014-01-06 Thread Edward J. Yoon (JIRA)
[ https://issues.apache.org/jira/browse/HAMA-837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward J. Yoon updated HAMA-837: Attachment: HAMA-837_v02.patch This patch adds sort option and enables the DiskVerticesInfo. Each

<    4   5   6   7   8   9   10   11   12   13   >