[
https://issues.apache.org/jira/browse/HAMA-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13689158#comment-13689158
]
MaoYuan Xian commented on HAMA-766:
-----------------------------------
This phase of the cluster（project）, 300+ machines (24 cores cpu+48G Memory per
unit), configured as 1500+ hama slots, compute data have about 600,000,000
vertexes, average input per vertex is about 10 (not large), but about 500
vertexes have more than 1M input message per super-step. Unfortunately, per
message is related long (about 50 bytes).
> Implements network based send queue
> -----------------------------------
>
> Key: HAMA-766
> URL: https://issues.apache.org/jira/browse/HAMA-766
> Project: Hama
> Issue Type: Improvement
> Components: bsp core
> Reporter: MaoYuan Xian
> Priority: Minor
>
> I would like to implement a so call directly send queue for performance
> enhancement. Currently, we have the memory queue, DiskQueue and
> SpillingQueue. The memory queue need to hold all of the message before send
> them out, DiskQueue and SpillingQueue need to operate Disk and cause some
> performance reduction.
> Can we implement a send queue? Something like SpillingQueue, the difference
> is, it will spill message directly to network instead of to disk.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
