[ 
https://issues.apache.org/jira/browse/HAMA-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13545654#comment-13545654
 ] 

Edward J. Yoon commented on HAMA-707:
-------------------------------------

{code}
  @SuppressWarnings("unchecked")
  private Map<V, List<M>> parseMessages(
      BSPPeer<Writable, Writable, Writable, Writable, GraphJobMessage> peer)
      throws IOException {
    GraphJobMessage msg = null;
    final Map<V, List<M>> msgMap = new HashMap<V, List<M>>();
{code}
...

It looks like grouping by vertexID is a biggest problem. All the msgMap and 
outgoingQueue should be keeped in memory during execute each vertex.compute() 
method.
                
> BSPMessageBundle should be able to encapsulate messages serialized in 
> ByteBuffer
> --------------------------------------------------------------------------------
>
>                 Key: HAMA-707
>                 URL: https://issues.apache.org/jira/browse/HAMA-707
>             Project: Hama
>          Issue Type: Improvement
>            Reporter: Suraj Menon
>             Fix For: 0.6.1
>
>
> BSPMessageBundle reads out all the messages from the queue and creates an in 
> memory list before sending it to peer. This does not work when all messages 
> could not be kept in memory. In case of spilling queue, where the messages 
> are already serialized, avoid complete read out of messages.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to