[ 
https://issues.apache.org/jira/browse/GIRAPH-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102377#comment-13102377
 ] 

Dmitriy V. Ryaboy commented on GIRAPH-28:
-----------------------------------------

I tried to benchmark the memory footprint on this and was surprised to find 
that it's actually larger than the existing implementation!

At Jake's suggestion, I also added a dummy "TinyVertex" that just does the 
simplest thing possible, by keeping an array of primitives and resizing it when 
needed. This gives us the lower bound on what our memory utilization could look 
like. The answer is, we could be 30x more efficient in terms of memory 
utilization, at the cost of some CPU.

Code is here: https://gist.github.com/1210245

> Introduce new primitive-specific MutableVertex subclasses
> ---------------------------------------------------------
>
>                 Key: GIRAPH-28
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-28
>             Project: Giraph
>          Issue Type: New Feature
>          Components: graph
>    Affects Versions: 0.70.0
>            Reporter: Jake Mannix
>            Assignee: Jake Mannix
>         Attachments: GIRAPH-28.diff
>
>
> As discussed on the list, 
> MutableVertex<LongWritable,DoubleWritable,FloatWritable,DoubleWritable> (for 
> example) could be highly optimized in its memory footprint if the vertex and 
> edge data were held in a form which minimized Java object usage.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to