Re: Computation hangs when Combiner is set and OOC is enabled

2016-11-15 Thread Denis Dudinski
Hi Hassan, Thank you very much for the quick response! Can increasing the number of partitions really help in this case? All partition data needed for calculations is already offloaded to disk, so there are no partitions in memory. OneMessagePerVertexStore contains vertexes for ALL partitions in

Re: Computation hangs when Combiner is set and OOC is enabled

2016-11-14 Thread Hassan Eslami
Hi Denis, Thanks for trying out the new OOC design. As you mentioned, by using message combiner we only keep one message for each vertex at all time. That means the storage needed for messages is #ofVertices*(SizeOfVertexId + SizeOfOneMessage). We studied several applications that use message comb