[
https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13041219#comment-13041219
]
Thomas Jungblut commented on HAMA-367:
--------------------------------------
Sorry for my annoyance (it's not my project), but what do you expect when
compressing something with bzip2 and zip?
I am 100% sure that bzip2 has the higher compression rate yielding into smaller
files.
The best thing overall would be that the compression codec can be configured.
So you have to create an interface that compresses a chunk of data, and then
provide implementations- for example of BZIP2 (high compression, but longer
runtime) or LZO(low compression, but shorter runtime).
And then this would be applied to the piece of code Edward posted.
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
> Key: HAMA-367
> URL: https://issues.apache.org/jira/browse/HAMA-367
> Project: Hama
> Issue Type: New Feature
> Components: bsp, documentation
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Labels: gsoc, gsoc2011, mentor
> Fix For: 0.3.0
>
> Attachments: test_files.tar.gz
>
> Original Estimate: 2016h
> Remaining Estimate: 2016h
>
> As you know, the exchanging data between processes, is a core part of whole
> performance in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context
> of large-scale distributed message-passing systems to reduce the
> communication time of individual messages and to improve the bandwidth of the
> overall system.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
