[
https://issues.apache.org/jira/browse/HAMA-367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13031183#comment-13031183
]
Edward J. Yoon commented on HAMA-367:
-------------------------------------
To ashish,
>> I'm assuming we prefer a higher speed of compression than a higher
>> compression ratio.
Well ... I think, the "high compression ratio" is more important than the speed
of compression. The message compression is a part of local computation and will
be used to saves network traffic and enhances speed of communication.
>> Do we transfer only text and images or do we transfer video and audio as
>> well ?
First of all, the data size is more important factor than the data type.
Compress only large messages, skip many small messages! It would be nice if we
can specify the minimum size of the messages for which compression must be
applied. For example,
{code}
<property>
<name>min.compression.size</name>
<value>10</value>
<description>minimum size in KB ....
</description>
</property>
{code}
> Runtime Compression of BSP Messages to Improve the Performance
> --------------------------------------------------------------
>
> Key: HAMA-367
> URL: https://issues.apache.org/jira/browse/HAMA-367
> Project: Hama
> Issue Type: New Feature
> Components: bsp, documentation
> Affects Versions: 0.3.0
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Labels: gsoc, gsoc2011, mentor
> Fix For: 0.3.0
>
> Original Estimate: 2016h
> Remaining Estimate: 2016h
>
> As you know, the exchanging data between processes, is a core part of whole
> performance in Bulk Synchronous Parallel.
> In this research, we investigate BSP message data compression in the context
> of large-scale distributed message-passing systems to reduce the
> communication time of individual messages and to improve the bandwidth of the
> overall system.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
