[
https://issues.apache.org/jira/browse/HADOOP-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12745100#action_12745100
]
Todd Lipcon commented on HADOOP-6166:
-------------------------------------
Personally, I'm satisfied at this point :) But, if others feel like squeezing
that last ounce out, I'm happy to rerun the tests when you have some new
candidates. Just let me know.
Regarding the importance of the different sizes, I think the next step is to
instrument the CRC32 to log every invocation to a file and run some single-node
wordcounts or something. With a histogram of the results it should be easy to
see whether the small-buffer case matters at all in real scenarios.
> Improve PureJavaCrc32
> ---------------------
>
> Key: HADOOP-6166
> URL: https://issues.apache.org/jira/browse/HADOOP-6166
> Project: Hadoop Common
> Issue Type: Improvement
> Components: util
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Tsz Wo (Nicholas), SZE
> Attachments: c6166_20090722.patch, c6166_20090722_benchmark_32VM.txt,
> c6166_20090722_benchmark_64VM.txt, c6166_20090727.patch,
> c6166_20090728.patch, c6166_20090810.patch, c6166_20090811.patch, graph.r,
> graph.r, Rplots-laptop.pdf, Rplots-nehalem32.pdf, Rplots-nehalem64.pdf,
> Rplots.pdf, Rplots.pdf, Rplots.pdf
>
>
> Got some ideas to improve CRC32 calculation.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
