[
https://issues.apache.org/jira/browse/HADOOP-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12472776
]
Owen O'Malley commented on HADOOP-333:
--------------------------------------
I'd still like to see some checksums, bytes, and record information about the
input and output directories compared. Otherwise a problem that changed all of
the data to 0's would be counted as fine.
> we should have some checks that the sort benchmark generates correct outputs
> ----------------------------------------------------------------------------
>
> Key: HADOOP-333
> URL: https://issues.apache.org/jira/browse/HADOOP-333
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Reporter: Owen O'Malley
> Assigned To: Arun C Murthy
> Attachments: HADOOP-333_20070213_1.patch
>
>
> We should implement some checks of the input versus output of the sort
> benchmark to get some correctness guarantees:
> 1. the number of records
> 2. the number of bytes
> 3. the output records are in fact sorted
> 4. the xor of the md5 of each record's key/value pair
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
