[
https://issues.apache.org/jira/browse/MAPREDUCE-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073003#comment-14073003
]
Sean Zhong commented on MAPREDUCE-5987:
---------------------------------------
The steps to reproduce this bug:
1. allocate a small direct buffer, like 10 bytes
2. prepare a large data set in java side, suppose 1MB. And make the source data
a incremental sequence.
3. write the data, it will first try to fill direct buffer, when it is full, it
will notify native side to fetch the data, over and over.
4. In native side, check the flushed data, and make sure there are also
sequential. Ocassionally, one data element data is corrupted.
5. The test can only be reproduced when direct buffer size is extremely small.
After the Glibc update to https://rhn.redhat.com/errata/RHBA-2013-0279.html,
this no longer happens.
> native-task: Unit test TestGlibCBug fails on ubuntu
> ---------------------------------------------------
>
> Key: MAPREDUCE-5987
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5987
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: task
> Reporter: Sean Zhong
> Assignee: Sean Zhong
> Priority: Minor
>
> On ubuntu12, glibc: 2.15-0ubuntu10.3, UT TestGlibCBug fails
> [ RUN ] IFile.TestGlibCBug
> 14/07/21 15:55:30 INFO TestGlibCBug ./testData/testGlibCBugSpill.out
> /home/decster/projects/hadoop-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/main/native/test/TestIFile.cc:186:
> Failure
> Value of: realKey
> Actual: 1127504685
> Expected: expect[index]
> Which is: 4102672832
> [ FAILED ] IFile.TestGlibCBug (0 ms)
> [----------] 2 tests from IFile (240 ms total)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
