[
https://issues.apache.org/jira/browse/MAPREDUCE-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16450744#comment-16450744
]
Hudson commented on MAPREDUCE-6459:
-----------------------------------
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14057 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/14057/])
MAPREDUCE-6459. Native task crashes when merging spilled file on ppc64. (xyao:
rev d423ac2604114b60b1da6167da9d1311785ce914)
* (edit)
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-nativetask/src/CMakeLists.txt
> Native task crashes when merging spilled file on ppc64
> ------------------------------------------------------
>
> Key: MAPREDUCE-6459
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6459
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 2.6.0
> Environment: Linux version 2.6.32-431.el6.ppc64
> Reporter: Tao Jie
> Assignee: Tao Jie
> Priority: Major
> Fix For: 3.0.0-alpha4
>
> Attachments: MAPREDUCE-6459.001.patch, MAPREDUCE-6459.002.patch,
> ppc64_error.txt
>
>
> when running native task on ppc64，merging spilled files fails since we could
> not deserialize local spill file correctly.
> Function readVLong in WritableUtils.h and Buffers.h, we try to compare a char
> with a number and convert a char to int64_t. It does not work correctly on
> ppc64 since char definition is different between ppc64 and x86 platform. On
> x86 platform char is defined as signed number while on ppc64 char is
> unsigned. As a result, we write EOF marker [-1, -1] at the end of spill
> partition, but deserialize chars as [255, 255].
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
