[
https://issues.apache.org/jira/browse/HADOOP-4396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12640209#action_12640209
]
Raghu Angadi commented on HADOOP-4396:
--------------------------------------
> And you are right, the final writes and reads that reach the disk are
> governed by the io.file.buffer.size. That is exactly why I did not try this
> change earlier
I meant the opposite. With the patch, writes will be governed by
io.file.buffer.size irrespective of IFile level write size. Without it, it will
depend on IFile write size, it could less than io.file.buffer.size or more
(more commonly, more).
> sort on 400 nodes is now slower than in 18
> ------------------------------------------
>
> Key: HADOOP-4396
> URL: https://issues.apache.org/jira/browse/HADOOP-4396
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Jothi Padmanabhan
> Assignee: Jothi Padmanabhan
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: 4396-v3.patch
>
>
> Sort on 400 nodes on hadoop release 18 takes about 29 minutes, but with the
> 19 branch takes about 32 minutes. This behavior is consistent.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
