[
https://issues.apache.org/jira/browse/HADOOP-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12634185#action_12634185
]
Owen O'Malley commented on HADOOP-4189:
---------------------------------------
{quote}
task updates (as they come in pairs)
{quote}
For restartability, we really should separate the start event from the finish
event. The start event should be generated when the task starts, not when it
ends. (Assuming that hasn't been changed already.)
{quote}
On an avg I found ~300-350 characters per line. Which makes 600-700 bytes per
line
{quote}
Why does it double? Hopefully we are using UTF-8 encoding so it should be 1
byte/char.
If I assume it is actually 300 bytes per an event, I'd bump the default to 3mb.
> HADOOP-3245 is incomplete
> -------------------------
>
> Key: HADOOP-4189
> URL: https://issues.apache.org/jira/browse/HADOOP-4189
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.19.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Blocker
> Fix For: 0.19.0
>
> Attachments: HADOOP-4189-v1.patch, HADOOP-4189-v2.patch,
> HADOOP-4189-v3.1.patch, HADOOP-4189-v3.patch, HADOOP-4189.patch
>
>
> There are 2 issues with HADOOP-3245
> - The default block size for the history files in hadoop-default.conf is set
> to 0. This file will be empty throughout. It should be made null.
> - Same goes for the buffer size.
> - InterTrackerProtocol version needs to be bumped.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
