[
https://issues.apache.org/jira/browse/HADOOP-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12534878
]
Christian Kunz commented on HADOOP-1788:
----------------------------------------
to 1: silly mistake: thank you for pointing it out
to 2: first it seemed to me an overkill to send progress upstream every second
(especially because it is flushed) but unless it is coordinated with the
configurable 'mapred.task.timeout' it might be not enough to send it just once
per minute. Also it hardly makes a big difference in performance. For now I
will take it out.
to 3: I did not test it without the setsockopt, but I doubt it makes a
difference -- I will take it out.
to 4: as far as I know, 'hadoop.pipes.command.file' is only for debugging, so I
did not bother to do anything about it.
I upload a patch reflecting the changes due to 1-3.
> Increase the buffer size of pipes from 1k to 128k
> -------------------------------------------------
>
> Key: HADOOP-1788
> URL: https://issues.apache.org/jira/browse/HADOOP-1788
> Project: Hadoop
> Issue Type: Bug
> Components: pipes
> Reporter: Owen O'Malley
> Assignee: Amareshwari Sri Ramadasu
> Attachments: patch-1788-1.txt, patch-1788-2.txt, patch-1788.txt
>
>
> Currently pipes applications use 1k writes to the socket and it should be
> larger to increase throughput.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
