[
https://issues.apache.org/jira/browse/MAPREDUCE-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151099#comment-13151099
]
Vinod Kumar Vavilapalli commented on MAPREDUCE-3402:
----------------------------------------------------
Independent invention! I was so into debugging I didn't check the JIRA posts.
Yes, I am just using the same benchmark, and reproduced many a oddities with
100K maps, and was extolling you on the way for the benchmark :)
Playing with heap-dumps and profilers on this benchmark now.
> AMScalability test of Sleep job with 100K 1-sec maps regressed into running
> very slowly
> ---------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3402
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3402
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: applicationmaster, mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Vinod Kumar Vavilapalli
> Fix For: 0.23.1
>
>
> The world was rosier before October 19-25, [~karams] says.
> The 100K 1 second sleep job used to take around 800mins or 13-14 mins. It now
> runs till 45 mins and still manages to complete only about 45K tasks.
> One/more of the flurry of commits for 0.23.0 deserve(s) the blame.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
