[
https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13996737#comment-13996737
]
Vinod Kumar Vavilapalli commented on YARN-2014:
-----------------------------------------------
Thanks for the info Jason. Do you have a link to the JIRA covering the FS
ServiceLoader stuff?
In your configs, what are the file-systems whose impls are defined? Or is it
just the default impls added by the default config files? May be one thing that
can be done, if possible and if you have time, is to remove the unnecessary
service-loader declaration files (not sure what you call them) from the
installation and try this again.
> Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9
> --------------------------------------------------------------------
>
> Key: YARN-2014
> URL: https://issues.apache.org/jira/browse/YARN-2014
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 2.4.0
> Reporter: patrick white
> Assignee: Jason Lowe
>
> Performance comparison benchmarks from 2.x against 0.23 shows AM scalability
> benchmark's runtime is approximately 10% slower in 2.4.0. The trend is
> consistent across later releases in both lines, latest release numbers are:
> 2.4.0.0 runtime 255.6 seconds (avg 5 passes)
> 0.23.9.12 runtime 230.4 seconds (avg 5 passes)
> Diff: -9.9%
> AM Scalability test is essentially a sleep job that measures time to launch
> and complete a large number of mappers.
> The diff is consistent and has been reproduced in both a larger (350 node,
> 100,000 mappers) perf environment, as well as a small (10 node, 2,900
> mappers) demo cluster.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
