Status: Untriaged
Owner: ----
CC: [email protected],  [email protected],  [email protected]
Labels: Type-Bug Pri-2 OS-All Area-Infrastructure Size-Medium

New issue 21398 by [email protected]: New Tab UI performance graphs aren't  
useful
http://code.google.com/p/chromium/issues/detail?id=21398

Here's 8 weeks worth of New Tab UI performance graphing from the Mac:

http://build.chromium.org/buildbot/perf/mac-release-10.5/new-tab-ui-
cold/report.html?history=1500

It's fairly flat.  There's a small amount of movement in there, so it's
measuring something, but it's not measuring new tab UI time.  I recently
found that the new tab UI was taking between 2 and 3 seconds, just for the
time between when the renderer made its first resource request and when
all of the resources for the NTP were satisfied and available in the
renderer.  With delays like that, it's preposterous for the test results to  
have
been in 500ms that entire time.  When I recently fixed that performance
nightmare, the New Tab UI performance graphs didn't budge.

Here we are on Linux:

http://build.chromium.org/buildbot/perf/linux-release-hardy/new-tab-
ui-cold/report.html?history=1500

Again, no real movement on that test.  My changes should have had some
impact on Linux too.  None measurable, according to these graphs,
though.

The Mac and Linux graphs do show some larger changes if you go back
further, but I don't believe that the actual performance has been as flat as
the graphs indicate, and I don't believe that the Mac was ever in the 500ms
neighborhood until last week.

The Windows graphs do show more movement:

http://build.chromium.org/buildbot/perf/xp-release-single-core/new-
tab-ui-cold/report.html?history=1500
http://build.chromium.org/buildbot/perf/xp-release-dual-core/new-
tab-ui-cold/report.html?history=1500
http://build.chromium.org/buildbot/perf/vista-release-single-core/new-
tab-ui-cold/report.html?history=1500
http://build.chromium.org/buildbot/perf/vista-release-dual-core/new-
tab-ui-cold/report.html?history=1500

Outside of XP Dual, the Windows results are in the 700-800 ms range.  I
don't believe that Mac and Linux are that much faster than Windows on
New Tab UI performance.  The Windows numbers almost seem plausible
(speaking without having ever used Chrome on a single-core system),
although Vista Dual feels too high.

Something is very wrong here.

--
You received this message because you are listed in the owner
or CC fields of this issue, or because you starred this issue.
You may adjust your issue notification preferences at:
http://code.google.com/hosting/settings

--~--~---------~--~----~------------~-------~--~----~
Automated mail from issue updates at http://crbug.com/
Subscription options: http://groups.google.com/group/chromium-bugs
-~----------~----~----~----~------~----~------~--~---

Reply via email to