[chromium-dev] Re: layout test dashboard goofup

2009-10-15 Thread Ojan Vafai
I put some more thought into this. Given that we only store a month's worth of data, it's not worth doing backups. Keeping around all the data (maybe a year's worth?) would be awesome though. I actually think that would not be too much work and would add value to the dashboard. At that point,

[chromium-dev] Re: layout test dashboard goofup

2009-10-15 Thread Julie Parent
I actually have a copy of the data from Tuesday at 2:30pm. If you need any information out of the results page, just let me know. Julie On Thu, Oct 15, 2009 at 10:58 AM, Ojan Vafai o...@google.com wrote: I put some more thought into this. Given that we only store a month's worth of data,

[chromium-dev] Re: layout test dashboard goofup

2009-10-14 Thread Peter Kasting
On Wed, Oct 14, 2009 at 3:58 PM, Ojan Vafai o...@google.com wrote: I accidentally checked in some test code (one number was wrong!) and clobbered all but 10 of the runs of data for each builder. There's no way to recover it. Do you moonlight for the Danger team at Microsoft? PK

[chromium-dev] Re: layout test dashboard goofup

2009-10-14 Thread Jeremy Orlow
I assume we're going to start backing this data up from now on? On Wed, Oct 14, 2009 at 4:13 PM, Peter Kasting pkast...@google.com wrote: On Wed, Oct 14, 2009 at 3:58 PM, Ojan Vafai o...@google.com wrote: I accidentally checked in some test code (one number was wrong!) and clobbered all but

[chromium-dev] Re: layout test dashboard goofup

2009-10-14 Thread Evan Martin
Sounds like we've got a volunteer! :D :D :D On Wed, Oct 14, 2009 at 4:15 PM, Jeremy Orlow jor...@chromium.org wrote: I assume we're going to start backing this data up from now on? On Wed, Oct 14, 2009 at 4:13 PM, Peter Kasting pkast...@google.com wrote: On Wed, Oct 14, 2009 at 3:58 PM,

[chromium-dev] Re: layout test dashboard goofup

2009-10-14 Thread Jeremy Orlow
I haven't actually gotten anything done on LocalStorage this week because I've been doing so many small side projects like this.but if it's a priority, sure. How about a cron job on some machine that ssh's via a cert into whatever machines the data is stored on, pulls it back, and dumps it

[chromium-dev] Re: layout test dashboard goofup

2009-10-14 Thread Ojan Vafai
The data is stored in a single file per bot. For example, the webkit release bot's results are at http://build.chromium.org/buildbot/layout_test_results/webkit-rel/results.json. That file holds all the historical data for that bot and is copied over during the archive step of each run. We

[chromium-dev] Re: layout test dashboard goofup

2009-10-14 Thread Nicolas Sylvain
On Wed, Oct 14, 2009 at 4:53 PM, Ojan Vafai o...@google.com wrote: The data is stored in a single file per bot. For example, the webkit release bot's results are at http://build.chromium.org/buildbot/layout_test_results/webkit-rel/results.json. That file holds all the historical data for

[chromium-dev] Re: layout test dashboard

2009-09-01 Thread Ojan Vafai
I lied. Another update worth spamming about. The dashboard now by default hides both WONTFIX tests and tests that match their expectations. This way, the dashboard represents a concrete list of work to make tests match their expectations. By default this list should be near-zero. This also makes

[chromium-dev] Re: layout test dashboard

2009-09-01 Thread Peter Kasting
On Tue, Sep 1, 2009 at 5:15 PM, Ojan Vafai o...@chromium.org wrote: I lied. Another update worth spamming about. The dashboard now by default hides both WONTFIX tests and tests that match their expectations. This way, the dashboard represents a concrete list of work to make tests match their

[chromium-dev] Re: layout test dashboard

2009-09-01 Thread Ojan Vafai
On Tue, Sep 1, 2009 at 6:42 PM, Peter Kasting pkast...@google.com wrote: On Tue, Sep 1, 2009 at 5:15 PM, Ojan Vafai o...@chromium.org wrote: I lied. Another update worth spamming about. The dashboard now by default hides both WONTFIX tests and tests that match their expectations. This way,

[chromium-dev] Re: layout test dashboard

2009-08-26 Thread Ojan Vafai
One final update. 1. The bogus results on windows are gone. 2. BUG*** now actually links to the bug. 3. Hides WONTFIX tests by default, with a checkbox to show them. 4. Linux release bot is now listed (debug coming soon) 5. The dashboard now shows (highlights in blue) all cases

[chromium-dev] Re: layout test dashboard

2009-08-26 Thread Peter Kasting
On Wed, Aug 26, 2009 at 5:12 PM, Ojan Vafai o...@chromium.org wrote: The only work I still plan to do on it is to make it perform a bit better. Please file bugs if there are other additions that would be useful to you. This is super-minor, but it might be nice to indicate, for the flakiness

[chromium-dev] Re: layout test dashboard

2009-08-25 Thread Ojan Vafai
One more thing (since people are asking), you can see all the platforms' expectations for a test from the view for any builder. The ones that don't apply to this builder are greyed out. For example, see LayoutTests/fast/dom/HTMLObjectElement/object-as-frame.html on the WebKit builder. Ojan On

[chromium-dev] Re: layout test dashboard

2009-08-24 Thread Peter Kasting
On Mon, Aug 24, 2009 at 6:42 PM, Ojan Vafai o...@chromium.org wrote: A first version of the layout test flakiness dashboard is up. http://src.chromium.org/viewvc/chrome/trunk/src/webkit/tools/layout_tests/flakiness_dashboard.html AWESOME O RAMA Seriously, this has been critically needed,

[chromium-dev] Re: layout test dashboard

2009-08-24 Thread Dimitri Glazkov
Great work, dude. Seriously good stuff. I'll be digging through this tomorrow. Now, how do I change the theme on this thing? ;P :DG On Mon, Aug 24, 2009 at 6:42 PM, Ojan Vafaio...@chromium.org wrote: A first version of the layout test flakiness dashboard is up.