Chromium already has a ton of architecture for automated runs of the
PLT which I'm sure they'd be happy to share.  (e.g.
http://build.chromium.org/f/chromium/perf/dashboard/overview.html)
The problem remains that (aside from the SVG PLT no one uses) we have
no publicly available PLT content. :)

-eric

On Tue, Dec 21, 2010 at 1:23 PM, Simon Fraser <simon.fra...@apple.com> wrote:
> On Dec 21, 2010, at 11:14 AM, Darin Adler wrote:
>
>> Here’s my attempt to list the tests we currently have:
>>
>>    - Automated regression tests (from LayoutTests directory). Many different 
>> types: Layout/pixel, text, script-tests, ref-tests coming soon, some 
>> requiring local server, some JavaScript only. Better organization needed. 
>> Need to replace old driver with new driver for non-Chromium platforms. Our 
>> #1 most critical tests. Includes copies of some entire test suites, such as 
>> ietestcenter and CSS 2.1 and sputnik.
>>
>>    - Manual regression tests (in WebCore/manual-tests directory). These 
>> would be in the primary regression tests if we found a way to automate them. 
>> A good project for a contributor would be to convert these to automated 
>> tests one at a time to try to empty this directory.
>>
>>    - Automated DOM binding generation regression tests (in 
>> WebCore/bindings/scripts/test).
>>
>>    - JavaScript regression tests from Mozilla (in 
>> JavaScriptCore/tests/mozilla). We would like run-webkit-tests to know how to 
>> run these, but currently it does not.
>>
>>    - SunSpider JavaScript performance test (in SunSpider).
>>
>>    - SVG page load test performance test (in PageLoadTests/svg). I am not 
>> familiar with this one.
>>
>>    - Platform-specific unit tests (in WebKit/chromium/tests, 
>> WebKit/gtk/tests, and WebKit/qt/tests). Not familiar with these, how they 
>> are run, or what their coverage are.
>>
>>    - Python regression tests. Not sure where they are, but I see these 
>> failing on the bots so I know they exist.
>>
>> Maybe this list will give us some ideas about how we want to organize tests 
>> in the future.
>
> Plus in some shiny future:
>  - automatable performance tests
>
> Simon
>
> _______________________________________________
> webkit-dev mailing list
> webkit-dev@lists.webkit.org
> http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev
>
_______________________________________________
webkit-dev mailing list
webkit-dev@lists.webkit.org
http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev

Reply via email to