On Tue, Apr 19, 2011 at 11:44 PM, Tim Koopmans <tim.ko...@gmail.com> wrote: > I think we mentioned at watirday that we should communicate spec > capabilities for the different browsers and APIs in the watir domain. > Is this something we can automate from watirspec? i.e. output a table and > reference on Watir.com: > API IE6 IE7 IE8 IE9 FF3 FF4 etc > watir 100% 98% 98% 80% n/a > firewatir > safariwatir > watir-webdriver > etc
I love this idea, but I see some problems. There are several branches of watirspec; the master branch is used by Celerity and matches the 1.X behaviour closely, the watir2 branch is what's used by watir-webdriver with its set of changes [1]. After some recent discussion [2], I switched the watirspec submodule in the Watir repo to point to the watir2 branch [3]. I haven't run the full suite with either IE-Watir or Firewatir, but I expect a lot of failures (including a lot of low-hanging fruit if someone wants to dig into the code!). The watir2 branch expects 0-indexing, for instance. So I'm not sure how valuable it would be for new users to see the spec results. If we run all the implementations against the watir2 branch, watir-webdriver will look very good and everyone else will look pretty bad. If we don't run the same branch for all the implementations then it won't be a real comparison. Watirspec also does guard specs for specific browser/os combinations, which makes it easy to use for CI without requiring all specs to pass [4], but hard to get the kind of overview we're looking for here. The being said, IMHO I think it'd be cool to have something like this to see how well the various browsers are supported, even if it was just for watir-webdriver running watirspec's watir2 branch. But I'm biased :) Jari [1] outlined in https://github.com/jarib/watir-webdriver/wiki/Comparison-with-Watir-1.X [2] http://rubyforge.org/pipermail/wtr-development/2011-April/003033.html - Read that bottom up. Some of the discussion is missing from the archive?! [3] https://github.com/bret/watir/commit/1a72a0867e7377e380347faadc162e34840c5554 [4] Here's an example of a recent spec run with watir-webdriver + IE: http://files.jaribakken.com/watir-webdriver/spec-results/2011-04-19/ _______________________________________________ Wtr-development mailing list Wtr-development@rubyforge.org http://rubyforge.org/mailman/listinfo/wtr-development
