Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-16 Thread Platonides
On 16/04/12 16:45, Chris McMahon wrote: > Cucumber adds a layer of abstraction I think is unnecessary-- these tests > are to be read by developers, many of whom will not be expert. Rspec is a > nice alternative to xUnit-style assertions, and the standard among Ruby > developers. Which seem to be

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-16 Thread Chris McMahon
On Mon, Apr 16, 2012 at 5:14 AM, Gergő Tisza wrote: > > Not sure what counts as authoritative, but there are a number of fairly > usable > PHP implementations such as php-webdriver [1] from Facebook or > phpunit-selenium > [2] from the PHPUnit framework, both of which are non-complete but very >

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-16 Thread Gergő Tisza
Chris McMahon wikimedia.org> writes: > As QA Lead for WMF, one of the things I want to do is to create an > institutional suite of automated cross-browser regression tests using > Selenium. I have two goals for this suite: first, to make it attractive > and convenient for the greater software t

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-11 Thread Chris McMahon
> > > - have a sysop account to watch the non-existing page name > - create that page with some content > - have a sysop to delete this page > > Very good testing case for DB transaction related problems. > > I doing such tests should be possible in the new framework? > > //Saper > Yes. This is a

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-11 Thread Marcin Cieslak
>> Markus Glaser wrote: > Some time ago some people from the test framework team started working on a > Selenium Framework for MediaWiki [1], in PHP and with Selenium 1.0. One of > the reasons the project discontinued was that there was no clear case of when > Selenium would be useful as oppose

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-10 Thread Chris McMahon
Thanks for the point-by-point notices! On Tue, Apr 10, 2012 at 4:17 PM, Markus Glaser wrote: > > * Testing complex interaction patterns with several page reloads (e.g. > maybe producing edit conflicts) > Yes, and also in environments where interactions among many extensions are not well underst

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-10 Thread Markus Glaser
enium -Ursprüngliche Nachricht- Von: wikitech-l-boun...@lists.wikimedia.org [mailto:wikitech-l-boun...@lists.wikimedia.org] Im Auftrag von Chris McMahon Gesendet: Donnerstag, 5. April 2012 23:46 An: wikitech-l@lists.wikimedia.org Betreff: [Wikitech-l] selenium browser testing proposa

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-09 Thread Chris McMahon
On Sun, Apr 8, 2012 at 10:52 AM, Platonides wrote: > I wasn't able to make the selenium work (presumably selenium 1.0). > How hard would it be to make this work? Who would be responsible of > sorting out any problems encountered doing that and ensuring all > developers can locally run those tests

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-08 Thread Platonides
I wasn't able to make the selenium work (presumably selenium 1.0). How hard would it be to make this work? Who would be responsible of sorting out any problems encountered doing that and ensuring all developers can locally run those tests? (Actually, I'd try this before creating too many tests in t

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread Ryan Lane
> Ryan, I only ran into it recently. But look over bundler: > http://gembundler.com/rationale.html > If another situation where something needs gems without existing apt > packages comes up it may be a helpful thing to have in your toolkit of > solutions. > > Two useful things that bundler seems to

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread Daniel Friesen
On Fri, 06 Apr 2012 12:33:40 -0700, Ryan Lane wrote: We've already gone down the Ruby road once. I think a lot of the people involved with that would say it was a bad call, especially ops. Ruby at scale can certainly be a lulz engine, especially for those on the sidelines. This project d

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread Ryan Lane
> We've already gone down the Ruby road once. I think a lot of the >> people involved with that would say it was a bad call, especially ops. >> > > Ruby at scale can certainly be a lulz engine, especially for those on the > sidelines.  This project doesn't seem to place any software demands on the

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread Chris McMahon
> > > Correct me if I am wrong, Chris: I think we came to the conclusion that > UnitTest may be better suited for local developer usage instead of > automated testing. > Jeremy, yes, I'm aware of what you're doing and I think it makes sense in context. In my original post I said " Since the purpo

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread Jeremy Postlethwaite
PHPUnit has been working on Selenium2 with the backwards compatibility API: https://github.com/sebastianbergmann/phpunit-selenium/blob/master/PHPUnit/Extensions/Selenium2TestCase.php I have not had a chance to test it out, it is still experimental. It would seem appropriate for someone to add it

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread Antoine Musso
Le 06/04/12 08:43, Asher Feldman a écrit : > passing bits of duct tape back and forth by transatlantic carrier pigeon. At least that was using a standard: RFC 1149 http://www.ietf.org/rfc/rfc1149.txt "A Standard for the Transmission of IP Datagrams on Avian Carriers" _

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread K. Peachey
On Fri, Apr 6, 2012 at 10:17 AM, Daniel Friesen wrote: > I've seen this assertion waved around again and again, but don't see where > it originates from, besides the very unreliable fact that we just don't talk > much about ruby around here. When I said community not knowing it, I was more referr

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-06 Thread Ryan Kaldari
You should talk to Jeremy Postlethwaite . He did some work on setting up automated Selenium tests for our fundraiser. Ryan Kaldari On 4/5/12 2:45 PM, Chris McMahon wrote: As QA Lead for WMF, one of the things I want to do is to create an institutional suite of automated cross-browser regressi

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-05 Thread Asher Feldman
On Thu, Apr 5, 2012 at 5:25 PM, Ryan Lane wrote: > How many languages can we reasonably support? We're currently using > PHP, Python, Java, OCaml and Javascript (and probably more). Should we > also throw Ruby in here as well? What level of support are the > Selenium tests really going to get if

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-05 Thread Rob Lanphier
On Thu, Apr 5, 2012 at 5:25 PM, Ryan Lane wrote: > How many languages can we reasonably support? We're currently using > PHP, Python, Java, OCaml and Javascript (and probably more). Should we > also throw Ruby in here as well? What level of support are the > Selenium tests really going to get if t

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-05 Thread Ryan Lane
> We really need to start surveying real statistics on what programming > languages community members know. > I've seen this assertion waved around again and again, but don't see where > it originates from, besides the very unreliable fact that we just don't talk > much about ruby around here. > >

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-05 Thread Daniel Friesen
On Thu, 05 Apr 2012 14:53:27 -0700, K. Peachey wrote: On Fri, Apr 6, 2012 at 7:45 AM, Chris McMahon wrote: For various reasons, I think the best language for this project is Ruby. I realize that is a controversial choice, and I would like to explain my reasoning. First let me address wha

Re: [Wikitech-l] selenium browser testing proposal and prototype

2012-04-05 Thread K. Peachey
On Fri, Apr 6, 2012 at 7:45 AM, Chris McMahon wrote: > For various reasons, I think the best language for this project is Ruby.  I > realize that is a controversial choice, and I would like to explain my > reasoning.  First let me address what I think will be the most serious > objections: > > **

[Wikitech-l] selenium browser testing proposal and prototype

2012-04-05 Thread Chris McMahon
As QA Lead for WMF, one of the things I want to do is to create an institutional suite of automated cross-browser regression tests using Selenium. I have two goals for this suite: first, to make it attractive and convenient for the greater software testing community to both use the suite locally