[mailto:wikitech-l-boun...@lists.wikimedia.org] On Behalf Of Markus Glaser
Sent: Friday, October 15, 2010 3:54 PM
To: Wikimedia developers
Subject: Re: [Wikitech-l] using parserTests code for selenium test framework
Hi,
I recently suggested some scheme for dynamically creating clean wikis for
Selenium tests
Gesendet: Mittwoch, 29. September 2010 20:02
An: Wikimedia developers
Betreff: Re: [Wikitech-l] using parserTests code for selenium test framework
Hi,
since the wiki under test is not neccessarily the wiki running the test, it
might be useful to visualize that (I have numbered the individual steps
Lane
Gesendet: Freitag, 24. September 2010 20:22
An: Wikimedia developers
Betreff: Re: [Wikitech-l] using parserTests code for selenium test framework
Here is all that is required:
* a single wildcard entry in Apache configuration
* one or two lines in LocalSettings.php to pull a DB name from
2010/9/23 Brion Vibber br...@pobox.com:
(If using memcached, be sure to clear those out, reinitialize, or otherwise
do something that forces old values to be cleared or ignored.)
$wgCacheEpoch is a good one for this. The easiest way to change it is
to touch LocalSettings.php.
Roan Kattouw
Dan, I think you're overestimating the difficulty of the basic wiki
family method.
Here is all that is required:
* a single wildcard entry in Apache configuration
* one or two lines in LocalSettings.php to pull a DB name from the
hostname/path/CLI parameters.
As for cleaning up resources to keep
Here is all that is required:
* a single wildcard entry in Apache configuration
* one or two lines in LocalSettings.php to pull a DB name from the
hostname/path/CLI parameters.
As for cleaning up resources to keep the machine from getting clogged,
it's very unlikely that your test wikis
On Wed, 22 Sep 2010 12:30:35 -0700, Brion Vibber wrote:
On Wed, Sep 22, 2010 at 11:09 AM, Dan Nessett dness...@yahoo.com
wrote:
Some have mentioned the possibility of using the wiki family logic to
help achieve these objectives. Do you have any thoughts on this? If you
think it is a good
Given a test matrix with multiple OSes, this ain't something
individual devs will be running in full over and over as they work.
Assume automated batch runs, which can be distributed over as many
databases and clients as you like.
For small test subsets that are being used during testing the
Another trick that comes to mind is adding a little smarts to your
tests to prevent multiple runs from stomping on each other.
For StatusNet's remote subscription features, I have a client-side
test set which registers user accounts on two sites and confirms that
behavior is as expected posting
On Thu, 23 Sep 2010 09:24:18 -0700, Brion Vibber wrote:
Given a test matrix with multiple OSes, this ain't something individual
devs will be running in full over and over as they work. Assume
automated batch runs, which can be distributed over as many databases
and clients as you like.
For
Hi.
Other good test software is JMeter http://jakarta.apache.org/jmeter/
You could record and replay your http requests
--
Lcdo. Wilfredo Rafael RodrÃguez Hernández
msn,googletalk = wilfre...@gmail.com
cv = http://www.wilfredor.co.cc
On Thu, Sep 23, 2010 at 9:46 AM, Dan Nessett dness...@yahoo.com wrote:
I am very much in favor of keeping it simple. I think the issue is
whether we will support more than one regression test (or individual test
associated with a regression test) running concurrently on the same test
wiki. If
On Thu, 23 Sep 2010 10:29:58 -0700, Brion Vibber wrote:
On Thu, Sep 23, 2010 at 9:46 AM, Dan Nessett dness...@yahoo.com wrote:
I am very much in favor of keeping it simple. I think the issue is
whether we will support more than one regression test (or individual
test associated with a
On Thu, Sep 23, 2010 at 1:04 PM, Dan Nessett dness...@yahoo.com wrote:
After thinking about this some more I think you are right. We should at
least start with something simple and only make it more complex (e.g.,
wiki resource switching) if the simple approach has significant problems.
On Thu, 23 Sep 2010 14:10:24 -0700, Brion Vibber wrote:
+ URLs identify test wikis. Only one regression test can run at time on
any one of these. How do you synchronize regression test initiation so
there is some sort of lock on a test wiki currently running a
regression test?
Simplest
On Thu, Sep 23, 2010 at 2:31 PM, Dan Nessett dness...@yahoo.com wrote:
Not sure I get this. Here is what I understand would happen when a
developer checks in a revision:
+ A script runs that manages the various regression tests run on the
revision (e.g., parserTests, PHPUnit tests, the
On Thu, 23 Sep 2010 14:41:32 -0700, Brion Vibber wrote:
On Thu, Sep 23, 2010 at 2:31 PM, Dan Nessett dness...@yahoo.com wrote:
Not sure I get this. Here is what I understand would happen when a
developer checks in a revision:
+ A script runs that manages the various regression tests run on
On Thu, Sep 23, 2010 at 2:54 PM, Dan Nessett dness...@yahoo.com wrote:
On Thu, 23 Sep 2010 14:41:32 -0700, Brion Vibber wrote:
There's no need to have a fixed set of URLs; just as with Wikimedia's
public-hosted sites you can add individually-addressable wikis
dynamically at whim without
On Thu, 23 Sep 2010 15:50:48 -0700, Brion Vibber wrote:
On Thu, Sep 23, 2010 at 2:54 PM, Dan Nessett dness...@yahoo.com wrote:
On Thu, 23 Sep 2010 14:41:32 -0700, Brion Vibber wrote:
There's no need to have a fixed set of URLs; just as with Wikimedia's
public-hosted sites you can add
On Thu, Sep 23, 2010 at 4:03 PM, Dan Nessett dness...@yahoo.com wrote:
Thinking about this a bit, we seem to have come full circle. If we use a
URL per regression test run, then we need to multiplex wiki resources.
When you set up a wiki family, the resources are permanent. But, for a
test
On Thu, 23 Sep 2010 20:13:23 -0700, Brion Vibber wrote:
On Thu, Sep 23, 2010 at 7:19 PM, Dan Nessett dness...@yahoo.com wrote:
I appreciate your recent help, so I am going to ignore the tone of your
last message and focus on issues. While a test run can set up, use and
then delete the
Hi,
here are my thoughts about phpunit and selenium testing.
The wiki under test is set up with a master database consisting of a single
objectcache table.
The entries of this table specify a test run identifier as primary key
and temporary resource identifiers as dependent fields.
If I
On Wed, 22 Sep 2010 15:49:40 +0200, Markus Glaser wrote:
Hi,
here are my thoughts about phpunit and selenium testing.
The wiki under test is set up with a master database consisting of a
single objectcache table. The entries of this table specify a test run
identifier as primary key and
On Wed, Sep 22, 2010 at 6:47 PM, Dan Nessett dness...@yahoo.com wrote:
I think the object cache and memcached are alternative ways of storing
persistent data. (I also am not an expert in this, so I could be wrong).
My understanding is memcached uses the memcached daemon (http://
On Wed, 22 Sep 2010 18:57:12 +0200, Bryan Tong Minh wrote:
On Wed, Sep 22, 2010 at 6:47 PM, Dan Nessett dness...@yahoo.com wrote:
I think the object cache and memcached are alternative ways of storing
persistent data. (I also am not an expert in this, so I could be
wrong). My understanding
2010/9/22 Dan Nessett dness...@yahoo.com:
How does memcached fit into this? When I looked at BagOStuff, I didn't
find a MemcacheBagOStuff class. Is it defined elsewhere?
Either memcached.php, MemCached.php or MWMemcached.php, I forget. The
class name is MWMemcached.
Roan Kattouw (Catrope)
I just looked at SqlBagOStuff. It already has entry expiration logic.
So, it seems perfect for use by the switch-in/clean-up functionality.
I spoke too soon. Expired entries are deleted automatically when any
entry is referenced. Unfortunately, that means there is no opportunity to
reclaim
Hmm, I think you guys are overthinking the details on this; let's step back
a level.
When you're running tests, you have these tasks:
* create a blank-slate wiki to run tests in
* populate the empty wiki with known data
* run tests on this wiki in a known state
* clean up in some way
The
On Wed, 22 Sep 2010 11:00:53 -0700, Brion Vibber wrote:
Hmm, I think you guys are overthinking the details on this; let's step
back a level.
When you're running tests, you have these tasks: * create a blank-slate
wiki to run tests in * populate the empty wiki with known data * run
tests on
On Wed, Sep 22, 2010 at 11:09 AM, Dan Nessett dness...@yahoo.com wrote:
Some have mentioned the possibility of using the wiki family logic to
help achieve these objectives. Do you have any thoughts on this? If you
think it is a good idea, how do we find out more about it?
I'd just treat it
On Wed, 22 Sep 2010 12:30:35 -0700, Brion Vibber wrote:
On Wed, Sep 22, 2010 at 11:09 AM, Dan Nessett dness...@yahoo.com
wrote:
Some have mentioned the possibility of using the wiki family logic to
help achieve these objectives. Do you have any thoughts on this? If you
think it is a good
Dan Nessett wrote:
On Sun, 19 Sep 2010 23:42:08 +0200, Platonides wrote:
You load originaldb.objectcache, retrieve the specific configuration,
and switch into it.
For supporting many sumyltaneous configurations, the keyname could have
the instance (whatever that cookie is set to) appended,
On Mon, 20 Sep 2010 22:32:24 +0200, Platonides wrote:
Dan Nessett wrote:
On Sun, 19 Sep 2010 23:42:08 +0200, Platonides wrote:
You load originaldb.objectcache, retrieve the specific configuration,
and switch into it.
For supporting many sumyltaneous configurations, the keyname could
have
On Fri, 17 Sep 2010 19:13:33 +, Dan Nessett wrote:
On Fri, 17 Sep 2010 18:40:53 +, Dan Nessett wrote:
I have been tasked to evaluate whether we can use the parserTests db
code for the selenium framework. I just looked it over and have serious
reservations. I would appreciate any
On Sun, 19 Sep 2010 02:47:00 +0200, Platonides wrote:
Dan Nessett wrote:
What about memcached?
(that would be a key based on the original db name)
The storage has to be persistent to accommodate wiki crashes (e.g.,
httpd crash, server OS crash, power outage). It might be possible to
use
Dan Nessett wrote:
Platonides wrote:
Dan Nessett wrote:
What about memcached?
(that would be a key based on the original db name)
The storage has to be persistent to accommodate wiki crashes (e.g.,
httpd crash, server OS crash, power outage). It might be possible to
use memcachedb, but as
On Sun, 19 Sep 2010 23:42:08 +0200, Platonides wrote:
Dan Nessett wrote:
Platonides wrote:
Dan Nessett wrote:
What about memcached?
(that would be a key based on the original db name)
The storage has to be persistent to accommodate wiki crashes (e.g.,
httpd crash, server OS crash, power
Dan Nessett wrote:
On Sat, 18 Sep 2010 00:53:04 +0200, Platonides wrote:
+ Switch the wiki to use this db and return a cookie or some other
state information that identifies this test run configuration.
I think you mean for remote petitions, not just for internal queries,
where do you
On Sun, 19 Sep 2010 00:28:42 +0200, Platonides wrote:
Where to store the data is an open question, one that requires
consultation with others. However, here are some thoughts:
+ The data must be persistent. If the wiki crashes for some reason,
there may be cloned dbs and test-specific
Dan Nessett wrote:
What about memcached?
(that would be a key based on the original db name)
The storage has to be persistent to accommodate wiki crashes (e.g., httpd
crash, server OS crash, power outage). It might be possible to use
memcachedb, but as far as I am aware that requires
I have been tasked to evaluate whether we can use the parserTests db code
for the selenium framework. I just looked it over and have serious
reservations. I would appreciate any comments on the following analysis.
The environment for selenium tests is different than that for
parserTests. It is
Dan Nessett wrote:
Given this background, consider the following (and feel free to comment
on it):
parserTests temporary table code:
A fixed set of tables are specified in the code. parserTests creates
temporary tables with the same name, but using a different static prefix.
These
On Fri, 17 Sep 2010 18:40:53 +, Dan Nessett wrote:
I have been tasked to evaluate whether we can use the parserTests db
code for the selenium framework. I just looked it over and have serious
reservations. I would appreciate any comments on the following analysis.
The environment for
On Fri, 17 Sep 2010 21:05:12 +0200, Platonides wrote:
Dan Nessett wrote:
Given this background, consider the following (and feel free to comment
on it):
parserTests temporary table code:
A fixed set of tables are specified in the code. parserTests creates
temporary tables with the same
Dan Nessett wrote:
After reflection, here are some other problems.
+ Some tests assume the existence of data in the db. For example, the
PagedTiffHandler tests assume the image Multipage.tiff is already loaded.
However, this requires an entry in the image table. You could modify the
test
On Sat, 18 Sep 2010 00:53:04 +0200, Platonides wrote:
+ Switch the wiki to use this db and return a cookie or some other
state information that identifies this test run configuration.
I think you mean for remote petitions, not just for internal queries,
where do you expect to store that
46 matches
Mail list logo
