Re: [Wikitech-l] Counting revisions in 2011090

2011-09-30 Thread Platonides
Happy Melon wrote: > > SELECT * FROM `revision` LEFT JOIN `page` ON `rev_page` = `page_id` WHERE > `page_id` IS NULL > > Anyone want a sweepstake on how long that'll take? 8-) > > --HM 142978 rows in set (1 hour 25 min 39.26 sec) ___ Wikitech-l mailin

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-29 Thread Happy Melon
On 28 September 2011 16:41, Brion Vibber wrote: > On Wed, Sep 28, 2011 at 3:27 AM, K. Mueller wrote: > > > Platonides gmail.com> writes: > > > Do doing things the slow way: > > > mysql> SELECT COUNT(*) FROM revision; > > > | 416988781 | > > > > Thanks, this is quite close to the result from Sep

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-28 Thread Brion Vibber
On Wed, Sep 28, 2011 at 3:27 AM, K. Mueller wrote: > Platonides gmail.com> writes: > > Do doing things the slow way: > > mysql> SELECT COUNT(*) FROM revision; > > | 416988781 | > > Thanks, this is quite close to the result from September 1st ( 412,482,641 > ). I > assume that the contents of the

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-28 Thread K . Mueller
Platonides gmail.com> writes: > > I thought InnoDB had a count, too. Don't worry, I'm happy with Wikipedia > servers not crashing. :) > > Do doing things the slow way: > mysql> SELECT COUNT(*) FROM revision; > +---+ > | COUNT(*) | > +---+ > | 416988781 | > +---+ > 1 ro

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Platonides
I thought InnoDB had a count, too. Don't worry, I'm happy with Wikipedia servers not crashing. :) Do doing things the slow way: mysql> SELECT COUNT(*) FROM revision; +---+ | COUNT(*) | +---+ | 416988781 | +---+ 1 row in set (1 hour 36 min 52.58 sec) Result from about 1.5

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Brion Vibber
2011/9/26 Platonides > Roan Kattouw wrote: > > As you say, there are gaps in the rev_id sequence due to undeleted > > revisions and possibly the occasional transaction-rollback-induced > > gap. The real real number would be SELECT COUNT(*) FROM revision; but > > that'll probably take like half an

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Roan Kattouw
On Mon, Sep 26, 2011 at 8:50 PM, Roan Kattouw wrote: > 2011/9/26 Platonides : >> Wouldn't it be able to use the index in rev_id to return it in O(1) ? >> It takes ages in the toolserver view, but I guess it would be the >> 428660376 rows it shows in the explain. Yeah that number is an estimate, bu

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Roan Kattouw
2011/9/26 Platonides : > Wouldn't it be able to use the index in rev_id to return it in O(1) ? > It takes ages in the toolserver view, but I guess it would be the > 428660376 rows it shows in the explain. No. This works for the MAX(), but not for the COUNT(), where it literally has to count row-by-

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Platonides
Roan Kattouw wrote: > On Mon, Sep 26, 2011 at 4:59 PM, Ariel T. Glenn wrote: >> Στις 26-09-2011, ημέρα Δευ, και ώρα 08:47 +0200, ο/η melvin_mm έγραψε: mysql>select max(rev_id) from revision; +-+ | max(rev_id) | +-+ | 452476647 | >>

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Roan Kattouw
On Mon, Sep 26, 2011 at 4:59 PM, Ariel T. Glenn wrote: > Στις 26-09-2011, ημέρα Δευ, και ώρα 08:47 +0200, ο/η melvin_mm έγραψε: >> >    mysql>  select max(rev_id) from revision; >> >  +-+ >> >  | max(rev_id) | >> >  +-+ >> >  |   452476647 | >> >  +-+ >> >  1 ro

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Ariel T. Glenn
Στις 26-09-2011, ημέρα Δευ, και ώρα 17:59 +0300, ο/η Ariel T. Glenn έγραψε: > Στις 26-09-2011, ημέρα Δευ, και ώρα 08:47 +0200, ο/η melvin_mm έγραψε: > > Ariel T. Glenn wikimedia.org> writes: > > > Στις 26-09-2011, ημέρα Δευ, και ώρα 02:20 +0200, ο/η melvin_mm έγραψε: > > > > Ok, thanks! So in

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Ariel T. Glenn
Στις 26-09-2011, ημέρα Δευ, και ώρα 08:47 +0200, ο/η melvin_mm έγραψε: > Ariel T. Glenn wikimedia.org> writes: > > Στις 26-09-2011, ημέρα Δευ, και ώρα 02:20 +0200, ο/η melvin_mm έγραψε: > > > Ok, thanks! So in pages-meta-history, those ~33.000.000 archived / > > > deleted revisions are not i

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-26 Thread Jelle Zijlstra
Perhaps it's the "revisions" that are created when someone protects or moves a page? 2011/9/26 melvin_mm > Ariel T. Glenn wikimedia.org> writes: > > Στις 26-09-2011, ημέρα Δευ, και ώρα 02:20 +0200, ο/η melvin_mm έγραψε: > > > Ok, thanks! So in pages-meta-history, those ~33.000.000 archived

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-25 Thread melvin_mm
Ariel T. Glenn wikimedia.org> writes: > Στις 26-09-2011, ημέρα Δευ, και ώρα 02:20 +0200, ο/η melvin_mm έγραψε: > > Ok, thanks! So in pages-meta-history, those ~33.000.000 archived / > > deleted revisions are not included. Probably this number consists of > > content from all Namespaces. >

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-25 Thread Ariel T. Glenn
Στις 26-09-2011, ημέρα Δευ, και ώρα 02:20 +0200, ο/η melvin_mm έγραψε: > John gmail.com> writes: > > > > mysql> select count(*) from archive; > > +--+ > > | count(*) | > > +--+ > > | 33263574 | > > +--+ > > 1 row in set (8 min 47.50 sec) > > > > On Sun, Sep 25, 20

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-25 Thread melvin_mm
John gmail.com> writes: > > mysql> select count(*) from archive; > +--+ > | count(*) | > +--+ > | 33263574 | > +--+ > 1 row in set (8 min 47.50 sec) > > On Sun, Sep 25, 2011 at 5:13 PM, melvin_mm gmx.de> wrote: > > > Bryan Tong Minh gmail.com> writes: > > >

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-25 Thread John
mysql> select count(*) from archive; +--+ | count(*) | +--+ | 33263574 | +--+ 1 row in set (8 min 47.50 sec) On Sun, Sep 25, 2011 at 5:13 PM, melvin_mm wrote: > Bryan Tong Minh gmail.com> writes: > > On Sun, Sep 25, 2011 at 9:09 PM, melvin_mm gmx.de> > wrote: > > > >

Re: [Wikitech-l] Counting revisions in 2011090

2011-09-25 Thread melvin_mm
Bryan Tong Minh gmail.com> writes: > On Sun, Sep 25, 2011 at 9:09 PM, melvin_mm gmx.de> wrote: > > > > Are some revisions, e.g. minor edits not included in the dump? > > > Deleted revisions? > If deleted revisions sum up to ~70.000.000 - could I add this information to http://en.wikipedia