Your message dated Mon, 16 Apr 2012 19:50:35 +0000
with message-id <[email protected]>
and subject line Bug#668000: fixed in moin 1.9.4-2
has caused the Debian Bug report #668000,
regarding Scalability problem with large numbers of registered users
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
668000: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=668000
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Package: python-moinmoin
Version: 1.9.3-3~bpo60+1
Severity: important
Tags: upstream
We've been experiencing performance problems for a while on
wiki.debian.org, which uses moin. Specifically, page saves take a
*very* long time, on the order of 90 seconds on a system that is
otherwise performing well. I've debugged into this and I've found the
problem: the code that works out which users need notifying about page
changes.
We've currently got 10,686 registered users on wiki.debian.org. strace
shows that moin is opening the user data file for every one of those
users in turn to check the subscribed_pages array. That takes a long
time! I've verified this is the problem - hacking saveText to disable
the notification code reduces the page save time from ~90 seconds to
~3 seconds.
This is clearly an upstream issue - it's a scalability bug in moin's
design. This area needs fixing in some way - maybe add a cache in
front of the user lookup here, or store the subscribed_pages
information differently. I might be able to help with coding this, but
I'd want to see what upstream plans might be first.
-- System Information:
Debian Release: 6.0.4
APT prefers stable
APT policy: (500, 'stable')
Architecture: amd64 (x86_64)
Kernel: Linux 2.6.32-5-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Versions of packages python-moinmoin depends on:
ii python 2.6.6-3+squeeze6 interactive high-level object-orie
ii python-parsedatetime 0.8.7-2 Python module to parse human-reada
ii python-pygments 1.3.1+dfsg-1 syntax highlighting package writte
ii python-recaptcha 1.0.5-1+squeeze1 client library for reCAPTCHA and M
ii python-werkzeug 0.6.2-1 collection of utilities for WSGI a
ii python2.5 2.5.5-11 An interactive high-level object-o
ii python2.6 2.6.6-8+b1 An interactive high-level object-o
Versions of packages python-moinmoin recommends:
ii apache2-mpm-worker [ht 2.2.16-6+squeeze6 Apache HTTP Server - high speed th
ii exim4-daemon-light [ma 4.72-6+squeeze2 lightweight Exim MTA (v4) daemon
ii fckeditor 1:2.6.6-1 rich text format javascript web ed
ii python-xapian 1.2.3-3 Xapian search engine interface for
ii python-xappy 0.5-4 easy-to-use interface to the Xapia
Versions of packages python-moinmoin suggests:
ii antiword 0.37-6 Converts MS Word files to text, PS
pn catdoc <none> (no description available)
pn cifs-utils <none> (no description available)
pn docbook-dsssl <none> (no description available)
ii miscfiles [wordlist] 1.4.2.dfsg.1-9 Dictionaries and other interesting
ii poppler-utils [xpdf-utils 0.12.4-1.2 PDF utilitites (based on libpopple
pn python-4suite-xml <none> (no description available)
ii python-docutils 0.7-2 utilities for the documentation of
pn python-flup <none> (no description available)
pn python-gdchart <none> (no description available)
pn python-ldap <none> (no description available)
pn python-mysqldb <none> (no description available)
pn python-openid <none> (no description available)
pn python-pyxmpp <none> (no description available)
ii python-tz 2010b-1 Python version of the Olson timezo
pn python-xml <none> (no description available)
ii wamerican [wordlist] 6-3 American English dictionary words
ii wbritish [wordlist] 6-3 British English dictionary words f
-- Configuration Files:
/etc/moin/mywiki.py changed [not included]
-- no debconf information
--- End Message ---
--- Begin Message ---
Source: moin
Source-Version: 1.9.4-2
We believe that the bug you reported is fixed in the latest version of
moin, which is due to be installed in the Debian FTP archive:
moin_1.9.4-2.debian.tar.gz
to main/m/moin/moin_1.9.4-2.debian.tar.gz
moin_1.9.4-2.dsc
to main/m/moin/moin_1.9.4-2.dsc
python-moinmoin_1.9.4-2_all.deb
to main/m/moin/python-moinmoin_1.9.4-2_all.deb
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Steve McIntyre <[email protected]> (supplier of updated moin package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Format: 1.8
Date: Mon, 16 Apr 2012 20:18:27 +0100
Source: moin
Binary: python-moinmoin
Architecture: source all
Version: 1.9.4-2
Distribution: unstable
Urgency: low
Maintainer: Jonas Smedegaard <[email protected]>
Changed-By: Steve McIntyre <[email protected]>
Description:
python-moinmoin - Python clone of WikiWiki - library
Closes: 668000
Changes:
moin (1.9.4-2) unstable; urgency=low
.
* Add a cache for subscriber lookup to boost performance on page save.
Patch from Vitaliy Shchupak. Closes: #668000
Checksums-Sha1:
889c13247c0c3535fcf9a1f1e901273277c717e5 1949 moin_1.9.4-2.dsc
c6f810da227d0c0d7acfefa8867681544f75484b 125021 moin_1.9.4-2.debian.tar.gz
1160a4c54da998ad1afac5fbf1dca3e61617b310 21394520
python-moinmoin_1.9.4-2_all.deb
Checksums-Sha256:
7e1c560f2fe2ac31112ee21ec82b95de7ad553baced36175676b38200a0db2c5 1949
moin_1.9.4-2.dsc
cc9085e68a897a4182940395b74f680a06800ceabde7dc769f1e7a7f4e8cdb1a 125021
moin_1.9.4-2.debian.tar.gz
da7467dc2d5cea5f8b28a20c91bd18bf12057a46f1f91d78f45efb301a72f4fe 21394520
python-moinmoin_1.9.4-2_all.deb
Files:
5ff575cc0017c72aec9fc7cdd9ab4dae 1949 net optional moin_1.9.4-2.dsc
20d063b8eb4bd4a2c0f98042a2f6b129 125021 net optional moin_1.9.4-2.debian.tar.gz
c739b2a23ba76d5e96fc0b7e5be0cefc 21394520 python optional
python-moinmoin_1.9.4-2_all.deb
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
iQIcBAEBCAAGBQJPjHLBAAoJEFh5eVc0QmhOy1EP/1HmsWZHvXE7MQhH1Ch+lLua
p/IgdLVNlQPOmlwkcVIS5XgMbYA2Bb1H22+ZpJ+SBe4Zj8ND1y2WOe4Bc+w9taSO
sOr9OG1e6nJjpnC+ckeYihcJZCs2Fi/NTnPLnb5PZBFk1BOr631npV+lqHVOK7oA
9nJbngZrFeZrJdkbRTbgmIpnIIookioYnfCbqJQeRIm3bnvbjt/lPxbi9hkQSsC5
o8cBThcfFyttcTh1DWHDZTcbw19DdyKX1R5hbdGpXvOHowCdZfSlsD3PfYxZNR6b
UKMLyhHXj0Os5uTsDO5u1Eqdzn9abaxA6+HqU9gWDSYwc+OkXgwAovn7i+vt2ke/
v1150/4GG/lOgeSy33jR9oTTWwHjCVvHGk1ohwLThwo94FLJcxylgR5/N1g31nV7
h13z/QMZBBVeNh0J8U499viWpKmUNo/39CC+hDJXJL2092D0TP6cLd7sAHSw78As
SXABkPs3Kl9anepXSeAWtzH1eS1AWP5kAIK8AMiVCOUXvjiC6V3sf6mEIXuH5Bqx
+uIotLZQRnwZ9nSh4zlhcWZkhk99kCcrwZDWxBXDWQADijj1MzDFAxyRw+idVoKC
EaoUc9tfFVH987izOciH97P1GfdlRn8iiV85ryNLyEJu4C5Hrrrn8EFBuP8uzJhU
II1M6N4/G9a6AtneuCqz
=loEg
-----END PGP SIGNATURE-----
--- End Message ---
