Re: [Mailman-Users] MemoryError
At 9:12 PM -0600 2005-10-30, [EMAIL PROTECTED] wrote: admin(7105): File /usr/local/cpanel/3rdparty/mailman/scripts/driver, line 101, in run_main Please see http://www.python.org/cgi-bin/faqw-mm.py?req=showfile=faq06.011.htp. -- Brad Knowles, [EMAIL PROTECTED] Those who would give up essential Liberty, to purchase a little temporary Safety, deserve neither Liberty nor Safety. -- Benjamin Franklin (1706-1790), reply of the Pennsylvania Assembly to the Governor, November 11, 1755 SAGE member since 1995. See http://www.sage.org/ for more info. -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp
Re: [Mailman-Users] MemoryError
Mark, Here is your reply that you wanted bounced to the list. I did a little more digging with the customer and found out that he was trying to import 250,000 new emails to the list he created so your answer might have hit the nail on the head. Brad Thanks for your reply, I will make sure to check check with the CPanel folks as well when I run into issues. Thanks! Zeus -Original Message- From: Mark Sapiro Sent: Sunday, October 30, 2005 9:14 PM To: [EMAIL PROTECTED] Subject: RE: [Mailman-Users] MemoryError [EMAIL PROTECTED] wrote: Sorry, didnt realize I had missed that Oct 29 18:07:35 2005 admin(7105): admin(7105): [- Mailman Version: 2.1.6 -] admin(7105): [- Traceback --] admin(7105): Traceback (most recent call last): admin(7105): File /usr/local/cpanel/3rdparty/mailman/scripts/driver, line 101, in run_main admin(7105): main() admin(7105): File /usr/local/cpanel/3rdparty/mailman/Mailman/Cgi/admin.py, line 198, in main admin(7105): mlist.Save() admin(7105): File /usr/local/cpanel/3rdparty/mailman/Mailman/MailList.py, line 557, in Save admin(7105): self.__save(dict) admin(7105): File /usr/local/cpanel/3rdparty/mailman/Mailman/MailList.py, line 514, in __save admin(7105): cPickle.dump(dict, fp, 1) admin(7105): MemoryError I can't tell you a whole lot. First, please see http://www.python.org/cgi-bin/faqw-mm.py?req=showfile=faq06.011.htp That said, the error occurs in saving the mail list object. This code is exercised continuously for all lists, so the error must have somethig to do with this list in particular. A MemoryError exception is a built-in Python exception Raised when an operation runs out of memory but the situation may still be rescued (by deleting some objects). How many members does this list have? According to the FAQ, the largest list reported to date has 147,000 members and presumably works. Possibly something in the cPanel implementation or your particular installation limits this to a greater degree. Possibly, there's something amis in the list's config.pck file, but short of dumping it with bin/dumpdb or maybe listing members with bin/list_members and examining those outputs for 'garbled data', I wouldn't know what to look for. -- Mark Sapiro [EMAIL PROTECTED] The highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -Original Message- From: Mark Sapiro Sent: Sunday, October 30, 2005 12:37 AM To: [EMAIL PROTECTED]; mailman-users@python.org Subject: Re: [Mailman-Users] MemoryError [EMAIL PROTECTED] wrote: I am getting the following error with mailman 2.1.6, red-hat. It started to occur while a customer was importing a new set of email adresss into their mailinglist. They can login to the webadmin, but when they click on Membership they get the Weve Hit A Bug message. This is what I see in the error.log I have searched around for what it could be, but cant find anything on this specific problem admin(7105): MemoryError admin(7105): [- Python Information -] admin(7105): sys.version = 2.2.3 (#1, Feb 2 2005, 12:20:51) [GCC 3.2.3 20030502 (Red Hat Linux 3.2.3-49)] snip And what immediately precedes this in the log. The part that begins: mmm dd hh:mm:ss admin(pid): admin(pid): [- Mailman Version: 2.1.6 -] admin(pid): [- Traceback --] followed by the traceback. -- Mark Sapiro [EMAIL PROTECTED] The highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp
Re: [Mailman-Users] MemoryError
Sorry, didnt realize I had missed at the top Z Oct 29 18:07:35 2005 admin(7105): admin(7105): [- Mailman Version: 2.1.6 -] admin(7105): [- Traceback --] admin(7105): Traceback (most recent call last): admin(7105): File /usr/local/cpanel/3rdparty/mailman/scripts/driver, line 101, in run_main admin(7105): main() admin(7105): File /usr/local/cpanel/3rdparty/mailman/Mailman/Cgi/admin.py, line 198, in main admin(7105): mlist.Save() admin(7105): File /usr/local/cpanel/3rdparty/mailman/Mailman/MailList.py, line 557, in Save admin(7105): self.__save(dict) admin(7105): File /usr/local/cpanel/3rdparty/mailman/Mailman/MailList.py, line 514, in __save admin(7105): cPickle.dump(dict, fp, 1) admin(7105): MemoryError -Original Message- From: Mark Sapiro [mailto:[EMAIL PROTECTED] Sent: Sunday, October 30, 2005 12:37 AM To: [EMAIL PROTECTED]; mailman-users@python.org Subject: Re: [Mailman-Users] MemoryError [EMAIL PROTECTED] wrote: I am getting the following error with mailman 2.1.6, red-hat. It started to occur while a customer was importing a new set of email adresss into their mailinglist. They can login to the webadmin, but when they click on Membership they get the Weve Hit A Bug message. This is what I see in the error.log I have searched around for what it could be, but cant find anything on this specific problem admin(7105): MemoryError admin(7105): [- Python Information -] admin(7105): sys.version = 2.2.3 (#1, Feb 2 2005, 12:20:51) [GCC 3.2.3 20030502 (Red Hat Linux 3.2.3-49)] snip And what immediately precedes this in the log. The part that begins: mmm dd hh:mm:ss admin(pid): admin(pid): [- Mailman Version: 2.1.6 -] admin(pid): [- Traceback --] followed by the traceback. -- Mark Sapiro [EMAIL PROTECTED] The highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp
[Mailman-Users] MemoryError
I am getting the following error with mailman 2.1.6, red-hat. It started to occur while a customer was importing a new set of email adresss into their mailinglist. They can login to the webadmin, but when they click on Membership they get the Weve Hit A Bug message. This is what I see in the error.log I have searched around for what it could be, but cant find anything on this specific problem admin(7105): MemoryError admin(7105): [- Python Information -] admin(7105): sys.version = 2.2.3 (#1, Feb 2 2005, 12:20:51) [GCC 3.2.3 20030502 (Red Hat Linux 3.2.3-49)] admin(7105): sys.executable = /usr/bin/python admin(7105): sys.prefix = /usr admin(7105): sys.exec_prefix = /usr admin(7105): sys.path= /usr admin(7105): sys.platform= linux2 admin(7105): [- Environment Variables -] admin(7105):HTTP_COOKIE: newsletters_procapperschallenge.com+admin=2802006910f263437328003761 316139346239656165653537633762363363306230$ admin(7105):SERVER_SOFTWARE: Apache/1.3.33 (Unix) mod_auth_passthrough/1.8 mod_log_bytes/1.2 mod_bwlimited/1.4 PHP/4.3.11 FrontPage/5.0.2.2635 $ admin(7105):PYTHONPATH: /usr/local/cpanel/3rdparty/mailman admin(7105):SCRIPT_FILENAME: /usr/local/cpanel/3rdparty/mailman/cgi-bin/admin admin(7105):SERVER_ADMIN: [EMAIL PROTECTED] admin(7105):SCRIPT_NAME: /mailman/admin admin(7105):REQUEST_METHOD: GET admin(7105):HTTP_HOST: procapperschallenge.com admin(7105):PATH_INFO: /newsletters_procapperschallenge.com/members admin(7105):SERVER_PROTOCOL: HTTP/1.1 admin(7105):QUERY_STRING: admin(7105):REQUEST_URI: /mailman/admin/newsletters_procapperschallenge.com/members admin(7105):HTTP_ACCEPT: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/x-shockwave-flash, application/vnd.ms-powerpoint, app$ admin(7105):HTTP_USER_AGENT: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 1.0.3705) admin(7105):HTTP_CONNECTION: Keep-Alive admin(7105):HTTP_REFERER: http://procapperschallenge.com/mailman/admin/newsletters_procapperschallenge .com admin(7105):SERVER_NAME: www.professionalcapperschallenge.com admin(7105):REMOTE_ADDR: 67.184.23.240 admin(7105):REMOTE_PORT: 33760 admin(7105):HTTP_ACCEPT_LANGUAGE: en-us admin(7105):PATH_TRANSLATED: /home/dpage/public_html/newsletters_procapperschallenge.com/members admin(7105):SERVER_PORT: 80 admin(7105):GATEWAY_INTERFACE: CGI/1.1 admin(7105):HTTP_ACCEPT_ENCODING: gzip, deflate admin(7105):SERVER_ADDR: 70.86.123.210 admin(7105):DOCUMENT_ROOT: /home/dpage/public_html -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp
Re: [Mailman-Users] MemoryError
[EMAIL PROTECTED] wrote: I am getting the following error with mailman 2.1.6, red-hat. It started to occur while a customer was importing a new set of email adresss into their mailinglist. They can login to the webadmin, but when they click on Membership they get the Weve Hit A Bug message. This is what I see in the error.log I have searched around for what it could be, but cant find anything on this specific problem admin(7105): MemoryError admin(7105): [- Python Information -] admin(7105): sys.version = 2.2.3 (#1, Feb 2 2005, 12:20:51) [GCC 3.2.3 20030502 (Red Hat Linux 3.2.3-49)] snip And what immediately precedes this in the log. The part that begins: mmm dd hh:mm:ss admin(pid): admin(pid): [- Mailman Version: 2.1.6 -] admin(pid): [- Traceback --] followed by the traceback. -- Mark Sapiro [EMAIL PROTECTED] The highway is for gamblers, San Francisco Bay Area, Californiabetter use your sense - B. Dylan -- Mailman-Users mailing list Mailman-Users@python.org http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ Unsubscribe: http://mail.python.org/mailman/options/mailman-users/archive%40jab.org Security Policy: http://www.python.org/cgi-bin/faqw-mm.py?req=showamp;file=faq01.027.htp
[Mailman-Users] MemoryError
I have a bunch of emails stuck in the qfiles/shunt folder that all suffer from the following error when I try and unshunt them. Apr 15 09:25:33 2004 (1382650) Uncaught runner exception: Apr 15 09:25:33 2004 (1382650) Traceback (most recent call last): File /usr/local/mailman/Mailman/Queue/Runner.py, line 110, in _oneloop self._onefile(msg, msgdata) File /usr/local/mailman/Mailman/Queue/Runner.py, line 160, in _onefile keepqueued = self._dispose(mlist, msg, msgdata) File /usr/local/mailman/Mailman/Queue/ArchRunner.py, line 73, in _dispose mlist.ArchiveMail(msg) File /usr/local/mailman/Mailman/Archiver/Archiver.py, line 217, in ArchiveMail h.processUnixMailbox(f) File /usr/local/mailman/Mailman/Archiver/pipermail.py, line 606, in processUnixMailbox a = self._makeArticle(m, self.sequence) File /usr/local/mailman/Mailman/Archiver/HyperArch.py, line 651, in _makeArticle mlist=self.maillist) File /usr/local/mailman/Mailman/Archiver/HyperArch.py, line 320, in __init__ body = message.get_payload(decode=True) File /usr/local/mailman/pythonlib/email/Message.py, line 197, in get_payload return Utils._qdecode(payload) File /usr/local/lib/python2.3/quopri.py, line 161, in decodestring return a2b_qp(s, header = header) MemoryError Apr 15 09:25:33 2004 (1382650) SHUNTING: 1075876188.8703721+89f1d4373368e55d6fef59a2a5c31fa92d07050c I upgraded to Mailman 2.1.4 but the problem still persists. Has anyone else seen this? -- Patrick Finnerty, System Administrator, Mission Critical Proactive Services, Hewlett Packard, Ballybrit Business Park, Galway, IRELAND. p: +353-91-754722 e: [EMAIL PROTECTED] The contents of this message and any attachments to it are confidential and may be legally privileged. If you have received this message in error you should delete it from your system immediately and advise the sender. To any recipient of this message within HP, unless otherwise stated , you should consider this message and attachments as HP CONFIDENTIAL. -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/
Re: [Mailman-Users] MemoryError in htmlformat.py
What version of Mailman are you using? (it looks like one of the 2.1.x versions). Hope you have already fixed this by now, but just in case, here is something you can try. Look in the data directory for Mailman - this is where the held messages are stored. You can actually scan the heldmsg files manually and delete ones that might be overly large. cd /usr/local/mailman/data ls -l The default message format in version 2.1 is pickle (instead of text), but you can still easily look at each held message by using the strings command (strings is a utility that used to be loaded by default, if you don't have it loaded it's very easy to find). strings heldmsg-b2b-list-1.pck Deleting the heldmsg's here does not delete them from your lists request.db file, but when you run admindb for the list, that will compare the heldmsg files to the ones in request.db and then update request.db (the handling of the request.db file is a lot smarter in version 2.1 of Mailman). In other words,once you launch the Web-admindb everything should sync up and you will just see the messages you left that need approving. It *should* work at this point. assuming that problem was a bad email and you deleted the bad email If not, I recommend removing that lists request.db file: /usr/local/mailman/lists/b2b-list/request.db Just rename the file to something else and then try launching the web-admindb again. Good Luck - Jon Carnes == On Wed, 2003-02-19 at 05:14, Stephan Spencer wrote: This one is out of my depth. The Tend to Pending Moderator Requests page has become inaccessible due to a MemoryError. The traceback follows below. Any guidance would be greatly appreciated. (The list in question is gated to the moderated Usenet newsgroup rec.travel.bed+breakfast, so it gets a lot of incoming spam. Not sure if that has anything to do with the problem at hand, however.). Thanks! Traceback (most recent call last): File /usr/local/mailman/scripts/driver, line 87, in run_main main() File /usr/local/mailman/Mailman/Cgi/admindb.py, line 236, in main print doc.Format() File /usr/local/mailman/Mailman/htmlformat.py, line 331, in Format output.append(Container.Format(self, indent)) File /usr/local/mailman/Mailman/htmlformat.py, line 264, in Format output.append(HTMLFormatObject(item, indent)) File /usr/local/mailman/Mailman/htmlformat.py, line 50, in HTMLFormatObject return item.Format(indent) File /usr/local/mailman/Mailman/htmlformat.py, line 417, in Format output = output + Container.Format(self, indent+2) File /usr/local/mailman/Mailman/htmlformat.py, line 264, in Format output.append(HTMLFormatObject(item, indent)) File /usr/local/mailman/Mailman/htmlformat.py, line 50, in HTMLFormatObject return item.Format(indent) File /usr/local/mailman/Mailman/htmlformat.py, line 200, in Format output = output + self.FormatRow(i, indent + 2) MemoryError Python information: Variable Value sys.version 2.2.2 (#1, Jan 14 2003, 02:49:11) [GCC 2.96 2731 (Red Hat Linux 7.1 2.96-98)] sys.executable /usr/local/bin/python sys.prefix /usr/local sys.exec_prefix /usr/local sys.path /usr/local sys.platform linux2 Environment variables: Variable Value PATH_INFO /bnb-list HTTP_ACCEPT */* CONTENT_TYPE application/x-www-form-urlencoded HTTP_REFERER http://www.innsite.com/mailman/admindb/bnb-list SERVER_SOFTWARE Apache/1.3.26 (Unix) PHP/4.2.3 PYTHONPATH /usr/local/mailman SCRIPT_FILENAME /usr/local/mailman/cgi-bin/admindb SERVER_ADMIN [EMAIL PROTECTED] SCRIPT_NAME /mailman/admindb SCRIPT_URI http://www.innsite.com/mailman/admindb/bnb-list SERVER_SIGNATURE Apache/1.3.26 Server at www.innsite.com Port 80 REQUEST_METHOD POST HTTP_HOST www.innsite.com SCRIPT_URL /mailman/admindb/bnb-list SERVER_PROTOCOL HTTP/1.0 QUERY_STRING REQUEST_URI /mailman/admindb/bnb-list CONTENT_LENGTH 35 PATH_TRANSLATED /www/data/innsite/bnb-list HTTP_USER_AGENT Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) AppleWebKit/48 (like Gecko) Safari/48 HTTP_CONNECTION close HTTP_COOKIE Apache=219.88.207.149.5151045648465275 SERVER_NAME www.innsite.com REMOTE_ADDR 219.88.207.149 REMOTE_PORT 49346 HTTP_ACCEPT_LANGUAGE en-us, ja;q=0.33, en;q=0.67 SERVER_ADDR 66.250.38.164 SERVER_PORT 80 GATEWAY_INTERFACE CGI/1.1 UNIQUE_ID PlNUVkL6JqQAAAICmwI DOCUMENT_ROOT /www/data/innsite -- Mailman-Users mailing list [EMAIL PROTECTED] http://mail.python.org/mailman/listinfo/mailman-users Mailman FAQ: http://www.python.org/cgi-bin/faqw-mm.py Searchable Archives: http://www.mail-archive.com/mailman-users%40python.org/ This message was sent to: [EMAIL PROTECTED] Unsubscribe or change your options at http://mail.python.org/mailman/options/mailman-users/jonc%40nc.rr.com
Re: [Mailman-Users] MemoryError in htmlformat.py
Hmmm Now that is a good question! I assume you tried copying the heldmsg files back into the data directory and then running the web-admindb (and that didn't work?) If so then try sending a message to the list that would be held for moderation and then replace the heldmsg-...pck file that is created with one of the ones you copied off (just renaming it). Then approve the moderated message and see if that does the job proper. If that doesn't work, you can use the strings command to find who sent the message and drop them a note asking them to resend the message. Good Luck (and let us know what happens!) On Fri, 2003-02-21 at 18:53, Stephan Spencer wrote: Thanks for that, Jon. I am indeed running 2.1. I tried deleting held messages but that didn't work. I'm still getting a low-level error: Feb 21 17:38:44 2003 admin(32190): admin(32190): [- Mailman Version: 2.1 -] admin(32190): [- Traceback --] admin(32190): Traceback (most recent call last): admin(32190): File /usr/local/mailman/scripts/driver, line 87, in run_main I deleted request.db and it works fine now. I've made backups of the 15 or so legitimate held messages (heldmsg-bnb-list-xxx.pck). How do I get those back into request.db? Thanks, Stephan On Saturday, February 22, 2003, at 04:54 AM, Jon Carnes wrote: What version of Mailman are you using? (it looks like one of the 2.1.x versions). Hope you have already fixed this by now, but just in case, here is something you can try. Look in the data directory for Mailman - this is where the held messages are stored. You can actually scan the heldmsg files manually and delete ones that might be overly large. cd /usr/local/mailman/data ls -l The default message format in version 2.1 is pickle (instead of text), but you can still easily look at each held message by using the strings command (strings is a utility that used to be loaded by default, if you don't have it loaded it's very easy to find). strings heldmsg-b2b-list-1.pck Deleting the heldmsg's here does not delete them from your lists request.db file, but when you run admindb for the list, that will compare the heldmsg files to the ones in request.db and then update request.db (the handling of the request.db file is a lot smarter in version 2.1 of Mailman). In other words,once you launch the Web-admindb everything should sync up and you will just see the messages you left that need approving. It *should* work at this point. assuming that problem was a bad email and you deleted the bad email If not, I recommend removing that lists request.db file: /usr/local/mailman/lists/b2b-list/request.db Just rename the file to something else and then try launching the web-admindb again. Good Luck - Jon Carnes == On Wed, 2003-02-19 at 05:14, Stephan Spencer wrote: This one is out of my depth. The Tend to Pending Moderator Requests page has become inaccessible due to a MemoryError. The traceback follows below. Any guidance would be greatly appreciated. (The list in question is gated to the moderated Usenet newsgroup rec.travel.bed+breakfast, so it gets a lot of incoming spam. Not sure if that has anything to do with the problem at hand, however.). Thanks! Traceback (most recent call last): File /usr/local/mailman/scripts/driver, line 87, in run_main main() File /usr/local/mailman/Mailman/Cgi/admindb.py, line 236, in main print doc.Format() File /usr/local/mailman/Mailman/htmlformat.py, line 331, in Format output.append(Container.Format(self, indent)) File /usr/local/mailman/Mailman/htmlformat.py, line 264, in Format output.append(HTMLFormatObject(item, indent)) File /usr/local/mailman/Mailman/htmlformat.py, line 50, in HTMLFormatObject return item.Format(indent) File /usr/local/mailman/Mailman/htmlformat.py, line 417, in Format output = output + Container.Format(self, indent+2) File /usr/local/mailman/Mailman/htmlformat.py, line 264, in Format output.append(HTMLFormatObject(item, indent)) File /usr/local/mailman/Mailman/htmlformat.py, line 50, in HTMLFormatObject return item.Format(indent) File /usr/local/mailman/Mailman/htmlformat.py, line 200, in Format output = output + self.FormatRow(i, indent + 2) MemoryError Python information: Variable Value sys.version 2.2.2 (#1, Jan 14 2003, 02:49:11) [GCC 2.96 2731 (Red Hat Linux 7.1 2.96-98)] sys.executable /usr/local/bin/python sys.prefix /usr/local sys.exec_prefix /usr/local sys.path /usr/local sys.platform linux2 Environment variables: Variable Value PATH_INFO /bnb-list HTTP_ACCEPT */* CONTENT_TYPE application/x-www-form-urlencoded HTTP_REFERER http://www.innsite.com/mailman/admindb/bnb-list SERVER_SOFTWARE Apache/1.3.26 (Unix)