All raw mail is being compressed (bzip2) which has freed up quite a few gigabytes so far. I expect the compression to take another 36 hours or so. I also adjusted the mail transfer agent to limit incoming message sizes 50k. Next capacity steps are:
1) compress HTML files on inactive lists and modify apache's mod_gzip to handle them intelligently. This might be a pain. 2) offload raw email to cold storage 3) either add new disk or start recycling bytes. Technology wise, a stabalizing linux 2.4 w/ reiserfs and lvm are looking progressively good for disk expansion, while IDE RAID continues to lag. Too bad, as IBM is supposedly planning to sell 200GB commodity IDE drives sometime in 2003. Haven't heard back from VA about whether they'd be willing to send a terabyte our direction, and am not holding my breath. If we recycle bytes, onelist.com lists will be the first against the wall. Finally, the pgsql lists' splintering is being cleaned up, and I may need to tweak the sorting heuristics after further analysis of what caused the problem. I'm seeing minor missorts elsewhere, too, although only a handful of lists seem to be affected. Jeff ====== PS. For technical people with time on their hands, who have read the mail-archive source, and who are interested in debugging (HAH!) the following header sorted under [EMAIL PROTECTED] despite the existance of the following list archives. If someone wants to do the analysis, great, otherwise I'll tackle it next week. [EMAIL PROTECTED] [EMAIL PROTECTED] [EMAIL PROTECTED] [EMAIL PROTECTED] Return-Path: [EMAIL PROTECTED] Delivery-Date: Thu May 03 21:50:29 2001 Envelope-to: archive@jab.org Received: from yucca.anv.net ([216.241.111.3]) by zamboni.jab.org with esmtp (Exim 3.12 #1 (Debian)) id 14vXXw-0001iR-00 for <archive@jab.org>; Thu, 03 May 2001 21:50:28 -0700 Received: (from majordomo@localhost) by yucca.anv.net (8.9.3/8.9.3) id WAA09961 for ldrider-outgoing; Thu, 3 May 2001 22:27:56 -0700 (PDT) Received: from corinth.bossig.com (corinth.bossig.com [208.26.239.66]) by yucca.anv.net (8.9.3/8.9.3) with ESMTP id WAA09956; Thu, 3 May 2001 22:27:47 -0700 (PDT) Received: from pavilion (unverified [208.26.241.195]) by corinth.bossig.com (Rockliffe SMTPRA 4.5.4) with SMTP id <[EMAIL PROTECTED]>; Thu, 3 May 2001 21:52:07 -0700 Message-Id: <[EMAIL PROTECTED]> X-Sender: [SNIP] X-Mailer: Windows Eudora Pro Version 3.0.1 (32) Date: Thu, 03 May 2001 21:57:46 -0700 To: [EMAIL PROTECTED], [EMAIL PROTECTED] From: [SNIP] Subject: [SNIP] Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Sender: [EMAIL PROTECTED] Precedence: bulk Reply-To: [SNIP] _______________________________________________ Gossip mailing list [EMAIL PROTECTED] http://jab.org/cgi-bin/mailman/listinfo/gossip