On Thu, Jul 30, 2009 at 12:07 PM, Michael Scheidell<scheid...@secnap.net> wrote:
> role it in. let amavisd add partition_tag values (for now) without doing > the mysql thing. > in (14 days?) how long is your retention period?) in 14 days, anything > without a partition tag is useless, then just create new table (with mysql > partition tags) with non zero tagged data. > > 50gb!!! how many users do you have to need 50gb of partition data? > our clients average about 1gb per 1000 users (and a 14 day retention period) 50GB is about 45,000 email boxes worth of quarantine at variable 14-20 day retention. Only a portion of them have quarantine enabled, the remainder push their spam into oblivion. I'd say this crummy image spam with fake <style> tags that has increased 100 fold lately contributes to a lot of it. We've been populating the partition_tag in the db for about 3 weeks and already blown away everything with partition_tag = 0. I've also indexed the partition_tag on the 3 smaller tables so purges from those are very fast with delete queries targetted to the indexed partition_tag. The only remaining table to finish is the quarantine db, which is the big'un. I think I get where your going with that suggestion. Create a new schema that is properly indexed and partitioned. Switch amavisd to log to the new schema instead. Then copy over all the entries from the old schema. Am I hearing you or are we on a different page? I've thought of this, and variants as a solution; however, it seems like a significant mess to copy the old schema contents to the new schema because all the rid values would change. Would have to write a script to sync them all up. p.s. Of note, the mysql version being run currently does not have partitioning support. I'm starting off by adding the new partition_tags, followed by indexing those to just create a faster purge based on the indexing. If that doesn't suffice, I plan on updating the server to support true partitioning and going that route. Thanks, appreciate the discussion. - N ------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ AMaViS-user mailing list AMaViS-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/amavis-user AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 AMaViS-HowTos:http://www.amavis.org/howto/
