[Dbmail] DBMail in as a part of a PHP CRM app
Hi There, We have been asked to build an online (lite) CRM package that is customised to a specific customers needs.. That bit is easy.. But the one thing they want integrated into the package is their incoming and outgoing mail. They want for the online CRM to be able to view all incoming and outgoing correspondence to a certain customer... They will have their own Linux server for Mail/Apache/PHP/MySQL. Im wondering if dbmail (and postfix) would be a good fit for the Mail part of that role considering that its all in mysql. Can anyone give their opinions/ideas regarding this? They are much appreciated! Simon
[Dbmail] Re: [mydns-users] MyDNS Questions / Delopment question
On Thu, 24 Feb 2005 17:18:19 +, Alex Leonhardt [EMAIL PROTECTED] wrote: I tried to figure out if it's possible to run a script or similar each time a request comes in to the DNS Server. MyDNS can write a line to the log file for each request with the --verbose option. See contrib/stats.php for information on how to process this. You could process in near realtime by watching the file for changes (like the tail program) or in realtime by using a fifo for the log file. What sort of overhead processing/disk-wise does this consume? Regards, Simon
[Dbmail] Native webmail for version 2.x? (Need SQL)
Is there a native webmail package for dbmail version 2.x? I can only find one for version 1.x The reason i ask is that we have been asked by a client to build a very customised webmail (with PHP) system for use with dbmail 2.x and would like to take a look at the sql commands for various things... Or does someone have a list of the SQL commands? We are looking to build it as a standard webmail package with a 'plugin' type system for the customisation for the client... and will consider open-sourcing the basic webmail once completed. Any help is appreciated. Simon
[Dbmail] User receiving duplicates in DBmail.
Hi there, One of my users is complaining about recieving duplicates. Hes one of the on-to-it ones :), so its not a config error on his side or anything. Can anyone rule out dbamil here? Is this a amavis problem? Thanks. Headers for emails below: HEADER 1:--- Received: from localhost (localhost [127.0.0.1]) by mx1.xxx.co.nz (Postfix) with ESMTP id B76AE262010C for [EMAIL PROTECTED]; Tue, 12 Apr 2005 10:07:53 +1200 (NZST) Received: from mx1.xxx.co.nz ([127.0.0.1]) by localhost (mx1.xxx.co.nz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 19551-01 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 10:07:39 +1200 (NZST) Received: from kermit.xxx.govt.nz (unknown [202.49.35.20]) by mx1.xxx.co.nz (Postfix) with ESMTP id 74DE226200D4 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:02 +1200 (NZST) Received: from venus.xxx.govt.nz (Not Verified[10.1.1.30]) by kermit.xxx.govt.nz with NetIQ MailMarshal (v5.5.6.7) id Bfe243; Tue, 12 Apr 2005 09:48:56 +1200 HEADER 2:--- Received: from localhost (localhost [127.0.0.1]) by mx1.xxx.co.nz (Postfix) with ESMTP id 8E7A2262010B for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:20 +1200 (NZST) Received: from mx1.xxx.co.nz ([127.0.0.1]) by localhost (mx1.xxx.co.nz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 18868-04 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:05 +1200 (NZST) Received: from kermit.xxx.govt.nz (unknown [202.49.35.20]) by mx1.xxx.co.nz (Postfix) with ESMTP id 74DE226200D4 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:02 +1200 (NZST) Received: from venus.xxx.govt.nz (Not Verified[10.1.1.30]) by kermit.xxx.govt.nz with NetIQ MailMarshal (v5.5.6.7) id Bfe243; Tue, 12 Apr 2005 09:48:56 +1200
Re: [Dbmail] User receiving duplicates in DBmail.
Sri Gupta wrote: One of my users is complaining about recieving duplicates. Hes one of the on-to-it ones :), so its not a config error on his side or anything. Can anyone rule out dbamil here? Is this a amavis problem? Thanks. Headers for emails below: HEADER 1:--- Received: from localhost (localhost [127.0.0.1]) by mx1.xxx.co.nz (Postfix) with ESMTP id B76AE262010C for [EMAIL PROTECTED]; Tue, 12 Apr 2005 10:07:53 +1200 (NZST) Received: from mx1.xxx.co.nz ([127.0.0.1]) by localhost (mx1.xxx.co.nz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 19551-01 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 10:07:39 +1200 (NZST) Received: from kermit.xxx.govt.nz (unknown [202.49.35.20]) by mx1.xxx.co.nz (Postfix) with ESMTP id 74DE226200D4 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:02 +1200 (NZST) Received: from venus.xxx.govt.nz (Not Verified[10.1.1.30]) by kermit.xxx.govt.nz with NetIQ MailMarshal (v5.5.6.7) id Bfe243; Tue, 12 Apr 2005 09:48:56 +1200 HEADER 2:--- Received: from localhost (localhost [127.0.0.1]) by mx1.xxx.co.nz (Postfix) with ESMTP id 8E7A2262010B for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:20 +1200 (NZST) Received: from mx1.xxx.co.nz ([127.0.0.1]) by localhost (mx1.xxx.co.nz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 18868-04 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:05 +1200 (NZST) Received: from kermit.xxx.govt.nz (unknown [202.49.35.20]) by mx1.xxx.co.nz (Postfix) with ESMTP id 74DE226200D4 for [EMAIL PROTECTED]; Tue, 12 Apr 2005 09:49:02 +1200 (NZST) Received: from venus.xxx.govt.nz (Not Verified[10.1.1.30]) by kermit.xxx.govt.nz with NetIQ MailMarshal (v5.5.6.7) id Bfe243; Tue, 12 Apr 2005 09:48:56 +1200 Grep your mail logs for 'twice' and see what you find. I had similar trouble, it turned out to be amavis having funny behaviour re:stale children. I stopgapped a solution by increasing postfix's timeout length and adding 'amavisd reload' to my hourly cron. (Stupid, I know, but effective.) Hmm.. no mention of 'twice' in any of the logs. I am currently having a problem with /usr/bin/python /usr/bin/pyzor check, in the fact that there are LOTS of processes running... Could this be one in the same problem?
Re: [Dbmail] User receiving duplicates in DBmail.
Sri Gupta wrote: Sorry, I'm a moron, grep your logs for once. The error I had was Message may be delivered more than once, and it was an amavis timeout problem with stale childs. -Sri On Wed, Apr 13, 2005 at 04:15:42PM +1200, Simon wrote: Hmm.. no mention of 'twice' in any of the logs. I am currently having a problem with /usr/bin/python /usr/bin/pyzor check, in the fact that there are LOTS of processes running... Could this be one in the same problem? OK!: Found it. I've just solved the problem with the pyzor thing above.. So i'll monitor it and see if that helps. Can you outline your work around in detail? Thanks SImon
Re: [Dbmail] User receiving duplicates in DBmail.
Sri Gupta wrote: OK!: Found it. I've just solved the problem with the pyzor thing above.. So i'll monitor it and see if that helps. Can you outline your work around in detail? I almost feel stupid sharing this, because it's a kludge of the worst kind. I'm too lazy to see what's actually wrong so I'm throwing voodoo and hoping it works itself out. In this case, it's a working kludge, but I still don't like it. I'm delivering mail to amavis from postfix using lmtp, and from postfix to dbmail using dbmail-smtp.. the only lmtp connection is postfix-amavis, so I added this to main.cf: lmtp_connect_timeout = 600s and I have one of these in my crontab: */30 * * * * /usr/sbin/amavisd reload /dev/null 21 and I got rid of DCC, razor and pyzor.. the penalty for starting them up for each message was huge, even compared to virus scanners.. I sorted the problem out with pyzor, and it seems to have sorted out the duplicates as well!!
[Dbmail] For Debian... dbmail-mysql or dbmail2-mysql??
Hi There, Ive noticed that there are two dbmail packages for debian... dbmail-mysql (2.0.4-0.20050211) and dbmail2-mysql (2.0.4-1.20050422). Im currently using dbmail-mysql (2.0.4-0.20050211) in a production environment and it is working well - should i be using the dbmail2-mysql?? Simon
Re: [Dbmail] For Debian... dbmail-mysql or dbmail2-mysql??
Paul J Stevens wrote: Simon: yes. Use dbmail2-mysql Thanks for the reply Paul. Is there any GOTCHAs with doing a simple apt-get install dbmail2-mysql in this case? I have about a 2GB mail store with several hundred users running on debian sarge. Simon
Re: [Dbmail] DBMail + Vacation Solution, for right now?
Kevin Baker wrote: Simon, This sounds great. Would you mind sharing it? I have wanted to move to DBMail for some time now, unfortunately I require the Vacation functionality... so this would be great! What version of DBMail would I need to be running to pipe the mail into your PHP solution? Or is this at the postfix level? Hi Kevin, I will reply offlist to this for you. Simon
Re: [Dbmail] DBMail dies sometimes
Paul J Stevens wrote: I wrote that init script for the debian packages. It predates the pid-file solution, and needs cleaning up. I'm on it. Cool as! This is happening to me once or twice a day with both pop3 and imap clients. Im wondering if it is worth restarting dbmail at night? Would this be a bit of a temp fix? Simon
Re: [Dbmail] DBMail dies sometimes
Thanks for the reply Paul... Is there any suggestions for a short term sort of hack/fix to somehow sidestep the problem? If not... tell me to have a bit more patience :) Simon Paul J Stevens wrote: Simon, the problem with the init script is unrelated to the unresponsive imapd afaik. So a fix of the init script (cosmetic) will not fix the your problem, alas. Simon wrote: Paul J Stevens wrote: I wrote that init script for the debian packages. It predates the pid-file solution, and needs cleaning up. I'm on it. Cool as! This is happening to me once or twice a day with both pop3 and imap clients. Im wondering if it is worth restarting dbmail at night? Would this be a bit of a temp fix? Simon ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] DBMail dies sometimes
Paul J Stevens wrote:
check_dbmail() {
timeout -1 2 nc -w 5 localhost imap 2/dev/null |\
head -1|grep -E '\* OK' || return 1
return 0
}
Can someone let me know what debian package (etc) we get the command
'nc' from?
Thanks
Re: [Dbmail] DBMail dies sometimes
Thanks Paul. I have got this script working now.. (just manually at the
mo), but when i run it, it restarts dbmail every time... is this correct?
Im guessing that it checks to see if the imap times out then restarts
dbmail if it does.
Is the pop3 problem:
A month ago or so i updated from dbmail-mysql 2.0.4-0.20050211 to
dbmail2-mysql 2.0.4-1.20050630. Since then we have had a few problems
with dbmail IMAP and POP just stopping responding... On a restart this
is the output:
also covered by this script? In other words, is the pop3 a br product
of the imap timing out. Sorry if i havent written this correctly :)
Simon
Paul J Stevens wrote:
timeout is in package timeout, iirc,
nc is in package netcat.
Simon wrote:
Paul J Stevens wrote:
check_dbmail() {
timeout -1 2 nc -w 5 localhost imap 2/dev/null |\
head -1|grep -E '\* OK' || return 1
return 0
}
Can someone let me know what debian package (etc) we get the command
'nc' from?
Re: [Dbmail] DBMail dies sometimes
Hi Paul, Paul J Stevens wrote: I wrote that init script for the debian packages. It predates the pid-file solution, and needs cleaning up. I'm on it. I noticed that the 2.0.4 package was updated yesterday(ish), and that it installed a new init script on upgrading. Just wondering if this sorted the above query? Thanks for all your hard work! Simon
Re: [Dbmail] DBMail dies sometimes
Paul J Stevens wrote: I wrote that init script for the debian packages. It predates the pid-file solution, and needs cleaning up. I'm on it. I noticed that the 2.0.4 package was updated yesterday(ish), and that it installed a new init script on upgrading. Just wondering if this sorted the above query? It does. But I may have to re-open bug: http://www.dbmail.org/mantis/bug_view_advanced_page.php?bug_id=158 Some testing is indicated here. Groovy... I will keep any eye on our server to see if the problem happens again. Simon
Re: [Fwd: [Dbmail] apt-get Upgrading to 2.0.5-1]
Paul J Stevens wrote: Simon wrote: Futher to this, i get this error on an apt-get install dbmail2-mysql The following packages have unmet dependencies: dbmail2-mysql: Depends: libc6 (= 2.3.5-1) but 2.3.2.ds1-22 is to be installed Those packages are for unstable, not for sarge, not for etch. I'll release sarge packages shortly. Yea- i clicked just before your reply came back! Thanks Paul. Any ETA on those packages? We have been having all sorts of problems with pop3 zombies etc and am keen to upgrade. Thanks again Simon
Re: [Dbmail] MySQL Connections
Steven Lynn wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 The real question is what version of MySQL are you running? 4.x or 5.x? 4.1.11a-4 on debian sarge
Re: [Dbmail] imap and pop3 bugging out...
Paul J Stevens wrote: What version are you running? 2.0.6+20050831-1 on sarge. Ive just noticed that there is 2.0.7-1 out. I will upgrade over the weekend. Do you thing that will solve the issue? Thanks! Simon
[Dbmail] dbmail 2.0.7 Missing table? syslog message
Hi There, Just noticed this message in the syslog: Oct 15 14:28:37 mx1 dbmail/smtp[4831]: db.c, db_get_mailbox_from_filters: default mailbox [(null)] Oct 15 14:28:37 mx1 dbmail/smtp[4831]: db.c,db_get_mailbox_from_filters: error gettings filters for user_id [87]. Missing table? Oct 15 14:28:37 mx1 dbmail/smtp[4831]: sort.c, sort_and_deliver: message id=800446, size=2144 is inserted Its happening quite a lot and for different users_id's. Any suggestions? Simon
[Dbmail] The table 'dbmail_messageblks' is full error message (yelp!!!)
Hi There, Running dbmail Version: 2.0.7+20050927-1 on debian sarge with mysql 4.1 and getting this error all of a sudden, (trace 5 turned on now): Nov 10 16:31:17 mx1 dbmail/smtp[23103]: dbmysql.c,db_query: mysql_real_query failed: The table 'dbmail_messageblks' is full Nov 10 16:31:17 mx1 dbmail/smtp[23103]: db.c,db_insert_message_block_physmessage: dbquery failed Nov 10 16:31:17 mx1 dbmail/smtp[23103]: db.c,db_insert_message_block: error inserting messageblks for physmessage [407131] Nov 10 16:31:17 mx1 dbmail/smtp[23103]: store_message_temp(): error inserting msgblock [header] Nov 10 16:31:17 mx1 dbmail/smtp[23103]: pipe.c, insert_messages: failed to store temporary message. Nov 10 16:31:17 mx1 dbmail/smtp[23103]: dbmysql.c,db_query: executing query [ROLLBACK] Nov 10 16:31:17 mx1 dbmail/smtp[23103]: main(): insert_messages failed Nov 10 16:31:17 mx1 dbmail/smtp[23103]: main(): freeing dsnuser list Nov 10 16:31:17 mx1 dbmail/smtp[23103]: dsn.c, dsnuser_free: dsnuser freed Nov 10 16:31:17 mx1 dbmail/smtp[23103]: main(): freeing all other lists Nov 10 16:31:17 mx1 dbmail/smtp[23103]: main(): freeing memory blocks Nov 10 16:31:17 mx1 dbmail/smtp[23103]: main(): they're all free. we're done. Nov 10 16:31:17 mx1 dbmail/smtp[23103]: main(): exit code is [75]. Anyone can help with this urgently? Simon
[Dbmail] mysql_real_query failed: Can't open file: 'dbmail_messageblks.MYI' (errno: 144)
Now im getting these errors: Nov 10 16:55:52 mx1 dbmail/smtp[2721]: main(): exit code is [75]. Nov 10 16:55:52 mx1 dbmail/smtp[2722]: dbmysql.c,db_query: mysql_real_query failed: Can't open file: 'dbmail_messageblks.MYI' (errno: 144) Nov 10 16:55:52 mx1 postfix/pipe[2719]: A91C82620177: to= [EMAIL PROTECTED], orig_to=[EMAIL PROTECTED], relay=dbmail, delay=1, status=deferred (temporary failure) Nov 10 16:55:52 mx1 dbmail/smtp[2722]: db.c,db_insert_message_block_physmessage: dbquery failed Nov 10 16:55:52 mx1 dbmail/smtp[2722]: db.c,db_insert_message_block: error inserting messageblks for physmessage [407191] Nov 10 16:55:52 mx1 dbmail/smtp[2722]: store_message_temp(): error inserting msgblock [header] Nov 10 16:55:52 mx1 dbmail/smtp[2722]: pipe.c, insert_messages: failed to store temporary message. Nov 10 16:55:52 mx1 dbmail/smtp[2722]: dbmysql.c,db_query: executing query [ROLLBACK] Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): insert_messages failed Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): freeing dsnuser list Nov 10 16:55:52 mx1 dbmail/smtp[2722]: dsn.c, dsnuser_free: dsnuser freed Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): freeing all other lists Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): freeing memory blocks Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): they're all free. we're done. Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): exit code is [75]. Anybody who is onhand to help, please. Simon
Re: [Dbmail] mysql_real_query failed: Can't open file: 'dbmail_messageblks.MYI' (errno: 144)
I had a f*ked dbmail_messageblks.MYI file, so did a repair on that table and things have come right. The dbmail_messageblks.MYD is 3.9GB, checking the number of records in the dbmail_messageblks table, there are 107107. Here is a error report after restarting mysql: warning : Table is marked as crashed and last repair failed warning : Size of datafile is: 4294967256 Should be: 4112108256 warning : Datafile is almost full, 4294967256 of 4294967294 used error: Found 106921 keys of 80477 error: Corrupt It has been fixed now, but does this point to some issue with max row count? On 11/10/05, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: 1) Disk full. 2) More likely. You have reached the max row count limit of the table. This is a well known problem that can be easily fixed by rebuldind the mysql table with ALTER and changing the avg row size I believe. Do a show tables in phpmyadmin and you see if you have reached this limit. As for the exact syntax, I don't remember. Check: http://dev.mysql.com/doc/refman/5.0/en/full-table.html ALTER TABLE tbl_name MAX_ROWS=10 AVG_ROW_LENGTH=nnn; Check the page to see what value to put for nnn. Xing Simon wrote: Now im getting these errors: Nov 10 16:55:52 mx1 dbmail/smtp[2721]: main(): exit code is [75]. Nov 10 16:55:52 mx1 dbmail/smtp[2722]: dbmysql.c,db_query: mysql_real_query failed: Can't open file: 'dbmail_messageblks.MYI' (errno: 144) Nov 10 16:55:52 mx1 postfix/pipe[2719]: A91C82620177: to=[EMAIL PROTECTED] mailto:[EMAIL PROTECTED], orig_to=[EMAIL PROTECTED] mailto:[EMAIL PROTECTED], relay=dbmail, delay=1, status=deferred (temporary failure) Nov 10 16:55:52 mx1 dbmail/smtp[2722]: db.c,db_insert_message_block_physmessage: dbquery failed Nov 10 16:55:52 mx1 dbmail/smtp[2722]: db.c,db_insert_message_block: error inserting messageblks for physmessage [407191] Nov 10 16:55:52 mx1 dbmail/smtp[2722]: store_message_temp(): error inserting msgblock [header] Nov 10 16:55:52 mx1 dbmail/smtp[2722]: pipe.c, insert_messages: failed to store temporary message. Nov 10 16:55:52 mx1 dbmail/smtp[2722]: dbmysql.c,db_query: executing query [ROLLBACK] Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): insert_messages failed Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): freeing dsnuser list Nov 10 16:55:52 mx1 dbmail/smtp[2722]: dsn.c, dsnuser_free: dsnuser freed Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): freeing all other lists Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): freeing memory blocks Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): they're all free. we're done. Nov 10 16:55:52 mx1 dbmail/smtp[2722]: main(): exit code is [75]. Anybody who is onhand to help, please. Simon ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail ___ Dbmail mailing list Dbmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
[Dbmail] Max_data_length for dbmail_messageblks reached
Hi There, It looks like we have reached the Max_data_length for the dbmail_messageblks table, this is currently 4294967295 (which is 4GB im gussing - which is about right). From the mysql docs, this can be easliery solved by running: ALTER TABLE tbl_name MAX_ROWS=10 AVG_ROW_LENGTH=nnn; But before i do this, im just wondering if there is anyone out there who has done this before, and it there was any issues/TFYPs in doing so? Thanks for any replies in advance! Simon
Re: [Dbmail] Max_data_length for dbmail_messageblks reached
Hi... On 11/15/05, Dominic Amann [EMAIL PROTECTED] wrote: ALTER TABLE tbl_name MAX_ROWS=10 AVG_ROW_LENGTH=nnn; But before i do this, im just wondering if there is anyone out there who has done this before, and it there was any issues/TFYPs in doing so? We did that almost right away on installing dbmail: the initial data import took us over the 4gb limit. No problems stemming from that. OK.. What i might do is dump the table to a file, alter the table and then re-import. Rather than doing the alter... http://dev.mysql.com/doc/refman/4.1/en/full-table.html On the notes above... some have had problems with data loss after not doing a OPTIMIZE on the database before hand. Any more comments from the list on this? Thanks Simon
Re: [Dbmail] Max_data_length for dbmail_messageblks reached
Paul J Stevens wrote: [EMAIL PROTECTED] wrote: Importing that much data is slow. Just copy the files for backup then alter. Check to see if the number of rows match. Yes, dump and reload is slow, but it will most likely still be a lot faster than an alter command. OK.. so the process would be: 1). Backup everything! 2). mysqldump the dbmail_messageblks table to a file 3). drop the dbmail_messageblks table 4). recreate the dbmail_messageblks table structure 5). do the alter 6). import the data back in Is there any other way todo this, keeping dbmail live? (i cant think of any).. Also, im using postfix/amavis, just wondering if there is some way to delay the bounce back for that time (considering that dbmail wont be accepting mail from amavis)? Any thoughts appreciated. Simon
[Dbmail] DBMail Logging question
Hi There, DBMail 2.0.7 on debian sarge. DBMail logs to both the /var/log/mail.log and the /var/log/syslog. Is there a way to stop it logging to var/log/syslog? Im guessing that this might be a syslog question more than a DBMail question - but wonder if anyone has had the same issue and could help? Thanks Simon
Re: [Dbmail] Max_data_length for dbmail_messageblks reached
It looks like we have reached the Max_data_length for the dbmail_messageblks table, this is currently 4294967295 (which is 4GB im gussing - which is about right). From the mysql docs, this can be easliery solved by running: ALTER TABLE tbl_name MAX_ROWS=10 AVG_ROW_LENGTH=nnn; Any idea what i would put in the AVG_ROW_LENGTH= here? From the mysql docs: You have to specify AVG_ROW_LENGTH only for tables with BLOB or TEXT columns; in this case, MySQL can't optimize the space required based only on the number of rows. show table status from dbmail like 'dbmail_messageblks'; give me an AVG_ROW_LENGTH of 35381, is this what i use here? Thanks!!! Simon
Re: [Dbmail] Max_data_length for dbmail_messageblks reached (a different idea?)
It looks like we have reached the Max_data_length for the dbmail_messageblks table, this is currently 4294967295 (which is 4GB im gussing - which is about right). From the mysql docs, this can be easliery solved by running: ALTER TABLE tbl_name MAX_ROWS=10 AVG_ROW_LENGTH=nnn; Got an updated suggestion on how to tackle this one. Any comments are welcome: Instead of dumping/altering etc etc. (Which keeps DBmail offline for a fair amount of time)... Use a MERGE table: - Rename dbmail_messageblks to mdbmail_messageblks_part1 - create table dbmail_messageblks_part2 using the dbmail_messageblks stucture - CREATE TABLE dbmail_messageblks (column defs,) TYPE=MERGE UNION(dbmail_messageblks_part1, dbmail_messageblks_part2) INSERT_METHOD=LAST Then just keep adding 4GB dbmail_messageblks_partX when needed. ?? Simon
Re: Re[2]: [Dbmail] Max_data_length for dbmail_messageblks reached
On 11/23/05, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: PJS Simon, PJS This limitation is only relevant for MyISAM tables, and your solution PJS (MERGE engine) also applies to MyISAM only. Please note however, that PJS MyISAM is deprecated for dbmail-2.1+ since we've stopped trying to PJS maintain referential integrety in the database-client (dbmail). PJS So you better start thinking about moving to innodb, I guess. Yes, my previous question about merged tables is not valid anymore :) But question about big dbmail_messageblks still actual. Will dbmail 2.0.x solve this problem ? This is one of the reasons that i wanted to move to a MERGE table for dbmail_messageblks, as 10 * 4GB tables spread the data are simply easier to manage that one 40GB table.. if one gets damaged for some reason, take the table offline, repair it and put it back in the merge. If im barking up the wonrg tree here - please speak up! :)
Re: [Dbmail] Max_data_length for dbmail_messageblks reached
On 11/23/05, Paul J Stevens [EMAIL PROTECTED] wrote: This limitation is only relevant for MyISAM tables, and your solution (MERGE engine) also applies to MyISAM only. Please note however, that MyISAM is deprecated for dbmail-2.1+ since we've stopped trying to maintain referential integrety in the database-client (dbmail). So you better start thinking about moving to innodb, I guess. OK - point also taken. Where do i start with this one? is there a way to convert data over? Thanks Simon
Re: Re[2]: [Dbmail] Max_data_length for dbmail_messageblks reached (Solved)
S ) TYPE=MERGE UNION(dbmail_messageblks_part1, dbmail_messageblks_part2) S INSERT_METHOD=LAST; It's rather interesting decision. I wonder is it real to build something like an array of merged dbmail_messageblks_partX tables? In previous maillists I have asked about big dbmail_messageblks table (now it's around 50Gb) and there was no decision to make OPTIMIZE TABLE dbmail_messageblks because of it's locking for a long time. As I understand we can make 10 or X number of dbmail_messageblks tables and we shall be able to make OPTIMIZE of each table separately. What do you think about it? Here is some more thinking on this: Because we used INSERT_METHOD=LAST, the data is always inserted into the last _partX table. It states in the mysql manual MERGE TABLES: Differences in table options such as AVG_ROW_LENGTH, MAX_ROWS, or PACK_KEYS do not matter... so i can just continue to add 4GB (or what ever) _partX's as and when needed. This way, if a table becomes corrupted, i only have to remove the offending 4GB table and repair, and then re-insert into the MERGE - shure, some old IMAP data is temp unavailable, but new mail is fine and the old mail will re-appear once the repaired table is put back into the MERGE. You can then OPTIMISE each partition thus: FLUSH TABLES, then copy the _partX file, then optimize it then stop the DB, put back in-place optimized _part1, then restart. This means that delivery to _part2 (or what ever your last part is) continues unabated. You need to do the optimize and restore IN-BETWEEN dbmail-maintenance runs though. e.g. the deletes need to not occur from the messageblks table. Any comments, bad or good are very welcome and needed. :) (Thanks again to Mark for help with this) Simon
Re: [Dbmail] Max_data_length for dbmail_messageblks reached (Solved)
On 11/24/05, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: You have fixed a short term problem but forgot about long term consequences. Email system is a delete/insert/update/select heavy system, if you have lots of users. Going with innodb you get concurrent reads + writes. I can do most of the dbmail-util cleanup functions without having to lock tables. A user can be downloading/updating delete flags of 50K pop3 messages via dbmail-pop3d and I don't have to worry about it locking up the system and slowing inserts other updates (pop/imap users) to a turtle pace. Can't say the same for myisam. Good point. Im starting to look into moving to innodb tables, but will save the actual upgrade until a server upgrade in Jan/Feb of next year :) . Any good references to start here?
[Dbmail] DBMail 2.0.7 to 2.0.9?
Hi There, Is there any issues in performing an apt-get upgrade of the dbmail2 debian package from 2.0.7+20050927-1 to 2.0.9-1? Is this just a simple apt-get upgrade? Thanks Simon
[Dbmail] NAMESPACE support in dbmail
Hi There, I can see that from v2.0 on, dbmail has NAMESPACE suport. Sorry if this is a lamo question, but how do i go about acually configuring this from the server end for a client to use this? Thanks Simon
[Dbmail] Best practices for a DBmail server move
Hi There, Im just starting to investigate this and wondering if anyone has some good tips to move dbmail from one server to the other with minimal down time? (We have 3.7GB in the dbmail database). There must be a better way that mysqldump, copy, import etc etc... Has anyone done this using mysql replication as a step? Simon
[Dbmail] Re: /usr/sbin/mysqld: Forcing close of thread
Further to this... I think there is a dbmail issue here?? as my maillog is full with: dbmail/pop3d[31289]: serverchild.c,CreateChild: child_register failed messages... 30MBs of it :) Simon On 6/28/06, Simon [EMAIL PROTECTED] wrote: Hi there, We are running dbmail on debian sarge with 2.6.8-12-em64t-p4-smp kernel and running dbmail version 2.0.9-1. We havd had our mail server stuck (or running really slow!!!) this morning and it seems that its running out of ram!... Could this be a dbmail issue? Jun 28 09:20:33 mx1 kernel: cpu 3 hot: low 32, high 96, batch 16 Jun 28 09:20:33 mx1 mysqld[4071]: 060628 9:20:07 [ERROR] /usr/sbin/mysqld: Forcing close of thread 6284 user: 'dbmail' Jun 28 09:20:33 mx1 kernel: cpu 3 cold: low 0, high 32, batch 16 Jun 28 09:20:33 mx1 mysqld[4071]: Jun 28 09:20:33 mx1 kernel: HighMem per-cpu: empty Could someone take a look at this small clip from the syslog and offer any advice here. I have the full syslog if someone could please take a look at it (i can email you the link). I really apprciate the help here please? Regards, Simon
Re: [Dbmail] /usr/sbin/mysqld: Forcing close of thread
On 6/28/06, DK [EMAIL PROTECTED] wrote: On 6/27/06, Simon [EMAIL PROTECTED] wrote: Hi there, We are running dbmail on debian sarge with 2.6.8-12-em64t-p4-smp kernel and running dbmail version 2.0.9-1. We havd had our mail server stuck (or running really slow!!!) this morning and it seems that its running out of ram!... Could this be a dbmail issue? Jun 28 09:20:33 mx1 kernel: cpu 3 hot: low 32, high 96, batch 16 Jun 28 09:20:33 mx1 mysqld[4071]: 060628 9:20:07 [ERROR] /usr/sbin/mysqld: Forcing close of thread 6284 user: 'dbmail' Jun 28 09:20:33 mx1 kernel: cpu 3 cold: low 0, high 32, batch 16 Jun 28 09:20:33 mx1 mysqld[4071]: Jun 28 09:20:33 mx1 kernel: HighMem per-cpu: empty Could someone take a look at this small clip from the syslog and offer any advice here. I have the full syslog if someone could please take a look at it (i can email you the link). I really apprciate the help here please? Regards, Simon Hello Simon, I am not a dbmail dev. but they will probably need at leased follwing info # cat /proc/cpuinfo # cat /proc/meminfo # ps -aux Thanks... as requested: http://gremin.orcon.net.nz/cpuinfo.txt http://gremin.orcon.net.nz/meminfo.txt http://gremin.orcon.net.nz/ps.txt Please note, this is after the server has been restarted. Simon
Re: [Dbmail] /usr/sbin/mysqld: Forcing close of thread
On 6/28/06, Jorge Bastos [EMAIL PROTECTED] wrote: Simon, I think you have to do some tunning with the configuration: NCHILDREN=15 MAXCHILDREN=15 each one for lmtpd, imapd and pop3d in dbmail.conf the number os processes cannot be bigger than the number os processes that MySQL accepts MySQL by default has a limit to 100 i think, you have to see how much you'll need depending on the users you have. The register child failed because he's trying to create a new process (connection to MySQL) and he can't 'cause on the limit. (it seams to me that is that, i may be wrong) Thanks for the reply... Suggestions here? Have i got too many max connections in mysql, or is it a dbmail config issue... My.cnf: set-variable=max_connections=500 set-variable=wait_timeout=300 Here is my dbmail config below: [LMTP] NCHILDREN=5 MAXCHILDREN=200 MAXCONNECTS=1 MINSPARECHILDREN=2 MAXSPARECHILDREN=10 MAX_ERRORS=500 [POP] NCHILDREN=5 MAXCHILDREN=200 MAXCONNECTS=1 MINSPARECHILDREN=4 MAXSPARECHILDREN=8 [IMAP] NCHILDREN=5 MAXCONNECTS=1 MINSPARECHILDREN=4 MAXSPARECHILDREN=8 MAXCHILDREN=200
Re: [Dbmail] /usr/sbin/mysqld: Forcing close of thread
Thanks Paul... Further questions below if pos:
On 6/29/06, Paul J Stevens [EMAIL PROTECTED] wrote:
[LMTP]
NCHILDREN=5
MAXCHILDREN=200
MAXCONNECTS=1
MINSPARECHILDREN=2
MAXSPARECHILDREN=10
MAX_ERRORS=500
Why so many lmtp daemons? Try setting :
NCHILDREN=2
MAXCONNECTS=100
MAXCHILDREN=8
MINSPARECHILDREN=0
MAXSPARECHILDREN=4
but don't forget to fix postfix/master.cf accordingly by setting the
maxproc field for lmtp to 8. Even 8 seems a bit high, but that seems to
be the width of your amavis pipe.
This is my lmtp line in postfix/master.cf..
lmtp unix - - n - - lmtp
So this should now be(??):
lmtp unix - - n - 8 lmtp
I have attached my master.cf file below if you could please run your
eye over it and make sure that i have things correct??
[IMAP]
NCHILDREN=5
MAXCONNECTS=1
MINSPARECHILDREN=4
MAXSPARECHILDREN=8
MAXCHILDREN=200
The psinfo listing shows a *lot* of dbmail-imapd processes right after a
restart. Are you typically serving webmail connects or fat clients?
We have around 250 mailboxes in use currently, with approx 1/4 'fat'
IMAP clients, however all uses do have access to webmail via
SquirrelMail (set to IMAP).
Note: This is a Dual HT Xeon server with 2GB RAM and HW RAID5, running
debian sarge with 2.6.8-12-em64t-p4-smp kernel.
Thanks Again,
Simon
postfix/master.cf:
lmtp unix - - n - - lmtp
anvil unix - - n - 1 anvil
#
# Interfaces to non-Postfix software. Be sure to examine the manual
# pages of the non-Postfix software to find out what options it wants.
#
# maildrop. See the Postfix MAILDROP_README file for details.
#
maildrop unix - n n - - pipe
flags=DRhu user=vmail argv=/usr/local/bin/maildrop -d ${recipient}
uucp unix - n n - - pipe
flags=Fqhu user=uucp argv=uux -r -n -z -a$sender - $nexthop!rmail ($recipient)
ifmailunix - n n - - pipe
flags=F user=ftn argv=/usr/lib/ifmail/ifmail -r $nexthop ($recipient)
bsmtp unix - n n - - pipe
flags=Fq. user=bsmtp argv=/usr/lib/bsmtp/bsmtp -d -t$nexthop
-f$sender $recipient
scalemail-backend unix - n n - 2 pipe
flags=R user=scalemail argv=/usr/lib/scalemail/bin/scalemail-store
${nexthop} ${user} ${extension}
# only used by postfix-tls
#tlsmgr fifo - - n 300 1 tlsmgr
#smtpsinet n - n - - smtpd -o
smtpd_tls_wrappermode=yes -o smtpd_sasl_auth_enable=yes
#587 inet n - n - - smtpd -o
smtpd_enforce_tls=yes -o smtpd_sasl_auth_enable=yes
dbmailunix - n n - - pipe
flags= user=dbmail:dbmail argv=/usr/sbin/dbmail-smtp -d ${recipient}
smtp-amavis unix - - n - 6 smtp
-o smtp_data_done_timeout=1200
-o smtp_send_xforward_command=yes
-o disable_dns_lookups=yes
#smtp-amavis unix - - n - 2 lmtp
#-o lmtp_data_done_timeout=1200
#-o lmtp_send_xforward_command=yes
127.0.0.1:10025 inet n - n - - smtpd
-o content_filter=
-o local_recipient_maps=
-o relay_recipient_maps=
[Dbmail] Best proxy for use with dbmail
Just wondering what other people are using as a POP and IMAP proxy for dbmail? What are the best options here? Any recommendations/suggestions are welcome. Thanks Simon
[Dbmail] MyISAM to InnoDB
Hi There, I am running MyISAM tables in mysql 4.1 with dbmail 2.0.9-1 on debian sarge. I am reaching a 4GB limit on the messageblks table and am going to move from MyISAM to innodb tables. As instructed i should do the following: set unique_checks=0; alter table dbmail_users type=innodb; alter table dbmail_mailboxes type=innodb; alter table dbmail_messages type=innodb; alter table dbmail_messageblks type=innodb; ... etc ... set unique_checks=1; This seems to have worked fine on my dev server, shutting down dbmail before doing so... My question is: Is there any small tweaks needed within mysql before doing this? Thanks Simon
Re: [Dbmail] MyISAM to InnoDB
On 7/10/06, Paul J Stevens [EMAIL PROTECTED] wrote: Simon, Simon wrote: set unique_checks=0; alter table dbmail_users type=innodb; ... etc ... set unique_checks=1; This seems to have worked fine on my dev server, shutting down dbmail before doing so... My question is: Is there any small tweaks needed within mysql before doing this? After doing this, you will still need to add all the foreign keys by hand. That is not an urgent matter while you're on 2.0.x, but 2.1.x relies on them. Thanks Paul is there instructions on doing this with dbmail?... or can you point me in the correct direction? Also: is there any my.cnf tweaks needed? THanks Simon
[Dbmail] Quota Bounce Message - Is there a way to customise?
Hi There, Is there a way to customise the bounce back if a quota is full, or is this a thing for postfix? Thanks Simon
[Dbmail] Fwd: Quota Bounce Message - Is there a way to customise?
A quick update here, this is what i am getting back from the mail server: Your message did not reach some or all of the intended recipients. Subject: Sent: 12/07/2006 4:49 p.m. The following recipient(s) could not be reached: [EMAIL PROTECTED] on 12/07/2006 4:50 p.m. The e-mail system was unable to deliver the message, but did not report a specific reason. Check the address and try again. If it still fails, contact your system administrator. mx2.networker.co.nz #5.0.0 X-Postfix; user unknown -- Forwarded message -- From: Simon [EMAIL PROTECTED] Date: Jul 12, 2006 2:19 PM Subject: Quota Bounce Message - Is there a way to customise? To: DBMail mailinglist dbmail@dbmail.org, dbmail-dev@dbmail.org Hi There, Is there a way to customise the bounce back if a quota is full, or is this a thing for postfix? Thanks Simon
[Dbmail] Postfix amamvis dbmail
Hi there, We have a setup as follows: postfix amamvis spamas clamav dbmail Does any one have any suggestions on how to go about finding out where the load is centered over this.. e.g. which parts of the setup are using the most CPU / Memory over a given period? I know this is not a dbmail question, but i thought that someone might have faced a similar problem before. Thanks Simon
Re: [Dbmail] Postfix amamvis dbmail
Opps...! On 8/2/06, Matthew Smith [EMAIL PROTECTED] wrote: Quoth Simon at 08/02/06 10:41... postfix amamvis spamas clamav dbmail Does any one have any suggestions on how to go about finding out where the load is centered over this.. e.g. which parts of the setup are using the most CPU / Memory over a given period? The big question - what OS are you running this on? Debian sarge. (Sorry - Duh!)
Re: [Dbmail] Re: DBMail 2.2 Question
On 12/12/06, Paul J Stevens [EMAIL PROTECTED] wrote: Leander Koornneef wrote: I'm no debian packaging guru, but if you download the dbmail source and run `sed -i -e 's/libmysqlclient15off/libmysqlclient14/' debian/control`, you should be able to create your own debian package for use with mysql-server-4.1 on Sarge with `dpkg-buildpackage -rfakeroot -uc -b` the libmysqlclient dependency is automatically generated during the build by dh_makeshlibs and dh_gencontrol. Sarge contains mysql-server-4.1 and libs which is OK. However, sarge does *not* contain the right gmime/glib versions, and those are very much required. So: if you want to build and package dbmail for sarge some of the packages in the build-deps need backporting also: asciidoc, libgmime-2.0-2.dev libglib-2.0-dev, xmlto. Hi Paul, thanks for the info... a query again: We are trying to get dbmail running on a VM under XenEnterprise. I have everything setup and have deb http://www.backports.org/debian/ sarge-backports main in my sources.list and deb http://debian.nfgd.net/debian unstable main for dbmail. But im not allowed to update glibc, as it is built by Xen... Any ideas here? I might just have to stick with old-stable until etch is supported by Xen ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
[Dbmail] Re: DBMail configuration question (separate MSA and MTA)
Sorry!!! Just found it in the WIKI!!! On 12/14/06, Simon [EMAIL PROTECTED] wrote: Hi There, Up till now we have been running postfix bla dbmail all on one box. We had mysql telling postfix to accept and deliver mail for users to a dbmail pipe. Now we have a few more users and $$ coming in, we are setting up a box for dbmail (MSA) and a box for incoming etc (MTA). How do i tell postfix on the dbmail box to just send all mail it receives to dbmail? (it will only ever receive mail from the MTA server) Thanks ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
Re: [Dbmail] Re: DBMail 2.2 Question
On 12/14/06, Paul J Stevens [EMAIL PROTECTED] wrote: Simon wrote: I might just have to stick with old-stable until etch is supported by Xen ?? Xen is in etch already We are using the commercial XenEnterprise product, under which debian sarge is fully supprted ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
[Dbmail] Upgrading from 2.0.10-1 on Sarge to 2.2.10-1 on Etch
Hi There, We have a running dmail-mysql 2.0.10-1 running on debian sarge and would like to move it over to a new server running etch. I have read the following: http://www.dbmail.org/dokuwiki/doku.php?id=upgrading_to_2.1 But i was just wondering if there are any gotchas that anyone knows about? My dbmail_messageblks table is currently 9.8GB and is mysqldump'ed each night, so i am going to use the nightly backup as a test for the new server. Thanks Simon ___ DBmail mailing list DBmail@dbmail.org https://mailman.fastxs.nl/mailman/listinfo/dbmail
[Dbmail] Forced upgrade from 2.0 to 2.2
Hi There, Our dbmail 2.0 running on debian sarge was damaged last night. We are currently building a new VM with debian etch and dbmail 2.2. The innodb mysql database from the old server is just being recovered onto the new server... once completed, is this just simply a matter of running the migrate_from_2.0_to_2.2.mysql file, configuring dbmail for our environment and starting it? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Forced upgrade from 2.0 to 2.2
On Wed, Mar 11, 2009 at 12:44 PM, Simon grem...@gmail.com wrote: Hi There, Our dbmail 2.0 running on debian sarge was damaged last night. We are currently building a new VM with debian etch and dbmail 2.2. The innodb mysql database from the old server is just being recovered onto the new server... once completed, is this just simply a matter of running the migrate_from_2.0_to_2.2.mysql file, configuring dbmail for our environment and starting it? Oh.. i have read: http://www.dbmail.org/dokuwiki/doku.php?id=upgrading_to_2.1 So i would need to perform a dbmail-util -by as well correct? Thanks Again, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Forced upgrade from 2.0 to 2.2
On Wed, Mar 11, 2009 at 1:07 PM, Aaron Stone aa...@serendipity.cx wrote: Our dbmail 2.0 running on debian sarge was damaged last night. We are currently building a new VM with debian etch and dbmail 2.2. The innodb mysql database from the old server is just being recovered onto the new server... once completed, is this just simply a matter of running the migrate_from_2.0_to_2.2.mysql file, configuring dbmail for our environment and starting it? Yep. Oh.. i have read: http://www.dbmail.org/dokuwiki/doku.php?id=upgrading_to_2.1 So i would need to perform a dbmail-util -by as well correct? Correct. Thanks Aaron, The VM has 2 x E5310 Xeon Cores @ 1.6GHz... and the ibdata1 file is approx 40GB.. so that upgrade script might take a while huh? Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Forced upgrade from 2.0 to 2.2
On Wed, Mar 11, 2009 at 1:26 PM, Aaron Stone aa...@serendipity.cx wrote: I'm sure it will! Be sure to keep a backup of the restored database in pre-2.2 script state, just in case, of course. If you could report back to the list how long the two steps take (sql migration and dbmail-util) that would be great to know. Any ideas rough approx time? 30mins, 30hours, 30 days? THanks Simon PS: WIll do on the reports. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Forced upgrade from 2.0 to 2.2
On Wed, Mar 11, 2009 at 1:26 PM, Aaron Stone aa...@serendipity.cx wrote: Thanks Aaron, The VM has 2 x E5310 Xeon Cores @ 1.6GHz... and the ibdata1 file is approx 40GB.. so that upgrade script might take a while huh? I'm sure it will! Be sure to keep a backup of the restored database in pre-2.2 script state, just in case, of course. If you could report back to the list how long the two steps take (sql migration and dbmail-util) that would be great to know. Hi Aaron (or others). The mysql script has completed (im guessing it took approx on the 40GB innodb file). I went to run the dbmail-util -by command and got this: # dbmail-util -by Mar 11 14:06:48 mail-store1 dbmail-util[10266]: Error:[sql] dbmysql.c,db_mysql_check_collations(+138): collation mismatch, your MySQL configuration specifies a different charset than the data currently in your DBMail database. Failed. An error occured. Please check log. I have read various things, but it would be good to get the correct thing todo here please? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Postfix DBMail 2.2 (lost connections)
Hi There, After our forced upgrade of the os and dbmail from stage/dbmail_2.0 to etch/dbmail_2.2 we are seeing this sometimes in the mail filter log: Mar 11 17:32:21 mail-in1 postfix/qmgr[31948]: BAE4B482F9: to=clie...@emailaddress.is.obscured, relay=none, delay=0.08, delays=0.06/0.02/0/0, dsn=4.4.2, status=deferred (delivery temporarily suspended: lost connection with 210.OUR.DBMAIL.SERVER[210.OUR.DBMAIL.SERVER] while sending end of data -- message may be sent more than once) And there are multiple copies of mail going into mailboxes. I havent the foggiest where to start with this one? Any pointers? Thanks, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Postfix DBMail 2.2 (lost connections)
On Thu, Mar 12, 2009 at 7:29 AM, Paul J Stevens p...@nfg.nl wrote: Simon wrote: Hi There, After our forced upgrade of the os and dbmail from stage/dbmail_2.0 to etch/dbmail_2.2 we are seeing this sometimes in the mail filter log: Mar 11 17:32:21 mail-in1 postfix/qmgr[31948]: BAE4B482F9: to=clie...@emailaddress.is.obscured, relay=none, delay=0.08, delays=0.06/0.02/0/0, dsn=4.4.2, status=deferred (delivery temporarily suspended: lost connection with 210.OUR.DBMAIL.SERVER[210.OUR.DBMAIL.SERVER] while sending end of data -- message may be sent more than once) Increase the logging level on the lmtpd server. Set trace_level=5 until you catch above error, and send in the resulting logs. I have set the trace log and i think it is a collation issue in the database... my tables are still set to latin. Could this be the issue? I have the trace of several emails going into dbmail, some of which had the above issue: http://devtga.newmedia.co.nz/dbmail_trace.txt (I will remove this after ive solved the issue and i reported back to the list). Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Forced upgrade from 2.0 to 2.2
On Thu, Mar 12, 2009 at 7:27 AM, Paul J Stevens p...@nfg.nl wrote: Aleksander Kamenik wrote: Simon wrote: I have read various things, but it would be good to get the correct thing todo here please? First check your database settings. Default collation was latin/swedish for mysql I think. Compare your old and new my.cnf files. Check the client as well as the mysql subsections. Has anything changed? Obviously they have to match. If you can run both mysql and dbmail with utf8 encoding. IIRC you can use show create table_name to see the encoding/collation. Correct. Also, you're not using mysql 5.1 by any chance. It's not recommended yet. Stick to 5.0. Actually, 5.1.32 was released last week which was pitched as production quality. Personally, I'll stick with Monty's advice: avoid 5.1: http://monty-says.blogspot.com/2008/11/oops-we-did-it-again-mysql-51-released.html\ I think i need to change the encoding/collation: show create table dbmail_messageblks; ++---+ | Table | Create Table | ++---+ | dbmail_messageblks | CREATE TABLE `dbmail_messageblks` ( `messageblk_idnr` bigint(21) NOT NULL auto_increment, `physmessage_id` bigint(21) NOT NULL default '0', `messageblk` longblob NOT NULL, `blocksize` bigint(21) NOT NULL default '0', `is_header` tinyint(1) NOT NULL default '0', PRIMARY KEY (`messageblk_idnr`), KEY `physmessage_id_index` (`physmessage_id`), KEY `physmessage_id_is_header_index` (`physmessage_id`,`is_header`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1 | ++---+ 1 row in set (0.00 sec) If this is so... can someone post the steps here please? ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Postfix DBMail 2.2 (lost connections)
On Thu, Mar 12, 2009 at 8:45 AM, Paul J Stevens p...@nfg.nl wrote: Looking at the logs I see: Mar 12 08:11:40 mail-store1 dbmail/lmtpd[3544]: Info:[delivery] pipe.c,send_mail(+144): opening pipe to [/usr/local/autoresponder/autoresponder.php] Is that script accessible? No - not as yet as we are recovering the data on the old VM at the moment. As you might guess, this is our auto responder script. In the dbmail_aliases table we have two entries, one to deliver the mail to the mailbox and one for the auto responder (for the clients who have auto reponders on). Do you think this could cause the issue? Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Postfix DBMail 2.2 (lost connections)
On Thu, Mar 12, 2009 at 8:53 AM, Simon grem...@gmail.com wrote: On Thu, Mar 12, 2009 at 8:45 AM, Paul J Stevens p...@nfg.nl wrote: Looking at the logs I see: Mar 12 08:11:40 mail-store1 dbmail/lmtpd[3544]: Info:[delivery] pipe.c,send_mail(+144): opening pipe to [/usr/local/autoresponder/autoresponder.php] Is that script accessible? No - not as yet as we are recovering the data on the old VM at the moment. As you might guess, this is our auto responder script. In the dbmail_aliases table we have two entries, one to deliver the mail to the mailbox and one for the auto responder (for the clients who have auto reponders on). Do you think this could cause the issue? Update on this. I created a blank executable so make sure that there was a script avaialble, but that didnt work. So i removed the entries in the dbmail_aliases table and now we have no more errors. However: We do need to make this work again. Is there a trick to delivering to external scripts in 2.2? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] External forwards piped out to a command
Hi There, I am trying to get an external forward to a pipe. These are the commands that im using: # dbmail-users -l newmedia2 newmedia2:x:768:0:0.00:0.06:t...@newmedia.net.nz # dbmail-users -x t...@newmedia.net.nz -t |/usr/local/autoresponder/autoresponder.php [|/usr/local/autoresponder/autoresponder.php] Done OK. The once I run the command again to check to see if the pipe is attached to the user: # dbmail-users -l newmedia2 newmedia2:x:768:0:0.00:0.08:t...@newmedia.net.nz It doesnt list the forward. To see the forward i need to run dbmail-users -l and at the bottom i see the forward: t...@newmedia.net.nz: |/usr/local/autoresponder/autoresponder.php OK.. That is fine. The problem i am having is that when i add a forward using the above method, i postfix cant deliver the message to dbmail: Mar 12 16:03:00 mail-in1 postfix/lmtp[15149]: 7BA9C485AD: to=t...@newmedia.net.nz, relay=210.48.80.133[210.48.80.133]:24, delay=0.19, delays=0.05/0.01/0/0.13, dsn=4.4.2, status=deferred (lost connection with 210.48.80.133[210.48.80.133] while sending end of data -- message may be sent more than once) As soon as i remove the forward, i can flush the postfix queue and the message goes thru. Note that the /usr/local/autoresponder/autoresponder.php is owned by the dbmail user and is executable. An assistance would be greatly apprectiated! Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] External forwards piped out to a command
On Thu, Mar 12, 2009 at 10:01 PM, Paul J Stevens p...@nfg.nl wrote: Simon wrote: An assistance would be greatly apprectiated! Show me the code. Thanks Paul.. The code for /usr/local/autoresponder/autoresponder.php? I have removed all the PHP that we currently have in the scipt to make sure that it is not that which is causing the issue. Currently the file has this in it: #!/usr/bin/php ? echo works; exit(); ? I have su'ed to dbmail and run the script like this: # /usr/local/autoresponder/autoresponder.php # /usr/bin/php /usr/local/autoresponder/autoresponder.php Both these work correctly and output works. So i removed the echo works; part and tried again. Still the same issue, postfix wont deliver the mail: status=deferred (lost connection with 210.48.80.133[210.48.80.133] while sending end of data -- message may be sent more than once) Remove the pipe and it works with no issues. Cheers Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Calculate mailbox size?
Hi There, We have a external client management app that we would like to be able to calculate the size of a dbmail mailbox with a SQL query. Can anyone give me some pointers here to get this right please? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] 2 DB mail servers to one mysql server
Hi There, We are upgrading our DBmail server from etch to lenny... im wondering if it is OK to have both the current (production) etch dbmail and the new (testing) lenny dbmail server connected to the same mysql box? We would only be accessing test mailboxes on the testing server... Can anyone see any issues here? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] IMAP dies after a couple of mins
Hi There, We added a new server (B below) to our mail config... So now we have: A) DBMail 2.2.11 on debian etch (also running mysql 5.0.32) B) DBMail 2.2.15 on debian lenny Both these servers connect to the mysql instance running on server A. Email is delivered via dbmail-lmtp (from our mail filter servers) to server B and is all running fine. We have a problem where imap fails after a couple of mins when people are connecting to server B.. we start dbmail on server B and it just stops working (e.g. you cant telnet to port 143 any more). POP3 is working find and connecting via imap to server A works with no issues. Any ideas on how to go about solving this one? Many thanks, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] IMAP dies after a couple of mins
Solved! MAXCHILDREN was set to low (default setting) On Mon, Nov 22, 2010 at 3:20 PM, Simon grem...@gmail.com wrote: Hi There, We added a new server (B below) to our mail config... So now we have: A) DBMail 2.2.11 on debian etch (also running mysql 5.0.32) B) DBMail 2.2.15 on debian lenny Both these servers connect to the mysql instance running on server A. Email is delivered via dbmail-lmtp (from our mail filter servers) to server B and is all running fine. We have a problem where imap fails after a couple of mins when people are connecting to server B.. we start dbmail on server B and it just stops working (e.g. you cant telnet to port 143 any more). POP3 is working find and connecting via imap to server A works with no issues. Any ideas on how to go about solving this one? Many thanks, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] DBmail ical (OT a bit)
Hi There, I know that this is off topic a little, but we have a client who we are using DBmail (our choice) and have moved over to macs. They would like to have a ical server... just wondering if anyone else is providing this solution to their clients, and if so - would you be happy to point in a direction that works? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] dbmail and debian squeeze
Hi There, Currently we are using DBMail 2.2.15-1lenny0 from http://debian.nfgd.net/ on... Debian Lenny, and are in the process of updating/upgrading our VMs to Debian Squeeze and just wondering what is the best idea going forward. Should we simply use the debian default of 2.2.11-1+b1 or compile dbmail-2.2.17.tar.gz? Many thanks! Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail and debian squeeze
On Wed, Jun 29, 2011 at 11:50 AM, Schattenfell p...@michael-neubert.de wrote: Hello Simon, I recommend you to use DBMail 2.2.17 or the new DBMail 3.0 RC2. I also tested 2.2.11 with Debian but there were some really annoying bugs relating IMAP daemon in this old release (IMAP daemons / processes got frozen / hanged up, 100% CPU load, ...). So if you want to use the IMAP daemon just take the latest versions of DBMail. DBMail 3.0 RC2 also has native TLS support if you need it :). In my opinion DBMail 2.2.17 is a little more stable at the moment. However I also already use the latest DBMail 3.0 RC2. Thank you for your reply! ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] dbmail-util questions
Hi There, We are using dbmail 2.2.17 on debian squeeze connected to a mysql 5.1.49-3 server (replicated to another 5.1.49-3 server ). There is around 70GB in the dbmail_messageblks table. Each night (morning) at 3am we run /usr/local/sbin/dbmail-util -ay which results in a process that takes about 2 hours to complete (output below). During this time, however, messages queue in postfix and are not delivered until it is completed. As well as that, sometimes we get timed out pop3/imap connections. I have some clients who complain that their messages do not get thru during this period (early birds!). Is this a normal process? Is there any changes or a different way of doing this so that the mail will continue to flow thru? Thanks Simon dbmail-util -ay output: # cat dbmail-util.log Repairing DBMAIL messageblocks integrity... Ok. Found [0] unconnected messageblks. Repairing DBMAIL physmessage integrity... Ok. Found [0] unconnected physmessages. Repairing DBMAIL message integrity... Ok. Found [0] unconnected messages. Repairing DBMAIL mailbox integrity... Repairing DBMAIL for NULL messages... Ok. Found [0] NULL messages. Checking DBMAIL for NULL physmessages... Ok. Found [0] physmessages without messageblocks. Deleting messages with DELETE status... Ok. [2049] messages deleted. Repairing DBMAIL for rfcsize field... Ok. Found [0] missing rfcsize values. Repairing DBMAIL for incorrect is_header flags... Ok. Found [0] incorrect is_header flags. Repairing DBMAIL for cached envelopes... Repairing DBMAIL for cached header values... Setting DELETE status for deleted messages... Ok. [5790] messages set for deletion. Re-calculating used quota for all users... Ok. Used quota updated for all users. Removing aliases with nonexistent delivery userid's... Ok. Found [0] dangling aliases. Vacuuming and optimizing database... Ok. Database cleaned up. ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail-util questions
On 30/08/2011, at 9:42 AM, Reindl Harald wrote: your innodb-settings sucks this should not be so slow on our 15 GB dbmail-database dbmail-util needs only 5 minutes and there is normal access to anything while it tuns how much mameory has your box and what are your mysql-settings Thanks for the quick reply... i had thought it might be something like this. 2GB RAM on the MySQL box with the following: http://www.nzlocal.com/simon/mysqlconf.txt Simon___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail-util questions
On Mon, Sep 5, 2011 at 9:54 PM, Reindl Harald h.rei...@thelounge.net wrote: this is very bad, you should really take more care of what your setups are looking like before going in production! Tell me about it. I ran our migration from mysql4 to mysql 5 (where we are now) 3 times with absolutely no fault what so ever. Our testing dbmail servers worked bang on with our testing mysql5 server. So for some dumb/stupid reason i never checked if the tables were in innodb format on the production run. My own stupid fault. :( current dbmail-versions are relying heavy on innodb and key-constraints for removing depending records in other tables. i wonder that this works with MyISAM in any way Funny enough except for the issue with the dbmail-util cleanup command the whole thing works very well. Go figure. :) as said in the previous reply you can try to dump/import without the structures but personally i do not like really hughe sql-dumps personally i would setup a dbmail-instance in any virtalizing solution I have this all in a virtual environment with a drbd copy of the mysql data that i can snapshot, create new VM, test etc. So at least ive got that * import the user/alias-tables Just checking here.. so that would be dbmail_aliases and dbmail_users right? * change them to innodb Then get all the other tables setup correctly, but empty, then... * transfer the messages via imapsync Is there any switches to note when using imapsync between two dbmail servers? * stop live/vm server * rsync of new mysql-datadir to the live-server * start services/mysql on the liveserver All good with the last 3... BTW: Thank you for your replies. Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] imapsync with dbmail
Hi There, Would like to quiz the users in the list to see if there is anything I'm missing when using imapsync to sync 2 dbmail servers (each connected to their own mysql server)… The command I'm using is: imapsync \ --host1 HOST1 --user1 USER1 --authuser1 USER1 --password1 PASS1 --authmech1 LOGIN --sep1 '/' \ --host2 HOST2 --user2 USER1 --authuser2 USER1 --password2 PASS1 --authmech2 LOGIN This seems to work with a basic IMAP mailbox with a couple of messages in it and some folders etc… but is there anything that might muck up with larger mailboxes/messages? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] 2.2.17 3? (need to migrate to new mysql server, should i upgrade?)
Hi There, We need to migrate our 80+GB of mail over to a new mysql server (old and new servers are 5.1 on 64bit debian squeeze). We are doing this with imapsync. Is it worth upgrading to dbmail 3 at the same time? Its still rc, but that might change soon? Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Backups with 100GB mail
Hi There, I know this has been discussed on the list off and on and i have searched and reviewed the list for these.. but i would just like to get peoples opinion of the best strategy to move forward with… We have DBmail 2.2.17 running: 3 separate mail servers one for DBmail and two for MySQL in a master/slave environment. We provide IMAP mailboxes to our clients and have about 90-100GB worth of mail in the DB currently and stop the slave to mysqldump the database at night and start it again. This works fine from a backup data point of view, we have reasonable fast servers and a good SAN and backups work well…. Restores are another thing tho. 100GB just takes time to import! I have read some emails on the list about using LVM and taking snapshots… but have not used this before. Would this be a good path to look? I would like to have a quick way to recover our mail platform for our clients. Any feedback is very welcome! Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] MySQL config for dbmail
Hi There, This may be slightly OT… but I'm wondering if someone would be able to give me a few pointers new dbmail mysql VM please? Currently it has 2 VCPUs (Xeon E5645 @ 2.4GHz) and 1GB RAM (note: this is only in testing, no mail flow to it or no client connections, and we are using imapsync to populate it). It has apron 1000 mailboxes using 80GBs worth of DBMail database and is running well during this testing mode. We are about to put this into production and we will increase the RAM to 10GB… I have two questions: 1). Is it worth adding more VCPUs? 2). Would any body be able to assist with mysql config to best utilise the resources of the new VM? Current my.conf is http://www.nzlocal.com/simon/dbmail_my_conf.txt Many Thanks!!! Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Change of mysql backend comes with increase in CPU
Hi There,We are running dbmail 2.2.17 on a debian squeeze VM. It has two VCPUs and 1GB of RAM. Up until today it was connected to our old mailstore mysql VM (debian lenny, mysql 5.1, 2 GB RAM). Over the past couple of weeks we have been syncing mail (using imapsync - don't ask.) to our new mailstore mysql VM (debian lenny, mysql 5.1, 20GB RAM). We service about 1000 mailboxes with approx 80GB worth of email in storage.So, i stopped mail flow and client access, performed the final sync, changed the database host settings in dbmail.conf to point to the new mailstore and re-enabledmail flow and client access.We have seen a massive increase in CPU on the dbmail VM for approx one hour (80-90%), then it has dropped back (20-30%) but not to the same level during the height of the day, the vm only ever used to sit on 5-10% CPU.I have attached a quick graph from our XenServer console to show you…I had thought this might be imap clients re-syncing their email or something… Any ideas?ThanksSimon___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Change of mysql backend comes with increase in CPU
Hi Gordon On 2/11/2011, at 11:06 PM, Gordan Bobic wrote: How does your CPU time get measured? Does it include iowait time? If so, it could just be the period during which the caches are getting warmed up. yes - it looks like you are correct here. CPU does include iowait i believe.. and it has settled down to normal now :) Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Log IP address without TRACE_SYSLOG = 4?
Hi There, Is there anyway to log the IP address of the pop and imap connections without increasing TRACE_SYSLOG up to 4? DBmail 2.2.17 on debian squeeze BTW. Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail3?
On 26/01/2012, at 4:18 PM, Reindl Harald wrote: hi i hope all is well with paul! DBMail 3.0.0 final release candidate 2011-08-15 is there a plan for the final version? Yes - i would like to know this as well :) ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] dbmail3?
Thanks for this Paul... For a really large database I would not do any storage transition initially. New messages will be stored in the new schema, old messages are still available. This will break IMAP body searches (who uses those??), but everything else works just fine. OK, just to confirm here (we have a 100GB dbmail mysql db running in a masterslave setup)... we could move over to dbmail 3 without any storage transition at first - is there new tables you need to add to the DB? When you feel like everything is working as it should, you may start migrating old content in batches at times when fewer clients are connected. dbmail-util is used for that -M:: migrate legacy 2.2.x messageblks to mimeparts table. -m limit:: limit number of physmessages migrated. Default 1 per run. Cool - so once all working, we can do things bit by bit. Nice. Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] 2_2-3_0.mysql run again?
Hi There, I was testing the 2_2-3_0.mysql script on our dbmail-2.2.17 database (115GB - running under a cloned VM of our live database), but the SSH connection died before it completed... can i just simply run the script again or should i just re-clone a new VM? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] DBMail insert email via SQL?
Hi There, We have a CRM package that emails on behalf of our users, who are using DBMail (3.x) and IMAP for their email. I know its SQL so i know its techincally possible, but is there a correct way todo this? if so, pointers would be really appreciated thanks! Thanks! Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] DBMail insert email via SQL?
On 22/06/2012, at 10:19 PM, Reindl Harald wrote: Am 22.06.2012 07:47, schrieb Simon: Hi There, We have a CRM package that emails on behalf of our users, who are using DBMail (3.x) and IMAP for their email. I know its SQL so i know its techincally possible, but is there a correct way todo this? if so, pointers would be really appreciated thanks! do not do this you would need to behave EXACTLY like internel dbmail-code and be aware of any internal changes / bugfixes and so on this is why SMTP as generic protocol exists the MTP is for Mail Transport Protocol and the S for Simple Thanks for the reply.. sorry i should have been a little bit more in-depth with what we want todo. we would like the CRM to add the outgoing email to the Sent Items folder for the given user.. but as you note above, i will be looking todo this outside of SQL. Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
On 6/07/2012, at 8:40 AM, Reindl Harald wrote: Am 05.07.2012 22:37, schrieb Simon: Hi There, We are running dbmail 3.0.2 on debian squeeze for a client who all use Max OSX and Apple Mail for their client... there is a weird issue(s): 1). When sending email, the email does not show up in the Sent Items folder until they either Rebuild the folder or restart the app. 2). When saving something to draft, then subsequently sending the email they end up with emails in the drafts folder with No Recipients and No Subject Ive tried with some other email clients and cant replicate the issue, so it seems its the Apple Mail client's issue.. has anyone else seen this and/or know of a fix or workaround? not really, but i have seen so many issues with apple clients the last years starting with a lot of fidderent sent-folders from different mail.app an d differsent iOS versions, each containing some messages if there is no really good reason throw away any apple mail-client and replace it with thunderbird Oh i agree with you... :D But that does not work in the real world with normal users... Move the client from their fav apple mail app to thunderbird all hell will brake loose :) Sorry but move your client to another app is really not an answer for any technical issue (but one that i hear all the time). The client is more likely to say we will find another supplier than yes we will move to thunderbird as the mail server software you said was so great does not work will apple mail. I understand dbmail is open source, im not asking people to drop everything and just fix it, im just checking to see if any one as seen this issue and or would understand how to go about trying to solve it before i move them to another mail server Thanks! Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
On 6/07/2012, at 9:35 AM, Daniel Urstöger wrote: Hi Simon, I can feel your pain. One of my customers runs roughly 25-30 Apple clients (Macs, iPhones, iPads, etc.) against dbmail 2.x and I havent seen any problem like the two you described. Yes - our main customer dbmail cluster (1500+ mailboxes and 200GB+ data) runs on 2.x and does not have these issues with Apple Mail clients. Its just that this particular client wanted their own VM with their own private mail cloud :) I am sure Paul will give it a shot but you need to provide him with the proper logs for him to be able to dig up the issue. And happy to provide all the proper logs... would someone be able to give me a quick outline as to what i should grab? Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
On 6/07/2012, at 9:54 AM, Simon wrote: On 6/07/2012, at 9:35 AM, Daniel Urstöger wrote: Hi Simon, I can feel your pain. One of my customers runs roughly 25-30 Apple clients (Macs, iPhones, iPads, etc.) against dbmail 2.x and I havent seen any problem like the two you described. Yes - our main customer dbmail cluster (1500+ mailboxes and 200GB+ data) runs on 2.x and does not have these issues with Apple Mail clients. Its just that this particular client wanted their own VM with their own private mail cloud :) I am sure Paul will give it a shot but you need to provide him with the proper logs for him to be able to dig up the issue. And happy to provide all the proper logs... would someone be able to give me a quick outline as to what i should grab? Ive double-triple checked on this as it is def OK on dbmail 2.x - if there is any assistance anyone can give that would be great... otherwise i guess migrate to 2.x right? Fanks, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
Hey Paul, Just wondering if you got anywhere with this? We are happy to assist where ever we can... its only dbmail 3.0, 2.2.x is absolutely fine :) Thanks! Simon On Wed, Aug 1, 2012 at 11:05 PM, Paul J Stevens p...@nfg.nl wrote: On 07/05/2012 10:37 PM, Simon wrote: Hi There, We are running dbmail 3.0.2 on debian squeeze for a client who all use Max OSX and Apple Mail for their client... there is a weird issue(s): 1). When sending email, the email does not show up in the Sent Items folder until they either Rebuild the folder or restart the app. Since I now own an iPad3 I can look into it. No promisses though. 2). When saving something to draft, then subsequently sending the email they end up with emails in the drafts folder with No Recipients and No Subject -- Paul J Stevenspjstevns @ gmail, twitter, skype, linkedin * Premium Hosting Services and Web Application Consultancy * www.nfg.nl/i...@nfg.nl/+31.85.877.99.97 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
Sorry to keep asking.. but i really want to keep using dbmail (!!!), but cant with this client if there is not even an answer when it will be compatible with apple mail? I understand that this is an issue with Mac Mail - i do. But its not going away? This also puts a issue on us upgrading to dbmail3 for our core mail server platform.. many of our clients are mac users and use Mac Mail - asking them to change their mail program is not viable... so therefore we have to change our platform Thanks! Simon On 17/08/2012, at 5:38 PM, Simon grem...@gmail.com wrote: Hey Paul, Just wondering if you got anywhere with this? We are happy to assist where ever we can... its only dbmail 3.0, 2.2.x is absolutely fine :) Thanks! Simon On Wed, Aug 1, 2012 at 11:05 PM, Paul J Stevens p...@nfg.nl wrote: On 07/05/2012 10:37 PM, Simon wrote: Hi There, We are running dbmail 3.0.2 on debian squeeze for a client who all use Max OSX and Apple Mail for their client... there is a weird issue(s): 1). When sending email, the email does not show up in the Sent Items folder until they either Rebuild the folder or restart the app. Since I now own an iPad3 I can look into it. No promisses though. 2). When saving something to draft, then subsequently sending the email they end up with emails in the drafts folder with No Recipients and No Subject -- Paul J Stevenspjstevns @ gmail, twitter, skype, linkedin * Premium Hosting Services and Web Application Consultancy * www.nfg.nl/i...@nfg.nl/+31.85.877.99.97 ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
On 23/08/2012, at 2:55 AM, Paul J Stevens p...@nfg.nl wrote: On 08/22/2012 05:11 AM, Simon wrote: Sorry to keep asking.. but i really want to keep using dbmail (!!!), but cant with this client if there is not even an answer when it will be compatible with apple mail? I understand that this is an issue with Mac Mail - i do. But its not going away? Supporting Mac Mail is important. All the hipster incrowd seem to use macbooks there days... hipsters... *shudder* I own an iPad, but that's a different animal all together. I can't even save messages as drafts. But when I do sent it, it shows up in the Sent folder just fine. In short: I'm unable to reproduce this. So, In order to get a grip on what might be going on, at the very least I need a protocol trace. A syslog_logging_levels = 64 should do the trick, or a tshark/wireshark dump. I will organise this and email to you. Also try to allow for the fact that I do need to make a living, and this is an open-source project. Paying clients and projects do take precedence! At the same time: all your patches/documentation/user-support is/are most welcome. Absolutely! Thanks Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
On 22/08/2012, at 9:57 PM, Harald Leithner harald.leith...@itronic.at wrote: Hi Simon, I'm running dbmail 3 commit 22b964b, I tested it with one of our Imac using Mail.app Version 5.2 (1278) and have no problem... so could you give me a version number of Mail.app? Version 6.0 (1485), which comes with Mac OS X Mountain Lion. Im running dbmail-3.0.2 on debian 64-bit - i dont know what commit sorry, just from the standard download from the dbmail website. Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Drafts sent items with apple mail and dbmail 3.0.2
On 25/08/2012, at 2:37 AM, Harald Leithner harald.leith...@itronic.at wrote: Hi Simon, I have similar problems in Mail.app 6.0 but I'm not sure if we have the sample problems ;-) I added my own account to mail.app (bad Idea adding a 5Gb mailbox) after downloading my mails (I'm still not sure if all mails has been downloaded) I tried to send a mail, the mail was saved in the Gesendet Mailbox local or so, because its in none of IMAP folders, the same with drafts. Maybe I'm wrong. I created a new User and tried to send another message, mail.app created a new directory on the server Sent Messages and worked as expected. (I found the mail of my main account also in this folder so it works also there) The same for Drafts, I created a Mail saved it as draft (a new Folder was created), I loaded the draft and send it without problems The only difference to is the version you use and I use, but there are only 3 commits between us and I think non of them has something todo with your problem. --- commit 22b964b653ba149b63b9b6787aeac7803c2121e5 Author: Paul J Stevens p...@nfg.nl Date: Tue Apr 10 09:31:07 2012 +0200 AUTOREPLY: check Precedence header commit 9e2f272541621d898d9485bfbf43818d7dce708c Author: Paul J Stevens p...@nfg.nl Date: Fri Apr 6 21:23:37 2012 +0200 IMAP: fix SORT-ing on multiple criteria commit 64cedfabfee664471a9129ac744609853f2d5463 Author: Paul J Stevens p...@nfg.nl Date: Thu Mar 15 23:53:23 2012 +0100 fix literal-s2c #963 --- Maybe the update of OS X 10.8.1 helps you. Thanks for the Feedback on this one... I will check out 10.8.1 and see if this makes a difference. I might try re-setting this up and run thru compile again and see what happens. Thanks again, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Memory usage with dbmail-2.2.18?
Hi There, We are using dbmail-2.2.18 on freshly minted debian squeeze for about 400+ mailboxes. The VM (esxi 5.0) it is running on has dual core Xeon E5645 @ 2.4GHz with 1GB RAM. Default install with build-essentials + the following packages: mysql-client-5.1, libmysqlclient-dev, pkg-config, libglib2.0-0, libglib2.0-data, libgmime-2.0-2-dev, libgmime-2.0-2a. Then a simple ./configure --with-mysql to configure and install etc. We are using the init script and debian.default from dbmail-2.2.18/debian and the standard config, except bumping up the following: NCHILDREN = 30 MAXCHILDREN = 200 MINSPARECHILDREN = 10 MAXSPARECHILDREN = 100 The issue we have with this new install is that it runs into SWAP and just (very) slowly fills the swap up.. its load average is 0.01-0.05. Any ideas here, or are my settings above to much? need more RAM? Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Force all POP users to delete from server?
Hi There, I might be asking the question in the wrong way.. but is there any way to force pop users to delete messages from the server? e.g. no mater what they have as keep a copy message on server dbmail still deletes it? Thanks! Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] Memory usage with dbmail-2.2.18?
On 12/09/2012, at 7:26 PM, Paul J Stevens p...@nfg.nl wrote: On 09/12/2012 02:10 AM, Simon wrote: Hi There, We are using dbmail-2.2.18 on freshly minted debian squeeze for about 400+ mailboxes. The VM (esxi 5.0) it is running on has dual core Xeon E5645 @ 2.4GHz with 1GB RAM. I have no idea how well isolated an esxi VM is. I'm not impressed by containers like openvz, but hypervisor domains like xen work really well. Afaik, esxi is more like xen, right? NCHILDREN = 30 I generally keep this *really* low, especially on memory constraint systems. Less is better. Also, make sure you enter different values below the pop3, lmtp, and imap stanzas, depending on the kind of traffic you get to handle. This goes for all pre-fork parameters. MAXCHILDREN = 200 1024MB/200 ~= 5MB per client in a fully loaded situation. That is way too low! Either reduce maxchildren to 100 or double your RAM: 10MB resident memory per client on average should be enough. And keep an eye on 'top' to see how much resident memory the imap processes use on avarage. MINSPARECHILDREN = 10 MAXSPARECHILDREN = 100 Again, way too high. A bandwidth of 2-4 spare clients should be sufficient, or maybe 2-8. That allows scaling down when daemons are idle. The issue we have with this new install is that it runs into SWAP and just (very) slowly fills the swap up.. its load average is 0.01-0.05. You will also want to set MAXCONNECTS to something low, like 10. Overhead for forking new children after reaping older ones is very low. Keep things neat and clean. Any ideas here, or are my settings above to much? need more RAM? More ram never hurts, but try tweaking a little more before you do that. Thanks for the great feedback Paul. Have made some modifications and things are a little better, plus gave it 2GB ram. Something to note here is that we were not seeing quite the same memory usage with a 32bit VM as a 64bit VM ... something in the configure line needed here? Also, we front-ended dbmail with perdition and that made a huge change to the memory usage - is this because it handles the connections better? Regards, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] curmail_size vs innodb disk usage
Hi There, We are using dbmail (2.2.18) on debian with a (separate) mysql 5.1 backend (master/slave with innodb_file_per_table enabled). We use innobackupex for nightly backups. Currently a SUM(curmail_size) of all mailboxes gives us about 110GB.. yet our dbmail_messageblks.ibd file is nearly 500GB and the mysql data space is just about full. Is this something that dbmail is not reporting correctly curmail_size or is this just innodb (e.g. does not reclaim the space). If the later, I would really appreciate some pointers to deal with reclaiming the space...? Many thanks, Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] curmail_size vs innodb disk usage
On Thu, Mar 19, 2015 at 10:27 PM, Reindl Harald h.rei...@thelounge.net wrote: 1. Optimize table rewrites the entire table into a new file. This means you'll need about 110G-150G of storage space to be able to perform this action in the first place sadly yes, maybe it's too late I can provision new space for the device, so not too late :) 2. In the process the table will be locked, and rewriting 110G of data will take a while. In this time you won't be able to write to this table. Every new message delivery will cause a new MySQL thread waiting for the table optimize to be over. Depending on how many incoming emails you get, you could run out of connections (see max_connection) and your reading clients (pop3) won't be able to connect. before MySQL 5.6 it's easy to weight: just shutdown mailservices for that time because it affects also sent-mail and drafts I can use (percona tools) pt-online-schema-change todo the same thing as Optimize, but without locking. 3. Unless you are using the MySQL server for something else too (you shouldn't) the space is not really wasted. The dbmail_messageblks.ibd file is managed by innodb and contains empty spaces. They get filled with new emails. Until your server reaches 500GB of messageblks data, the file won't grow that's not true, there is overhead too Yes.. in this case there is about 100MB of free data (SUM of Data_free), and the tables come to 500GB (SUM of SUM of Data_length). I performed a mysqldump of the entire DB (there is only the one database on the server, except for mysql that is), and the size of the file is 393G.. so the difference between the database size and the dump file is approx 100GB. What im trying to understand is why is the SUM of curmail_size is approx 110GB, yet the database size (even dump'ed) is 400GB. Surely dbmail does not have that much overhead in its database? Thanks! Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
Re: [Dbmail] curmail_size vs innodb disk usage
On Fri, Mar 20, 2015 at 9:31 AM, Reindl Harald h.rei...@thelounge.net wrote: Am 19.03.2015 um 21:16 schrieb Simon: What im trying to understand is why is the SUM of curmail_size is approx 110GB, yet the database size (even dump'ed) is 400GB. Surely dbmail does not have that much overhead in its database? mailsize has barely to do with database size completly different worlds no database at all gives back space just because data are removed because the overhead would be way too large, be it mysql, berkely db, postgresql or something else - they all try to re-use allocated space as good as possible without vacuum all the time OK thanks for the clarification on this. I just seems completely out of wack that the DB would use 4 times the amount of space for the actual data to me :) One of the reasons we have moved away from dbmail for our primary platform... Simon ___ DBmail mailing list DBmail@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
[Dbmail] Stupid postfix configuration problem...
Hi, I'm trying to get dbmail set up and in order to make the process as quick and painless as possible I decided to try to use postfix simply because that's what the INSTALL document seems tailored to; I don't know very much about it myself. Unfortunately, after setting everything up (I think!) as specified (added dbmail: to master.cf, domains to transport transport to main.cf), mail bounces with: 553 5.3.5 80.177.97.28. config error: mail loops back to me (MX problem?) 553 5.3.5 bellos.dyndns.info. config error: mail loops back to me (MX problem?) 554 5.3.5 Local configuration error I'm afraid I'm not entirely sure how to proceed from here. I know this isn't really a dbmail issue, but that error seems to be fairly generic so USENET search returns all sorts of different problems that have the same symptoms and I'm sure that somebody here will be able to help me out... Apologies if I'm just being stupid and failing to read/understand something obvious! Thanks in advance, Simon
