Re: [qmailtoaster] Duplicate emails
Use find and xargs A quick google https://www.everythingcli.org/find-exec-vs-find-xargs/ > Il giorno 20 ott 2019, alle ore 08:56, Jeff Koch > ha scritto: > > We just migrated a QMT7 mailserver from one DC to another but since the > backup was huge and it took couple days to FTP before we could do the final > incremental backup we now have many accounts with duplicate emails. The file > names are almost the same except for the suffixes. Does anyone know of a > script That will remove these dups? > > Jeff > > Sent from my iPhone > > - > To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com > For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com > - To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com
Re: [qmailtoaster] duplicate emails
On 07/13/2011 06:55 PM, sys wrote: Dont think so, whatever is in a default install from the qmail ISO - Original Message - *From:* Kalil Costa - Brasilsite mailto:ka...@brasilsite.com.br *To:* qmailtoaster-list@qmailtoaster.com mailto:qmailtoaster-list@qmailtoaster.com *Sent:* Wednesday, July 13, 2011 2:48 PM *Subject:* Re: [qmailtoaster] duplicate emails madmac, you use nfs to storage de messages ?? Em 13-07-2011 19:48, sys escreveu: Yesterday started getting Duplicate emails in only some accounts, including mine: Narrowed it down to imap accounts, some on Outlook, others on Thunderbird, so different clients. What can I check on the server end please. Thanks madmac check the user's .qmail file and make sure there's not a duplicate entry in there.
Re: [qmailtoaster] duplicate emails
Hi Jake: Should there be a .qmail file on all accounts or only at a perticular time, or only per domain? Thanks - Original Message - From: Jake Vickers To: qmailtoaster-list@qmailtoaster.com Sent: Wednesday, July 13, 2011 11:08 PM Subject: Re: [qmailtoaster] duplicate emails On 07/13/2011 06:55 PM, sys wrote: Dont think so, whatever is in a default install from the qmail ISO - Original Message - From: Kalil Costa - Brasilsite To: qmailtoaster-list@qmailtoaster.com Sent: Wednesday, July 13, 2011 2:48 PM Subject: Re: [qmailtoaster] duplicate emails madmac, you use nfs to storage de messages ?? Em 13-07-2011 19:48, sys escreveu: Yesterday started getting Duplicate emails in only some accounts, including mine: Narrowed it down to imap accounts, some on Outlook, others on Thunderbird, so different clients. What can I check on the server end please. Thanks madmac check the user's .qmail file and make sure there's not a duplicate entry in there.
Re: [qmailtoaster] duplicate emails
I do see a .qw and one of the accounts getting duplicate emails has two. - Original Message - From: Jake Vickers To: qmailtoaster-list@qmailtoaster.com Sent: Wednesday, July 13, 2011 11:08 PM Subject: Re: [qmailtoaster] duplicate emails On 07/13/2011 06:55 PM, sys wrote: Dont think so, whatever is in a default install from the qmail ISO - Original Message - From: Kalil Costa - Brasilsite To: qmailtoaster-list@qmailtoaster.com Sent: Wednesday, July 13, 2011 2:48 PM Subject: Re: [qmailtoaster] duplicate emails madmac, you use nfs to storage de messages ?? Em 13-07-2011 19:48, sys escreveu: Yesterday started getting Duplicate emails in only some accounts, including mine: Narrowed it down to imap accounts, some on Outlook, others on Thunderbird, so different clients. What can I check on the server end please. Thanks madmac check the user's .qmail file and make sure there's not a duplicate entry in there.
Re: [qmailtoaster] duplicate emails
I always recive double e-mails too, but only from qmailtoaster-list. Prolly I have a double account here but I can't remember... :| On 14/07/2011 16:50, sys wrote: Hi Jake: Should there be a .qmail file on all accounts or only at a perticular time, or only per domain? Thanks - Original Message - *From:* Jake Vickers mailto:j...@qmailtoaster.com *To:* qmailtoaster-list@qmailtoaster.com mailto:qmailtoaster-list@qmailtoaster.com *Sent:* Wednesday, July 13, 2011 11:08 PM *Subject:* Re: [qmailtoaster] duplicate emails On 07/13/2011 06:55 PM, sys wrote: Dont think so, whatever is in a default install from the qmail ISO - Original Message - *From:* Kalil Costa - Brasilsite mailto:ka...@brasilsite.com.br *To:* qmailtoaster-list@qmailtoaster.com mailto:qmailtoaster-list@qmailtoaster.com *Sent:* Wednesday, July 13, 2011 2:48 PM *Subject:* Re: [qmailtoaster] duplicate emails madmac, you use nfs to storage de messages ?? Em 13-07-2011 19:48, sys escreveu: Yesterday started getting Duplicate emails in only some accounts, including mine: Narrowed it down to imap accounts, some on Outlook, others on Thunderbird, so different clients. What can I check on the server end please. Thanks madmac check the user's .qmail file and make sure there's not a duplicate entry in there.
Re: [qmailtoaster] duplicate emails
madmac, you use nfs to storage de messages ?? Em 13-07-2011 19:48, sys escreveu: Yesterday started getting Duplicate emails in only some accounts, including mine: Narrowed it down to imap accounts, some on Outlook, others on Thunderbird, so different clients. What can I check on the server end please. Thanks madmac - Qmailtoaster is sponsored by Vickers Consulting Group (www.vickersconsulting.com) Vickers Consulting Group offers Qmailtoaster support and installations. If you need professional help with your setup, contact them today! - Please visit qmailtoaster.com for the latest news, updates, and packages. To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com
Re: [qmailtoaster] duplicate emails
Dont think so, whatever is in a default install from the qmail ISO - Original Message - From: Kalil Costa - Brasilsite To: qmailtoaster-list@qmailtoaster.com Sent: Wednesday, July 13, 2011 2:48 PM Subject: Re: [qmailtoaster] duplicate emails madmac, you use nfs to storage de messages ?? Em 13-07-2011 19:48, sys escreveu: Yesterday started getting Duplicate emails in only some accounts, including mine: Narrowed it down to imap accounts, some on Outlook, others on Thunderbird, so different clients. What can I check on the server end please. Thanks madmac - Qmailtoaster is sponsored by Vickers Consulting Group (www.vickersconsulting.com) Vickers Consulting Group offers Qmailtoaster support and installations. If you need professional help with your setup, contact them today! - Please visit qmailtoaster.com for the latest news, updates, and packages. To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com
Re: [qmailtoaster] duplicate emails
Ah ok. I see this using nfs for storage the messages I solved synchronizing the time, but i don't think this is the case Em 13-07-2011 19:55, sys escreveu: Dont think so, whatever is in a default install from the qmail ISO - Original Message - From: Kalil Costa - Brasilsite To: qmailtoaster-list@qmailtoaster.com Sent: Wednesday, July 13, 2011 2:48 PM Subject: Re: [qmailtoaster] duplicate emails madmac, you use nfs to storage de messages ?? Em 13-07-2011 19:48, sys escreveu: Yesterday started getting Duplicate emails in only some accounts, including mine: Narrowed it down to imap accounts, some on Outlook, others on Thunderbird, so different clients. What can I check on the server end please. Thanks madmac - Qmailtoaster is sponsored by Vickers Consulting Group (www.vickersconsulting.com) Vickers Consulting Group offers Qmailtoaster support and installations. If you need professional help with your setup, contact them today! - Please visit qmailtoaster.com for the latest news, updates, and packages. To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com - Qmailtoaster is sponsored by Vickers Consulting Group (www.vickersconsulting.com) Vickers Consulting Group offers Qmailtoaster support and installations. If you need professional help with your setup, contact them today! - Please visit qmailtoaster.com for the latest news, updates, and packages. To unsubscribe, e-mail: qmailtoaster-list-unsubscr...@qmailtoaster.com For additional commands, e-mail: qmailtoaster-list-h...@qmailtoaster.com
RE: [qmailtoaster] duplicate emails
And to follow up. I've just realized everyone who has started to receive duplicate emails has put on their out of office reply via QmailAdmin. When they return and take it off they receive duplicate emails... From: Dan Herbon [mailto:[EMAIL PROTECTED] Sent: Thursday, December 11, 2008 10:14 AM To: qmailtoaster-list@qmailtoaster.com Subject: [qmailtoaster] duplicate emails So a bunch of my users are receiving duplicate emails but not everyone. Only a select few. I looked through past posts on duplicates and noticed people having problem with server performance. Mine is running just fine. I then noticed a post about the .qmail file. Sure enough, all the users that are receiving duplicate emails have this in their .qmail file: -- |/var/qmail/bin/preline /usr/bin/maildrop -A 'Content-Filter: maildrop-toaster' /etc/mail/mailfilter /home/vpopmail/domains/fbchomeloans.com/bferguson/Maildir/ -- The users who are receiving emails just fine have this: --- |/var/qmail/bin/preline /usr/bin/maildrop -A 'Content-Filter: maildrop-toaster' /etc/mail/mailfilter --- Any idea what would have caused the system to add the second line?
Re: [qmailtoaster] duplicate emails
I'm as well encountering this problem still. It seems to be related clamd or spamd getting stuck, but I haven't discovered further details. Restarting qmail resolves the issue for a while. It is very annoying. How do I find out which email addresses are causing this? Maybe there is a pattern related to .qmail files etc as you have suggested Peter On Wed, May 14, 2008 at 10:08 PM, Igor Vukotić [EMAIL PROTECTED] wrote: I have same problem, but i found out when user modify preference through webmail ( enable forwarding or out of office ) this is happening. On 2008.05.12, at 00:20, John wrote: I recently posted a message about this and found a solution but with negative effects. I determined that only one email address was receiving duplicate emails. I found that by moving that account's .qmail file out of the way the duplicates stopped. Here's the contents of .qmail: |/var/qmail/bin/preline /usr/bin/maildrop -A 'Content-Filter: maildrop-toaster' /etc/mail/mailfilter /home/vpopmail/domains/boubion.com/dominic/Maildir/ Don't I need this for the spambox I set up? Memory and server loads are pretty consistent as not much has changed on this server in recent months so I don't think this is a RAM issue as has been suggested in other threads. Only odd thing is the timestamp on .qmail for the user is April 30th. I looked back in my trash can and can easily see the duplicates started after the file was modified. To be honest I don't remember what I might have done to modify the file. spamassassin-toaster-3.1.8-1.3.8 clamav-toaster-0.93-1.3.18 Thanks, John - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
I have same problem, but i found out when user modify preference through webmail ( enable forwarding or out of office ) this is happening. On 2008.05.12, at 00:20, John wrote: I recently posted a message about this and found a solution but with negative effects. I determined that only one email address was receiving duplicate emails. I found that by moving that account's .qmail file out of the way the duplicates stopped. Here's the contents of .qmail: |/var/qmail/bin/preline /usr/bin/maildrop -A 'Content-Filter: maildrop-toaster' /etc/mail/mailfilter /home/vpopmail/domains/ boubion.com/dominic/Maildir/ Don't I need this for the spambox I set up? Memory and server loads are pretty consistent as not much has changed on this server in recent months so I don't think this is a RAM issue as has been suggested in other threads. Only odd thing is the timestamp on .qmail for the user is April 30th. I looked back in my trash can and can easily see the duplicates started after the file was modified. To be honest I don't remember what I might have done to modify the file. spamassassin-toaster-3.1.8-1.3.8 clamav-toaster-0.93-1.3.18 Thanks, John - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] smime.p7s Description: S/MIME cryptographic signature
Re: [qmailtoaster] Duplicate emails
Raymond Webster wrote: Hello; I have a new qmt-iso install, and It has been working very well since Jan 18th until about a week ago. When users would have messages stuck in the outbox in both Outlook Express and Outlook. Then emails would be sent multiple times. This is not limited to the Outlook/Outlook Express users. Many of my users are also seeing outside emails multiple times. I have looked in the archives and seen other toaster users with the same problem. The solutions seem to point at spammassassin and clamav consuming a lot of cpu time. This new install I have does not seem to be all that busy as it was with a previous qmail install. Maybe 57% usage when a large attachment is being scanned by clamav. Most of the time less than 10% cpu usage. Are there any other suggestions as to stopping multiple identical messages from being passed to the inboxes of the toaster? If it's a high-load server (lots of users/emails) you may also want to look at increasing the number of connections mysql can handle. The default is 100 or 200 if I remember right.
Re: [qmailtoaster] Duplicate emails
Raymond Webster wrote: Hello; I have a new qmt-iso install, and It has been working very well since Jan 18th until about a week ago. When users would have messages stuck in the outbox in both Outlook Express and Outlook. Then emails would be sent multiple times. This is not limited to the Outlook/Outlook Express users. Many of my users are also seeing outside emails multiple times. I have looked in the archives and seen other toaster users with the same problem. The solutions seem to point at spammassassin and clamav consuming a lot of cpu time. This new install I have does not seem to be all that busy as it was with a previous qmail install. Maybe 57% usage when a large attachment is being scanned by clamav. Most of the time less than 10% cpu usage. Are there any other suggestions as to stopping multiple identical messages from being passed to the inboxes of the toaster? Ray Webster If Outlook (possibly OE too, I'm not sure though) users are sending very large messages/attachments, you may need to increase Outlook's timeout setting to give the toaster time enough to do its virus scan. -- -Eric 'shubes' - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: [qmailtoaster] Duplicate emails and increased spam getting through
More information: Below are a few lines from the /var/log/qmail/spamd/current file. This information does not look good but I do not know what it means. Can someone give me some idea of what this means and what I should be looking at? @4000470285c9110f939c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285ca11a7c874 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285cb12414d3c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285cc12da83e4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285cd1373e19c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285ce140bef64 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285cf14a531c4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d0153dcc2c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d115d6a514 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d2166fe774 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d3170977f4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d417a1df94 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d5183c6a14 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d618d4606c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d7196c898c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d81a0629ac [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285d91a9ed79c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285da1b3825b4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285db1bd196f4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285dc1c6a8364 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285dd1d03c1dc [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285de1d9c92f4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285df1e35b9fc [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e01ed0159c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e11f67c1bc [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e22000b9e4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e320995064 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e42132d914 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e521cd30cc [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e62264ec8c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e722fe2b04 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e82397232c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285e92430752c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285ea24c93e74 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285eb256353c4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285ec25fb695c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285ed269459b4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285ee272ead84 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285ef27c680b4 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f0285fd69c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f128f8b754 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f22991de5c [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f32a2af9ac [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f42ac3c6dc [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f52b5d20ac [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f62bf5f994 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor @4000470285f72c8f6304 [19049] warn: prefork: select returned -1! recovering: Bad file descriptor
Re: [qmailtoaster] Duplicate emails again (New toaster on Centos 5)
you probably have 2 lines for incoming mail forwarding. Check .qmail file in your vpopmail/domains/yourdomain.com/youruser if it has two identical line then you need to remove one. to be sure you could paste the contents of it back here. Jake Vickers wrote: Mark Piekos wrote: I recently built a new toaster on Centos 5 with all packages from the production site. All has been well until I changed the password of my mail account and I am suddenly getting duplicate emails for thi saccount only. It doesn't matter whether I am sending a message to myself or receiving them from external sources. I've copied full headers from 'two' that I sent to myself. (just one sent, two received). I've noticed that the Delivered-To: address is different for the two headers. I'd be really grateful for any help/advice. Do you have a .qmail file hiding in there somewhere? And id the address you're sending to an alias for other email addresses? - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] Duplicate emails again (New toaster on Centos 5)
Mark Piekos wrote: I recently built a new toaster on Centos 5 with all packages from the production site. All has been well until I changed the password of my mail account and I am suddenly getting duplicate emails for thi saccount only. It doesn't matter whether I am sending a message to myself or receiving them from external sources. I've copied full headers from 'two' that I sent to myself. (just one sent, two received). I've noticed that the Delivered-To: address is different for the two headers. I'd be really grateful for any help/advice. Do you have a .qmail file hiding in there somewhere? And id the address you're sending to an alias for other email addresses? smime.p7s Description: S/MIME Cryptographic Signature
Re: [qmailtoaster] Duplicate emails on ezmlm lists and in general
I've seen this also when the SA bayes database is problematic. When auto-expire is used, it can take quite some time for the initial expiration cycle, and smtp sessions appear to simply hang. Are there any errors in /var/log/qmail/smtpd/current? What do you have in your /etc/mail/spamassassin/local.cf? Try running # sudo -u vpopmail -H spamassassin -D bayes --lint Any errors from that? Michael Amster wrote: The machine is not swapping, and DNS is running fast. Try telneting to port 25 of koala.webeasy.com - should come back in 2s. -MA Jake Vickers wrote: Michael Amster wrote: I have been seeing a problem on the toaster where emails from some people send to me multiple times. This is especially annoying to people on some ezmlm lists I run. In particular, the domain netrin.com (some friends of mine) I always get duplicates. Looks like the same delivery maybe 5 or six times. Has anyone seen this on their qmailtoaster and/or have some hints on what to do? Duplicates are usually linked to low resources (memory) or the smtp daemon taking to long. Can also be caused by LONG DNS lookups, but in my experience it has been because of low memory. Swapping is no good. -- -Eric 'shubes' - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] Duplicate emails on ezmlm lists and in general
Michael Amster wrote: I have been seeing a problem on the toaster where emails from some people send to me multiple times. This is especially annoying to people on some ezmlm lists I run. In particular, the domain netrin.com (some friends of mine) I always get duplicates. Looks like the same delivery maybe 5 or six times. Has anyone seen this on their qmailtoaster and/or have some hints on what to do? Duplicates are usually linked to low resources (memory) or the smtp daemon taking to long. Can also be caused by LONG DNS lookups, but in my experience it has been because of low memory. Swapping is no good. - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] Duplicate emails on ezmlm lists and in general
The machine is not swapping, and DNS is running fast. Try telneting to port 25 of koala.webeasy.com - should come back in 2s. -MA Jake Vickers wrote: Michael Amster wrote: I have been seeing a problem on the toaster where emails from some people send to me multiple times. This is especially annoying to people on some ezmlm lists I run. In particular, the domain netrin.com (some friends of mine) I always get duplicates. Looks like the same delivery maybe 5 or six times. Has anyone seen this on their qmailtoaster and/or have some hints on what to do? Duplicates are usually linked to low resources (memory) or the smtp daemon taking to long. Can also be caused by LONG DNS lookups, but in my experience it has been because of low memory. Swapping is no good. - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
Steve Ingraham wrote: I want to thank Jake, Andrew, George, Eric, Loren, Jimmy and anyone else who has sent information to help me with my email problems the last couple of days. Despite all of your good advice our domain is still having email problems. I am not exactly sure what the root of the problem is exactly. I received an email to [EMAIL PROTECTED] that appears to have only gone to that account so Jake may be the only one reading this aware of his comments. In it he states that he was unable to connect to remote host when he digs our MX okcca.net. I have included the contents of his message here: Jake Vickers wrote: Hey Steve. I've been in those shoes before To get email working, for now take out all of your SA rules. Then run spamassassin -D --lint to parse everything and make sure all is okay. I am trying to do as much trouble shooting without actually logging into your machine as I can from here. Here is my first problem Your DNS is wrong, or you have a network problem somewhere: Steve, in looking at what I was doing late last night, I did not specify the port for the telnet connection. It was my outbound firewall that was causing the no route to host. Apologize for this. If email is working now, keep an eye on it. Are all of your clients set up to use the Exchange as the inbound/outbound server?
RE: [qmailtoaster] duplicate emails
Jake Vickers wrote: Steve, in looking at what I was doing late last night, I did not specify the port for the telnet connection. It was my outbound firewall that was causing the no route to host. Apologize for this. If email is working now, keep an eye on it. Are all of your clients set up to use the Exchange as the inbound/outbound server? Apology is not necessary. I appreciate the efforts by all. It just concerned me because coincidently I had recent DNS problems. To answer your question, yes, the clients are using Outlook and mail is routed through Microsoft Exchange 2000. I also have just placed (in July) a new server running Windows 2003 Server and Exchange 2003. I have moved several mailboxes to the new Exchange 2003 server including my account. So all the clients email is relayed from qmail to either the old Exchange 2000 server or the new Exchange 2003 server. Steve Ingraham
Re: [qmailtoaster] duplicate emails
That's great that it works, George. I ran into a situation w/ an x86_64 machine (client's, I don't have one) where bash treated an unquoted environment variable as if it were quoted. I'm not positive on this, but am guessing that in this case the separate lines would prematurely end the exec command in /var/qmail/supervise/smtp/run. No? George Sweetnam wrote: You need the -r which means to use as a rejection list -a is a white list (don't run through an rbl). I don't have any problems using multiple lines when entering then in the blacklists file... putting it directly into the smtp/run file without a \ on the end of the line would be foolish though. Use the qmail-inject line I sent last time to test your email...it'll show you where it's failing. George. - Original Message - From: Eric Shubes [EMAIL PROTECTED] To: qmailtoaster-list@qmailtoaster.com Cc: [EMAIL PROTECTED] Sent: Wednesday, September 27, 2006 6:12 PM Subject: Re: [qmailtoaster] duplicate emails Steve Ingraham wrote: Eric (Shubes) wrote: Caution: the contents of /var/qmail/control/blacklists must be on a single line (I think - you might be able to escape the newline (CR), but I'm not sure w/out testing it). Eric, can you explain what you are referring to in your Caution statement above? Do you mean that all of the content should be listed on one line? So using an example from George's blacklist below the content should look like: -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org . . . etc. Yes, that looks good. If this is the way it needs to be input into the blacklists file should there be commas, spaces or something else between each entry? Just spaces between each entry. No commas, only space(s). If not, then I guess I am a little confused on what you are referring to. Don't put them on separate lines. Steve Ingraham ___ George Sweetnam wrote: You might also want to add some additional blacklists from orbs (don't do the all-in-one). Some like the dynamic shouldn't be used, but the exploited server rbl is very handy. I added 5 or 6 to my servers and it's helped even more. The content of my current blacklists control file (I does change): -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org -r block.dnsbl.sorbs.net -r http.dnsbl.sorbs.net -r misc.dnsbl.sorbs.net -r rhsbl.sorbs.net -r smtp.dnsbl.sorbs.net -r socks.dnsbl.sorbs.net -r spam.dnsbl.sorbs.net -r web.dnsbl.sorbs.net -r zombie.dnsbl.sorbs.net Just eliminate the biggest files in your setup - comment out BLACKLIST and BLACKLIST_URL from your config. Those two are huge and taking them out of my setup returned my system to normal behavior. Thanks, I will look at adding to my blacklists control file. Can you tell me what the -r command means? Steve Ingraham --Original Message-- Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones won't. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham -- -Eric 'shubes
RE: [qmailtoaster] duplicate emails
George Sweetnam wrote: You might also want to add some additional blacklists from orbs (don't do the all-in-one). Some like the dynamic shouldn't be used, but the exploited server rbl is very handy. I added 5 or 6 to my servers and it's helped even more. The content of my current blacklists control file (I does change): -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org -r block.dnsbl.sorbs.net -r http.dnsbl.sorbs.net -r misc.dnsbl.sorbs.net -r rhsbl.sorbs.net -r smtp.dnsbl.sorbs.net -r socks.dnsbl.sorbs.net -r spam.dnsbl.sorbs.net -r web.dnsbl.sorbs.net -r zombie.dnsbl.sorbs.net Just eliminate the biggest files in your setup - comment out BLACKLIST and BLACKLIST_URL from your config. Those two are huge and taking them out of my setup returned my system to normal behavior. Thanks, I will look at adding to my blacklists control file. Can you tell me what the -r command means? Steve Ingraham --Original Message-- Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones won't. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: [qmailtoaster] duplicate emails
Jdow wrote:
Steve, it might help if you listed which rule sets. There are some
which are obscenely large and others that are obsolete. Maybe we
can prune the list for you a little.
As some have mentioned I may have too many rules. I would like to know
what is a must have and what I should not use. Here is a list of what
is currently in the /etc/mail/spamassassin/ folder:
CURRENTLY IN /ETC/MAIL/SPAMASSASSIN
70_sare_adult.cf
70_sare_bayes_poison_nxm.cf
70_sare_evilnum0.cf
occa_phishing.cf
occa_replica.cf
sa-blacklist.cf
sa-blacklist.current.uri.cf
tripwire.cf
chickenpox.cf
init.pre
random.cf
random.current.cf
weeds2.cf
local.cf
The rules below were moved yesterday and placed in a different folder.
Once I moved these and restarted spamassassin by rebooting the server it
was no longer bogging down and duplicating emails.
REMOVED YESTERDAY FROM /ETC/MAIL/SPAMASSASSIN
70_sare_evilnum1.cf
70_sare_evilnum2.cf
70_sare_header0.cf
70_sare_header.cf
70_sare_header_eng.cf
70_sare_html0.cf
70_sare_html1.cf
70_sare_html2.cf
70_sare_html3.cf
70_sare_html4.cf
70_sare_html_eng.cf
70_sare_oem.cf
70_sare_random.cf
70_sare_ratware.cf
70_sare_specfic.cf
70_sare_uri0.cf
70_sare_uri.cf
70_sare_whitlelist.cf
70_sare_whitelist_pre30.cf
72_sare_bml_post23x.cf
99_sare_fraud_post25x.cf
antidrug.cf
blacklist.cf
blacklist-uri.cf
bogus-virus-warnings.cf
Here is the content of my config file for rules_du_jour:
TRUSTED_RULESETS=TRIPWIRE ANTIDRUG SARE_EVILNUMBERS0 BLACKLIST
BLACKLIST_URI RANDOMVAL BOGUSVIRUS SARE_ADULT SARE_FRAUD
SARE_BAYES_POISON_NXM SARE_OEM SARE_RANDOM SARE_HEADER SARE_HEADER0
SARE_HEADER_ENG SARE_HTML0 SARE_HTML1 SARE_HTML2 SARE_HTML3 SARE_HTML4
SARE_HTML_ENG SARE_RATWARE SARE_SPECIFIC SARE_URI SARE_BML_POST25X
SARE_WHITELIST SARE_WHITELIST_PRE30
SA_DIR=/etc/mail/spamassassin
MAIL_ADDRESS=[EMAIL PROTECTED]
SA_RESTART=killall -HUP spamd
I have quite a few users who get a lot of spam, especially
pharmaceuticals and stocks delivered to their mailboxes. They are why I
began trying to work on the spamassassin filtering. An interesting note
I have observed but do not understand why it is happening. When I
updated the rules on Monday, many users started seeing an increase
number of spam in their mailboxes. One user who was getting a great
deal of duplicate emails was also seeing a huge increase in the total
numbers of spam emails. Where she would receive 100 spam emails per day
before the rules_du_jour update, afterwards she was seeing 800 or 900
spam emails per day. Much of it was porn spam that she was not seeing
before the update to the rules files.
I would appreciate any advice and/or education offered on the spam
filtering.
Thanks,
Steve Ingraham
{^_^}
- Original Message -
From: Steve Ingraham [EMAIL PROTECTED]
Steve Ingraham wrote:
I need help with a problem. Our users are seeing some multiple
duplicate emails coming from the same sender. This is not occurring
with every email so there does not seem to be any pattern to which
incoming emails will be duplicated and which ones won't. They are also
reporting that duplicate emails are sent when they send to an outside
email. Has anyone experienced this problem before? What could be
causing this to occur and what can I do to stop this? I am running
qmailtoaster and spamassassin as an external email gateway. There has
been nothing changed with qmail but I did update some rules in SA using
rules_du_jour yesterday. Would these rules updates cause this problem?
If so, what would have changed?
Jake Vickers wrote:
If your system is low on resources (ie: RAM), then the spamd process can
take too long, making Toaster think the mail got lost somewhere, so it
resends it.
Might want to check and see how much RAM you're using.
I want to thank everyone who posted a reply on my inquiry. I believe
Jake Vickers was right about the problem. The RAM on the email server
was bogged down since yesterday when I updated the various .cf files
using rules_du_jour. I had included just a handful of rules from RDJ
but it appears that RDJ utilizes much too much of my server resources to
use it to update my spamassassin rules. It was slowing down the server
so much that simple functions were not responding. This appears to have
affected the delivery of emails. In fact I noticed that my original
message to these mail lists took several hours to post and were
duplicated also. I resolved the problem by moving the various rules .cf
files out of the /etc/mail/spamassassin folder and restarting
spamassassin.
If anyone has a simple way of updating rules for spamassassin I would
welcome your input. I still need to update the rules as I have been
getting a great number of emails coming through to users. Specifically,
we are getting a lot of the pharmaceutical spam and the stock spam.
Again, thanks to everyone for the posts.
Steve Ingraham
-
QmailToaster hosted by: VR
RE: [qmailtoaster] duplicate emails
Jimmy Smith wrote: required_hits 3 report_safe 0 # report_header 1 # use_terse_report 1 # rewrite_subject 0 rewrite_header Subject ***SPAM*** Here, required_hits sets the threshold for what is marked and considered spam (score of 3). The report_safe is turned off, leaving the original message intact. The next three are commented out, leaving the Headers as originally sent. The setting, terse_reports shortens the report format without losing valuable information. Being commented out allows spamassassin to insert information as well as some explanations. The rewrite_subject has been set to insert the SPAM tag in the subject line when hitting the threshold of 3. These are typical of most installations. The local.cf file over-rides the rules in the /usr/share folder. This is where you should place custom rules that are specific to the type of mail your organization receives. The settings above won't have any effect on your duplication problem. For more information, at the mailfilter type perldoc Mail::SpamAssassin::Conf for some tips and guidelines about rules and configuration. There are many sites that will help with understanding configuration settings, such as the one below. http://www.mines.edu/academic/computer/spamuserprefs.shtml Good Luck! Luck appears to be what I am running out of. These email problems are eating my lunch! I know everyone out there has been very helpful and I appreciate the information. However, the suggestions do not seem to be effective in my getting our email functional again. We are still having multiple email failures. Duplicate emails are still coming in, users emails that are sent from our network are not being delivered (this is upsetting users the most as they feel they cannot trust that their emails are being delivered) and outside emails are also being delayed or not delivered at all. These problems began on Monday when I was attempting to update SA rules using RDJ. I have removed all but a small number of .cf files in /etc/mail/spamassassin and rebooted the server. The files currently in /etc/mail/spamassassin folder are: 70_sare_adult.cf 70_sare_bayes_poison_nxm.cf 70_sare_evilnum0.cf occa_phishing.cf occa_replica.cf chickenpox.cf init.pre random.cf tripwire.cf weeds2.cf local.cf Right now I cannot rely on receiving emails as delivery is very sporadic. Please send any replies to this post to [EMAIL PROTECTED] As of this writing no outside email is being delivered to our mailboxes. I would appreciate any help anyone can offer. Steve Ingraham - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: [qmailtoaster] duplicate emails
Eric (Shubes) wrote: Caution: the contents of /var/qmail/control/blacklists must be on a single line (I think - you might be able to escape the newline (CR), but I'm not sure w/out testing it). Eric, can you explain what you are referring to in your Caution statement above? Do you mean that all of the content should be listed on one line? So using an example from George's blacklist below the content should look like: -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org . . . etc. If this is the way it needs to be input into the blacklists file should there be commas, spaces or something else between each entry? If not, then I guess I am a little confused on what you are referring to. Steve Ingraham ___ George Sweetnam wrote: You might also want to add some additional blacklists from orbs (don't do the all-in-one). Some like the dynamic shouldn't be used, but the exploited server rbl is very handy. I added 5 or 6 to my servers and it's helped even more. The content of my current blacklists control file (I does change): -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org -r block.dnsbl.sorbs.net -r http.dnsbl.sorbs.net -r misc.dnsbl.sorbs.net -r rhsbl.sorbs.net -r smtp.dnsbl.sorbs.net -r socks.dnsbl.sorbs.net -r spam.dnsbl.sorbs.net -r web.dnsbl.sorbs.net -r zombie.dnsbl.sorbs.net Just eliminate the biggest files in your setup - comment out BLACKLIST and BLACKLIST_URL from your config. Those two are huge and taking them out of my setup returned my system to normal behavior. Thanks, I will look at adding to my blacklists control file. Can you tell me what the -r command means? Steve Ingraham --Original Message-- Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones won't. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham -- -Eric 'shubes' - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
Steve Ingraham wrote: Eric (Shubes) wrote: Caution: the contents of /var/qmail/control/blacklists must be on a single line (I think - you might be able to escape the newline (CR), but I'm not sure w/out testing it). Eric, can you explain what you are referring to in your Caution statement above? Do you mean that all of the content should be listed on one line? So using an example from George's blacklist below the content should look like: -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org . . . etc. Yes, that looks good. If this is the way it needs to be input into the blacklists file should there be commas, spaces or something else between each entry? Just spaces between each entry. No commas, only space(s). If not, then I guess I am a little confused on what you are referring to. Don't put them on separate lines. Steve Ingraham ___ George Sweetnam wrote: You might also want to add some additional blacklists from orbs (don't do the all-in-one). Some like the dynamic shouldn't be used, but the exploited server rbl is very handy. I added 5 or 6 to my servers and it's helped even more. The content of my current blacklists control file (I does change): -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org -r block.dnsbl.sorbs.net -r http.dnsbl.sorbs.net -r misc.dnsbl.sorbs.net -r rhsbl.sorbs.net -r smtp.dnsbl.sorbs.net -r socks.dnsbl.sorbs.net -r spam.dnsbl.sorbs.net -r web.dnsbl.sorbs.net -r zombie.dnsbl.sorbs.net Just eliminate the biggest files in your setup - comment out BLACKLIST and BLACKLIST_URL from your config. Those two are huge and taking them out of my setup returned my system to normal behavior. Thanks, I will look at adding to my blacklists control file. Can you tell me what the -r command means? Steve Ingraham --Original Message-- Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones won't. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham -- -Eric 'shubes' - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
Steve Ingraham wrote: Luck appears to be what I am running out of. These email problems are eating my lunch! I know everyone out there has been very helpful and I appreciate the information. However, the suggestions do not seem to be effective in my getting our email functional again. We are still having multiple email failures. Duplicate emails are still coming in, users emails that are sent from our network are not being delivered (this is upsetting users the most as they feel they cannot trust that their emails are being delivered) and outside emails are also being delayed or not delivered at all. Are you sure all your problems are SA related? SA shouldn't affect outgoing main in normal configurations. I would try disabling SA (change /var/qmail/control/simcontrol, then # qmailctl cdb) and see if things stabilize. Then add SA back in a little at a time. Local rules only at first, then add rules which require network access, a few at a time. Leave bayes db disabled until all other rules seem to work ok. These problems began on Monday when I was attempting to update SA rules using RDJ. I have removed all but a small number of .cf files in /etc/mail/spamassassin and rebooted the server. The files currently in /etc/mail/spamassassin folder are: 70_sare_adult.cf 70_sare_bayes_poison_nxm.cf 70_sare_evilnum0.cf occa_phishing.cf occa_replica.cf chickenpox.cf init.pre random.cf tripwire.cf weeds2.cf local.cf Right now I cannot rely on receiving emails as delivery is very sporadic. Please send any replies to this post to [EMAIL PROTECTED] As of this writing no outside email is being delivered to our mailboxes. I would appreciate any help anyone can offer. Duplicates are symptomatic of smtp timeouts. Are you getting a lot of exit 256 status codes? When the session times out in SA, the sender will send again, and often the mail is delivered too, resulting in duplicates. I've experienced a problem with the bayes database that I haven't nailed down yet. When expiration of tokens kicks in, SA seems to hang. I rename (or remove) /home/vpopmail/.spamassassin directory (where bayes db resides), and everything is hunky dorey for a while, until token expiration rules kick in again (apparently). Steve Ingraham -- -Eric 'shubes' - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
You need the -r which means to use as a rejection list -a is a white list (don't run through an rbl). I don't have any problems using multiple lines when entering then in the blacklists file... putting it directly into the smtp/run file without a \ on the end of the line would be foolish though. Use the qmail-inject line I sent last time to test your email...it'll show you where it's failing. George. - Original Message - From: Eric Shubes [EMAIL PROTECTED] To: qmailtoaster-list@qmailtoaster.com Cc: [EMAIL PROTECTED] Sent: Wednesday, September 27, 2006 6:12 PM Subject: Re: [qmailtoaster] duplicate emails Steve Ingraham wrote: Eric (Shubes) wrote: Caution: the contents of /var/qmail/control/blacklists must be on a single line (I think - you might be able to escape the newline (CR), but I'm not sure w/out testing it). Eric, can you explain what you are referring to in your Caution statement above? Do you mean that all of the content should be listed on one line? So using an example from George's blacklist below the content should look like: -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org . . . etc. Yes, that looks good. If this is the way it needs to be input into the blacklists file should there be commas, spaces or something else between each entry? Just spaces between each entry. No commas, only space(s). If not, then I guess I am a little confused on what you are referring to. Don't put them on separate lines. Steve Ingraham ___ George Sweetnam wrote: You might also want to add some additional blacklists from orbs (don't do the all-in-one). Some like the dynamic shouldn't be used, but the exploited server rbl is very handy. I added 5 or 6 to my servers and it's helped even more. The content of my current blacklists control file (I does change): -r sbl.spamhaus.org -r bl.spamcop.net -r relays.ordb.org -r block.dnsbl.sorbs.net -r http.dnsbl.sorbs.net -r misc.dnsbl.sorbs.net -r rhsbl.sorbs.net -r smtp.dnsbl.sorbs.net -r socks.dnsbl.sorbs.net -r spam.dnsbl.sorbs.net -r web.dnsbl.sorbs.net -r zombie.dnsbl.sorbs.net Just eliminate the biggest files in your setup - comment out BLACKLIST and BLACKLIST_URL from your config. Those two are huge and taking them out of my setup returned my system to normal behavior. Thanks, I will look at adding to my blacklists control file. Can you tell me what the -r command means? Steve Ingraham --Original Message-- Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones won't. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham -- -Eric 'shubes' - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED
Re: [qmailtoaster] duplicate emails
Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones wont. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using.
RE: [qmailtoaster] duplicate emails
Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones wont. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham
Re: [qmailtoaster] duplicate emails
Steve Ingraham wrote: Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones wont. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Same here. The ones I get are using GIF overlays, with transparent (read white) text. Only way I can think of to block them would be to block GIF files, but that would PO a lot of my clients. Unless someone else has a better suggestion? Please?
Re: [qmailtoaster] duplicate emails
Just eliminate the biggest files in your setup - comment out BLACKLIST and BLACKLIST_URL from your config. Those two are huge and taking them out of my setup returned my system to normal behavior. -MA Steve Ingraham wrote: Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones won’t. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
You should always test the mail going through your server when you make changes like that. Anyone making changes to spamassassin, rbl's, clamav, ssattach, ect should be sending a test message to see if/where it hangs. Most of the time you'll see it's stuck on spamc. I have a short script I've made to test mail myself (/home/testmail.sh) and it makes life much easier. It's a good idea to look for errors with: spamassassin -D --lint ===repost (i've saved this one now!) === Anytime I make updates to the mailserver settings I also using qmail-inject to send a message through (great for showing what is failing): echo mail test message /tmp/mailtest.txt env QMAILQUEUE=/var/qmail/bin/simscan SIMSCAN_DEBUG=2 /var/qmail/bin/qmail-inject [EMAIL PROTECTED] /tmp/mailtest.txt == George Sweetnam - Original Message - From: Steve Ingraham To: qmailtoaster-list@qmailtoaster.com ; users@spamassassin.apache.org ; qmail@list.cr.yp.to Sent: Tuesday, September 26, 2006 4:39 PM Subject: RE: [qmailtoaster] duplicate emails Steve Ingraham wrote: I need help with a problem. Our users are seeing some multiple duplicate emails coming from the same sender. This is not occurring with every email so there does not seem to be any pattern to which incoming emails will be duplicated and which ones won't. They are also reporting that duplicate emails are sent when they send to an outside email. Has anyone experienced this problem before? What could be causing this to occur and what can I do to stop this? I am running qmailtoaster and spamassassin as an external email gateway. There has been nothing changed with qmail but I did update some rules in SA using rules_du_jour yesterday. Would these rules updates cause this problem? If so, what would have changed? Jake Vickers wrote: If your system is low on resources (ie: RAM), then the spamd process can take too long, making Toaster think the mail got lost somewhere, so it resends it. Might want to check and see how much RAM you're using. I want to thank everyone who posted a reply on my inquiry. I believe Jake Vickers was right about the problem. The RAM on the email server was bogged down since yesterday when I updated the various .cf files using rules_du_jour. I had included just a handful of rules from RDJ but it appears that RDJ utilizes much too much of my server resources to use it to update my spamassassin rules. It was slowing down the server so much that simple functions were not responding. This appears to have affected the delivery of emails. In fact I noticed that my original message to these mail lists took several hours to post and were duplicated also. I resolved the problem by moving the various rules .cf files out of the /etc/mail/spamassassin folder and restarting spamassassin. If anyone has a simple way of updating rules for spamassassin I would welcome your input. I still need to update the rules as I have been getting a great number of emails coming through to users. Specifically, we are getting a lot of the pharmaceutical spam and the stock spam. Again, thanks to everyone for the posts. Steve Ingraham - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
I was have same problem, and i found in /home/vpopmail/domains/ (doman) /(user name)/.qmail line number 3 (it is not exist in user what dont have duplicate mail) and i deleted this 3. line. From that moment everything works normal. On 2006.06.20, at 04:41, [EMAIL PROTECTED] wrote: Hi all, I have a strange situation lately where certain email account gets double/duplicate emails. This only happens to certain email accounts. All other accounts are ok. The only thing that similar to those error accounts are: they were over quota, then I increased the quota. Have anybody experienced this? Thanks. - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: qmailtoaster-list- [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] duplicate emails
I search on google and locate this text "If you start to recieve many copies of the same email (particulary large emails) then you may have a timeout problem with your qmail server. This is caused by your server not sending a "250 OK" message back to the remote server after accepting the email. This can happen if your server timeouts after accepting the email. We have ssen this several time where the customer has installed filtering software and incorporated it into the server incorrectly. If you see this happen we suggest that you have a look at the filltering software (spam / virus etc) is installed correctly." It is possible? 1 day ago i receiv very spams on server it´s start my dupe problem. - Original Message - From: "Igor Vukoti" [EMAIL PROTECTED] To: qmailtoaster-list@qmailtoaster.com Sent: Friday, June 23, 2006 8:25 AM Subject: Re: [qmailtoaster] duplicate emails I was have same problem, and i found in /home/vpopmail/domains/ (doman) /(user name)/.qmail line number 3 (it is not exist in user what dont have duplicate mail) and i deleted this 3. line. >From that moment everything works normal. On 2006.06.20, at 04:41, [EMAIL PROTECTED] wrote: Hi all, I have a strange situation lately where certain email account gets double/duplicate emails. This only happens to certain email accounts. All other accounts are ok. The only thing that similar to those error accounts are: they were over quota, then I increased the quota. Have anybody experienced this? Thanks. - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: qmailtoaster-list- [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] -- No virus found in this incoming message. Checked by AVG Free Edition. Version: 7.1.394 / Virus Database: 268.9.2/372 - Release Date: 21/6/2006
Re: [qmailtoaster] duplicate emails
Actually, I have run into something like this, but it had nothing to do with the e-mail server. In that case, I had a user who was using MS Outlook that had begun to experience this. The only solution I was able to find for that user was to back up their PST, wipe the entire system and rebuild, thanks to the hooks in Windows of any variety that prevent one from actually uninstalling and then re-installing OE or MS Outlook. If you run a search on the Support forums for MS, you'll find articles delineating this. It happens when a certain hidden database file key gets corrupted, so that the software can no longer accurately distinguish whether or not it has already picked up a given e-mail message. I don't know that to be the problem you are having, but I did think I should mention it may not be the server at all. There is also the possibility that if it is server-side, the same address might be getting the message both as itself, and as one of its aliases. On 6/19/06, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: Hi all, I have a strange situation lately where certain email account gets double/duplicate emails. This only happens to certain email accounts. All other accounts are ok. The only thing that similar to those error accounts are: they were over quota, then I increased the quota. Have anybody experienced this? Thanks. - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] Duplicate emails
Mark Martin ha scritto: I have asked this question before, but I will ask again to see if anyone else is having the same problem. I am running the current release (1.2). I have re-occurring problems with duplicate emails. There are several domains on these servers. They are actually coming in on the server, they will all have the same delivery times. If anyone has encountered this problem, please advise and I would be extremely grateful if you could extend your solution. I've got exactly the same kind of problem . The only difference is that I manage just one single domain . We are noticing that when more than one e-mail address is specified for sending , n (where n indicates the amount of addresses specified) duplicate e-mails will be sent to each account . I really don't know how to solve this - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] Duplicate emails
I sent copies of this message to two other people (cc), I got duplicates of your messages and my own message. I have some that get 100 or so. On Thu, 2006-02-16 at 08:49 -0600, Mark Martin wrote: I have asked this question before, but I will ask again to see if anyone else is having the same problem. I am running the current release (1.2). I have re-occurring problems with duplicate emails. There are several domains on these servers. They are actually coming in on the server, they will all have the same delivery times. If anyone has encountered this problem, please advise and I would be extremely grateful if you could extend your solution. -- Mark Martin, Operations Frontier Broadband, LLC. 919 Hwy. 377 E. Granbury, TX 76048 817.579.5050, Ext. 105 - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] Duplicate emails
2 gig memory, nfs mounted homedirs, dual Xeons... Oh, one vnc session. On Thu, 2006-02-16 at 11:15 -0500, Aaron Stanford wrote: I experienced this issue also. In my case, it was due to low system resources (specifically memory). If you have a gui running, and you're on a Redhat based distro, try telinit 3 to unload the gui and release some system resources. Shut down unneeded services. If it's the same issue I had, this should take care of the issue, at least temporarily.. Cheers, Aaron Mark Martin wrote: I sent copies of this message to two other people (cc), I got duplicates of your messages and my own message. I have some that get 100 or so. On Thu, 2006-02-16 at 08:49 -0600, Mark Martin wrote: I have asked this question before, but I will ask again to see if anyone else is having the same problem. I am running the current release (1.2). I have re-occurring problems with duplicate emails. There are several domains on these servers. They are actually coming in on the server, they will all have the same delivery times. If anyone has encountered this problem, please advise and I would be extremely grateful if you could extend your solution. - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] -- Mark Martin, Operations Frontier Broadband, LLC. 919 Hwy. 377 E. Granbury, TX 76048 817.579.5050, Ext. 105 - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: [qmailtoaster] Duplicate emails
Well, that ought to be enough :) What other tweaks have you tried? Have you increased the softlimit in supervise/smtp/run? Anything in the /var/log/qmail/smtp or send logs? Mark Martin wrote: 2 gig memory, nfs mounted homedirs, dual Xeons... Oh, one vnc session. On Thu, 2006-02-16 at 11:15 -0500, Aaron Stanford wrote: I experienced this issue also. In my case, it was due to low system resources (specifically memory). If you have a gui running, and you're on a Redhat based distro, try telinit 3 to unload the gui and release some system resources. Shut down unneeded services. If it's the same issue I had, this should take care of the issue, at least temporarily.. Cheers, Aaron Mark Martin wrote: I sent copies of this message to two other people (cc), I got duplicates of your messages and my own message. I have some that get 100 or so. On Thu, 2006-02-16 at 08:49 -0600, Mark Martin wrote: I have asked this question before, but I will ask again to see if anyone else is having the same problem. I am running the current release (1.2). I have re-occurring problems with duplicate emails. There are several domains on these servers. They are actually coming in on the server, they will all have the same delivery times. If anyone has encountered this problem, please advise and I would be extremely grateful if you could extend your solution. - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - QmailToaster hosted by: VR Hosted http://www.vr.org - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
