Totally agree that YYYYMMDD works better for date-stamped directory names...especially if you're sorting.
Good points about the bugs in not quoting directory names with spaces, or accounting for no date-stamped directories, but as a temporary workaround you could use the structure they intended, reporting the bugs and migrating back to your desired config after they're fixed. Have you tried increasing the number of threads to deal with the PROC folder backup? The messages not processed seems like the most unclear, but that could still be due to a particular config. I would suggest again posting the configs, if not to the list then at least to Declude support. Darin. ----- Original Message ----- From: "Michael Jaworski" <[EMAIL PROTECTED]> To: <Declude.JunkMail@declude.com> Sent: Sunday, September 04, 2005 12:50 PM Subject: RE: [Declude.JunkMail] Declude bugs and problems with smartermail - Folder Names On the subject of folder names. Second the vote on no spacxes in file or folder names. Might it be better to use a simple format of 20050905 or 050905?? Also consider the issue of moving into a new year and the visual order of the folders when sorting by file name. This coming from using a GUI perspective when managing and troubleshooting date related issues. Mike -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dave Beckstrom Sent: Sunday, September 04, 2005 9:30 AM To: Declude.JunkMail@declude.com Cc: [EMAIL PROTECTED] Subject: RE: [Declude.JunkMail] Declude bugs and problems with smartermail Darin, Here are a couple of things I found. A few minutes ago, I set log level to DEBUG so that I could show you the problems, and I changed my WIEGHT30 from a value of "WEIGHT30 SUBJECT [SPAM]" to "WEIGHT30 HOLD %DATE%" to enable holding of spam. Here is a log snippet with HOLD in effect: 09/04/2005 10:53:14.565 68454536903 [5476] Moving file to spam hold directory [D:\APPS\SMARTERMAIL\SPOOL\proc\68454536903.EML][D:\APPS\SMARTERMAIL\SPOOL\s pam\04 Sep 2005 \68454536903.EML] 09/04/2005 10:53:14 68454536903 ERROR: Could not move spam to hold! Code: [3] Error String: [The system cannot find the path specified.] Note the space after "04 Sep 2005 " and before the slash. That is one bug in Declude. On a different topic, while we're talking about this, I'd like to suggest that Declude name the date folders something like "04_Sep_2005" with no spaces anywhere in the path. The reason is because people may wish to run DOS batch scripts against the folder. I'm pretty sure that DOS won't accept spaces in a directory path unless it's coded with double quotes in the path. EG (D:\APPS\SMARTERMAIL\SPOOL\spam\"04 Sep 2005"\68454536903.EML) Thus if Declude avoids spaces in the path to begin with someone who later wants to write a bat file to delete old spam folders will have a much easier time of it. Okay, back to the topic of bugs. Here is the next problem.... If I change the WEIGHT30 to "WEIGHT30 HOLD" (no date parameter) with the idea the spam would go directly into the SPOOL/SPAM directory, then another bug crops up. The path in the log would look something like this: [D:\APPS\SMARTERMAIL\SPOOL\proc\68454536903.EML][D:\APPS\SMARTERMAIL\SPOOL\s pam\\68454536903.EML] Note the double slashes before the spool file name. Declude didn't account for the fact that if you're not using their new date folders then one of those slashes in the path must be removed. Also, with HOLD in effect, over time messages will start to back up in the SPOOL/PROC directory and never be moved back into the SPOOL directory for re-processing. I have to manually copy them. Also, ironically, if I have "HOLD" in effect than the directories that appear in the SPOOL/PROC folder with a name such as 68454536903.VIR will never be cleaned up. They will exist until I delete them. If I do not have "HOLD" in effect, then Declude will remove those .VIR folders from the PROC directory when it's done processing them. So this is yet another bug I found. The third problem I'm fighting is a situation where Declude analyzes an email and may recognize it as spam but it still passes through Declude and arrives in my in-box with no Declude headers attached to the message. I can tell Declude processed it because the logs show it being analyzed, failing and weights being set. Yet the subject isn't modified and when I view the mail headers there is no sign of Declude ever having looked at the message. I think this may have some problem to do with copied or forwarded messages or perhaps some problem with email moving back and forth between the PROC and SPOOL folder and not being processed properly. I'll keep looking at this issue to see if I can find a pattern with the overlooked messages. Thanks, Dave > -----Original Message----- > From: [EMAIL PROTECTED] [mailto:Declude.JunkMail- > [EMAIL PROTECTED] On Behalf Of Darin Cox > Sent: Sunday, September 04, 2005 8:32 AM > To: Declude.JunkMail@declude.com > Subject: Re: [Declude.JunkMail] Declude bugs and problems with > smartermail > > Too funny! > > I thought I had heard more success than that with 2.0.6. I forgot > that the 3.0 version for SmarterMail wasn't quite out yet. > > Can any other Declude/SmarterMail users comment on their success, and > what they did to achieve it? > > It might be worth posting your config here in case someone who has > been using SmarterMail can point out a configuration change that would > help. I believe there's a THREADS parameter in the Declude.cfg in > 2.0.6 that can be increased from the default to better handle the > SPOOL/PROC directory under even moderate load. > > One of the main reasons we haven't tried the Declude/SmarterMail combo > yet is SmarterMail's inability to give Declude SMTP AUTH info. > Whitelisting authenticated users is pretty important with our setup, > since we have the CMDSPACE and some dynamic IP tests weighted pretty > heavily, and our customers have to have that setting in place anyway > since we're not an ISP. Not having SMTP AUTH whitelisting would reduce > our catch rate significantly > since we'd have to lower those test weights quite a bit. > > Darin. > > > ----- Original Message ----- > From: "Dave Beckstrom" <[EMAIL PROTECTED]> > To: <Declude.JunkMail@declude.com> > Sent: Sunday, September 04, 2005 12:55 AM > Subject: RE: [Declude.JunkMail] Declude bugs and problems with > smartermail > > > Darin, > > It's amazing how much time servers and software can suck up. Pretty > soon you're working almost around the clock.... > > I actually am running the 2.0.6 version of Declude for Smartermail. > As long as I don't try to HOLD spam it seems that only about 2 out of > every 10 spams > makes it through with no Declude headers attached to the message. > > The software is pretty buggy. With "HOLD" turned off the .VIR > directories are being cleaned up in the SPOOL/PROC directory now, too. > > It seems that the logic in the program changes with different settings > in the config file and right now I have it set at the lesser of two > evils. At least 80% of the spam is being processed by Declude now. > The rest of the spam comes through to my in-box untouched. I'm > starting to think that maybe my wife is going to dump me because my > manhood isn't large enough and that I > just can't live without a Rolex watch! LOL!!!!! > > > > > > > -----Original Message----- > > From: [EMAIL PROTECTED] [mailto:Declude.JunkMail- > > [EMAIL PROTECTED] On Behalf Of Darin Cox > > Sent: Saturday, September 03, 2005 11:29 PM > > To: Declude.JunkMail@declude.com > > Subject: Re: [Declude.JunkMail] Declude bugs and problems with > smartermail > > > > Hi Dave, > > > > I know what you mean. After the first startup venture in the late > > 90's, holidays have never been the same... > > > > You might try running the 2.06 version for SmarterMail. I've heard > mostly > > success for that. That may buy you some time until the kinks get > > worked out of the 3.0 beta. > > > > Darin. > > > > > > ----- Original Message ----- > > From: "Dave Beckstrom" <[EMAIL PROTECTED]> > > To: <Declude.JunkMail@declude.com> > > Sent: Saturday, September 03, 2005 10:19 PM > > Subject: RE: [Declude.JunkMail] Declude bugs and problems with > smartermail > > > > > > Darin, > > > > Ever since I started working out of a home office I do forget about > > the holidays! > > > > Well, the "good news" is that I've made some progress in > > understanding > the > > problem. > > > > As long as I don't specify a "HOLD" action (EG. WEIGHT30 HOLD > > %DATE%) > and > > instead run with (WEIGHT30 SUBJECT [SPAM]) then Declude will at > > least process MOST of the incoming email. > > > > When I tell Declude to hold email above a certain weight, it falls > > all over itself with problems. I'm seeing messages in the logs > > about attempts to move non-existent files. I see paths for these > > files having spaces or double slashes in the path names which are > > obvious programming errors. I'm > > half tempted to edit the Declude.exe file with a hex editor and fix the > > path > > problems myself. But there are some logic problems too so there is no > > point. > > > > I hate the thought of running for 3 days not being able to block ANY > spam > > at > > all. But what are you going to do? At least I can tag the majority > > of the spam. > > > > > > > > > > > > > > > > > > > -----Original Message----- > > > From: [EMAIL PROTECTED] [mailto:Declude.JunkMail- > > > [EMAIL PROTECTED] On Behalf Of Darin Cox > > > Sent: Saturday, September 03, 2005 8:15 PM > > > To: Declude.JunkMail@declude.com > > > Subject: Re: [Declude.JunkMail] Declude bugs and problems with > > smartermail > > > > > > Hi Dave, > > > > > > Probably not... Monday's Labor Day. Easy to forget those little > things > > > called holidays, isn't it? <grin> > > > > > > Darin. > > > > > > > > > ----- Original Message ----- > > > From: "Dave Beckstrom" <[EMAIL PROTECTED]> > > > To: <Declude.JunkMail@declude.com> > > > Sent: Saturday, September 03, 2005 7:42 PM > > > Subject: RE: [Declude.JunkMail] Declude bugs and problems with > > smartermail > > > > > > > > > Gary, > > > > > > Yeah, that sounds exactly like what is happening and I see > > > messages in > > the > > > log, as well, that supports what you're saying. > > > > > > Hopefully Declude support will be around on Monday and maybe we > > > can > work > > > on > > > getting that one solved. > > > > > > > -----Original Message----- > > > > From: [EMAIL PROTECTED] > > > > [mailto:Declude.JunkMail- [EMAIL PROTECTED] On Behalf Of Gary > > > > Steiner > > > > Sent: Saturday, September 03, 2005 5:51 PM > > > > To: Declude.JunkMail@declude.com > > > > Subject: re: [Declude.JunkMail] Declude bugs and problems with > > > smartermail > > > > > > > > Regarding #5. I've run into spam that was sent to multiple > addresses > > on > > > > the server, and the spam was processed by Declude (it's listed > > > > in > the > > > log > > > > files), but somehow when this spam is then moved to the hold > directory > > > it > > > > gets confused and somehow loses track of the file, and the file > > doesn't > > > > end up in the hold directory (you see an error message about > > > > this in > > the > > > > log file). It gets delivered, but without any Declude > > > > processing > > > messages > > > > in the header. > > > > > > > > > > > > -------- Original Message -------- > > > > > From: "Dave Beckstrom" <[EMAIL PROTECTED]> > > > > > Sent: Saturday, September 03, 2005 1:01 PM > > > > > To: Declude.JunkMail@declude.com > > > > > Subject: [Declude.JunkMail] Declude bugs and problems with > > > smartermail > > > > > > > > > > I've found a few Declude bugs and other problems when running > > > > > in > the > > > > > smartermail environment. > > > > > > > > > > 1) Declude leaves directories with names such as > > > > > 6432144091.vir in > > the > > > > > SPOOL/PROC overflow directory and it NEVER goes back and > > > > > removes > > these > > > > > directories or cleans them up. I have to manually delete the > > > > > .vir directories. > > > > > > > > > > 2) Orphaned files. I have found files in the SPOOL/PROC > > > > > directory > > > where > > > > the > > > > > .EML extension has been renamed to .EM$ and there is no > > > > > matching > > .HDR > > > > file. > > > > > These stay until I delete the orphans. I currently have a file > in > > my > > > > SPOOL > > > > > directory called X6432144091.EML with no matching .HDR file - > which > > > > means > > > > > its an orphan file too. > > > > > > > > > > 3) The PROC overflow directory is being populated with files > > > > > even > > when > > > > the > > > > > server is under very low utilization. This, in my opinion, > portends > > > > major > > > > > performance problems ahead of us when the server is under a > > > > > high > > load. > > > > I > > > > > don't see any tuning parameters available which allow me to > > > > > tweak > > > under > > > > what > > > > > circumstances the PROC directory is utilized. I have a dual > > processor > > > > > server with 2 gig of RAM on it and I should not be forced to > > > > > the > > same > > > > > limitations as someone with a single processor server. This > process > > > > needs > > > > > to be tunable. > > > > > > > > > > 4) This morning I had about 100 files in the SPOOL/PROC > > > > > directory. > > I > > > > had to > > > > > manually copy them to the SPOOL directory for processing. > > > > > Once I > > > moved > > > > > them, the new files being placed into the PROC directory would > > > > automatically > > > > > move back to the SPOOL directory for processing. So it > > > > > appears > that > > > > there > > > > > is some situation where Declude forgets about some files in > > > > > the > > > > SPOOL/PROC > > > > > directory and never goes back and moves them back to the > > > > > SPOOL. I > > can > > > > set > > > > > up a script to do this (and delete the .vir folders too) every > > > > > 15 > > > > minutes > > > > > but I shouldn't have to do that. > > > > > > > > > > 5) This morning I had 45 spam emails in my in-box that had no > header > > > > records > > > > > indicating that they were ever processed by Declude. > > > > > Apparently > > there > > > > is > > > > > some situation where Declude doesn't process messages. I > > > > > haven't > > yet > > > > > figured out how or why this may be happening. I'll do more > research > > > to > > > > see > > > > > what I can find. > > > > > > > > > > I am hoping that support will get with me ASAP and that > > > > > together > we > > > can > > > > > identify the cause of these problems and make some > > > > > enhancements to > > > > Declude > > > > > which will make it more smartemail friendly. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > --- > > > > > [This E-mail scanned for viruses by Declude Virus] > > > > > > > > > > > > > > > --- > > > > > This E-mail came from the Declude.JunkMail mailing list. To > > > > > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and > > > > > type "unsubscribe Declude.JunkMail". The archives can be > > > > > found at http://www.mail-archive.com. > > > > > --- > > > > > [This E-mail scanned for viruses by Declude Virus] > > > > > > > > > > > > --- > > > > [This E-mail scanned for viruses by Declude Virus] > > > > > > > > > > > > --- > > > > This E-mail came from the Declude.JunkMail mailing list. To > > > > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and > > > > type "unsubscribe Declude.JunkMail". The archives can be found > > > > at http://www.mail-archive.com. > > > > --- > > > > [This E-mail scanned for viruses by Declude Virus] > > > > > > > > > --- > > > [This E-mail scanned for viruses by Declude Virus] > > > > > > > > > --- > > > This E-mail came from the Declude.JunkMail mailing list. To > > > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type > > > "unsubscribe Declude.JunkMail". The archives can be found at > > > http://www.mail-archive.com. > > > > > > --- > > > This E-mail came from the Declude.JunkMail mailing list. To > > > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type > > > "unsubscribe Declude.JunkMail". The archives can be found at > > > http://www.mail-archive.com. > > > > > > --- > > This E-mail came from the Declude.JunkMail mailing list. To > > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type > > "unsubscribe Declude.JunkMail". The archives can be found at > > http://www.mail-archive.com. > > > > --- > > This E-mail came from the Declude.JunkMail mailing list. To > > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type > > "unsubscribe Declude.JunkMail". The archives can be found at > > http://www.mail-archive.com. > > --- > > [This E-mail scanned for viruses by Declude Virus] > > > --- > [This E-mail scanned for viruses by Declude Virus] > > > --- > This E-mail came from the Declude.JunkMail mailing list. To > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type > "unsubscribe Declude.JunkMail". The archives can be found at > http://www.mail-archive.com. > > --- > This E-mail came from the Declude.JunkMail mailing list. To > unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type > "unsubscribe Declude.JunkMail". The archives can be found at > http://www.mail-archive.com. > --- > [This E-mail scanned for viruses by Declude Virus] --- [This E-mail scanned for viruses by Declude Virus] --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type "unsubscribe Declude.JunkMail". The archives can be found at http://www.mail-archive.com. --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type "unsubscribe Declude.JunkMail". The archives can be found at http://www.mail-archive.com. --- This E-mail came from the Declude.JunkMail mailing list. To unsubscribe, just send an E-mail to [EMAIL PROTECTED], and type "unsubscribe Declude.JunkMail". The archives can be found at http://www.mail-archive.com.
