I found the cleanlist.exe takes care of this for me with come manual intervention. Reduced the file a bit for me.
Thanks Everyone! Travis -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of William Van Hefner Sent: Friday, November 18, 2005 10:39 AM To: [email protected] Subject: RE: [IMail Forum] Compressing the URL-DOMAIN-BL.txt First of all, I would have to question exactly why you would want any of those domains in your list in the first place? If you receive a spam with the url rudolph.reindeer.com in it, you can pretty much bet that anything preceding the domain name (i.e. "rudolph") is worthless to include in your list. Most of the time, these are just added as a way to track a particular mailing campaign or to throw-off amateurish spam-harvesting devices like Imail's antispamseeder.exe. Spammers don't use sub-domains. If that is the kind of output that antispamseeder gives, then it is practically of no use without some third-party tool to check the results against. As we've all seen here in the past, Ipswitch's own list often contains URLs of large corporations, government agencies, ISPs, etc. I think that the only way that this tool could possibly be considered useful is if you do small batches of extractions at one time and then parse the list by hand for accuracy. Then, you can merge the lists together later. Anything else is going to be of minimal value in stopping spam, and produce a LOT of false positives. I also seem to recall there being some discussion on this list awhile back about there being a functional limitation to the amount of listings that could be included in url-domain-bl list. If memory serves correct (take that for what it's worth), it was something like 30,000 domains. After that, the program would tend to "forget" some of the entries on the list. It's been my experience that even at numbers well below that, it tends to be a rather hit-and-miss affair. Finally, I'm not sure how often you are running this program, but other than a few hard-core spammer networks that never seem to go away, keeping a domain listed permanently is eventually going to cause the size of your list to grow to a quite unmanageable size. Spammers rarely register domains for over a year, so it is usually safe to purge the obvious "throw away" domains after a year or so. The domains that you have added over the past month will probably stop more spam collectively than ones from all of the months prior to that. So, it would probably be a good idea to track when you added each domain, and have a separate list (to merge) that contains ones that you don't ever want to delete. FYI, you can also always use our list below. I do all of that nasty work for you. :-) http://www.vantekcommunications.com/spam/ William Van Hefner Network Administrator Vantek Communications, Inc. e-mail: [EMAIL PROTECTED] -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Travis Rabe Sent: Friday, November 18, 2005 9:46 AM To: [email protected] Subject: [IMail Forum] Compressing the URL-DOMAIN-BL.txt Hello, QUESTION 1: I haves asked this questions in the past and did not get a response, so I am going to take another shot at it today. Scenario: There are three entries in the url-domain-bl.tx file. They are: rudolph.reindeer.com comet.reindeer.com dasher.reindeer.com How can I write a script and/or program and doe someone have something that would change this to just one entry that says: reindeer.com Any help would be appreciated. My list is 133,584 entries long and I try to go through every once ina while to do this manually, but what a pain. QUESTION 2: I see that with the antispamseeder.exe file that you can add on the fly, the URLs from a mailbox into the file. Can the same be done for removing them? Does anyone have experience with this and can you show me a snippet of what it is you actually run at the command line? Is this something I could automate in the Task Scheduler? Thanks! Travis To Unsubscribe: http://www.ipswitch.com/support/mailing-lists.html List Archive: http://www.mail-archive.com/imail_forum%40list.ipswitch.com/ Knowledge Base/FAQ: http://www.ipswitch.com/support/IMail/ To Unsubscribe: http://www.ipswitch.com/support/mailing-lists.html List Archive: http://www.mail-archive.com/imail_forum%40list.ipswitch.com/ Knowledge Base/FAQ: http://www.ipswitch.com/support/IMail/
