Read the GUI - ''Collecting' and 'Rebuild SpamDB' should answer the
questions.
Thomas
Von: Jay Altemoos <j...@herodata.com>
An: assp-user@lists.sourceforge.net
Datum: 05.06.2014 00:08
Betreff: Re: [Assp-user] ASSP 2.4.1 (14085) - RebuildSpamDB
Juts wanted to report back and also ask another question Thomas.
First, the MySQL database has been implemented and my memory usage went
down almost in half using this setup. So Thank you for the suggestion I
really appreciate it.
The questions I have has to do with the MaxFiles setting and how it
affects the rebuild. You mentioned about 10,000 files in a folder is
useless. I checked the default setting in ASSP for this setting and it's
14,000. So here's my questions about this:
1. If setting this back to default(14,000) in this case, does ASSP go
into that folder and clean out this folder until it reaches the 14,000
file mark? Or do the spam & notspam files just continue to accumilate?
2. When I run the rebuildspamDB how does this change affect the MySQL
database now? Meaning, I have less files in the spam & notspam folders
now. Does the database still keep the data from the previous build and
continue to add to the database? Or does the rebuild start fresh each
time?
Sorry for all the questions. I just want to know how this affects the
spamdb. I don't want angry users calling me at all hours about elevated
spam after our next rebuild. Thank you in advanced for the help.
Jay Altemoos
*Hero Data Services,LLC*
*2 Sunshine Drive*
*Amherst, NY 14228*
*Phone:*716-833-1685 ext. 121
*Fax:*716-833-1685
Contact us for all your IT needs.
*http://www.herodata.com*
On 5/26/2014 3:56 PM, Thomas Eckardt wrote:
>> You mentioned that it's not recommended to hold spamdb/HHMMdb in
memory.
>> What do you mean by this?
> Read the startup log !!!
>
> Because all threads have to share all list , hashes and caches the data
> are hold in memory per default.
> It is recommended to use a database
(mysql,mssql,oracle,postgres,firebird,
> db2 ) for large data collections.
>
> GUI->File Paths and Databases
>
>> I have my 'MaxFiles' set to 50,000
> more than 10.000 files per folder are useless.
>
> Thomas
>
>
>
> Von: Jay Altemoos <j...@herodata.com>
> An: For Users of ASSP <assp-user@lists.sourceforge.net>
> Datum: 26.05.2014 21:26
> Betreff: Re: [Assp-user] ASSP 2.4.1 (14085) - RebuildSpamDB
>
>
>
> Hey Thomas, thank you for the speedy reply. I appreciate it.
> So I just wanted to let you know I changed the setting you mentioned
> 'ReplaceOldSpamdb" and that worked out just fine.
>
> I have my 'MaxFiles' set to 50,000 files to get a good collection of
> spam & notspam. Hence part of the reason it takes a long time to
rebuild.
>
> You mentioned that it's not recommended to hold spamdb/HHMMdb in memory.
> What do you mean by this? Length of rebuild time?
>
>
> On 5/24/2014 4:46 AM, Thomas Eckardt wrote:
>>> May-23-14 11:46:08 done - add/modify Spamdb records - 800971
>> 800.000 records in spamdb looks too much
>>
>> set 'ReplaceOldSpamdb' to ON - run again
>>
>>
>>> done - add/modify Spamdb records - 800971
>> it is not recommended to hold the spamdb/HMMdb in memory
>>
>>
>> Thomas
>>
>>
>>
>>
>> Von: Jay Altemoos <j...@herodata.com>
>> An: assp-user@lists.sourceforge.net
>> Datum: 23.05.2014 21:42
>> Betreff: Re: [Assp-user] ASSP 2.4.1 (14085) - RebuildSpamDB
>>
>>
>>
>> Hey Thomas. Thanks for the speedy reply. So the rebuilddebug.txt file
is
>> already there. After running the rebuildspamdb again this is the last
>> line that the log shows me:
>>
>> May-23-14 11:46:08 done - add/modify Spamdb records - 800971
>>
>> On the previous log it showed it getting farther than this and showed
>> the file spamdb.rb.tmp being created. On this time around it doesn't
>> even make it to this. Weird. I know the version I am on is outdated,
the
>> weird issue is that I ran a rebuild on the day after we updated ASSP on
>> 4/18/2014 and it ran fine. I haven't run a rebuild in awhile since
then.
>>
>> Would updating to the latest version help you troubleshoot this?
>>
>> On 5/23/2014 11:15 AM, Thomas Eckardt wrote:
>>> create the file 'assp/rebuilddebug.txt' before starting the rebuild.
>>>
>>> remove the file shown in the last line of this file after the
> unexpected
>>> quit
>>>
>>>> runs for about an hour
>>> don't forget to use a DB for the temporary rebuild hashes and the
>> spamdb
>>> -> one hour = large corpus or slow system
>>>
>>> 14085 is outdated !
>>>
>>> Thomas
>>>
>>>
>>>
>>>
>>> Von: Jay Altemoos <j...@herodata.com>
>>> An: assp-user@lists.sourceforge.net
>>> Datum: 23.05.2014 17:04
>>> Betreff: [Assp-user] ASSP 2.4.1 (14085) - RebuildSpamDB
>>>
>>>
>>>
>>> I have a question about the rebuildspamdb function in ASSP. I am
> running
>>> into a weird issue since I updated to version 2.4.1(14085). When I run
>>> the spam rebuild from the interface, the rebuild runs for about an
hour
>>> and then quits for no apparent reason. So the spamdb file never gets
>>> updated and sometimes the rebuild gets as far as making the file
>>> spamdb.rb.tmp but gets no further. Looking at the rebuilddebug.txt
file
>>> I see no errors there and ASSP is still running because my users can
>>> still send email. Is there a bug in this version of the rebuild?
>>>
>>> i can post my logs if that will help. Thanks in advanced for any help.
> I
>>> appreciate it.
>>>
>>>
>>>
>
------------------------------------------------------------------------------
>>> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
>>> Instantly run your Selenium tests across 300+ browser/OS combos.
>>> Get unparalleled scalability from the best Selenium testing platform
>>> available
>>> Simple to use. Nothing to install. Get started now for free."
>>> http://p.sf.net/sfu/SauceLabs
>>> _______________________________________________
>>> Assp-user mailing list
>>> Assp-user@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/assp-user
>>>
>>>
>>>
>>>
>>> DISCLAIMER:
>>> *******************************************************
>>> This email and any files transmitted with it may be confidential,
>> legally
>>> privileged and protected in law and are intended solely for the use of
>> the
>>> individual to whom it is addressed.
>>> This email was multiple times scanned for viruses. There should be no
>>> known virus in this email!
>>> *******************************************************
>>>
>>>
>>>
>>>
>>>
>
------------------------------------------------------------------------------
>>> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
>>> Instantly run your Selenium tests across 300+ browser/OS combos.
>>> Get unparalleled scalability from the best Selenium testing platform
>> available
>>> Simple to use. Nothing to install. Get started now for free."
>>> http://p.sf.net/sfu/SauceLabs
>>>
>>>
>>> _______________________________________________
>>> Assp-user mailing list
>>> Assp-user@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/assp-user
>>>
>>>
>>> -----
>>> No virus found in this message.
>>> Checked by AVG - www.avg.com
>>> Version: 2013.0.3469 / Virus Database: 3722/7547 - Release Date:
>> 05/23/14
>>
>>
>
------------------------------------------------------------------------------
>> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
>> Instantly run your Selenium tests across 300+ browser/OS combos.
>> Get unparalleled scalability from the best Selenium testing platform
>> available
>> Simple to use. Nothing to install. Get started now for free."
>> http://p.sf.net/sfu/SauceLabs
>> _______________________________________________
>> Assp-user mailing list
>> Assp-user@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/assp-user
>>
>>
>>
>>
>> DISCLAIMER:
>> *******************************************************
>> This email and any files transmitted with it may be confidential,
> legally
>> privileged and protected in law and are intended solely for the use of
> the
>> individual to whom it is addressed.
>> This email was multiple times scanned for viruses. There should be no
>> known virus in this email!
>> *******************************************************
>>
>>
>>
>>
>>
>
------------------------------------------------------------------------------
>> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE
>> Instantly run your Selenium tests across 300+ browser/OS combos.
>> Get unparalleled scalability from the best Selenium testing platform
> available
>> Simple to use. Nothing to install. Get started now for free."
>> http://p.sf.net/sfu/SauceLabs
>>
>>
>> _______________________________________________
>> Assp-user mailing list
>> Assp-user@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/assp-user
>>
>>
>> -----
>> No virus found in this message.
>> Checked by AVG - www.avg.com
>> Version: 2013.0.3469 / Virus Database: 3722/7564 - Release Date:
> 05/26/14
>
>
------------------------------------------------------------------------------
> The best possible search technologies are now affordable for all
> companies.
> Download your FREE open source Enterprise Search Engine today!
> Our experts will assist you in its installation for $59/mo, no
commitment.
> Test it for FREE on our Cloud platform anytime!
>
http://pubads.g.doubleclick.net/gampad/clk?id=145328191&iu=/4140/ostg.clktrk
>
> _______________________________________________
> Assp-user mailing list
> Assp-user@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
>
>
>
> DISCLAIMER:
> *******************************************************
> This email and any files transmitted with it may be confidential,
legally
> privileged and protected in law and are intended solely for the use of
the
>
> individual to whom it is addressed.
> This email was multiple times scanned for viruses. There should be no
> known virus in this email!
> *******************************************************
>
>
>
>
>
------------------------------------------------------------------------------
> The best possible search technologies are now affordable for all
companies.
> Download your FREE open source Enterprise Search Engine today!
> Our experts will assist you in its installation for $59/mo, no
commitment.
> Test it for FREE on our Cloud platform anytime!
>
http://pubads.g.doubleclick.net/gampad/clk?id=145328191&iu=/4140/ostg.clktrk
>
>
> _______________________________________________
> Assp-user mailing list
> Assp-user@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/assp-user
>
>
> -----
> No virus found in this message.
> Checked by AVG - www.avg.com
> Version: 2013.0.3469 / Virus Database: 3722/7564 - Release Date:
05/26/14
------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech
_______________________________________________
Assp-user mailing list
Assp-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-user
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Learn Graph Databases - Download FREE O'Reilly Book
"Graph Databases" is the definitive new guide to graph databases and their
applications. Written by three acclaimed leaders in the field,
this first edition is now available. Download your free book today!
http://p.sf.net/sfu/NeoTech
_______________________________________________
Assp-user mailing list
Assp-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/assp-user
