Juts wanted to report back and also ask another question Thomas. First, the MySQL database has been implemented and my memory usage went down almost in half using this setup. So Thank you for the suggestion I really appreciate it.
The questions I have has to do with the MaxFiles setting and how it affects the rebuild. You mentioned about 10,000 files in a folder is useless. I checked the default setting in ASSP for this setting and it's 14,000. So here's my questions about this: 1. If setting this back to default(14,000) in this case, does ASSP go into that folder and clean out this folder until it reaches the 14,000 file mark? Or do the spam & notspam files just continue to accumilate? 2. When I run the rebuildspamDB how does this change affect the MySQL database now? Meaning, I have less files in the spam & notspam folders now. Does the database still keep the data from the previous build and continue to add to the database? Or does the rebuild start fresh each time? Sorry for all the questions. I just want to know how this affects the spamdb. I don't want angry users calling me at all hours about elevated spam after our next rebuild. Thank you in advanced for the help. Jay Altemoos *Hero Data Services,LLC* *2 Sunshine Drive* *Amherst, NY 14228* *Phone:*716-833-1685 ext. 121 *Fax:*716-833-1685 Contact us for all your IT needs. *http://www.herodata.com* On 5/26/2014 3:56 PM, Thomas Eckardt wrote: >> You mentioned that it's not recommended to hold spamdb/HHMMdb in memory. >> What do you mean by this? > Read the startup log !!! > > Because all threads have to share all list , hashes and caches the data > are hold in memory per default. > It is recommended to use a database (mysql,mssql,oracle,postgres,firebird, > db2 ) for large data collections. > > GUI->File Paths and Databases > >> I have my 'MaxFiles' set to 50,000 > more than 10.000 files per folder are useless. > > Thomas > > > > Von: Jay Altemoos <j...@herodata.com> > An: For Users of ASSP <assp-user@lists.sourceforge.net> > Datum: 26.05.2014 21:26 > Betreff: Re: [Assp-user] ASSP 2.4.1 (14085) - RebuildSpamDB > > > > Hey Thomas, thank you for the speedy reply. I appreciate it. > So I just wanted to let you know I changed the setting you mentioned > 'ReplaceOldSpamdb" and that worked out just fine. > > I have my 'MaxFiles' set to 50,000 files to get a good collection of > spam & notspam. Hence part of the reason it takes a long time to rebuild. > > You mentioned that it's not recommended to hold spamdb/HHMMdb in memory. > What do you mean by this? Length of rebuild time? > > > On 5/24/2014 4:46 AM, Thomas Eckardt wrote: >>> May-23-14 11:46:08 done - add/modify Spamdb records - 800971 >> 800.000 records in spamdb looks too much >> >> set 'ReplaceOldSpamdb' to ON - run again >> >> >>> done - add/modify Spamdb records - 800971 >> it is not recommended to hold the spamdb/HMMdb in memory >> >> >> Thomas >> >> >> >> >> Von: Jay Altemoos <j...@herodata.com> >> An: assp-user@lists.sourceforge.net >> Datum: 23.05.2014 21:42 >> Betreff: Re: [Assp-user] ASSP 2.4.1 (14085) - RebuildSpamDB >> >> >> >> Hey Thomas. Thanks for the speedy reply. So the rebuilddebug.txt file is >> already there. After running the rebuildspamdb again this is the last >> line that the log shows me: >> >> May-23-14 11:46:08 done - add/modify Spamdb records - 800971 >> >> On the previous log it showed it getting farther than this and showed >> the file spamdb.rb.tmp being created. On this time around it doesn't >> even make it to this. Weird. I know the version I am on is outdated, the >> weird issue is that I ran a rebuild on the day after we updated ASSP on >> 4/18/2014 and it ran fine. I haven't run a rebuild in awhile since then. >> >> Would updating to the latest version help you troubleshoot this? >> >> On 5/23/2014 11:15 AM, Thomas Eckardt wrote: >>> create the file 'assp/rebuilddebug.txt' before starting the rebuild. >>> >>> remove the file shown in the last line of this file after the > unexpected >>> quit >>> >>>> runs for about an hour >>> don't forget to use a DB for the temporary rebuild hashes and the >> spamdb >>> -> one hour = large corpus or slow system >>> >>> 14085 is outdated ! >>> >>> Thomas >>> >>> >>> >>> >>> Von: Jay Altemoos <j...@herodata.com> >>> An: assp-user@lists.sourceforge.net >>> Datum: 23.05.2014 17:04 >>> Betreff: [Assp-user] ASSP 2.4.1 (14085) - RebuildSpamDB >>> >>> >>> >>> I have a question about the rebuildspamdb function in ASSP. I am > running >>> into a weird issue since I updated to version 2.4.1(14085). When I run >>> the spam rebuild from the interface, the rebuild runs for about an hour >>> and then quits for no apparent reason. So the spamdb file never gets >>> updated and sometimes the rebuild gets as far as making the file >>> spamdb.rb.tmp but gets no further. Looking at the rebuilddebug.txt file >>> I see no errors there and ASSP is still running because my users can >>> still send email. Is there a bug in this version of the rebuild? >>> >>> i can post my logs if that will help. Thanks in advanced for any help. > I >>> appreciate it. >>> >>> >>> > ------------------------------------------------------------------------------ >>> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE >>> Instantly run your Selenium tests across 300+ browser/OS combos. >>> Get unparalleled scalability from the best Selenium testing platform >>> available >>> Simple to use. Nothing to install. Get started now for free." >>> http://p.sf.net/sfu/SauceLabs >>> _______________________________________________ >>> Assp-user mailing list >>> Assp-user@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/assp-user >>> >>> >>> >>> >>> DISCLAIMER: >>> ******************************************************* >>> This email and any files transmitted with it may be confidential, >> legally >>> privileged and protected in law and are intended solely for the use of >> the >>> individual to whom it is addressed. >>> This email was multiple times scanned for viruses. There should be no >>> known virus in this email! >>> ******************************************************* >>> >>> >>> >>> >>> > ------------------------------------------------------------------------------ >>> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE >>> Instantly run your Selenium tests across 300+ browser/OS combos. >>> Get unparalleled scalability from the best Selenium testing platform >> available >>> Simple to use. Nothing to install. Get started now for free." >>> http://p.sf.net/sfu/SauceLabs >>> >>> >>> _______________________________________________ >>> Assp-user mailing list >>> Assp-user@lists.sourceforge.net >>> https://lists.sourceforge.net/lists/listinfo/assp-user >>> >>> >>> ----- >>> No virus found in this message. >>> Checked by AVG - www.avg.com >>> Version: 2013.0.3469 / Virus Database: 3722/7547 - Release Date: >> 05/23/14 >> >> > ------------------------------------------------------------------------------ >> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE >> Instantly run your Selenium tests across 300+ browser/OS combos. >> Get unparalleled scalability from the best Selenium testing platform >> available >> Simple to use. Nothing to install. Get started now for free." >> http://p.sf.net/sfu/SauceLabs >> _______________________________________________ >> Assp-user mailing list >> Assp-user@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/assp-user >> >> >> >> >> DISCLAIMER: >> ******************************************************* >> This email and any files transmitted with it may be confidential, > legally >> privileged and protected in law and are intended solely for the use of > the >> individual to whom it is addressed. >> This email was multiple times scanned for viruses. There should be no >> known virus in this email! >> ******************************************************* >> >> >> >> >> > ------------------------------------------------------------------------------ >> "Accelerate Dev Cycles with Automated Cross-Browser Testing - For FREE >> Instantly run your Selenium tests across 300+ browser/OS combos. >> Get unparalleled scalability from the best Selenium testing platform > available >> Simple to use. Nothing to install. Get started now for free." >> http://p.sf.net/sfu/SauceLabs >> >> >> _______________________________________________ >> Assp-user mailing list >> Assp-user@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/assp-user >> >> >> ----- >> No virus found in this message. >> Checked by AVG - www.avg.com >> Version: 2013.0.3469 / Virus Database: 3722/7564 - Release Date: > 05/26/14 > > ------------------------------------------------------------------------------ > The best possible search technologies are now affordable for all > companies. > Download your FREE open source Enterprise Search Engine today! > Our experts will assist you in its installation for $59/mo, no commitment. > Test it for FREE on our Cloud platform anytime! > http://pubads.g.doubleclick.net/gampad/clk?id=145328191&iu=/4140/ostg.clktrk > > _______________________________________________ > Assp-user mailing list > Assp-user@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/assp-user > > > > > DISCLAIMER: > ******************************************************* > This email and any files transmitted with it may be confidential, legally > privileged and protected in law and are intended solely for the use of the > > individual to whom it is addressed. > This email was multiple times scanned for viruses. There should be no > known virus in this email! > ******************************************************* > > > > > ------------------------------------------------------------------------------ > The best possible search technologies are now affordable for all companies. > Download your FREE open source Enterprise Search Engine today! > Our experts will assist you in its installation for $59/mo, no commitment. > Test it for FREE on our Cloud platform anytime! > http://pubads.g.doubleclick.net/gampad/clk?id=145328191&iu=/4140/ostg.clktrk > > > _______________________________________________ > Assp-user mailing list > Assp-user@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/assp-user > > > ----- > No virus found in this message. > Checked by AVG - www.avg.com > Version: 2013.0.3469 / Virus Database: 3722/7564 - Release Date: 05/26/14 ------------------------------------------------------------------------------ Learn Graph Databases - Download FREE O'Reilly Book "Graph Databases" is the definitive new guide to graph databases and their applications. Written by three acclaimed leaders in the field, this first edition is now available. Download your free book today! http://p.sf.net/sfu/NeoTech _______________________________________________ Assp-user mailing list Assp-user@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-user
