Re: [PERFORM] Performance problems testing with Spamassassin 3.1.0

2005-07-30 Thread John Arbash Meinel
Matthew Schumacher wrote: >Tom Lane wrote: > > > >>I looked into this a bit. It seems that the problem when you wrap the >>entire insertion series into one transaction is associated with the fact >>that the test does so many successive updates of the single row in >>bayes_vars. (VACUUM VERBOSE

Re: [PERFORM] Performance problems testing with Spamassassin 3.1.0

2005-07-30 Thread John Arbash Meinel
Matthew Schumacher wrote: >All it's doing is trying the update before the insert to get around the >problem of not knowing which is needed. With only 2-3 of the queries >implemented I'm already back to running about the same speed as the >original SA proc that is going to ship with SA 3.1.0. > >A

Re: [PERFORM] Performance problems testing with Spamassassin 3.1.0

2005-07-30 Thread Matthew Schumacher
Tom Lane wrote: > I looked into this a bit. It seems that the problem when you wrap the > entire insertion series into one transaction is associated with the fact > that the test does so many successive updates of the single row in > bayes_vars. (VACUUM VERBOSE at the end of the test shows it cl

Re: [PERFORM] Performance problems testing with Spamassassin 3.1.0

2005-07-30 Thread Tom Lane
Matthew Schumacher <[EMAIL PROTECTED]> writes: > One thing that is still very puzzling to me is why this runs so much > slower when I put the data.sql in a transaction. Obviously transactions > are acting different when you call a proc a zillion times vs an insert > query. I looked into this a bi

Re: [PERFORM] Performance problems testing with Spamassassin

2005-07-30 Thread Karim Nassar
On Sat, 2005-07-30 at 00:46 -0800, Matthew Schumacher wrote: > I'll do some more testing on Monday, perhaps grouping even 200 tokens at > a time using your method will yield significant gains, but probably not > as dramatic as it does using my loading benchmark. In that case, some of the clauses

Re: [PERFORM] Performance problems testing with Spamassassin

2005-07-30 Thread Matthew Schumacher
Karim Nassar wrote: > > [EMAIL PROTECTED]:~/k-bayesBenchmark$ time ./test.pl > <-- snip db creation stuff --> > 17:18:44 -- START > 17:19:37 -- AFTER TEMP LOAD : loaded 120596 records > 17:19:46 -- AFTER bayes_token INSERT : inserted 49359 new records into > bayes_token > 17:19:50 -- AFTER bayes_

Re: [PERFORM] Performance problems on 4/8way Opteron (dualcore)

2005-07-30 Thread William Yu
I've been running 2x265's on FC4 64-bit (2.6.11-1+) and it's been running perfect. With NUMA enabled, it runs incrementally faster than NUMA off. Performance is definitely better than the 2x244s they replaced -- how much faster, I can't measure since I don't have the transaction volume to compa