Jim Gallacher wrote:
Jorey Bump wrote:

I've installed it on a lightly used production server so I can test it against some real-world apps. Initial testing indicates that it's 10-20% slower than 3.2.10; I'm not sure why.

Ouch. Is that from a benchmark or just a gut feeling?

It was from ab, running against my own handler and consistently getting 950+ requests/sec with 3.2.10. Then I stopped apache, installed 3.3, started apache, and got no more than 850 requests/sec or worse.

I took it on faith that nothing could have changed in the environment in the meantime, but I just switched back to 3.2.10 and am still experiencing the lower numbers, so this is unlikely to be a mod_python problem.

Moral: Don't trust benchmarks, and don't report the results without exhaustive testing.

The sad part is that I want to know what caused the earlier performance boost so I can get it back!

Reply via email to