Re: [ANNOUNCE] Apache Hello World Benchmarks v1.02

2003-03-15 Thread Gerald Richter
> > > > Yes, Embperl per default caches a "compiled" version of the > > stylsheet in > > memory. > > > > Gerald > > > > P.S. There are also options to cache the result of the xslt > > transformation > > or any itermediate steps > > > > Oh - A way of making it even faster in the benchmarks? > Yes,

RE: [ANNOUNCE] Apache Hello World Benchmarks v1.02

2003-03-06 Thread Greg_Cope
> From: Gerald Richter [mailto:[EMAIL PROTECTED] > > Yes, Embperl per default caches a "compiled" version of the > stylsheet in > memory. > > Gerald > > P.S. There are also options to cache the result of the xslt > transformation > or any itermediate steps > Oh - A way of making it even faste

Re: [ANNOUNCE] Apache Hello World Benchmarks v1.02

2003-03-06 Thread Gerald Richter
> > This differs from Embperl where the application layer itself handles > the XSLT rending, not the script/XML file: > > PerlSetEnv EMBPERL_RECIPE LibXSLT > PerlSetEnv EMBPERL_XSLTPROC libxslt > PerlSetEnv EMBPERL_XSLTSTYLESHEET $ROOT/hello.xsl > > So perhaps Embperl 2 is able to do

Re: [ANNOUNCE] Apache Hello World Benchmarks v1.02

2003-03-05 Thread Josh Chamas
Ask Bjoern Hansen wrote: On Tue, 4 Mar 2003, Josh Chamas wrote: I thought it was interesting that Embperl 2 (barely) beat out PHP 4.3.0 on XSLT in both the XSLT Hello & XSLT Big tests. Why is that interesting? A bit more background would be interesting. :-) (post it to the list maybe). My ex

[ANNOUNCE] Apache Hello World Benchmarks v1.02

2003-03-04 Thread Josh Chamas
Hey, I have published the latest Hello World benchmarks, available at: http://chamas.com/bench/ Just updated are: - PHP 4.3.0 built with domxml extensions for XSLT tests - HTML::Embperl 1.3.6 - HTML::Mason 1.19 The PHP XSLT test are new, and the performance is similar is Embperl2 and

Re: Apache Hello World Benchmarks Updated

2002-10-15 Thread Gerald Richter
> > FYI, I reposted the benchmarks without the MaxRequestsPerChild 100 set > for HTML::Mason & Template Toolkit, as it was only Embperl 2.x that > needed it. > Embperl 2.0b8 has still some real memory leaks. That's why it called beta. Of course they will be fixed before the final release of 2.0.

Apache Hello World Benchmarks: AxKit config fixed XSLT, Cocoon benchmarksadded, Tomcat updated to 4.1.12

2002-10-15 Thread Josh Chamas
Hey, I updated the Apache Hello World Benchmarks with some major updates: AxKit config fixed XSLT performance Cocoon XSLT benchmarks added Tomcat updated to 4.1.12 Check them out at http://chamas.com/bench/ Regards, Josh

Re: Apache Hello World Benchmarks Updated

2002-10-15 Thread Josh Chamas
Ed wrote: > Hi, > > (as far as i can tell after a quick peek at the code and some debugging) > > It looks like there is a bug w/ AxKit::run_axkit_engine() and/or > Apache::AxKit::Cache::_get_stats() > This is really great Ed. Adding the AxGzipOutput On config to the XSLT tests in the benchmar

Re: Apache Hello World Benchmarks Updated

2002-10-15 Thread Josh Chamas
Dave Rolsky wrote: > On Mon, 14 Oct 2002, Josh Chamas wrote: > > >>This is interesting. I should look into upgrading to perl 5.8 on >>these tests & see what difference there may be. >> >>You might also see if it makes a difference if you run the tests for >>a long enough time. I run them at le

Re: Apache Hello World Benchmarks Updated

2002-10-14 Thread Ed
The Apache Hello World benchmarks are updated at > > http://chamas.com/bench/ > > The changes that affect performance numbers include: > > Set MaxRequestsPerChild to 1000 globally for more realistic run. > > Set MaxRequestsPerChild to 100 for applications that seem

Re: Apache Hello World Benchmarks Updated

2002-10-14 Thread Dave Rolsky
On Mon, 14 Oct 2002, Josh Chamas wrote: > This is interesting. I should look into upgrading to perl 5.8 on > these tests & see what difference there may be. > > You might also see if it makes a difference if you run the tests for > a long enough time. I run them at least 60 seconds for these be

Re: Apache Hello World Benchmarks Updated

2002-10-14 Thread Josh Chamas
Dave Rolsky wrote: > > I'm fairly sure, FWIW, that Mason does not have any memory leaks, as of > 1.12. Pre-1.10 versions do have a _very_ slow memory leak, and 1.10 and > 1.11 had that leak plus another, much nastier one. > Yes, Mason seemed pretty free of leaks when I tested it more today too

Re: Apache Hello World Benchmarks Updated

2002-10-14 Thread Josh Chamas
Perrin Harkins wrote: > Josh Chamas wrote: > >> Set MaxRequestsPerChild to 100 for applications that seem to leak >> memory which include Embperl 2.0, HTML::Mason, and Template Toolkit. >> This is a more typical setting in a mod_perl type application that >> leaks memory, so should be fai

Re: Apache Hello World Benchmarks Updated

2002-10-14 Thread Dave Rolsky
On Tue, 15 Oct 2002, Perrin Harkins wrote: > Josh Chamas wrote: > > > Set MaxRequestsPerChild to 100 for applications that seem to leak > > memory which include Embperl 2.0, HTML::Mason, and Template Toolkit. > > This is a more typical setting in a mod_perl type application that > > leaks

Re: Apache Hello World Benchmarks Updated

2002-10-14 Thread Perrin Harkins
Josh Chamas wrote: > Set MaxRequestsPerChild to 100 for applications that seem to leak > memory which include Embperl 2.0, HTML::Mason, and Template Toolkit. > This is a more typical setting in a mod_perl type application that > leaks memory, so should be fairly representative benchmark s

Apache Hello World Benchmarks Updated

2002-10-13 Thread Josh Chamas
Hey, The Apache Hello World benchmarks are updated at http://chamas.com/bench/ The changes that affect performance numbers include: Set MaxRequestsPerChild to 1000 globally for more realistic run. Set MaxRequestsPerChild to 100 for applications that seem to leak memory which

Re: [ANNOUNCE] Apache Hello World Benchmarks - Apache C API, HelloDB

2002-07-31 Thread Ged Haywood
Hi Josh, On Tue, 30 Jul 2002, Josh Chamas wrote: > Thanks for the feedback & still looking for more! Well for one thing you're doing a great job. :) Fo benchmarks to be more realistic, I feel that they need to include chunks of code to do lookups in serious databases, put together very complex

Re: [ANNOUNCE] Apache Hello World Benchmarks - Apache C API, HelloDB

2002-07-30 Thread Perrin Harkins
Josh Chamas wrote: > My only problem with Apache::DBI for a benchmark is its > default ping of the db per connect(). Oh, you're right I wasn't thinking about that. It is important in a benchmark to be testing equivalent functionality as much as possible, although it's very difficult to do. >

Re: [ANNOUNCE] Apache Hello World Benchmarks - Apache C API, HelloDB

2002-07-30 Thread Josh Chamas
Perrin Harkins wrote: > > To answer the original question, I don't think Apache::DBI is much > overhead at all. It amounts to little more than a hash lookup. > Certainly less work than the the thread synchronization required for > connection pooling. > My only problem with Apache::DBI for a

Re: [ANNOUNCE] Apache Hello World Benchmarks - Apache C API, HelloDB

2002-07-30 Thread Perrin Harkins
Dennis Haney wrote: >>The bias in the test is even a little slanted towards the JSP >>benchmarks since the trivial connection pooling I used there is >>nothing like the Apache::DBI overhead in the mod_perl test, when I >>could have just used a persistent global $dbh instead. ( maybe I >>should? )

re: [ANNOUNCE] Apache Hello World Benchmarks - Apache C API, HelloDB

2002-07-30 Thread Dennis Haney
> The bias in the test is even a little slanted towards the JSP > benchmarks since the trivial connection pooling I used there is > nothing like the Apache::DBI overhead in the mod_perl test, when I > could have just used a persistent global $dbh instead. ( maybe I > should? ) I believe you shou

[ANNOUNCE] Apache Hello World Benchmarks - Apache C API, HelloDB

2002-07-30 Thread Josh Chamas
Hey, The Apache Hello World Benchmarks are updated at: http://chamas.com/bench/ They now include 2 C Apache API benchmarks which show the fastest the benchmarks can run at, and how mod_perl is not much slower! Also included is a new HelloDB benchmark which is a trivial connection/query of

Re: Apache Hello World Benchmarks

2002-07-21 Thread Josh Chamas
urce code is available. > It would be good to see someone do this for mod_perl. None of the benchmarks I have done so far get anywhere near testing the scalability of systems in the real world, and it would be good to see this done. As a next step for the hello world benchmarks, I'll pr

Re: Linux Hello World Benchmarks - 11/19/2001

2001-11-19 Thread Joshua Chamas
Perrin Harkins wrote: > > on 11/19/01 8:05 PM, Joshua Chamas at [EMAIL PROTECTED] wrote: > > It has been a while, but here's a new set of Hello World benchmarks! > > There was a recent announcement of HTML::Template::JIT, and Template Toolkit > has an XS option now.

Re: Linux Hello World Benchmarks - 11/19/2001

2001-11-19 Thread Perrin Harkins
on 11/19/01 8:05 PM, Joshua Chamas at [EMAIL PROTECTED] wrote: > It has been a while, but here's a new set of Hello World benchmarks! There was a recent announcement of HTML::Template::JIT, and Template Toolkit has an XS option now. Any chance you could put those into the next round? - Perrin

Linux Hello World Benchmarks - 11/19/2001

2001-11-19 Thread Joshua Chamas
Hey, [[ NUMBERS ARE BELOW ]] It has been a while, but here's a new set of Hello World benchmarks! What took me so long in getting these out is that the java web environments that I had set up would keep crashing during the tests in ways that would not only render their benchmarks meanin

[ANNOUNCE] Hello World Benchmarks, 10 Minute Run

2001-07-13 Thread Joshua Chamas
Hey, It seemed that running the hello world benchmarks last time for only 60 seconds had problems with reproducibility, especially with mod_caucho. So here's some numbers for ~ 10 minute run. Its actually something like 20 benchmarks run for 30 seconds a piece, and the results s

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-12 Thread Joshua Chamas
Joshua Chamas wrote: > > mod_caucho > used to look a lot faster, but my testing methodology changed. > I used to take the results of the second benchmark run, and > publish those, but this time only ran the -test for minor > caching after starting resin ( & tomcat ). So, I'm gue

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Stas Bekman
On Wed, 11 Jul 2001, Philip Mak wrote: > And sorry for my newbie-ish question, but what is the difference > between "mod_perl handler" and "Apache::Registry mod_perl"? http://perl.apache.org/guide/performance.html#Apache_Registry_PerlHandler_vs_ including the benchmarks ___

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Joshua Chamas
Perrin Harkins wrote: > > > I do feel that compile time matters, but really with 60 seconds > > and high MaxRequestsPerChild, these systems are getting plenty > > of compiling caching. > > The thing is, if mod_caucho takes 5 seconds the first time it hits each > template, but is the fastest afte

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Perrin Harkins
> I do feel that compile time matters, but really with 60 seconds > and high MaxRequestsPerChild, these systems are getting plenty > of compiling caching. The thing is, if mod_caucho takes 5 seconds the first time it hits each template, but is the fastest afterwards, these numbers don't give a ve

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Joshua Chamas
Perrin Harkins wrote: > > > mod_caucho > > used to look a lot faster, but my testing methodology changed. > > I used to take the results of the second benchmark run, and > > publish those, but this time only ran the -test for minor > > caching after starting resin ( & tomcat ). S

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Perrin Harkins
Good work as usual, Joshua. > mod_caucho > used to look a lot faster, but my testing methodology changed. > I used to take the results of the second benchmark run, and > publish those, but this time only ran the -test for minor > caching after starting resin ( & tomcat ). So, I'

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Perrin Harkins
Good work as usual, Joshua. > mod_caucho > used to look a lot faster, but my testing methodology changed. > I used to take the results of the second benchmark run, and > publish those, but this time only ran the -test for minor > caching after starting resin ( & tomcat ). So, I'

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Joshua Chamas
Philip Mak wrote: > > One thing caught my eye; how come "mod_perl handler" (808.4 hits per > second) performed better than "HTML static" (768.2 hits per second)? > Here are my comments on this from the original post: HTML static for the first time, looks slower on my system than mod_perl.

Re: [ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Philip Mak
One thing caught my eye; how come "mod_perl handler" (808.4 hits per second) performed better than "HTML static" (768.2 hits per second)? And sorry for my newbie-ish question, but what is the difference between "mod_perl handler" and "Apache::Registry mod_perl"?

[ANNOUNCE] Hello World Benchmarks, updated

2001-07-11 Thread Joshua Chamas
Hey, The latest Hello World benchmarks at available at: http://www.chamas.com/bench/hello.tar.gz To reproduce the BELOW results on your platform, for whatever tests are available, run: ./bench.pl -test ./bench.pl -version -time=60 --Josh DISCLAIMER: these benchmarks test only what they

Re: [bordering on OT] Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2001-01-04 Thread Roger Espel Llima
On Thu, Jan 04, 2001 at 09:55:39AM -0500, Blue Lang wrote: > Eh, ab isn't really made as anything other than the most coarsely-grained > of benchmarks. Concurrency testing is useless because it will measure the > ratio of requests/second/processor, not the scalability of requests from > single to

[bordering on OT] Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2001-01-04 Thread Blue Lang
On Thu, 4 Jan 2001, Roger Espel Llima wrote: > JR Mayberry <[EMAIL PROTECTED]> wrote: > > Linux does serious injustice to mod_perl. Anyone who uses Linux knows > > how horrible it is on SMP, I think some tests showed it uses as litle as > > 25% of the second processor.. > > A simple benchmark wit

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2001-01-04 Thread Roger Espel Llima
JR Mayberry <[EMAIL PROTECTED]> wrote: > The Modperl handler benchmark, which was done on a dual P3 500mhz on > Linux does serious injustice to mod_perl. Anyone who uses Linux knows > how horrible it is on SMP, I think some tests showed it uses as litle as > 25% of the second processor.. It's an

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-18 Thread Joshua Chamas
[EMAIL PROTECTED] wrote: > > On Mon, Dec 18, 2000 at 10:37:16AM -0800, Joshua Chamas wrote: > > > > Please feel free to run the tests yourself, and if you give > > me the results, I'll be sure to post them at a later date > > at http://www.chamas.com/bench/ . You can grab the benchmarks > > from

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-18 Thread newsreader
On Mon, Dec 18, 2000 at 10:37:16AM -0800, Joshua Chamas wrote: > > Please feel free to run the tests yourself, and if you give > me the results, I'll be sure to post them at a later date > at http://www.chamas.com/bench/ . You can grab the benchmarks > from http://www.chamas.com/bench/hello.tar

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-18 Thread Joshua Chamas
JR Mayberry wrote: > > I strongly dislike the benchmarks on the below URL, its very > misleading.. > > The Modperl handler benchmark, which was done on a dual P3 500mhz on > Linux does serious injustice to mod_perl. Anyone who uses Linux knows > how horrible it is on SMP, I think some tests show

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-18 Thread JR Mayberry
I strongly dislike the benchmarks on the below URL, its very misleading.. The Modperl handler benchmark, which was done on a dual P3 500mhz on Linux does serious injustice to mod_perl. Anyone who uses Linux knows how horrible it is on SMP, I think some tests showed it uses as litle as 25% of the

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-17 Thread Perrin Harkins
Gunther Birznieks wrote: > But it's a shame that the only way to > get faster than PHP is to write a raw Mod_perl handler according to the > benchmarks. All the other mod_perl tools seem slower. It makes sense though. All the other tools do more setup work on each request: parsing input, manipul

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-17 Thread G.W. Haywood
Hi all, On Sun, 17 Dec 2000, Gerald Richter wrote: > there are so many factors, so they are very difficult to compare. True. But nevertheless I think it's a very useful bit of work because the thing that stands out is that all (server) dynamic content comes at a high cost in processor cycles.

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-17 Thread Gerald Richter
> For the raw benchmarks... > > OK, I finally got a little time to download and read some the hello.tar.gz. > > It's good to see TT is fairly fast. But it's a shame that the only way to > get faster than PHP is to write a raw Mod_perl handler according to the > benchmarks. All the other mod_perl

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-17 Thread Joshua Chamas
Gunther Birznieks wrote: > > For the raw benchmarks... > > OK, I finally got a little time to download and read some the hello.tar.gz. > > It's good to see TT is fairly fast. But it's a shame that the only way to > get faster than PHP is to write a raw Mod_perl handler according to the > benchm

Re: Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-16 Thread Gunther Birznieks
For the raw benchmarks... OK, I finally got a little time to download and read some the hello.tar.gz. It's good to see TT is fairly fast. But it's a shame that the only way to get faster than PHP is to write a raw Mod_perl handler according to the benchmarks. All the other mod_perl tools seem

Linux Hello World Benchmarks: +PHP,JSP,ePerl

2000-12-16 Thread Joshua Chamas
Hey, Still very rough, the hello world benchmark suite is available for download at: http://www.chamas.com/bench/hello.tar.gz You may run it like: # to get started, see what tests will run, note you # may need some CPAN modules installed to get this far perl ./bench.pl -test # to run t

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Joe Schaefer
Joshua Chamas <[EMAIL PROTECTED]> writes: > Joe Schaefer wrote: > > > > IME, simple mod_perl handlers typically run around 50% as fast as > > HTML static pages. Your hello world benchmark seems to be slightly > > misleading in this respect, since the content-length is small > > relative to the

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Joshua Chamas
Joe Schaefer wrote: > > IME, simple mod_perl handlers typically run around 50% as fast as > HTML static pages. Your hello world benchmark seems to be slightly > misleading in this respect, since the content-length is small > relative to the header size. > I'll send you my benchmark suite separ

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Joe Schaefer
Joshua Chamas <[EMAIL PROTECTED]> writes: > RESULTS: > > [hello]# ./bench.pl -time=60 > ... > Test Name Test FileHits/sec Total Hits Total Time Total >Bytes > > > HTML Stati

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Joshua Chamas
"Alexander Farber (EED)" wrote: > > Hi Joshua, > > you sort the table at http://www.chamas.com/bench/ by Hits/s, > but the ModPerl Handler was tested on PIII-500 x 2 and the Java > thingies below - only PII-266. > > Is it an intended joke or do I misunderstand something? > The first page is m

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Alexander Farber (EED)
Hi Joshua, Joshua Chamas wrote: > Note, this is the first benchmark that I've run of Apache::ASP on > Linux, which is nice to see because Linux is one of the faster OS's, > and it now looks bit more of a player, compared to what's listed at > http://www.chamas.com/bench/ when I benched it on Sola

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Joshua Chamas
Gunther Birznieks wrote: > > Then it seems odd that there is such a huge discrepency between CGI.pm and > no CGI.pm. If you preload CGI.pm in startup.pl does the difference go away? > I did preload CGI.pm. I'll send you the hello world suite separately since you seem curious. Note that at 500

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Gunther Birznieks
Then it seems odd that there is such a huge discrepency between CGI.pm and no CGI.pm. If you preload CGI.pm in startup.pl does the difference go away? At 02:56 AM 12/11/2000 -0800, Joshua Chamas wrote: >Gunther Birznieks wrote: > > > > Is CGI Raw decoding the get/post yourself? Or using the Apac

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Matt Sergeant
On Mon, 11 Dec 2000, Joshua Chamas wrote: > Lastly, I was unable to get AxKit to run without segfaulting ... http://axkit.org/faq.xml Either you're running PHP on that server, or you have an Apache with expat included. Do "nm /path/to/apache/bin/httpd | grep -i XML" to find out if the latter is

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Joshua Chamas
Gunther Birznieks wrote: > > Is CGI Raw decoding the get/post yourself? Or using the Apache::args, > Apache::Request::param mechanism? > In the hello world scripts, there is no get/post processing as part of the benchmark. Here's the code that's run: http://www.chamas.com/bench/#perlrawcgi

Re: Linux Hello World Benchmarks...

2000-12-11 Thread Gunther Birznieks
Is CGI Raw decoding the get/post yourself? Or using the Apache::args, Apache::Request::param mechanism? At 02:13 AM 12/11/2000 -0800, Joshua Chamas wrote: >Hey, > >I have automated a portable Hello World test suite, but its not >CPAN ready, so if any would like to contribute, run, and comment >

Linux Hello World Benchmarks...

2000-12-11 Thread Joshua Chamas
Hey, I have automated a portable Hello World test suite, but its not CPAN ready, so if any would like to contribute, run, and comment on the sources, give me a holler & I'll send them to you. What it does is fire up a lean apache on a high port with only the config necessary to run the benchmar

Re: hello world benchmarks...

2000-06-21 Thread Stas Bekman
> Thanks Rudy! Any way you could throw some > of the others into the mix, like Apache::ASP, > Embperl, Mason, Registry CGI ? The more > data there is, the more useful the benchmarks > are, since some of the greatest value comes > from how they compare on the same system. > > I understand if not

Re: hello world benchmarks...

2000-06-20 Thread Joshua Chamas
Thanks Rudy! Any way you could throw some of the others into the mix, like Apache::ASP, Embperl, Mason, Registry CGI ? The more data there is, the more useful the benchmarks are, since some of the greatest value comes from how they compare on the same system. I understand if not since these ben

hello world benchmarks...

2000-06-20 Thread Rudy
Here are some new stats for Joshua's benchmarks: http://www.chamas.com/bench/index.html -- Machine: OS: FreeBSD 4.0-STABLE cpu: PII-300 session: no client: ab From: local Notes: I had to tune the TCP/IP stack... FreeBSD straight off the web does not ha