Re: [ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl + DBD::Oracle)

2000-12-08 Thread Perrin Harkins

> The enterprise mod_perl architectures idea that I posted earlier has
evolved
> into a slightly modified idea: a 'scaling mod_perl' site:
> http://www.lifespree.com/modperl.
>
> The point of this site will be to talk about & synthesize techniques for
> scaling, monitoring, and profiling large, complicated mod_perl
> architectures.

No offense, but the content you have here looks really well suited to be
part of the Guide.  It would fit nicely into the performance section.
Making it a separate site kind of fragments the documentation.

> So far, I've written up a basic scaling framework, and I've posted a
> particular development profiling tool that we wrote to capture, time, and
> explain all SQL select queries that occur on a particular page of a
mod_perl
> + DBD::Oracle application:
> -http://www.lifespree.com/modperl/explain_dbitracelog.pl
> -http://www.lifespree.com/modperl/DBD-Oracle-1.06-perfhack.tar.gz

Take a look at DBIx::Profile as well.

> 1. Performance benchmarking code. In particular, I'm looking for tools
that
> can read in an apache log, play it back realtime (by looking at the time
> between requests in the apache log), and simulate slow & simultaneous
> connections. I've started writing my own, but it would be cool if
something
> else out there existed.

The mod_backhand project was developing a tool like this called Daquiri.

> If folks could just send me pointers to various caching
> modules and code, I'll test them in a uniform environment and let folks
know
> what I come up with.

There are a bunch of discussions about this in the archives, including one
this week.  Joshua Chamas did some benchmarking on a dbm-based approach
recently.

- Perrin


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]




RE: [ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl + DBD::Oracle)

2000-12-08 Thread Wilt, Paul

Please do make it available.  The more examples the better.

Paul E Wilt 
Principal Software Engineer

XanEdu, Inc. ( a division of Bell+Howell Information&Learning)
http://www.XanEdu.com
mailto:[EMAIL PROTECTED]
mailto:[EMAIL PROTECTED]
300 North Zeeb Rd   Phone: (734) 975-6021  (800)
521-0600 x6021
Ann Arbor, MI 48106 Fax:(734) 973-0737




-Original Message-
From: Matt Sergeant [mailto:[EMAIL PROTECTED]]
Sent: Friday, December 08,2000 12:54 PM
To: Perrin Harkins
Cc: Ed Park; [EMAIL PROTECTED]; [EMAIL PROTECTED]
Subject: Re: [ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl +
DBD::Oracle)


On Fri, 8 Dec 2000, Perrin Harkins wrote:

> > 1. Performance benchmarking code. In particular, I'm looking for tools
> that
> > can read in an apache log, play it back realtime (by looking at the time
> > between requests in the apache log), and simulate slow & simultaneous
> > connections. I've started writing my own, but it would be cool if
> something
> > else out there existed.
>
> The mod_backhand project was developing a tool like this called Daquiri.

I also have a tool here that you install as a TransHandler, and it reads
querystring and POST data [*] and saves it to an XML log file, then it
appends to the PerlHandler phase and dumps the output that would go to the
browser to the same XML log file (of course this requires the output to
be stored somewhere, like Apache::Filter does, rather than printed direct
to the browser). Then there's a little playback tool. Its a bit specific
to the app I'm working on, because there's code in place to make
Apache::Request a singleton and also collect the output, but I could be
persuaded to open it up to people.

[*] using Apache::Request at the moment - but we need to modify
Apache::Request to be a singleton as it can't be instantiated twice in the
same application at the moment.

-- 


/||** Director and CTO **
   //||**  AxKit.com Ltd   **  ** XML Application Serving **
  // ||** http://axkit.org **  ** XSLT, XPathScript, XSP  **
 // \\| // ** Personal Web Site: http://sergeant.org/ **
 \\//
 //\\
//  \\


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]




Re: [ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl +DBD::Oracle)

2000-12-08 Thread Matt Sergeant

On Fri, 8 Dec 2000, Perrin Harkins wrote:

> > 1. Performance benchmarking code. In particular, I'm looking for tools
> that
> > can read in an apache log, play it back realtime (by looking at the time
> > between requests in the apache log), and simulate slow & simultaneous
> > connections. I've started writing my own, but it would be cool if
> something
> > else out there existed.
>
> The mod_backhand project was developing a tool like this called Daquiri.

I also have a tool here that you install as a TransHandler, and it reads
querystring and POST data [*] and saves it to an XML log file, then it
appends to the PerlHandler phase and dumps the output that would go to the
browser to the same XML log file (of course this requires the output to
be stored somewhere, like Apache::Filter does, rather than printed direct
to the browser). Then there's a little playback tool. Its a bit specific
to the app I'm working on, because there's code in place to make
Apache::Request a singleton and also collect the output, but I could be
persuaded to open it up to people.

[*] using Apache::Request at the moment - but we need to modify
Apache::Request to be a singleton as it can't be instantiated twice in the
same application at the moment.

-- 


/||** Director and CTO **
   //||**  AxKit.com Ltd   **  ** XML Application Serving **
  // ||** http://axkit.org **  ** XSLT, XPathScript, XSP  **
 // \\| // ** Personal Web Site: http://sergeant.org/ **
 \\//
 //\\
//  \\


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]




Re: [ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl + DBD::Oracle)

2000-12-08 Thread Tim Bunce

On Fri, Dec 08, 2000 at 05:47:00AM -0500, Ed Park wrote:
> 
> So far, I've written up a basic scaling framework, and I've posted a
> particular development profiling tool that we wrote to capture, time, and
> explain all SQL select queries that occur on a particular page of a mod_perl
> + DBD::Oracle application:
> -http://www.lifespree.com/modperl/explain_dbitracelog.pl

The docs should at least mention the ora_explain tool from Alan
Burlison (a Sun performance guy) that's included in the DBD::Oracle
distribution.

It'll let you and and explain the queries that are _actually_ slow or
expensive, in priority order, rather than drown in the explain plans of
many queries.

Tim.

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]




Re: [ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl + DBD::Oracle)

2000-12-08 Thread Gerald Richter

> 2. Caching techniques. I know that this is a topic that has been somewhat
> beaten to a pulp on this list, but it keeps coming up, and I don't know of
> any place where the current best thinking on the subject has been
> synthesized. I haven't used any caching techniques yet myself, but I
intend
> to begin caching data at the mod_perl tier in the next version of my
> application, so I have a very good incentive to synthesize and benchmark
> various techniques. If folks could just send me pointers to various
caching
> modules and code, I'll test them in a uniform environment and let folks
know
> what I come up with. Or, if someone has already done all that work of
> testing, I'd appreciate if you could point me to the results. I'd still
like
> to run my own tests, though.
>

Embperl 2.0 will have build in caching. I hope to release the first beta
during the next week

Gerald

-
Gerald Richterecos electronic communication services gmbh
Internetconnect * Webserver/-design/-datenbanken * Consulting

Post:   Tulpenstrasse 5 D-55276 Dienheim b. Mainz
E-Mail: [EMAIL PROTECTED] Voice:+49 6133 925131
WWW:http://www.ecos.de  Fax:  +49 6133 925152
-




-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]




Re: [ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl +DBD::Oracle)

2000-12-08 Thread Stas Bekman

On Fri, 8 Dec 2000, Ed Park wrote:

> The enterprise mod_perl architectures idea that I posted earlier has evolved
> into a slightly modified idea: a 'scaling mod_perl' site:
> http://www.lifespree.com/modperl.

Ed, this is all cool, but is it possible that we put this on one of the
public sites? At some point you will probably become too busy to maintain
this site... And maintaining the site whose sources are in HTML is a big
mess.

My suggestion is to pick the guide's code code base (Pod::HtmlPSPdf),
write in POD and deliver it as a separate package e.g. 'scale', which then
can be placed to perl.apache.org/scale or else and maintained with CVS. It
will also allow you to deliver ps/pdf formats. Re-use the existing mirrors
structure and the search facilities.

_
Stas Bekman  JAm_pH --   Just Another mod_perl Hacker
http://stason.org/   mod_perl Guide  http://perl.apache.org/guide 
mailto:[EMAIL PROTECTED]   http://apachetoday.com http://logilune.com/
http://singlesheaven.com http://perl.apache.org http://perlmonth.com/  



-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]




[ANNOUNCE] new site: scaling mod_perl (+tool: mod_perl + DBD::Oracle)

2000-12-08 Thread Ed Park

The enterprise mod_perl architectures idea that I posted earlier has evolved
into a slightly modified idea: a 'scaling mod_perl' site:
http://www.lifespree.com/modperl.

The point of this site will be to talk about & synthesize techniques for
scaling, monitoring, and profiling large, complicated mod_perl
architectures.

So far, I've written up a basic scaling framework, and I've posted a
particular development profiling tool that we wrote to capture, time, and
explain all SQL select queries that occur on a particular page of a mod_perl
+ DBD::Oracle application:
-http://www.lifespree.com/modperl/explain_dbitracelog.pl
-http://www.lifespree.com/modperl/DBD-Oracle-1.06-perfhack.tar.gz

Currently, I'm soliciting thoughts and code on the following subjects in
particular:
1. Performance benchmarking code. In particular, I'm looking for tools that
can read in an apache log, play it back realtime (by looking at the time
between requests in the apache log), and simulate slow & simultaneous
connections. I've started writing my own, but it would be cool if something
else out there existed.
2. Caching techniques. I know that this is a topic that has been somewhat
beaten to a pulp on this list, but it keeps coming up, and I don't know of
any place where the current best thinking on the subject has been
synthesized. I haven't used any caching techniques yet myself, but I intend
to begin caching data at the mod_perl tier in the next version of my
application, so I have a very good incentive to synthesize and benchmark
various techniques. If folks could just send me pointers to various caching
modules and code, I'll test them in a uniform environment and let folks know
what I come up with. Or, if someone has already done all that work of
testing, I'd appreciate if you could point me to the results. I'd still like
to run my own tests, though.

If folks could point me towards resources/code for these topics (as well as
any other topics you think might be relevant to the site), please let me
know. I'm offering to do the legwork required to actually test, benchmark,
and synthesize all of this stuff, and publish it on the page.

I'm also still interested in actually talking with various folks. If anyone
who has been through some significant mod_perl scaling exercise would like
to chat for 15-30 minutes to swap war stories or tactical plans, I'd love to
talk with you; send me a private email.

cheers,
Ed


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]