|
If you don't need a genuine spider or actual
spidering functionalit, just need to hit all the .cfm files with an http
request....
You'd either need to index all.cfm files on the
server, or maintain an index of all pages that needed to be called. Using a
script to pull back a recursive directory listing from the webroot
for *.cfm files perhaps, dumpt the results to a text file, and then loop
over the text file feeding the results through an http call
command...
Bear traps that spring to mind would be the
throwback with stats, the script timing out given that its got to wait for
everything to compile, error handling, etc.
I suspect to avoid the error handling you'd want to
trigger the HTTP call and then dump the process without waiting for results to
come back. The server should still execute the call, regardless of the fact that
there's nobody listening for a response.
Stats would be easy enough, you'd just need to
filer local host originating requests....
I'd probably gues that it'd be ideally a perl
thing. But it could probably be done in any language with file system controls
and http queries.
This is purely speculation.... Cause I'm too lazy
to test it, can't be stuffed writing perl at the best of times, don't have a
*nix box to play with under hand, and am just heinously bored today
:)
----- Original Message -----
Sent: Thursday, March 06, 2003 10:30
AM
Subject: [cfaussie] CFMX Spider on
Reboot
Hey,
I just wanted to throw an idea
out to y'all. Maybe someone is already doing this ...
As you know, CFMX = Java
Architecture = Pages being Bytecode = Page being compiled on first request =
Slow initial page request, however subsequent page calls being
fast.
So, in the event of a server
reboot, the first person to hit each page is the unlucky bugger to wait for
the page to compile.
(ok, so nothing news
breaking)
I'm thinking it would ideal if
upon a server reboot, application install, or even a single page update, a
spider could filter through the appropriate directory and emulate a HTTP
request against the scripts, resulting in a "real" user not having to
compile/wait for the page.
Thoughts? Anyone doing something
similar to this already? It seems really trivial and obvious ... am I missing
something?
thanks,
Sarah.
Sarah
Atkinson
ColdFusion
Programmer
![]()
Lonely
Planet Publications, Aust.
Telephone: +61 3 8379
8000
Fax: +61 3 8379 8111
[EMAIL PROTECTED]
---
You are currently
subscribed to cfaussie as: [EMAIL PROTECTED]
To unsubscribe send a blank
email to [EMAIL PROTECTED]
MX Downunder AsiaPac
DevCon - http://mxdu.com/ ---
You are currently subscribed to cfaussie as:
[EMAIL PROTECTED]
To unsubscribe send a blank email to
[EMAIL PROTECTED]
MX Downunder AsiaPac DevCon -
http://mxdu.com/
______________________________________________________________________
This email, including attachments, is intended only for the addressee
and may be confidential, privileged and subject to copyright. If you
have received this email in error, please advise the sender and delete
it. If you are not the intended recipient of this email, you must not
use, copy or disclose its content to anyone. You must not copy or
communicate to others content that is confidential or subject to
copyright, unless you have the consent of the content owner.
|
---
You are currently subscribed to cfaussie as: [EMAIL PROTECTED]
To unsubscribe send a blank email to [EMAIL PROTECTED]
MX Downunder AsiaPac DevCon - http://mxdu.com/
---
You are currently subscribed to cfaussie as: [EMAIL PROTECTED]
To unsubscribe send a blank email to [EMAIL PROTECTED]
MX Downunder AsiaPac DevCon - http://mxdu.com/
|
