RE: Summary: A CF limitation in building a spider?

2001-02-11 Thread Dave Watts
> Does anyone know if a template will timeout if called from > the command line (eg as a sceduled task). I'm thinking that > it will only timeout when called from the browser, and then > only because the browser stops waiting. Can someone confirm > or deny this? Templates will timeout if they

RE: Summary: A CF limitation in building a spider?

2000-12-06 Thread Paul Johnston
CF should not handle too much text parsing. Paul > -Original Message- > From: Daniel Lancelot [mailto:[EMAIL PROTECTED]] > Sent: 06 December 2000 11:07 > To: CF-Talk > Subject: RE: Summary: A CF limitation in building a spider? > > > depends on the settings in cf

RE: Summary: A CF limitation in building a spider?

2000-12-06 Thread JustinMacCarthy
sen [mailto:[EMAIL PROTECTED]] >Sent: Tuesday, December 05, 2000 11:43 PM >To: CF-Talk >Subject: RE: Summary: A CF limitation in building a spider? > > >Does anyone know if a template will timeout if called from the >command line (eg >as a sceduled task). I'm thinking that it

RE: Summary: A CF limitation in building a spider?

2000-12-06 Thread Daniel Lancelot
To: CF-Talk :> Subject: RE: Summary: A CF limitation in building a spider? :> :> :> Does anyone know if a template will timeout if called from :> the command line (eg :> as a sceduled task). I'm thinking that it will only timeout :> when called from the :> browser, and th

RE: Summary: A CF limitation in building a spider?

2000-12-05 Thread Dylan Bromby
Scheduled tasks in particular accept a timeout attribute; you can set them individually. -Original Message- From: Bruce Heerssen [mailto:[EMAIL PROTECTED]] Sent: Tuesday, December 05, 2000 3:43 PM To: CF-Talk Subject: RE: Summary: A CF limitation in building a spider? Does anyone know

RE: Summary: A CF limitation in building a spider?

2000-12-05 Thread Bruce Heerssen
Does anyone know if a template will timeout if called from the command line (eg as a sceduled task). I'm thinking that it will only timeout when called from the browser, and then only because the browser stops waiting. Can someone confirm or deny this? Thanks -- Bruce > -Original Message---

Summary: A CF limitation in building a spider?

2000-12-05 Thread Phill Gibson
Hi Everyone, Here is a summary of responses to "A CF limitation in building a spider?" that I posted a couple of weeks ago. I know a few folks had wanted to see the results; maybe others will as well. Apologies to any I may have missed. What will I do now? Use the existing CF spide

RE: A CF limitation in building a spider?

2000-11-23 Thread Scott, Andrew
the known methods!!! regards Andrew Scott Senior Cold Fusion Application Developer ANZ eCommerce Centre * Ph 9273 0693 * [EMAIL PROTECTED] -Original Message- From: Michael Thomas [mailto:[EMAIL PROTECTED]] Sent: 23 November 2000 17:11 To: CF-Talk Subject: Re: A CF limitation in buildin

RE: A CF limitation in building a spider?

2000-11-23 Thread Dave Watts
> Ive noticed one huge limitation that makes CF not a great > choice in building a spider. CFHTTP doesnt like the use of > URL pointers to another domain, like http://www.thisdomain.com > redirects to http://www.thisotherdomain.com... In testing > whether a domain is valid or not, an url point

Re: A CF limitation in building a spider?

2000-11-22 Thread Michael Thomas
James Sleeman <[EMAIL PROTECTED]> >Reply-To: [EMAIL PROTECTED] >To: CF-Talk <[EMAIL PROTECTED]> >Subject: Re: A CF limitation in building a spider? >Date: Thu, 23 Nov 2000 18:06:21 +1300 > >---Reply to mail from Phill Gibson about A CF limitation in building a >spi

Re: A CF limitation in building a spider?

2000-11-22 Thread James Sleeman
---Reply to mail from Phill Gibson about A CF limitation in building a spider? > Does anyone know of a better way to do the recursive call to cfhttp? Anyway > I see it, you are still calling one page, and it eventually times out. Others have pointed out that CF is not a great tool for th

RE: A CF limitation in building a spider?

2000-11-15 Thread Steve Bernard
You're probably better off using something like Linkbot. Dump the results to a db and use CF to create reports or whatever. This is also much more cost effective. You won't be able to completely mimic Linkbot's features and yet you'll spend many more man hours than an enterprise license would cost

RE: A CF limitation in building a spider?

2000-11-15 Thread Philip Arnold - ASP
> CF recursion, and the use of custom tags in general, doesn't > perform as well > as I'd like, due to each iteration of the script happening within > a separate > memory context, but the filesystem itself won't be a problem. Roll on CF5, hopefully they're solving a lot of these problems... of ma

RE: A CF limitation in building a spider?

2000-11-15 Thread Dave Watts
> There is no point in using up CF's resources on something > it's not really designed for. Until we get custom functions > (which we all hope will be in CF 5) then we can't really do > recursion very easily. This is because calling a custom tag > (even though it's 'cached' by the CF server)

RE: A CF limitation in building a spider?

2000-11-15 Thread Paul Johnston
t; Sent: 15 November 2000 08:40 > To: CF-Talk > Subject: RE: A CF limitation in building a spider? > > > I don't think that CF is the right tool for this task. In my eyes, this > falls under the category of 'offline processing', meaning that you're not &g

RE: A CF limitation in building a spider?

2000-11-15 Thread Paul Mone
mailto:[EMAIL PROTECTED]] Sent: Tuesday, November 14, 2000 9:54 AM To: CF-Talk Cc: Phill Gibson (E-mail) Subject: A CF limitation in building a spider? Hi All, I'm putting together a spider to be used with a search engine, and have come up to what looks like a limitation in using CF for the task.

Re: A CF limitation in building a spider?

2000-11-14 Thread Rob Keniger
on 11/15/00 3:54 AM, Phill Gibson at [EMAIL PROTECTED] wrote: > I'm using cfhttp to extract links from specific sites. It loops through, > collecting all hyperlinks that are within the site and adds them to a list > to be visited. In visiting/indexing these links, however, it is still > looping t

Re: A CF limitation in building a spider?

2000-11-14 Thread Joseph Thompson
I built a FTP "recursive" custom tag that may help... although I have my development server set to not time out I think that because it calls itself over and over it may work for you? http://cfhub.com/taggallery/ftp2tree/ftp2tree.zip

A CF limitation in building a spider?

2000-11-14 Thread Phill Gibson
Hi All, I'm putting together a spider to be used with a search engine, and have come up to what looks like a limitation in using CF for the task. Here's what's going on: I'm using cfhttp to extract links from specific sites. It loops through, collecting all hyperlinks that are within the site an