, January 13, 2003 7:04 PM
To: CF-Talk
Subject: Re: Search engine spider
I think they are talking about wanting to build a search engine, such as
google or something, correct? Wanting to hit it big, get rich then hit
us with pay-per-clicks, lol
- Original Message -
From: Tilbrook, Peter
On one of my sites I have a script that cfhttp's
a url and strips out all of the meta information,
body and such and does calculations such as keyword
density on them but it doesn't index an entire site.
It just does one url at a time.
I don't think it's what you're looking for but you
can try it
I suppose that depends on what language you want the code in, what platform,
what features, etc.
I know I wrote a web link mapper (built a map of all the links in a site) in
Perl in a couple of hours. I also wrote a doohicky that would scan a site
for given text mining /n/ layers deep etc. and
send it out to look for
certain keywords etc
-Original Message-
From: Ben Doom [mailto:[EMAIL PROTECTED]]
Sent: Monday, January 13, 2003 2:54 PM
To: CF-Talk
Subject: RE: Search engine spider
I suppose that depends on what language you want the code in, what
platform, what features
To: CF-Talk
Subject: RE: Search engine spider
On one of my sites I have a script that cfhttp's
a url and strips out all of the meta information,
body and such and does calculations such as keyword
density on them but it doesn't index an entire site.
It just does one url at a time.
I don't think
datasource
Eventually work on refinement so that I can send it out to look for
certain keywords etc
-Original Message-
From: Ben Doom [mailto:[EMAIL PROTECTED]]
Sent: Monday, January 13, 2003 2:54 PM
To: CF-Talk
Subject: RE: Search engine spider
I suppose that depends on what
Bascially I need to create a search engine. And the the spider would be
used to index links for the search engine
-Original Message-
From: Jerry Johnson [mailto:[EMAIL PROTECTED]]
Sent: Monday, January 13, 2003 3:24 PM
To: CF-Talk
Subject: RE: Search engine spider
What do you mean
, Inc
: -Original Message-
: From: Kris Pilles [mailto:[EMAIL PROTECTED]]
: Sent: Monday, January 13, 2003 3:29 PM
: To: CF-Talk
: Subject: RE: Search engine spider
:
:
: Bascially I need to create a search engine. And the the spider would be
: used to index links for the search engine
Thanks
-Original Message-
From: Ben Doom [mailto:[EMAIL PROTECTED]]
Sent: Monday, January 13, 2003 3:49 PM
To: CF-Talk
Subject: RE: Search engine spider
If by 'index the links' you mean generate a list of them, it seems to me
the following would work pretty well.
Create an empty array
CFMX has one built-in (using Verity) if that suits your purposes.
==
Peter Tilbrook
Internet Applications Developer
Australian Building Codes Board
GPO Box 9839
CANBERRA ACT 2601
AUSTRALIA
WWW: http://www.abcb.gov.au/
E-Mail: [EMAIL PROTECTED]
Telephone: (02) 6213 6731
Mobile: 0439
, 2003 6:57 PM
Subject: RE: Search engine spider
CFMX has one built-in (using Verity) if that suits your purposes.
==
Peter Tilbrook
Internet Applications Developer
Australian Building Codes Board
GPO Box 9839
CANBERRA ACT 2601
AUSTRALIA
WWW: http://www.abcb.gov.au/
E-Mail
11 matches
Mail list logo
