Re: Web Crawler/Spider ?

2006-11-16 Thread Dave Phillips
I like HTTrack (which has both a GUI and command-line interface): http://www.httrack.com/ Andy Anyone know anything about VSPIDER ?? ~| Introducing the Fusion Authority Quarterly Update. 80 pages of hard-hitting, up-to-date

RE: Web Crawler/Spider ?

2006-11-16 Thread Dave Watts
Anyone know anything about VSPIDER ?? That's the spider that comes with Verity. Its use is documented within the CF documentation, I believe. It only works with Verity, and the version that comes with CF is limited by its license to only spider localhost. Dave Watts, CTO, Fig Leaf Software

RE: Web Crawler/Spider ?

2006-11-15 Thread Andrew Tyrone
Has anyone ever used some sort of third-party crawler or spider to pull content from a group of web pages (similar to how Google indexes web pages), and then indexed that content with CFINDEX? If so, what have you used and what do you recommend? Or, if you've written something like