[cfaussie] Re: Vspider or jspider or something else
Charlie, I downloaded that program, and although it is feature rich it is lacking a few keys things that I do require, and as much as I appreciate the pointer to this, it will not suit our needs here. * I need the ability to schedule multiple searches, and define when and how often these schedules run. * I also need to be able to have an API that will connect into Coldfusion to have control As well as the other features I mentioned earlier. The main problem is that this must be able to search the web, and and any given urls. And to make it even harder we do not have access to the server as it is hosted on a shared environment so an API is important as we can not use cfexecute, although I can get around this but would like to not have to use that option if I can avoid it. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
Sure, no problem. I'd never used it so was just sharing it for your consideration. Given that you're reaching the end of your rope, I'll point out that BlueDragon has built-in spidering, via CFINDEX (and a new Type=WebSite) option. You could of course control scheduling using CFSCHEDULE (or the Admin). That would seem to give you all seek, and the spidering feature is not limited to just searching the localhost. As with CF, there is a free trial (30 day) as well as free developer edition (no expiration, limited to requests from localhost). There is also the free Server edition, free for non-commercial deployment, then the Server JX edition ($899). Not trying to sell BD. Just pointing out an alternative as you seem to have reached the end of other possibilities. /Charlie http://www.carehart.org/blog/ -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Andrew Scott Sent: Wednesday, January 10, 2007 6:59 PM To: cfaussie@googlegroups.com Subject: [cfaussie] Re: Vspider or jspider or something else Charlie, I downloaded that program, and although it is feature rich it is lacking a few keys things that I do require, and as much as I appreciate the pointer to this, it will not suit our needs here. * I need the ability to schedule multiple searches, and define when and how often these schedules run. * I also need to be able to have an API that will connect into Coldfusion to have control As well as the other features I mentioned earlier. The main problem is that this must be able to search the web, and and any given urls. And to make it even harder we do not have access to the server as it is hosted on a shared environment so an API is important as we can not use cfexecute, although I can get around this but would like to not have to use that option if I can avoid it. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
Charlie, I think I also stated that I do not have access to the server, and that this is on a shared host so although I appreciate you pointing me to BD this is not supported on this Hosting :-( Well I guess I will have to write it then, I just didn't want to waste time writing a HTML parser etc and scrape the forms from the websites if something already existed. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
No one's brought up using Lucene yet? http://lucene.apache.org/java/docs/features.html Andrew Scott wrote: Charlie, I think I also stated that I do not have access to the server, and that this is on a shared host so although I appreciate you pointing me to BD this is not supported on this Hosting :-( Well I guess I will have to write it then, I just didn't want to waste time writing a HTML parser etc and scrape the forms from the websites if something already existed. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 -- Haikal Saadh Applications Programmer ICT Resources, TALSS QUT Kelvin Grove --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
Yes Charlie did :-) Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
Hi Andrew, Sorry I can't help you with your situation. However I've got some questions about vspider. I've tried to use it to index my intranet site using command line but it didn't work. How cfexceute can be used for vspider? George On 11/01/07, Andrew Scott [EMAIL PROTECTED] wrote: Yes Charlie did :-) Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
George, Sorry I can't really answer that question as I have not used vpsider as yet. But what I have read is that vspider will only work on the machine it is installed on. Other than that I have no real clue, as soon as I read that I stopped reading. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 _ From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of George Lu Sent: Thursday, 11 January 2007 2:01 PM To: cfaussie@googlegroups.com Subject: [cfaussie] Re: Vspider or jspider or something else Hi Andrew, Sorry I can't help you with your situation. However I've got some questions about vspider. I've tried to use it to index my intranet site using command line but it didn't work. How cfexceute can be used for vspider? George On 11/01/07, Andrew Scott [EMAIL PROTECTED] wrote: Yes Charlie did :-) Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
Well, the vspider utility is a command line tool. It's at C:\CFusionMX7\verity\k2\_nti40\bin\vspider.exe (or C:\CFusionMX\lib\_nti40\bin\vspider.exe). And CFEXECUTE can be used to call any command line tool. Are you asking for more than that? You can find more info on it at: http://livedocs.macromedia.com/coldfusion/7/htmldocs/wwhelp/wwhimpl/common/h tml/wwhelp.htm?context=ColdFusion_Documentation http://livedocs.macromedia.com/coldfusion/7/htmldocs/wwhelp/wwhimpl/common/ html/wwhelp.htm?context=ColdFusion_Documentationfile=1781.htm file=1781.htm /Charlie http://www.carehart.org/blog/ _ From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of George Lu Sent: Wednesday, January 10, 2007 10:01 PM To: cfaussie@googlegroups.com Subject: [cfaussie] Re: Vspider or jspider or something else Hi Andrew, Sorry I can't help you with your situation. However I've got some questions about vspider. I've tried to use it to index my intranet site using command line but it didn't work. How cfexceute can be used for vspider? George --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~--- attachment: attc6416.jpg
[cfaussie] Re: Vspider or jspider or something else
Sorry. I'd just missed that. Hope it may help someone else in the future. Before you give up, is this a public site? Are you aware of the Google site search feature? That would be free. I blogged about it (from a slightly different perspective) at: http://www.tipicalcharlie.com/no_search_mechanism_on_a_site_never_fear_googl e_is_hear.htm Also, I'm pretty sure they offer an engine you can bundle (don't know if it's free). (Sorry if I'm not remembering some detail of your requirements that would obviate any of these tools' use). /Charlie http://www.carehart.org/blog/ -Original Message- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of Andrew Scott Sent: Wednesday, January 10, 2007 8:23 PM To: cfaussie@googlegroups.com Subject: [cfaussie] Re: Vspider or jspider or something else Charlie, I think I also stated that I do not have access to the server, and that this is on a shared host so although I appreciate you pointing me to BD this is not supported on this Hosting :-( Well I guess I will have to write it then, I just didn't want to waste time writing a HTML parser etc and scrape the forms from the websites if something already existed. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
[cfaussie] Re: Vspider or jspider or something else
Hi, from what i recall.. it been a while since i have done this... if you have the site setup locally on a dev machine, run vspider on it and create the colloection via vspider and than upload the collection to the shared hosting server. and call it via the cfsearch tag .eg cfsearch external=Yes note : in cfmx 7 external tag has been depreciated since its suppose to detect external or internal collections automatically. you might have to ask your host to create a collection in cfadmin by pointing to your uploaded collection. make sure the 2 CF server versions are the same. just my 2 cents worth. hth Joel - Original Message - From: Andrew Scott To: cfaussie@googlegroups.com Sent: Thursday, January 11, 2007 2:13 PM Subject: [cfaussie] Re: Vspider or jspider or something else George, Sorry I can't really answer that question as I have not used vpsider as yet. But what I have read is that vspider will only work on the machine it is installed on. Other than that I have no real clue, as soon as I read that I stopped reading. Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 -- From: cfaussie@googlegroups.com [mailto:[EMAIL PROTECTED] On Behalf Of George Lu Sent: Thursday, 11 January 2007 2:01 PM To: cfaussie@googlegroups.com Subject: [cfaussie] Re: Vspider or jspider or something else Hi Andrew, Sorry I can't help you with your situation. However I've got some questions about vspider. I've tried to use it to index my intranet site using command line but it didn't work. How cfexceute can be used for vspider? George On 11/01/07, Andrew Scott [EMAIL PROTECTED] wrote: Yes Charlie did :-) Andrew Scott Senior Coldfusion Developer Aegeon Pty. Ltd. www.aegeon.com.au Phone: +613 8676 4223 Mobile: 0404 998 273 --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups cfaussie group. To post to this group, send email to cfaussie@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/cfaussie?hl=en -~--~~~~--~~--~--~---
