Okay, I don't think I've explained this as clearly as I had thought. Sorry about that. What you are going to be doing is a two-step process. First, you use the AJAX Search API (or its RESTful side) to get the search results from Google. Then you use curl (PHP), UserAgent (Perl), or WebClient (ASP), etc., to retrieve the full content of the page from the original server, not Google. So, if the result's url is www.foo.com/bar.html , your proxy script grabs the content from www.foo.com/bar.html.
Jeremy R. Geerdes Effective website design & development Des Moines, IA For more information or a project quote: http://jgeerdes.home.mchsi.com http://jgeerdes.blogspot.com http://jgeerdes.wordpress.com [email protected] Unless otherwise noted, any price quotes contained within this communication are given in US dollars. If you're in the Des Moines, IA, area, check out Debra Heights Wesleyan Church! And check out my blog, Adventures in Web Development, at http://jgeerdes.blogspot.com ! On Apr 9, 2009, at 8:13 AM, Annddrew wrote: > > Jeremy, in the links you gave me they show how to use the REST > interface of the ajax api but this interface still doesn't allow one > to fetch the whole page from a URL. Again if I use Curl, UserAgent, or > WebClient to grab the full content of a page I won't be using the REST > interface of google and therefore I will be in violation of Google > rules which I think stipulate that we can access google database only > through the javascript api or its RESTful counterpart. Thanks > > On Apr 8, 10:20 pm, Jeremy Geerdes <[email protected]> wrote: >> Nope. They document doing exactly that at the links below: >> >> http://code.google.com/apis/ajaxsearch/documentation/index.html#fonjehttp >> ://code.google.com/apis/ajaxsearch/documentation/reference.html#_... >> >> Jeremy R. Geerdes >> Effective website design & development >> Des Moines, IA >> >> For more information or a project quote:http://jgeerdes.home.mchsi.comhttp >> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com >> [email protected] >> >> Unless otherwise noted, any price quotes contained within this >> communication are given in US dollars. >> >> If you're in the Des Moines, IA, area, check out Debra Heights >> Wesleyan Church! >> >> And check out my blog, Adventures in Web Development, >> athttp://jgeerdes.blogspot.com >> ! >> >> On Apr 8, 2009, at 9:18 PM, Annddrew wrote: >> >> >> >> >> >>> I understood your point Jeremy but if I use Curl, UserAgent, or >>> WebClient will google block me due to violation of its rules because >>> I'm not using the api? thanks >> >>> On Apr 8, 3:52 pm, Jeremy Geerdes <[email protected]> wrote: >>>> The AJAX API is the only legal way to access Google's search >>>> services >>>> from your own applications. However, your question was, "I would >>>> like >>>> to know if there is a way to grab the full content of a page given >>>> its >>>> URL?" The answer to that question is the method that I >>>> proposed. If >>>> you are wanting the full content of a search result, then you would >>>> run your search through the AJAX API and then run the appropriate >>>> URL(s) through Curl, UserAgent, or WebClient, etc. There is no way >>>> to >>>> get the full content of one of the search results directly through >>>> the >>>> Search or any other Google API that I'm aware of. >> >>>> Jeremy R. Geerdes >>>> Effective website design & development >>>> Des Moines, IA >> >>>> For more information or a project quote:http://jgeerdes.home.mchsi.comhttp >>>> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com >>>> [email protected] >> >>>> Unless otherwise noted, any price quotes contained within this >>>> communication are given in US dollars. >> >>>> If you're in the Des Moines, IA, area, check out Debra Heights >>>> Wesleyan Church! >> >>>> And check out my blog, Adventures in Web Development, >>>> athttp://jgeerdes.blogspot.com >>>> ! >> >>>> On Apr 8, 2009, at 2:43 PM, Annddrew wrote: >> >>>>> Thanks Jeremy for your reply but doesn't your method violate the >>>>> terms >>>>> of use of Google? I thought Google allows access to its database >>>>> only >>>>> through its ajax api. Thanks >> >>>>> Andrew >> >>>>> On Apr 8, 9:55 am, Jeremy Geerdes <[email protected]> wrote: >>>>>> There is no Google AJAX API to do this, but you can build >>>>>> something >>>>>> fairly quickly on your own using XMLHttpRequest and a server-side >>>>>> proxy application. Basically, the proxy application will accept a >>>>>> url >>>>>> via the XMLHttpRequest; retrieve that url using curl or UserAgent >>>>>> or - >>>>>> gulp - WebClient, etc.; and then return it to your JS. >> >>>>>> Jeremy R. Geerdes >>>>>> Effective website design & development >>>>>> Des Moines, IA >> >>>>>> For more information or a project >>>>>> quote:http://jgeerdes.home.mchsi.comhttp >>>>>> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com >>>>>> [email protected] >> >>>>>> Unless otherwise noted, any price quotes contained within this >>>>>> communication are given in US dollars. >> >>>>>> If you're in the Des Moines, IA, area, check out Debra Heights >>>>>> Wesleyan Church! >> >>>>>> And check out my blog, Adventures in Web Development, >>>>>> athttp://jgeerdes.blogspot.com >>>>>> ! >> >>>>>> On Apr 8, 2009, at 8:52 AM, Annddrew wrote: >> >>>>>>> Hi, >>>>>>> I would like to know if there is a way to grab the full content >>>>>>> of a >>>>>>> page given its URL? Thanks >> >>>>>>> Andrew- Hide quoted text - >> >>>>>> - Show quoted text -- Hide quoted text - >> >>>> - Show quoted text -- Hide quoted text - >> >> - Show quoted text - > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google AJAX APIs" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/Google-AJAX-Search-API?hl=en -~----------~----~----~----~------~----~------~--~---
