No problem, and sorry I wasn't clear before! Jeremy R. Geerdes Effective website design & development Des Moines, IA
For more information or a project quote: http://jgeerdes.home.mchsi.com http://jgeerdes.blogspot.com http://jgeerdes.wordpress.com [email protected] Unless otherwise noted, any price quotes contained within this communication are given in US dollars. If you're in the Des Moines, IA, area, check out Debra Heights Wesleyan Church! And check out my blog, Adventures in Web Development, at http://jgeerdes.blogspot.com ! On Apr 9, 2009, at 10:37 AM, Annddrew wrote: > > Ok Jeremy now I got it. Thank you very much for your explanation. > > On Apr 9, 9:19 am, Jeremy Geerdes <[email protected]> wrote: >> Okay, I don't think I've explained this as clearly as I had thought. >> Sorry about that. What you are going to be doing is a two-step >> process. First, you use the AJAX Search API (or its RESTful side) to >> get the search results from Google. Then you use curl (PHP), >> UserAgent >> (Perl), or WebClient (ASP), etc., to retrieve the full content of the >> page from the original server, not Google. So, if the result's url >> iswww.foo.com/bar.html >> , your proxy script grabs the content fromwww.foo.com/bar.html. >> >> Jeremy R. Geerdes >> Effective website design & development >> Des Moines, IA >> >> For more information or a project quote:http://jgeerdes.home.mchsi.comhttp >> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com >> [email protected] >> >> Unless otherwise noted, any price quotes contained within this >> communication are given in US dollars. >> >> If you're in the Des Moines, IA, area, check out Debra Heights >> Wesleyan Church! >> >> And check out my blog, Adventures in Web Development, >> athttp://jgeerdes.blogspot.com >> ! >> >> On Apr 9, 2009, at 8:13 AM, Annddrew wrote: >> >> >> >> >> >>> Jeremy, in the links you gave me they show how to use the REST >>> interface of the ajax api but this interface still doesn't allow one >>> to fetch the whole page from a URL. Again if I use Curl, >>> UserAgent, or >>> WebClient to grab the full content of a page I won't be using the >>> REST >>> interface of google and therefore I will be in violation of Google >>> rules which I think stipulate that we can access google database >>> only >>> through the javascript api or its RESTful counterpart. Thanks >> >>> On Apr 8, 10:20 pm, Jeremy Geerdes <[email protected]> wrote: >>>> Nope. They document doing exactly that at the links below: >> >>>> http://code.google.com/apis/ajaxsearch/documentation/index.html#fonje >>>> ... >>>> ://code.google.com/apis/ajaxsearch/documentation/ >>>> reference.html#_... >> >>>> Jeremy R. Geerdes >>>> Effective website design & development >>>> Des Moines, IA >> >>>> For more information or a project quote:http://jgeerdes.home.mchsi.comhttp >>>> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com >>>> [email protected] >> >>>> Unless otherwise noted, any price quotes contained within this >>>> communication are given in US dollars. >> >>>> If you're in the Des Moines, IA, area, check out Debra Heights >>>> Wesleyan Church! >> >>>> And check out my blog, Adventures in Web Development, >>>> athttp://jgeerdes.blogspot.com >>>> ! >> >>>> On Apr 8, 2009, at 9:18 PM, Annddrew wrote: >> >>>>> I understood your point Jeremy but if I use Curl, UserAgent, or >>>>> WebClient will google block me due to violation of its rules >>>>> because >>>>> I'm not using the api? thanks >> >>>>> On Apr 8, 3:52 pm, Jeremy Geerdes <[email protected]> wrote: >>>>>> The AJAX API is the only legal way to access Google's search >>>>>> services >>>>>> from your own applications. However, your question was, "I would >>>>>> like >>>>>> to know if there is a way to grab the full content of a page >>>>>> given >>>>>> its >>>>>> URL?" The answer to that question is the method that I >>>>>> proposed. If >>>>>> you are wanting the full content of a search result, then you >>>>>> would >>>>>> run your search through the AJAX API and then run the appropriate >>>>>> URL(s) through Curl, UserAgent, or WebClient, etc. There is no >>>>>> way >>>>>> to >>>>>> get the full content of one of the search results directly >>>>>> through >>>>>> the >>>>>> Search or any other Google API that I'm aware of. >> >>>>>> Jeremy R. Geerdes >>>>>> Effective website design & development >>>>>> Des Moines, IA >> >>>>>> For more information or a project >>>>>> quote:http://jgeerdes.home.mchsi.comhttp >>>>>> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com >>>>>> [email protected] >> >>>>>> Unless otherwise noted, any price quotes contained within this >>>>>> communication are given in US dollars. >> >>>>>> If you're in the Des Moines, IA, area, check out Debra Heights >>>>>> Wesleyan Church! >> >>>>>> And check out my blog, Adventures in Web Development, >>>>>> athttp://jgeerdes.blogspot.com >>>>>> ! >> >>>>>> On Apr 8, 2009, at 2:43 PM, Annddrew wrote: >> >>>>>>> Thanks Jeremy for your reply but doesn't your method violate the >>>>>>> terms >>>>>>> of use of Google? I thought Google allows access to its database >>>>>>> only >>>>>>> through its ajax api. Thanks >> >>>>>>> Andrew >> >>>>>>> On Apr 8, 9:55 am, Jeremy Geerdes <[email protected]> wrote: >>>>>>>> There is no Google AJAX API to do this, but you can build >>>>>>>> something >>>>>>>> fairly quickly on your own using XMLHttpRequest and a server- >>>>>>>> side >>>>>>>> proxy application. Basically, the proxy application will >>>>>>>> accept a >>>>>>>> url >>>>>>>> via the XMLHttpRequest; retrieve that url using curl or >>>>>>>> UserAgent >>>>>>>> or - >>>>>>>> gulp - WebClient, etc.; and then return it to your JS. >> >>>>>>>> Jeremy R. Geerdes >>>>>>>> Effective website design & development >>>>>>>> Des Moines, IA >> >>>>>>>> For more information or a project >>>>>>>> quote:http://jgeerdes.home.mchsi.comhttp >>>>>>>> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com >>>>>>>> [email protected] >> >>>>>>>> Unless otherwise noted, any price quotes contained within this >>>>>>>> communication are given in US dollars. >> >>>>>>>> If you're in the Des Moines, IA, area, check out Debra Heights >>>>>>>> Wesleyan Church! >> >>>>>>>> And check out my blog, Adventures in Web Development, >>>>>>>> athttp://jgeerdes.blogspot.com >>>>>>>> ! >> >>>>>>>> On Apr 8, 2009, at 8:52 AM, Annddrew wrote: >> >>>>>>>>> Hi, >>>>>>>>> I would like to know if there is a way to grab the full >>>>>>>>> content >>>>>>>>> of a >>>>>>>>> page given its URL? Thanks >> >>>>>>>>> Andrew- Hide quoted text - >> >>>>>>>> - Show quoted text -- Hide quoted text - >> >>>>>> - Show quoted text -- Hide quoted text - >> >>>> - Show quoted text -- Hide quoted text - >> >> - Show quoted text - > > --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google AJAX APIs" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/Google-AJAX-Search-API?hl=en -~----------~----~----~----~------~----~------~--~---
