Ok Jeremy now I got it. Thank you very much for your explanation.
On Apr 9, 9:19 am, Jeremy Geerdes <[email protected]> wrote:
> Okay, I don't think I've explained this as clearly as I had thought.
> Sorry about that. What you are going to be doing is a two-step
> process. First, you use the AJAX Search API (or its RESTful side) to
> get the search results from Google. Then you use curl (PHP), UserAgent
> (Perl), or WebClient (ASP), etc., to retrieve the full content of the
> page from the original server, not Google. So, if the result's url
> iswww.foo.com/bar.html
> , your proxy script grabs the content fromwww.foo.com/bar.html.
>
> Jeremy R. Geerdes
> Effective website design & development
> Des Moines, IA
>
> For more information or a project
> quote:http://jgeerdes.home.mchsi.comhttp://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com
> [email protected]
>
> Unless otherwise noted, any price quotes contained within this
> communication are given in US dollars.
>
> If you're in the Des Moines, IA, area, check out Debra Heights
> Wesleyan Church!
>
> And check out my blog, Adventures in Web Development,
> athttp://jgeerdes.blogspot.com
> !
>
> On Apr 9, 2009, at 8:13 AM, Annddrew wrote:
>
>
>
>
>
> > Jeremy, in the links you gave me they show how to use the REST
> > interface of the ajax api but this interface still doesn't allow one
> > to fetch the whole page from a URL. Again if I use Curl, UserAgent, or
> > WebClient to grab the full content of a page I won't be using the REST
> > interface of google and therefore I will be in violation of Google
> > rules which I think stipulate that we can access google database only
> > through the javascript api or its RESTful counterpart. Thanks
>
> > On Apr 8, 10:20 pm, Jeremy Geerdes <[email protected]> wrote:
> >> Nope. They document doing exactly that at the links below:
>
> >>http://code.google.com/apis/ajaxsearch/documentation/index.html#fonje...
> >> ://code.google.com/apis/ajaxsearch/documentation/reference.html#_...
>
> >> Jeremy R. Geerdes
> >> Effective website design & development
> >> Des Moines, IA
>
> >> For more information or a project quote:http://jgeerdes.home.mchsi.comhttp
> >> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com
> >> [email protected]
>
> >> Unless otherwise noted, any price quotes contained within this
> >> communication are given in US dollars.
>
> >> If you're in the Des Moines, IA, area, check out Debra Heights
> >> Wesleyan Church!
>
> >> And check out my blog, Adventures in Web Development,
> >> athttp://jgeerdes.blogspot.com
> >> !
>
> >> On Apr 8, 2009, at 9:18 PM, Annddrew wrote:
>
> >>> I understood your point Jeremy but if I use Curl, UserAgent, or
> >>> WebClient will google block me due to violation of its rules because
> >>> I'm not using the api? thanks
>
> >>> On Apr 8, 3:52 pm, Jeremy Geerdes <[email protected]> wrote:
> >>>> The AJAX API is the only legal way to access Google's search
> >>>> services
> >>>> from your own applications. However, your question was, "I would
> >>>> like
> >>>> to know if there is a way to grab the full content of a page given
> >>>> its
> >>>> URL?" The answer to that question is the method that I
> >>>> proposed. If
> >>>> you are wanting the full content of a search result, then you would
> >>>> run your search through the AJAX API and then run the appropriate
> >>>> URL(s) through Curl, UserAgent, or WebClient, etc. There is no way
> >>>> to
> >>>> get the full content of one of the search results directly through
> >>>> the
> >>>> Search or any other Google API that I'm aware of.
>
> >>>> Jeremy R. Geerdes
> >>>> Effective website design & development
> >>>> Des Moines, IA
>
> >>>> For more information or a project
> >>>> quote:http://jgeerdes.home.mchsi.comhttp
> >>>> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com
> >>>> [email protected]
>
> >>>> Unless otherwise noted, any price quotes contained within this
> >>>> communication are given in US dollars.
>
> >>>> If you're in the Des Moines, IA, area, check out Debra Heights
> >>>> Wesleyan Church!
>
> >>>> And check out my blog, Adventures in Web Development,
> >>>> athttp://jgeerdes.blogspot.com
> >>>> !
>
> >>>> On Apr 8, 2009, at 2:43 PM, Annddrew wrote:
>
> >>>>> Thanks Jeremy for your reply but doesn't your method violate the
> >>>>> terms
> >>>>> of use of Google? I thought Google allows access to its database
> >>>>> only
> >>>>> through its ajax api. Thanks
>
> >>>>> Andrew
>
> >>>>> On Apr 8, 9:55 am, Jeremy Geerdes <[email protected]> wrote:
> >>>>>> There is no Google AJAX API to do this, but you can build
> >>>>>> something
> >>>>>> fairly quickly on your own using XMLHttpRequest and a server-side
> >>>>>> proxy application. Basically, the proxy application will accept a
> >>>>>> url
> >>>>>> via the XMLHttpRequest; retrieve that url using curl or UserAgent
> >>>>>> or -
> >>>>>> gulp - WebClient, etc.; and then return it to your JS.
>
> >>>>>> Jeremy R. Geerdes
> >>>>>> Effective website design & development
> >>>>>> Des Moines, IA
>
> >>>>>> For more information or a project
> >>>>>> quote:http://jgeerdes.home.mchsi.comhttp
> >>>>>> ://jgeerdes.blogspot.comhttp://jgeerdes.wordpress.com
> >>>>>> [email protected]
>
> >>>>>> Unless otherwise noted, any price quotes contained within this
> >>>>>> communication are given in US dollars.
>
> >>>>>> If you're in the Des Moines, IA, area, check out Debra Heights
> >>>>>> Wesleyan Church!
>
> >>>>>> And check out my blog, Adventures in Web Development,
> >>>>>> athttp://jgeerdes.blogspot.com
> >>>>>> !
>
> >>>>>> On Apr 8, 2009, at 8:52 AM, Annddrew wrote:
>
> >>>>>>> Hi,
> >>>>>>> I would like to know if there is a way to grab the full content
> >>>>>>> of a
> >>>>>>> page given its URL? Thanks
>
> >>>>>>> Andrew- Hide quoted text -
>
> >>>>>> - Show quoted text -- Hide quoted text -
>
> >>>> - Show quoted text -- Hide quoted text -
>
> >> - Show quoted text -- Hide quoted text -
>
> - Show quoted text -
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Google AJAX APIs" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/Google-AJAX-Search-API?hl=en
-~----------~----~----~----~------~----~------~--~---
