I wonder if someone has used the robots.txt in bypass the ajax calls in the code.... Can anyone please advise if this is a good option or not. If it is a good option, should I treat this robots.txt as a static file or what?
Thank you very much, Nora On Apr 25, 8:43 pm, Nora <[email protected]> wrote: > Hello, > I have created a website using GAE. I used a treeview control from > Yahoo user Interface Library. I ceated a sitemap for the site to > helpGooglecrawlers to quickly index my site. I use a tree that > supportsAJAXtechniques: > 1. When the user clicks on one of the children nodes of my tree, the > request is sent asynchronously to the GAE server to fetch the data for > the client. > 2. When children nodes are requested for a parent node, the request is > sent asynchronously to the server to fetch the children nodes for the > client. > > Both of the above tasks send the same query names( /rpc?), for the > same handler on the server side, for instance, RPCHandler class. But > different class methods are used each time according to the action > required; fetching children nodes or in the first situation fetching > data linked to a child node. > > Now, thegooglecrawler is reporting to me that the filehttp://myapplication/rpc > is not found. There is no file called rpc in the first place as this > is the method used to fetch data asynchronously!!! > > Do I need to tellgoogleto ignore those links? how can I do that? > On the other hand, is it possible to make it clear to the crawler that > these areajaxcalls not pages to load? > > If you have any clues, please help as this is the first website I > develop and I don't have any clues on how to sort out the problem... > > Thank you very much. --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
