On Wed, Sep 4, 2013 at 4:35 AM, Martin Descours <[email protected]> wrote:
> High Frontend Instance Hours : is it really due to crawlers ? > It's impossible to say that without thoroughly analyzing your logs - what evidence do you have that the high traffic is due to a crawler? Most search engine crawlers identify themselves with a specific user agent string: for instance, Google's crawler calls itself *googlebot*, and Bing's crawler declares itself as *bingbot*. Look in your logs; do you see those user agents listed in the request logs? On Wed, Sep 4, 2013 at 4:35 AM, Martin Descours <[email protected]> wrote: > Analytics : is it common that analytics registers crawler visits ? > > Depending on how the analytics software is built, yes. See http://searchengineland.com/is-googlebot-skewing-google-analytics-data-22313 for an example. On Wed, Sep 4, 2013 at 4:35 AM, Martin Descours <[email protected]> wrote: > Does it mean the other instance hours are opened when crawlers come into > my webapp ? > Instances are opened whenever a request comes in to a dynamic request-handler (i.e. a script, servlet, etc). If the crawlers are requesting dynamic content, then instances will be opened up to handle those requests. ----------------- -Vinny P Technology & Media Advisor Chicago, IL App Engine Code Samples: http://www.learntogoogleit.com -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
