The thing that I've noticed is that the amount of bot traffic hitting my sites 
has been steadily increasing. I've addressed this through a combination of 
robots.txt and blocking certain IP address blocks in the firewall (I block the 
ones that don't respect crawl-delay or don't respect robots.txt).

It's a never-ending battle against these bots that all seem to be building 
their own google-scale web databases.

If your costs are coming from frontend instances, the simple solution to that 
is to just limit the maximum number of those. Although that means when you do 
get a traffic spike, users will suffer.

-Joshua

> On Sep 2, 2021, at 10:48 AM, Tapir <[email protected]> wrote:
> 
> 
> The costs of my projects rocketed from $5 to $50 in the previous months.
> Anyone else also got the same experience?
> 
> My websites are very small.
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Google App Engine" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to [email protected] 
> <mailto:[email protected]>.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/google-appengine/e122d075-4147-4151-b156-693c21484afdn%40googlegroups.com
>  
> <https://groups.google.com/d/msgid/google-appengine/e122d075-4147-4151-b156-693c21484afdn%40googlegroups.com?utm_medium=email&utm_source=footer>.

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/ACCBBA77-EABA-45CF-8E83-EA43DFFF0280%40gmail.com.

Reply via email to