How are you doing the reaps?  Are you doing an eventually-consistent query, 
or fully-consistent get by keys?


On Sunday, July 29, 2012 10:19:25 AM UTC-4, Richard wrote:
>
> This is for all you guys who know app engine really well:
>
> I want to be able to move data RELIABLY and with low latency from many 
> front end instances to a backend within 5 seconds.
>
> I am currently getting the F1's to do a db.put() on a lightweight object.  
> The data comes from web clients.  Around 10 seconds later, the backend 
> reaps them.  This should work nicely in theory.
>
> However, it is just unreliable.  Sometimes it will handle a load of 600 db 
> put()'s in that 10 second window.... and other times (in the same day!), it 
> won't even have completed 100 put()'s in 10 seconds.... so when I do the 
> reap... I get nothing!   It seems put() has some problems... 'eventually 
> consistent' is useless if it is several minutes later!
>
> How can I do this reliably in a 10 second window ?   I have had using a 
> PULL queue suggested, but I don't want to do all the work of converting the 
> app over if it will be just as unreliable (I remember posts about 
> tasksqueue's getting "stuck")....
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/TV2ILqKq39kJ.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Reply via email to