This is for all you guys who know app engine really well:

I want to be able to move data RELIABLY and with low latency from many 
front end instances to a backend within 5 seconds.

I am currently getting the F1's to do a db.put() on a lightweight object.  
The data comes from web clients.  Around 10 seconds later, the backend 
reaps them.  This should work nicely in theory.

However, it is just unreliable.  Sometimes it will handle a load of 600 db 
put()'s in that 10 second window.... and other times (in the same day!), it 
won't even have completed 100 put()'s in 10 seconds.... so when I do the 
reap... I get nothing!   It seems put() has some problems... 'eventually 
consistent' is useless if it is several minutes later!

How can I do this reliably in a 10 second window ?   I have had using a 
PULL queue suggested, but I don't want to do all the work of converting the 
app over if it will be just as unreliable (I remember posts about 
tasksqueue's getting "stuck")....


-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To view this discussion on the web visit 
https://groups.google.com/d/msg/google-appengine/-/Sz8tNeGAxpgJ.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Reply via email to