I've checked the performance of my datastore based task pipeline, the performance seems to be very poor, there are many missed/old tasks (db entities) - probably caused by query delays - as I query for tasks, and the delay should be ~30 seconds at most for the system to work, doesn't seem to be the case, always
Anyway, let's say the pull queue tags are random strings - and I add and pull 100's of items every seconds dynamically, would it work? I've experienced "taskqueue.TransientError" situations with non-tagged but extremely heavy usage, happened when I was pulling and deleting only 1 task, by multiple workers, however I have a feeling the above scenario, with infinite tags, might work better, as the incoming rate would be high, but the tasks would be pulled in batches and not so frequently Anyway the above explanation might not be sufficient to explain my usecase and needs, however I would appreciate any usage experience around pull queues, thanks in advance -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
