We've also the same problem. We even had to implement a versioning controlling algorithm to prevent ugly dirty reads.
Our appid is 'racetownzc' On Wednesday, August 1, 2012 10:57:50 AM UTC-3, Richard wrote: > > Hi Takashi, > > This is exactly my problem. Along with the fact that it seems to be > time-of-day dependent. Luckily/unluckily, this just happens to coincide > with the time when I have the least number of users playing. > > -R > > On Wednesday, August 1, 2012 1:16:54 AM UTC-4, Takashi Matsuo (Google) > wrote: >> >> Hi Richard, >> >> Alright, I've been misunderstanding your issue. I thought you were >> saying that the datastore put(s) are actually taking more than 10 >> secs. However, the issue you're tackling with is that, the datastore >> put calls themselves succeed, but the subsequent global query doesn't >> pick up the entities within 10 secs. >> >> If that's the case, please forget about tablet split/merge for now. >> It's a general eventually consistent problem. Let me think about it >> again. >> >> -- Takashi >> >> >> >> On Wed, Aug 1, 2012 at 1:45 AM, Richard <steven...@gmail.com> wrote: >> > Hi Takashi, >> > >> > App id is sven-wordhero. I don't specify keys when creating the >> Score() >> > entities. Just: >> > x = Score() >> > x.member = thing >> > x.put() >> > >> > Time is listed on the bottom plot and is actually from a datetime() on >> the >> > server, so between 8am and 1pm UTC ? >> > >> > >> > On Tuesday, July 31, 2012 12:32:42 PM UTC-4, Takashi Matsuo (Google) >> wrote: >> >> >> >> Hi Richard, >> >> >> >> How do you generate keys for those entities? >> >> What is your app-id? >> >> What time do you see this issue(It's not clear from the image, which >> >> timezone you're in)? >> >> >> >> -- Takashi >> >> >> >> On Wed, Aug 1, 2012 at 12:33 AM, Richard <steven...@gmail.com> wrote: >> >> > That might be... but sometimes it is just fine with 600+ players in >> a >> >> > game. >> >> > Then the same time each day when it has only 180 players, it has >> >> > problems ? >> >> > Also, this problem started 4 days ago...... >> >> > >> >> > I just tried pull queues in the last hour. Some entries to the pull >> >> > queue >> >> > arrive later than 10 seconds after being added to the queue. Also, >> when >> >> > processing at around 160 players/game, the number of 'late' entries >> was >> >> > randomly between 1-10. Obviously, this is completely unacceptable >> as it >> >> > appears to players that we 'lose' their score! >> >> > >> >> > So it seems PULL queues are not for anything that requires >> performance >> >> > (except maybe for batch?) and DEFINITELY NOT for timing.... >> >> > >> >> > >> >> > On Tuesday, July 31, 2012 10:16:22 AM UTC-4, Takashi Matsuo (Google) >> >> > wrote: >> >> >> >> >> >> On Tue, Jul 31, 2012 at 11:08 PM, Richard <steven...@gmail.com> >> wrote: >> >> >> > Thank you for that interesting post. Some points though: >> >> >> > >> >> >> > - behavior is observed at the same time each day >> >> >> > - behavior is observed when QPS is lowest >> >> >> > - behavior is not observed at high QPS >> >> >> >> >> >> The traffic patterns seems identical, so isn't it possible that the >> >> >> issue always happens after deleting bunch of entities? >> >> >> What happens if you just leave those entities instead of deleting >> them? >> >> >> >> >> >> >> >> > -- >> >> > You received this message because you are subscribed to the Google >> >> > Groups >> >> > "Google App Engine" group. >> >> > To view this discussion on the web visit >> >> > https://groups.google.com/d/msg/google-appengine/-/ZxqrFCQl0YsJ. >> >> > >> >> > To post to this group, send email to >> google-appengine@googlegroups.com. >> >> > To unsubscribe from this group, send email to >> >> > google-appengine+unsubscr...@googlegroups.com. >> >> > For more options, visit this group at >> >> > http://groups.google.com/group/google-appengine?hl=en. >> >> >> >> >> >> >> >> -- >> >> Takashi Matsuo >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups >> > "Google App Engine" group. >> > To view this discussion on the web visit >> > https://groups.google.com/d/msg/google-appengine/-/P1y70hJ2BLIJ. >> > >> > To post to this group, send email to google-appengine@googlegroups.com. >> >> > To unsubscribe from this group, send email to >> > google-appengine+unsubscr...@googlegroups.com. >> > For more options, visit this group at >> > http://groups.google.com/group/google-appengine?hl=en. >> >> >> >> -- >> Takashi Matsuo >> > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/4F4d7SoHefkJ. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
