Hi Takashi, This is exactly my problem. Along with the fact that it seems to be time-of-day dependent. Luckily/unluckily, this just happens to coincide with the time when I have the least number of users playing.
-R On Wednesday, August 1, 2012 1:16:54 AM UTC-4, Takashi Matsuo (Google) wrote: > > Hi Richard, > > Alright, I've been misunderstanding your issue. I thought you were > saying that the datastore put(s) are actually taking more than 10 > secs. However, the issue you're tackling with is that, the datastore > put calls themselves succeed, but the subsequent global query doesn't > pick up the entities within 10 secs. > > If that's the case, please forget about tablet split/merge for now. > It's a general eventually consistent problem. Let me think about it > again. > > -- Takashi > > > > On Wed, Aug 1, 2012 at 1:45 AM, Richard <[email protected]> wrote: > > Hi Takashi, > > > > App id is sven-wordhero. I don't specify keys when creating the Score() > > entities. Just: > > x = Score() > > x.member = thing > > x.put() > > > > Time is listed on the bottom plot and is actually from a datetime() on > the > > server, so between 8am and 1pm UTC ? > > > > > > On Tuesday, July 31, 2012 12:32:42 PM UTC-4, Takashi Matsuo (Google) > wrote: > >> > >> Hi Richard, > >> > >> How do you generate keys for those entities? > >> What is your app-id? > >> What time do you see this issue(It's not clear from the image, which > >> timezone you're in)? > >> > >> -- Takashi > >> > >> On Wed, Aug 1, 2012 at 12:33 AM, Richard <[email protected]> wrote: > >> > That might be... but sometimes it is just fine with 600+ players in a > >> > game. > >> > Then the same time each day when it has only 180 players, it has > >> > problems ? > >> > Also, this problem started 4 days ago...... > >> > > >> > I just tried pull queues in the last hour. Some entries to the pull > >> > queue > >> > arrive later than 10 seconds after being added to the queue. Also, > when > >> > processing at around 160 players/game, the number of 'late' entries > was > >> > randomly between 1-10. Obviously, this is completely unacceptable as > it > >> > appears to players that we 'lose' their score! > >> > > >> > So it seems PULL queues are not for anything that requires > performance > >> > (except maybe for batch?) and DEFINITELY NOT for timing.... > >> > > >> > > >> > On Tuesday, July 31, 2012 10:16:22 AM UTC-4, Takashi Matsuo (Google) > >> > wrote: > >> >> > >> >> On Tue, Jul 31, 2012 at 11:08 PM, Richard <[email protected]> > wrote: > >> >> > Thank you for that interesting post. Some points though: > >> >> > > >> >> > - behavior is observed at the same time each day > >> >> > - behavior is observed when QPS is lowest > >> >> > - behavior is not observed at high QPS > >> >> > >> >> The traffic patterns seems identical, so isn't it possible that the > >> >> issue always happens after deleting bunch of entities? > >> >> What happens if you just leave those entities instead of deleting > them? > >> >> > >> >> > >> > -- > >> > You received this message because you are subscribed to the Google > >> > Groups > >> > "Google App Engine" group. > >> > To view this discussion on the web visit > >> > https://groups.google.com/d/msg/google-appengine/-/ZxqrFCQl0YsJ. > >> > > >> > To post to this group, send email to > [email protected]. > >> > To unsubscribe from this group, send email to > >> > [email protected]. > >> > For more options, visit this group at > >> > http://groups.google.com/group/google-appengine?hl=en. > >> > >> > >> > >> -- > >> Takashi Matsuo > > > > -- > > You received this message because you are subscribed to the Google > Groups > > "Google App Engine" group. > > To view this discussion on the web visit > > https://groups.google.com/d/msg/google-appengine/-/P1y70hJ2BLIJ. > > > > To post to this group, send email to [email protected]. > > To unsubscribe from this group, send email to > > [email protected]. > > For more options, visit this group at > > http://groups.google.com/group/google-appengine?hl=en. > > > > -- > Takashi Matsuo > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/spFuRX92RHoJ. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
