Hi Sam, If you're polling 10,000 users every minute, I think you need to reconsider your approach. For example, make an arrangement with your data source to provide a feed of changes since you last polled. Polling every user every minute simply isn't scalable.
-Nick Johnson On Mon, Aug 17, 2009 at 6:48 PM, Sam Afifi <[email protected]> wrote: > > Hypothetical app .. > > Let's say I have 10,000 users and I need an application that queries > every minute, a service they all subscribe to. Obviously every minute > cron jobs won't work as it would take more than 30 seconds to process > 1..10000 as I traverse down the list. So instead, should I create > 10,000 tasks .. one for each customer? And load these tasks into the > tasks queue every minute? But then I'd have to do some checking in > case more than a minute has passed and some tasks in the queue still > haven't finished ... > > Any ideas? > > > > -- Nick Johnson, Developer Programs Engineer, App Engine --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
