Hi, Anuj, This is precisely what the App Engine task queue is designed for. Simply enqueue a task queue task for each photo the consumer uploads, and have them do the necessary image processing. Once they're done, they can update the datastore, or notify the user asynchronously over the channel API, that the work is complete.
-Nick Johnson On Thu, Apr 28, 2011 at 6:47 AM, footy <[email protected]> wrote: > Thanks guys for some info on task queues.. > I will try and outline what I am trying to do. > > Producer: Produces photos. These are uploaded by the user. > Once the upload is done, I would like to put up a task in the queue, > to be ready for further processing > > Consumer: Consumes these photos and processes them. Trying to do some > image transforms on the images. > Picks it up from the queue, applies the transforms. Once done, let's > the producer know that processing is complete. > > Producer: On receiving processing complete, fetches the transformed > images and serves them back to the user. > > Since, I am new to GAE, I don't see how I would use a single app. > > Another reason for separating the apps ( apart from different > codebase) is that the scaling required for both producer and consumer > is at different level. > So, no of instances required for both the producer and consumer is > different. > > Being able to upload the images from the producer, is much more > critical than being able to serve back the transformed images. But > consumer needs to be > scaled when there is a huge back log of transformation tasks. Thus the > level of scaling required for producer and consumer is different. > > What would you suggest in this case? > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- Nick Johnson, Developer Programs Engineer, App Engine -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
