On Apr 12, 2013, at 4:06 AM, uday 
<[email protected]<mailto:[email protected]>>
 wrote:

I have a pyramid app which handles file upload.  I am able to upload that file 
to amazon s3 as soon as user uploads the file without saving it anywhere on the 
file system.  The problem here is, it is taking more time than just storing 
file locally.  I just want a simple task to upload the file to amazon after 
file upload response is sent.  This makes the user experience a lot better.  Is 
it necessary to  use message queue in this case or some other solution would do 
the trick?  I have not tried message queues before.


I've seen folks use http://pythonhosted.org/APScheduler/ for this kind of thing 
to avoid having to use a worker.  Basically, you spawn a worker thread at app 
creation, and queue stuff for it to handle.   Not sure this is "simpler", but 
your failures and crashes at will happen in the same process which is 
convenient for debugging.    You could also do something similar with 
multiprocessing.

I feel like a recent post cover a bunch of these options, but I'm failing to 
google it up.

-w


d. "whit" morriss
Platform Codemonkey
[email protected]<mailto:[email protected]>


-- 
You received this message because you are subscribed to the Google Groups 
"pylons-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/pylons-discuss?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.


Reply via email to