Thanks a lot for sharing the method, it sounds really interesting - would be a great alternative if things don't work out with GCS
especially evaporateJS sounds really promising, I don't have any knowledge of upload protocols, don't know what happens when a large file upload gets disrupted, wondering how a mobile device can upload a large file, whether it's possible or not etc. It seems to me that, at one point, I will also be forced to improve the current structure, a client side library to handle these operations would be great, it seems to me that it would also be possible to imitate what you did for GCS, I'm using blobstore handlers to handle large files, but it sounds possible to send chunks of data and manually write it to the appropriate place using regular handlers, sounds possible but obviously challenging It would have been great, if something like that existed, something like channel js api, but this time, file uploader js api, a library that will handle uploads to gcs from the client On Monday, August 19, 2013 10:21:25 PM UTC+3, tom wrote: > > We use zencoder for transcoding videos. Our work flow is: > > 1. webpages uploads file direct from browser to AWS S3 > 2. webpage POST to our AE to notify that upload is complete > 3. our AE makes request to zencoder to start transcode > 4. zencoder completes job, then POSTs transcoded video to AWS S3 > 5. zencoder POSTs to our AE to notify us transcode is complete (or > errored), we update our assets status in DB > > Of course we also handle the error cases (#3 and #5 are where zencoder > notify us if there is a problem). The admins get an email if there is an > error (rarely, but not never) > > There's lots of other ways to skin the cat, of course. Ours works for us > in production. If you'd like more details then I'm very happy to share - > just ask. > > BTW, for #1 we use https://github.com/TTLabs/EvaporateJS, which we wrote, > and is handling 22GB uploads! > > tom > > On Sunday, August 18, 2013 11:05:26 AM UTC-7, Kaan Soral wrote: >> >> This issue has been on my mind, let's say a user uploads an 2gb .mov >> file, and let's say one decides to use a service like zencoder >> The upload to external service and the download from external service >> both sound challenging, if the RAM of an instance is 512mb's for example, >> and the runtime of a task is 10 minutes, would it be possible to achieve >> upload/download? >> >> I would really appreciate video encoding advice / file upload/download >> advice related to videos. >> >> Generally it's easy to upload a file to AppEngine, and download a file >> from AppEngine, thanks to Blobstore upload/download handlers, however as >> far as I know, there aren't any helpers that will do the reverse, upload >> file from AppEngine, and download file to AppEngine from an URL >> > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
