Hi Philip, >> should be able to do 4-8 threads easily This is something I've often thought about. A worker instance is a whole VM right? Surely I should be able to push something around threadpool.max number of threads from a single worker? I even built a smallish framework around parallelising multiple tasks on a single worker instance (on my blog) but I'm interested to know the stats around what we can really push before we get choked. 4-8 seems too small.
Regards, Steven Nagy Readify | Senior Developer M: +61 404 044 513 | E: steven.n...@readify.net<sip:steven.n...@readify.net> | B: azure.snagy.name<http://azure.snagy.name/> ________________________________ From: ozazure-boun...@lists.codify.com [ozazure-boun...@lists.codify.com] On Behalf Of Philip Richardson [phi...@philiprichardson.org] Sent: Tuesday, 3 November 2009 10:40 AM To: ozAzure Subject: Re: blob to blob copy Yeah - I'd spin up some Workers in US South Central and have them read your US North West blobs and write to a new South Central store account. Remember you can have two works in prod and two workers in staging. So that gives you four workers and each one should be able to do 4-8 threads easily for the download/upload work. Use a Windows Azure queue to distribute the work between the workers (ie. Load the URIs of all the blobs into the queue and then each thread in each worker picks items off the queue to do the work). Phil On Mon, Nov 2, 2009 at 4:20 PM, John OBrien <j...@soulsolutions.com.au<mailto:j...@soulsolutions.com.au>> wrote: Hey guys, has anyone written/seen/know how to do a direct blob to blob copy? I need to migrate thousands of little images from the closing NW datacentre to the other datacentre and uploading from Australia took well over 12 hours initially with my upload client failing 3-4 times. I’m thinking a little worker process hosted in azure should be the fastest hey? I did have plans for a little process where i could upload them as a single zip file then decompress into azure but never had time to built it. John. _______________________________________________ ozazure mailing list ozazure@lists.codify.com<mailto:ozazure@lists.codify.com> http://prdlxvm0001.codify.net/mailman/listinfo/ozazure
_______________________________________________ ozazure mailing list ozazure@lists.codify.com http://prdlxvm0001.codify.net/mailman/listinfo/ozazure
