Depends on the memory used by each thread I guess. It's worth experimenting with...
Phil On Mon, Nov 2, 2009 at 4:43 PM, Steven Nagy <steven.n...@readify.net> wrote: > Hi Philip, > > >> should be able to do 4-8 threads easily > This is something I've often thought about. A worker instance is a whole VM > right? > Surely I should be able to push something around threadpool.max number of > threads from a single worker? > I even built a smallish framework around parallelising multiple tasks on a > single worker instance (on my blog) but I'm interested to know the stats > around what we can really push before we get choked. 4-8 seems too small. > > > Regards, > > > > *Steven Nagy > *Readify | Senior Developer > > M: +61 404 044 513 | E: steven.n...@readify.net | B: azure.snagy.name > ------------------------------ > *From:* ozazure-boun...@lists.codify.com [ozazure-boun...@lists.codify.com] > On Behalf Of Philip Richardson [phi...@philiprichardson.org] > *Sent:* Tuesday, 3 November 2009 10:40 AM > *To:* ozAzure > *Subject:* Re: blob to blob copy > > Yeah - I'd spin up some Workers in US South Central and have them read > your US North West blobs and write to a new South Central store account. > > Remember you can have two works in prod and two workers in staging. So > that gives you four workers and each one should be able to do 4-8 threads > easily for the download/upload work. > > Use a Windows Azure queue to distribute the work between the workers (ie. > Load the URIs of all the blobs into the queue and then each thread in each > worker picks items off the queue to do the work). > > Phil > > On Mon, Nov 2, 2009 at 4:20 PM, John OBrien <j...@soulsolutions.com.au>wrote: > >> Hey guys, has anyone written/seen/know how to do a direct blob to blob >> copy? >> >> >> >> I need to migrate thousands of little images from the closing NW >> datacentre to the other datacentre and uploading from Australia took well >> over 12 hours initially with my upload client failing 3-4 times. I’m >> thinking a little worker process hosted in azure should be the fastest hey? >> >> >> >> I did have plans for a little process where i could upload them as a >> single zip file then decompress into azure but never had time to built it. >> >> >> >> John. >> >> _______________________________________________ >> ozazure mailing list >> ozazure@lists.codify.com >> http://prdlxvm0001.codify.net/mailman/listinfo/ozazure >> >> > > _______________________________________________ > ozazure mailing list > ozazure@lists.codify.com > http://prdlxvm0001.codify.net/mailman/listinfo/ozazure > >
_______________________________________________ ozazure mailing list ozazure@lists.codify.com http://prdlxvm0001.codify.net/mailman/listinfo/ozazure
