On Thu, Mar 25, 2010 at 10:39:47PM -0700, Rohan Roy wrote: > Currently, a queue which consists of pget jobs and mirror jobs will wait for > each job to finish before starting the next item in the queue. When one > pgets a file in n segments, the next item in the queue won't start until the > pget job is finished. The problem is this: say I pget a job in n segments, > but n-1 segments finish early leaving behind 1 "chunk," which transfers > SUPER slowly, I'd like to start the next item in the queue to speed up > transfer, since the server is far away, I speed up transfers by executing > multiple simultaneous transfers.
Just start all the transfers in parallel and limit maximum number of simultaneous connections: set net:connection-limit N -- Alexander.
