On Wed, May 7, 2014 at 12:32 AM, Fæ <[email protected]> wrote: > The consequent estimates appear off here. In practice, I have run 5 > threads using GWT and the results were an average of 1 file per minute > (i.e. 5 files every 5 minutes). These were 50MB to 110MB sized files, > so waiting on the source website might add to delays.
In theory it shouldn't: the scheduling and the uploads are done by two different jobs. The scheduler job reschedules itself for 1 minute later as soon as it started, then adds (# of threads) new upload jobs. Those jobs taking long does not delay the scheduler at all. Of course, just because a job schedules itself to run in a minute, there is no guarantee it is actually picked in that timeframe, so this might just depend on how congested the job queue is. We'll have to try and see.
_______________________________________________ Glamtools mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/glamtools
