On 12/04/2010 04:51 AM, Jinze Xue wrote: > hello experts！ > I added 2000 build tasks to my koji build system with --nowait . > I have 4 builder host and I set sleeptime=300, maxjobs=50. > but the tasks assigned to builders is to fast , why it not be 300 seconds? > the new tasks assigned to builders and my children tasks of my old builds > can't assigned .(one build task need have 3 children tasks in general) > how to solve this problem? > thanks > can I set the maxjobs to 500? > how much jobs can a general computer bear?
This is indeed an overload situation. The scheduler is admittedly simplistic. Due to some user complaints about previous behavior, kojid will bypass sleeps when loading up on tasks. This is why your sleeptime of 300 does not slow this process down. Since maxjobs is not the only limiting factor, you can generally raise it without too much risk. It depends on your hardware. The build tasks have very low impact, however they are separate processes and there is some overhead. Another thing you can do is to use the free-task command to free up some of the top level build jobs that are clogging up your builders. Because the buildArch subtasks are higher priority, this should free up the logjam. In the future, I would avoid dumping so many builds so fast on a koji system while it is idle. When you have 2000 jobs to submit to an idle koji system, start with a reasonable subset (say 4x the number of builders), let those get underway, and then submit the rest. > I think , parallel prent tasks and children tasks is not smart , will there > any changes in the future? A smarter scheduler is on my to do list. However, I don't expect to drop "parallel parent and child tasks." -- buildsys mailing list [email protected] https://admin.fedoraproject.org/mailman/listinfo/buildsys
