I'd like to propose adding the Jenkins Pipeline plugin as a way to help reduce load through number of jobs [1]. If we were to take jobs that spawn multiple jobs such as test_katello that does 4 different test sets each spawning a separate job and use the Pipeline plugin this could be reduced to a single job with multiple stages. These could either be parallelized to keep the current view of all pieces that break or do a true serialized pipeline with the fail fast jobs early to keep the test jobs as short as possible and eating as few slots as possible.
[1] https://wiki.jenkins-ci.org/display/JENKINS/Pipeline+Plugin On Tue, Aug 30, 2016 at 2:49 AM, Dominic Cleal <[email protected]> wrote: > On 29/08/16 17:13, Justin Sherrill wrote: > > On 08/16/2016 06:56 AM, Dominic Cleal wrote: > >> There are a few Jenkins slaves I've seen this morning that have stopped > >> responding during jobs, causing IOExceptions and remote channel failure > >> messages. > >> > >> I've taken a few of them offline so these should stop occurring. Jenkins > >> capacity will be much reduced until I can figure out why the hosts are > >> freezing. > >> > > Out of curiosity were these ever put back into use? Recently I have > > felt like jobs have been taking a lot longer and jenkins has gotten > > overloaded more frequently. It seemed to happen after this event. > > They were put back online with reduced slot counts (2 instead of 4) > which so far seems to have stopped them locking up. I intend to try 3 > slots at some point this week. > > -- > Dominic Cleal > [email protected] > > -- > You received this message because you are subscribed to the Google Groups > "foreman-dev" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- Eric D. Helms Red Hat Engineering Ph.D. Student - North Carolina State University -- You received this message because you are subscribed to the Google Groups "foreman-dev" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
