https://bugzilla.wikimedia.org/show_bug.cgi?id=48025

Antoine "hashar" Musso <[email protected]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Priority|Normal                      |High

--- Comment #5 from Antoine "hashar" Musso <[email protected]> ---
There is another issue that have triggered a few time this week which is that
updating the job description is suddenly slow.

Ganglia shows a CPU at 100%, top -i then H shows a jenkins thread at 100%

Looking at the apache proxy that handles Jenkins access, one can monitor what
Zuul is doing with Jenkins:


 tail -f /var/log/apache2/integration_access.log|grep Python-urllib

It shows Zuul update the build descriptions with requests such as:

  POST /ci/job/mediawiki-core-qunit/3359/submitDescription  302
  GET /ci/job/mediawiki-core-qunit/3359/  200

They take from 3 to 12 seconds and even more sometime. That is the root cause
of slowness.


Whenever a build is started or emit a result, Zuul will update the description
of all the builds that have been triggered by that change.  So given a pipeline
of 10 jobs, that is potentially a lot of description update.  Zuul is also
locked waiting for Jenkins to answer which in turns make it very slow to
process events.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to