Addshore added a comment.

  Personally i dont think that more resources would go amiss, but It would be 
good to try and tie any increase in resources / specs to increased speed and 
stability of CI.
  
  I did a comparison of speed running the same tests on Github actions vs on 
current CI VMs for the same mediawiki core change and this is what I saw (last 
year).
  
  | **Stage**         | **Jenkins** | **Github Actions (no caching)** |
  | ----------------- | ----------- | ------------------------------- |
  | Initial startup?  | 48s         | 46s                             |
  | Fetch Code        | 47s         | 20m 1s                          |
  | Start Backends    | 10s         | 10s                             |
  | Install MediaWiki | 4s          | 2s                              |
  | Composer Install  | 32s         | 51s                             |
  | NPM Install       | 23s         | 19s                             |
  | Tests             | 23m 10s     | 16m 3s                          |
  |
  
  (more details at 
https://github.com/addshore/wmf-gha/tree/75c525f91a8f4b04692083701022bbf0d5ae0346)
  
  Fetch Code obviously goes faster on Jenkins, as this takes advantage of 
caching and being much closer to the machines with the code on them (gerrit / 
zuul).
  However the tests take 7 extra minuites on Jenkins, which is very roughly an 
extra 30% of runtime.
  
  I ran this again today, and generally speaking, every seems faster in jenkins 
land (comparable to github actions)
  
  | **Stage**               | **Jenkins** | **Github Actions (no caching)** |
  | ----------------------- | ----------- | ------------------------------- |
  | Initial startup         | 37s         | 1s                              |
  | Fetch Code              | 53s         | 22m 30s                         |
  | Composer Install        | 8s          | 6s                              |
  | Start Backends          | 4s          | 4s                              |
  | Post dependency install | 6s          | 3s                              |
  | Install MediaWiki       | 5s          | 7s                              |
  | NPM Install             | 4m 39s      | 4m 40s                          |
  | Tests                   | 6m 51s      | 7m 8s                           |
  |
  
  So maybe something already changed int he past year? :)

TASK DETAIL
  https://phabricator.wikimedia.org/T281122

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: thcipriani, Ladsgroup, nskaggs, kostajh, hashar, Tonina_Zhelyazkova_WMDE, 
Jakob_WMDE, Addshore, WMDE-leszek, Aklapper, santhosh, TheReadOnly, 
karapayneWMDE, Ramtin2021, Invadibot, dcaro, Devnull, Slst2020, GeminiAgaloos, 
maantietaja, Raymond_Ndibe, Nintendofan885, Akuckartz, Phamhi, Nandana, 
NebulousIris, JKSTNK, skpuneethumar, Fheredia, sietec, Zylc, 1978Gage2001, 
Lahi, Operator873, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, 
Allthingsgo, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, 
Liudvikas, Scott_WUaS, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, 
Jay8g, bd808, Krenair
_______________________________________________
Wikidata-bugs mailing list -- [email protected]
To unsubscribe send an email to [email protected]

Reply via email to