bryancall opened a new pull request, #474:
URL: https://github.com/apache/trafficserver-ci/pull/474

   Branch build children fetch every branch from the CI mirror 
(`+refs/heads/*`) at depth 1000. Measured on the controller, one of those 
fetches is a 165 MB pack and uses about 570 MB of git memory on the server. A 
branch build starts about 30 children at once on an 8 GB controller, so it runs 
out of memory. Jenkins was killed three times during one master branch build on 
Oct 14.
   
   This changes the branch pipelines to fetch only 
`refs/heads/${GITHUB_BRANCH}`, with `honorRefspec: true` so the initial clone 
uses the same refspec, the way the PR pipelines already do. For master that is 
a 37 MB pack and about 306 MB on the server, and it serves in about 4 s instead 
of 15 s. Children still check out the SHA that `branch_build` resolved, which 
is on that branch within the existing depth of 1000. One trade-off: a manually 
requested `SHA1` now has to be on the branch being built, where before a commit 
from any branch worked.
   
   Tested by running the same fetch Jenkins will run against the mirror 
(`--depth=1000` with the master-only refspec): a 37 MB pack with only 
`origin/master`, and the SHA from rat #1422 checked out cleanly. Not yet 
exercised in a Jenkins run.
   
   Part of 
[apache/trafficserver#13839](https://github.com/apache/trafficserver/issues/13839).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to