Folks,

Status update on recent intermittent VPP CI job failures (Jenkins Failure Cause noted in quotes):

  - "Could not resolve host" --> These DNS failures have been resolved by Peter Mikus adding the Nomad hosted consul DNS server to all nomad hosts and subsequently docker containers running CI jobs.

  - "Make Test Testcase Error or Failure" --> There was an intermittent VPP anomaly introduced last week with the change from shmem to socket transport for PAPI which causes the MAP unittests to fail [0].  The root cause is being addressed and should be fixed shortly.

  - "VPP-Device Robot Framework Testcase" --> There are intermittent vpp-device test failures that occur when many instances of the VPP device test jobs are run simultaneously.  This is a known issue with NIC firmware and has a ticket open with the vendor.

  - "Error cloning remote repo" --> intermittent error that occurs when a multiple CI jobs are triggered within a short period of time.  A VExxhost ticket has been opened to address this anomaly.

I am keeping a close watch on VPP gerrit changes with verification failures and have been issuing 'recheck' for those patches which failed due to any of the above reasons.

Prior to issuing a 'recheck' please check the Jenkins time of the most recent vpp-checkstyle-verify jobs [0].  If there was a checkstyle job run in the past 5 minutes, please wait a few more minutes before issuing the 'recheck'.


Thank you for your patience as these issues are addressed.
-daw-

[0] https://logs.fd.io/production/vex-yul-rot-jenkins-1/vpp-verify-master-ubuntu2004-x86_64/3177/ [1] https://jenkins.fd.io/view/vpp/job/vpp-checkstyle-verify-master-ubuntu2004-x86_64/
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#19049): https://lists.fd.io/g/vpp-dev/message/19049
Mute This Topic: https://lists.fd.io/mt/81704308/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to