Jira (PUP-7014) Audit CI.next pipelines to ensure all tests are being run / RCA the Windows passing runs that ran 1900 tests instead of 20000

[Glenn Sarti (JIRA)]

Title: Message Title

Glenn Sarti commented on PUP-7014   Re: Audit CI.next pipelines to ensure all tests are being run / RCA the Windows passing runs that ran 1900 tests instead of 20000 1. I can't RCA the issue of only running the 1900 tests as the logs for that job have been lost and it has not occurred since. 2. I've updated the Hiera and MCO job configs so they now output Test Results into Jenkins so at least the test count can be audited 3. The ci:test:quick behaviour is not documented anywhere that I could find. I trawled through the source code to find that. Note that the full set of acceptance tests is run, but as part of the puppet-agent acceptance suite, not part of puppet. This looks like it's just a smoke acceptance test run. I cannot see this quick code in any of our other pipelines 4. I have noticed that the MCO acceptance tests (https://jenkins-master-prod-1.delivery.puppetlabs.net/job/platform_marionette-collective_intn-van-sys_master/configure) doesn't actually run anything. echo "" echo "Running Tests:" echo "true" echo "" Add Comment   This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.