Owen Nichols created GEODE-8230:
-----------------------------------

             Summary: cut pipeline time from 10hrs to 5hrs by running 
benchmarks in parallel with other tests
                 Key: GEODE-8230
                 URL: https://issues.apache.org/jira/browse/GEODE-8230
             Project: Geode
          Issue Type: Improvement
          Components: ci
            Reporter: Owen Nichols


currently, we run Build, then all <x>Test jobs in parallel (which takes ~5 
hours), then all Benchmark<x> jobs (which takes ~5 hours).

Presumably the benchmarks were run after all tests, on the premise that 
benchmarks are meaningless if the code is not correct.  However, required PR 
checks now prevent incorrect code from getting into develop in the first place, 
and the remaining occasional failures are flaky, so it's rather arbitrary to 
gate benchmarks on a lottery.

However, faster feedback has clear benefits, and cutting our CI pipeline from 
10 hours to 5 hours seems like low-hanging fruit.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to