On Thu, Mar 23, 2017 at 3:17 PM Greg Sheremeta <[email protected]> wrote:
> +1, any plans to get this into CI and perhaps using statistics (standard > deviation) to give us warnings? > > Still didn't work the details of producing reports from that. There is a jenkins-jmh plugin that can help https://github.com/blackboard/jmh-jenkins . If anyone has experience with something similar I'd be happy to hear about it. I still want to build something like BrowserLab [4], and I'm currently > working on > selenium + phantomjs in OST. > I'm very interested in this work. Thanks. > > Greg > > [4] > https://code.facebook.com/posts/1368798036482517/browserlab-automated-regression-detection-for-the-web/ > > On Thu, Mar 23, 2017 at 6:40 AM, Eldad Marciano <[email protected]> > wrote: > > very cool! > In terms of scale that sounds great for unit test | benchmarks, > assume we have some loaded DB. we can create some benchmarks for launching > vms for example, what do you think will be the challenge ? > > On Thu, Mar 23, 2017 at 12:25 PM Martin Sivak <[email protected]> wrote: > > Hi, > > I am just wondering whether you tried Roman's Hystrix integration to > see what command was so slow? > > Martin > > On Thu, Mar 23, 2017 at 11:05 AM, Roy Golan <[email protected]> wrote: > > Lately we came across an interesting case where multi-host+mult-networks > > resulted editing a host to conclude in minutes. One assumption that was > > raised which we wanted to eliminate was that the decryption we perform > on a > > fence agent password might be taking too long. > > > > So these days it's an easy task thanks to JMH[1], supplied by the jdk > > itself. I kickstarted [2] and added a 'DecryptionBenchmark', see the > output > > as an example[3] > > > > Although The JMH project recommends to create a separate project I find > it > > would be less trivial to people to contribute benchmarks let alone just > > playing around with current code they want to test. > > > > - So, (when it will be merged) you add your benchmark under > > backend/manager/modules/benchmarks/MyBenchmark.java > > > > - run it from intellij using the jmh plugin exactly like a unit-test > > OR > > - mvn test -P benchmarks -pl org.ovirt.engine:benchmarks > > OR > > - java -jar benchmarks.jar > > > > I hope this would serve all of us well, please review and add your > > benchmarks. > > > > PS - this will not run in the CI atm. > > > > [1] http://openjdk.java.net/projects/code-tools/jmh/ > > [2] https://gerrit.ovirt.org/74537 microbenchmarks: Introduce > > microbenchmarks using JMH > > [3] DecryptionBenchmark output (short version): > > > > # Run complete. Total time: 00:09:06 > > > > Benchmark Mode Samples Score Score error > > Units > > b.DecryptionBenchmark.decryption thrpt 50 101.258 1.270 > > ops/s > > b.DecryptionBenchmark.encryption thrpt 50 238.587 4.667 > > ops/s > > b.DecryptionBenchmark.decryption avgt 50 0.010 0.000 > > s/op > > b.DecryptionBenchmark.encryption avgt 50 0.004 0.000 > > s/op > > b.DecryptionBenchmark.decryption sample 5544 0.010 0.000 > > s/op > > b.DecryptionBenchmark.encryption sample 13067 0.004 0.000 > > s/op > > b.DecryptionBenchmark.decryption ss 50 0.014 0.001 > > s > > b.DecryptionBenchmark.encryption ss 50 0.009 0.001 > > s > > > > Process finished with exit code 0 > > > > > > _______________________________________________ > > Devel mailing list > > [email protected] > > http://lists.ovirt.org/mailman/listinfo/devel > _______________________________________________ > Devel mailing list > [email protected] > http://lists.ovirt.org/mailman/listinfo/devel > > > _______________________________________________ > Devel mailing list > [email protected] > http://lists.ovirt.org/mailman/listinfo/devel > > > > > -- > Greg Sheremeta, MBA > Red Hat, Inc. > Sr. Software Engineer > [email protected] >
_______________________________________________ Devel mailing list [email protected] http://lists.ovirt.org/mailman/listinfo/devel
