Existing benchmarks are in the Perf.java file: https://svn.apache.org/viewvc/avro/trunk/lang/java/ipc/src/test/java/org/apache/avro/io/Perf.java?view=markup
These are run with the incantation: ( cd lang/java/ipc/ ; mvn exec:java -Dexec.mainClass=org.apache.avro.io.Perf -Dexec.classpathScope="test" ) Converting these to JMH would be great. Doug On Mon, Nov 3, 2014 at 1:47 PM, Sean Busbey <[email protected]> wrote: > I don't think a subproject is needed; we should be able to do this as an > additional module in the Avro Java implementation. > > On Mon, Nov 3, 2014 at 3:17 PM, Zoltan Farkas <[email protected]> > wrote: > >> Sean, suggested I bring this up on the dev mailing list: >> >> Hi gentlemen, Can we create a subproject for avro with standard benchmarks >> with JMH? >> Jmh, is a good benchmarking framework that mitigates some of the common >> benchmarking pitfalls (http://openjdk.java.net/projects/code-tools/jmh/ < >> http://openjdk.java.net/projects/code-tools/jmh/>) >> these benchmarks results, can then be reported on (trends, detail..) >> jenkins with https://github.com/blackboard/jmh-jenkins < >> https://github.com/blackboard/jmh-jenkins> >> Here is how I do it in a project that I maintain: >> >> https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks >> < >> https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks >> > >> I also publish the results to the project site: >> http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html < >> http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html> >> In my case I also collect profiling information during benchmarking, which >> allows be to have the data ready when I see a performance degradation. (I >> also publish them to the project site, both spf4j stack sample data and >> java flight recorder data) >> I use this approach and it is really really useful. >> let me know what you think, cheers >> >> —Z > > > > > -- > Sean
