Sean, suggested I bring this up on the dev mailing list: Hi gentlemen, Can we create a subproject for avro with standard benchmarks with JMH? Jmh, is a good benchmarking framework that mitigates some of the common benchmarking pitfalls (http://openjdk.java.net/projects/code-tools/jmh/ <http://openjdk.java.net/projects/code-tools/jmh/>) these benchmarks results, can then be reported on (trends, detail..) jenkins with https://github.com/blackboard/jmh-jenkins <https://github.com/blackboard/jmh-jenkins> Here is how I do it in a project that I maintain: https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks <https://code.google.com/p/spf4j/source/browse/#svn%2Ftrunk%2Fspf4j-benchmarks> I also publish the results to the project site: http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html <http://zolyfarkas.github.io/spf4j/spf4j-benchmarks/index.html> In my case I also collect profiling information during benchmarking, which allows be to have the data ready when I see a performance degradation. (I also publish them to the project site, both spf4j stack sample data and java flight recorder data) I use this approach and it is really really useful. let me know what you think, cheers
—Z
