Hello again, current project in the sandbox now can generate a JSR-303 annotated bean graph with groups, inheritance and complex constraints, so it can simulate realistic scenarios. Only big missing aspect would be arrays/iterables support, but IMHO it won't make a difference in test results.
Current tests check the performance of a jsr-303 impl on these operations: - Parsing beans. - Validating already parsed beans. - Combined parsing+validating speed. - Multi-threaded validation of parsed beans. To run the benchmark, simply execute: mvn test The bean generator procedure is configurable, there is a list of all the modifiable properties in generator.default.properties. You can modify them in the commandline as: mvn -Dgenerator.numBeans=5 -Dgenerator.inheritanceratio=0.2 -Dtester.numthreads=8 Tests should be reproducible, as the bean generation algorithm will return the same beans if executed with the same parameters. The results may vary between different versions of the generator though, so the If there is no opposition, during the weekend I will benchmark our 0.1 release against hibernate validator 4.1.0.CR1 and post the results in my blog. Regards, Carlos On Thu, Jun 17, 2010 at 5:35 PM, Carlos Vara <[email protected]> wrote: > Hi all, > > I have committed to the sandbox a simple project to evaluate the > performance of a jsr303 implementation. It's in a very initial status and > only benchmarks the parsing and validation of beans with basic properties > and nested beans. I intend to add groups/group sequences, nested constraints > and possibly inheritance to make it more exhaustive. > > Any opinion / review of the code is very welcomed. Also, I have little > experience on the best practices integrating a custom code generator in > maven, so any help with that part would be very appreciated. > > Regards, > Carlos >
