[
https://issues.apache.org/jira/browse/JCR-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12895216#action_12895216
]
Jukka Zitting commented on JCR-2695:
------------------------------------
Currently the jcr-benchmark suite currently uses the commons-math class
SummaryStatistics which doesn't do percentiles, but it should be pretty
straightforward to switch to using DescriptiveStatistics instead. The above
plots show the mean value and standard deviations. But switching to something
like the median plus 10th and 90th percentiles might give a more accurate
picture. Alternatively we could just do a scatter plot of the entire data set.
About the 2.x figures, the increase in session startup times is probably due to
the extra JCR 2.0 features (access control?) we're starting up. Note that the
performance drop starts already in 1.6 where we started introducing new JCR 2.0
features. In any case starting up a single session still takes only about 0.1ms
on my computer, which seems OK to me.
The switch to using the FileDataStore by default in Jackrabbit 2.0 seems to
explain the changes in file handling performance. We're pretty good with both
reading and writing large files, but the handling of smaller files suffers
somewhat from the way the FileDataStore uses intermediate directories. Perhaps
we should consider putting all smaller binaries inside one big file instead.
> Jackrabbit performance test suite
> ---------------------------------
>
> Key: JCR-2695
> URL: https://issues.apache.org/jira/browse/JCR-2695
> Project: Jackrabbit Content Repository
> Issue Type: Improvement
> Components: jackrabbit-core
> Reporter: Jukka Zitting
> Assignee: Jukka Zitting
> Fix For: 2.2.0
>
> Attachments: bigread.png, bigwrite.png, login.png, logout.png,
> smallread.png, smallwrite.png
>
>
> I'd like to set up a multi-version performance test suite inside
> jackrabbit-core/src/test/performance, similar to the compatibility test suite
> we added in JCR-2631. This performance test suite would produce comparable
> performance numbers for a number of simple benchmark tests across different
> Jackrabbit versions, including the latest snapshot.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
