[
https://issues.apache.org/jira/browse/SLING-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357004#comment-14357004
]
ASF GitHub Bot commented on SLING-4494:
---------------------------------------
GitHub user vladbailescu opened a pull request:
https://github.com/apache/sling/pull/69
SLING-4494 - Performance: update performance test framework to allow
comparison of results
Performance testing features which allow us to not only log tests run time
but also compare them and fail in case a certain threshold ratio is surpassed.
Added:
- Annotations for reference method and performance threshold
- Deferred results logging to allow for comparison after all tests ran
- Analysis of performance against reference method and threshold enforcement
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vladbailescu/sling
SLING-4494_performance_framework_update
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/sling/pull/69.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #69
----
commit c065f663b5cbc46518972281939b231429180f19
Author: vladbailescu <baile...@adobe.com>
Date: 2015-03-11T15:04:02Z
@trivial Converted mixed tabs and spaces indentation to spaces
commit 7732f003aef962c21e66eb819190521e04cb7f06
Author: vladbailescu <baile...@adobe.com>
Date: 2015-03-11T15:16:43Z
SLING-4494 - Performance: update performance test framework to allow
comparison of results
Performance testing features which allow us to not only log tests run time
but also compare them and fail in case a certain threshold ratio is surpassed.
Added:
- Annotations for reference method and performance threshold
- Deferred results logging to allow for comparison after all tests ran
- Analysis of performance against reference method and threshold enforcement
----
> Performance: update performance test framework to allow comparison of results
> -----------------------------------------------------------------------------
>
> Key: SLING-4494
> URL: https://issues.apache.org/jira/browse/SLING-4494
> Project: Sling
> Issue Type: Test
> Reporter: Vlad Bailescu
> Priority: Minor
>
> Update the Sling performance test framework to allow comparison of test
> results. Specifically, add:
> - possibility to define a "reference test" and have the results of other
> tests compared to it
> - possibility to log results as a ratio compared to the "reference test"
> - possibility to define a maximum threshold and have the framework fail a
> test if it's ratio against the "reference test" exceeds this threshold
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
