[ 
https://issues.apache.org/jira/browse/OAK-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282701#comment-15282701
 ] 

angela commented on OAK-4364:
-----------------------------

Revision 1743674 initial setup within oak-run that allows to write benchmarks 
for _oak-auth-external_. The change introduces a separate package 
{{authentication.external}} as the amount of benchmarks keeps growing and find 
it hard to spot the right test i am looking for. that package contains:

h6. {{AbstractExternalTest}}
- creating the JCR repository with a whiteboard that has the relevant pieces 
from _oak-auth-external_ registered
- setting up a test-IDP that "knows" the configured amount of users and groups 
({{numberofUsers}}, {{numberofGroups}}, the latter effectively defines the 
membershipSize of each user)
- setting a default syncConfig; NOTE: currently on the {{expirationTime}} is 
picked from the benchmark options
- abstract method {{createConfiguration}} that allows specific the desired JAAS 
configuration

h6. {{ExternalLoginTest}}
- based on {{AbstractExternalTest}}
- JAAS config with {{LoginModuleImpl}} and {{ExternalLoginModule}}
- performs {{RepositoryLogin}} with random users known to the IDP

h6. {{SyncAllExternalUsersTest}}
- based on {{AbstractExternalTest}}
- performs {{SynchronizationMBean#syncAllExternalUsers()}}

h6. {{SyncExternalUsersTest}}
- based on {{AbstractExternalTest}}
- performs {{SynchronizationMBean#syncExternalUsers(String[])}} for random 
users known to the IDP
- configuration option {{batchSize}} allows to specify the size of the String[] 
array

[~baedke], [~reschke], [~tripod], maybe you want to take a look at that initial 
setup in order to help me verifying that the benchmarks based on 
{{AbstractExternalTest}} could actually be used to produce reliable information 
for _oak-auth-external_. So far I didn't invest a lot of time running the 
benchmarks and looking at the numbers. It might well be that they are not yet 
very sensible as my initial goal was to have _something_ that we can tweak 
according to our needs.
Feedback and review very welcome! 


> Initial Benchmarks for oak-auth-external
> ----------------------------------------
>
>                 Key: OAK-4364
>                 URL: https://issues.apache.org/jira/browse/OAK-4364
>             Project: Jackrabbit Oak
>          Issue Type: Task
>          Components: auth-external, run
>            Reporter: angela
>            Assignee: angela
>
> in order to properly measure performance improvements we should have 
> benchmarks for oak-auth-external module



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to