https://bz.apache.org/bugzilla/show_bug.cgi?id=58786

--- Comment #16 from Philippe Mouawad <[email protected]> ---
Hi Felix,
I made further tests:
1/ I don't see what you notice
2/ I was wrong in my previous approach as my machine was overloaded at 50
threads so results were meaningless


I made a new set of tests:
5 threads
DBCP2:
Generate Summary Results =  50000 in 00:00:02 = 22212.4/s Avg:     0 Min:     0
Max:    50 Err:     0 (0.00%)
Generate Summary Results =  50000 in 00:00:02 = 22341.4/s Avg:     0 Min:     0
Max:    45 Err:     0 (0.00%)
Generate Summary Results =  50000 in 00:00:02 = 22431.6/s Avg:     0 Min:     0
Max:    45 Err:     0 (0.00%)


Excalibur:
Generate Summary Results =  50000 in 00:00:02 = 22716.9/s Avg:     0 Min:     0
Max:     9 Err:     0 (0.00%)
Generate Summary Results =  50000 in 00:00:02 = 22779.0/s Avg:     0 Min:     0
Max:    10 Err:     0 (0.00%)
Generate Summary Results =  50000 in 00:00:02 = 22573.4/s Avg:     0 Min:     0
Max:     9 Err:     0 (0.00%)

Tomcat JDBC:
Generate Summary Results =  50000 in 00:00:02 = 23946.4/s Avg:     0 Min:     0
Max:     1 Err:     0 (0.00%)
Generate Summary Results =  50000 in 00:00:02 = 24108.0/s Avg:     0 Min:     0
Max:     1 Err:     0 (0.00%)
Generate Summary Results =  50000 in 00:00:02 = 24084.8/s Avg:     0 Min:     0
Max:     1 Err:     0 (0.00%)




10 Threads:
Excalibur
Please use CMSClassUnloadingEnabled in place of CMSPermGenSweepingEnabled in
the future
Writing log file to:/data/decathlon/workspace/jmeter/bin/jmeter.log
Generate Summary Results +      1 in 00:00:00 =    5.0/s Avg:    65 Min:    65
Max:    65 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 29841.5/s Avg:     0 Min:     0
Max:   105 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:04 = 28161.1/s Avg:     0 Min:     0
Max:   105 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 34916.2/s Avg:     0 Min:     0
Max:    10 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 35112.4/s Avg:     0 Min:     0
Max:    10 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    9.2/s Avg:     1 Min:     1
Max:     1 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 36179.1/s Avg:     0 Min:     0
Max:     9 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 34794.7/s Avg:     0 Min:     0
Max:     9 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    9.3/s Avg:     0 Min:     0
Max:     0 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 36562.7/s Avg:     0 Min:     0
Max:    11 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 35161.7/s Avg:     0 Min:     0
Max:    11 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 35174.1/s Avg:     0 Min:     0
Max:     9 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    9.5/s Avg:     0 Min:     0
Max:     0 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 36429.5/s Avg:     0 Min:     0
Max:    11 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 35087.7/s Avg:     0 Min:     0
Max:    11 Err:     0 (0.00%)



Tomcat jdbc:
Please use CMSClassUnloadingEnabled in place of CMSPermGenSweepingEnabled in
the future
Writing log file to:/data/decathlon/workspace/jmeter/bin/jmeter.log
Generate Summary Results +  40486 in 00:00:02 = 20826.1/s Avg:     0 Min:     0
Max:    79 Err:     0 (0.00%) Active: 10 Started: 10 Finished: 0
Generate Summary Results +  59514 in 00:00:01 = 43728.1/s Avg:     0 Min:     0
Max:     5 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 30257.2/s Avg:     0 Min:     0
Max:    79 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 36589.8/s Avg:     0 Min:     0
Max:     2 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 37050.8/s Avg:     0 Min:     0
Max:     3 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    8.8/s Avg:     1 Min:     1
Max:     1 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 38008.0/s Avg:     0 Min:     0
Max:     8 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 36429.9/s Avg:     0 Min:     0
Max:     8 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 37119.5/s Avg:     0 Min:     0
Max:     2 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    9.0/s Avg:     1 Min:     1
Max:     1 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 38925.3/s Avg:     0 Min:     0
Max:     6 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 37313.4/s Avg:     0 Min:     0
Max:     6 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 36954.9/s Avg:     0 Min:     0
Max:     2 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 36859.6/s Avg:     0 Min:     0
Max:     2 Err:     0 (0.00%)


DBCP2:
Please use CMSClassUnloadingEnabled in place of CMSPermGenSweepingEnabled in
the future
Writing log file to:/data/decathlon/workspace/jmeter/bin/jmeter.log
Generate Summary Results = 100000 in 00:00:04 = 26246.7/s Avg:     0 Min:     0
Max:   312 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 33233.6/s Avg:     0 Min:     0
Max:   210 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 33670.0/s Avg:     0 Min:     0
Max:   172 Err:     0 (0.00%)
Generate Summary Results +  99877 in 00:00:03 = 33403.7/s Avg:     0 Min:     0
Max:   162 Err:     0 (0.00%) Active: 1 Started: 10 Finished: 9
Generate Summary Results +    123 in 00:00:00 = 8200.0/s Avg:     0 Min:     0
Max:     1 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 33266.8/s Avg:     0 Min:     0
Max:   162 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.2/s Avg:   170 Min:   170
Max:   170 Err:     0 (0.00%) Active: 2 Started: 2 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 38520.4/s Avg:     0 Min:     0
Max:    69 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 34411.6/s Avg:     0 Min:     0
Max:   170 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 34387.9/s Avg:     0 Min:     0
Max:   158 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.3/s Avg:   157 Min:   157
Max:   157 Err:     0 (0.00%) Active: 2 Started: 2 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 37864.1/s Avg:     0 Min:     0
Max:    55 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 34002.0/s Avg:     0 Min:     0
Max:   157 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.4/s Avg:   160 Min:   160
Max:   160 Err:     0 (0.00%) Active: 2 Started: 2 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 36576.1/s Avg:     0 Min:     0
Max:    59 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 33025.1/s Avg:     0 Min:     0
Max:   160 Err:     0 (0.00%)

HikariCP:
Generate Summary Results = 100000 in 00:00:04 = 26617.0/s Avg:     0 Min:     0
Max:   320 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 33079.7/s Avg:     0 Min:     0
Max:   176 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 33806.6/s Avg:     0 Min:     0
Max:   174 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 34223.1/s Avg:     0 Min:     0
Max:   162 Err:     0 (0.00%)
Generate Summary Results +  95982 in 00:00:03 = 35430.8/s Avg:     0 Min:     0
Max:   161 Err:     0 (0.00%) Active: 4 Started: 10 Finished: 6
Generate Summary Results +   4018 in 00:00:00 = 18775.7/s Avg:     0 Min:     0
Max:     1 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 34211.4/s Avg:     0 Min:     0
Max:   161 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.4/s Avg:   160 Min:   160
Max:   160 Err:     0 (0.00%) Active: 2 Started: 2 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 37849.7/s Avg:     0 Min:     0
Max:    61 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 34059.9/s Avg:     0 Min:     0
Max:   160 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.4/s Avg:   161 Min:   161
Max:   161 Err:     0 (0.00%) Active: 2 Started: 2 Finished: 0
Generate Summary Results +  99999 in 00:00:03 = 37749.7/s Avg:     0 Min:     0
Max:    61 Err:     0 (0.00%) Active: 0 Started: 10 Finished: 10
Generate Summary Results = 100000 in 00:00:03 = 33955.9/s Avg:     0 Min:     0
Max:   161 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 33978.9/s Avg:     0 Min:     0
Max:   156 Err:     0 (0.00%)
Generate Summary Results = 100000 in 00:00:03 = 33602.2/s Avg:     0 Min:     0
Max:   158 Err:     0 (0.00%)


20 Threads:
Excalibur
Generate Summary Results = 200000 in 00:00:05 = 39223.4/s Avg:     0 Min:     0
Max:   197 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 42176.3/s Avg:     0 Min:     0
Max:   126 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40225.3/s Avg:     0 Min:     0
Max:   125 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40858.0/s Avg:     0 Min:     0
Max:   127 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 41042.5/s Avg:     0 Min:     0
Max:   126 Err:     0 (0.00%)
Generate Summary Results +  64952 in 00:00:02 = 35319.2/s Avg:     0 Min:     0
Max:   126 Err:     0 (0.00%) Active: 20 Started: 20 Finished: 0
Generate Summary Results + 135048 in 00:00:03 = 45302.9/s Avg:     0 Min:     0
Max:   145 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 41493.8/s Avg:     0 Min:     0
Max:   145 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 41382.2/s Avg:     0 Min:     0
Max:   126 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 41849.8/s Avg:     0 Min:     0
Max:   140 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40891.4/s Avg:     0 Min:     0
Max:   130 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40783.0/s Avg:     0 Min:     0
Max:   125 Err:     0 (0.00%)


Tomcat jdbc:
Generate Summary Results + 177333 in 00:00:04 = 45798.8/s Avg:     0 Min:     0
Max:   131 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 43177.9/s Avg:     0 Min:     0
Max:   131 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 43994.7/s Avg:     0 Min:     0
Max:   127 Err:     0 (0.00%)
Generate Summary Results + 113334 in 00:00:03 = 44288.4/s Avg:     0 Min:     0
Max:   126 Err:     0 (0.00%) Active: 20 Started: 20 Finished: 0
Generate Summary Results +  86666 in 00:00:02 = 47828.9/s Avg:     0 Min:     0
Max:   125 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:04 = 45756.1/s Avg:     0 Min:     0
Max:   126 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    8.9/s Avg:     1 Min:     1
Max:     1 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results + 199999 in 00:00:04 = 46082.7/s Avg:     0 Min:     0
Max:   245 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:04 = 44923.6/s Avg:     0 Min:     0
Max:   245 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:04 = 45987.6/s Avg:     0 Min:     0
Max:   156 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    9.7/s Avg:     1 Min:     1
Max:     1 Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
Generate Summary Results + 199999 in 00:00:04 = 46739.7/s Avg:     0 Min:     0
Max:   125 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:04 = 45630.8/s Avg:     0 Min:     0
Max:   125 Err:     0 (0.00%)


DBCP2:
Generate Summary Results = 200000 in 00:00:05 = 39062.5/s Avg:     0 Min:     0
Max:   173 Err:     0 (0.00%)
Generate Summary Results +  89785 in 00:00:02 = 37582.7/s Avg:     0 Min:     0
Max:   159 Err:     0 (0.00%) Active: 20 Started: 20 Finished: 0
Generate Summary Results + 110215 in 00:00:03 = 42768.7/s Avg:     0 Min:     0
Max:   128 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 40273.9/s Avg:     0 Min:     0
Max:   159 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.8/s Avg:   154 Min:   154
Max:   154 Err:     0 (0.00%) Active: 4 Started: 4 Finished: 0
Generate Summary Results + 199999 in 00:00:05 = 42462.6/s Avg:     0 Min:     0
Max:   207 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 40225.3/s Avg:     0 Min:     0
Max:   207 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40625.6/s Avg:     0 Min:     0
Max:   164 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 39666.8/s Avg:     0 Min:     0
Max:   160 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40379.6/s Avg:     0 Min:     0
Max:   161 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40184.9/s Avg:     0 Min:     0
Max:   158 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40176.8/s Avg:     0 Min:     0
Max:   159 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.6/s Avg:   159 Min:   159
Max:   159 Err:     0 (0.00%) Active: 4 Started: 4 Finished: 0
Generate Summary Results + 199999 in 00:00:05 = 42899.8/s Avg:     0 Min:     0
Max:   131 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 40502.2/s Avg:     0 Min:     0
Max:   159 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40404.0/s Avg:     0 Min:     0
Max:   165 Err:     0 (0.00%)

HikariCP:
Generate Summary Results + 198611 in 00:00:05 = 40278.0/s Avg:     0 Min:     0
Max:   167 Err:     0 (0.00%) Active: 2 Started: 20 Finished: 18
Generate Summary Results +   1389 in 00:00:00 = 15433.3/s Avg:     0 Min:     0
Max:     1 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 39832.7/s Avg:     0 Min:     0
Max:   167 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.6/s Avg:   170 Min:   170
Max:   170 Err:     0 (0.00%) Active: 4 Started: 4 Finished: 0
Generate Summary Results + 199999 in 00:00:05 = 42982.8/s Avg:     0 Min:     0
Max:   141 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 40535.1/s Avg:     0 Min:     0
Max:   170 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 40461.3/s Avg:     0 Min:     0
Max:   162 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 39904.2/s Avg:     0 Min:     0
Max:   164 Err:     0 (0.00%)
Generate Summary Results + 190298 in 00:00:05 = 39869.7/s Avg:     0 Min:     0
Max:   159 Err:     0 (0.00%) Active: 9 Started: 20 Finished: 11
Generate Summary Results +   9702 in 00:00:00 = 23434.8/s Avg:     0 Min:     0
Max:    26 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 38550.5/s Avg:     0 Min:     0
Max:   159 Err:     0 (0.00%)
Generate Summary Results +      1 in 00:00:00 =    3.7/s Avg:   163 Min:   163
Max:   163 Err:     0 (0.00%) Active: 4 Started: 4 Finished: 0
Generate Summary Results + 199999 in 00:00:05 = 40766.2/s Avg:     0 Min:     0
Max:   150 Err:     0 (0.00%) Active: 0 Started: 20 Finished: 20
Generate Summary Results = 200000 in 00:00:05 = 38639.9/s Avg:     0 Min:     0
Max:   163 Err:     0 (0.00%)
Generate Summary Results = 200000 in 00:00:05 = 38956.0/s Avg:     0 Min:     0
Max:   152 Err:     0 (0.00%)

-- 
You are receiving this mail because:
You are the assignee for the bug.

Reply via email to