Current issues using Olio

Thu, 15 Jan 2009 22:59:35 -0800 

Hello,

I was able to run the Olio benchmark successfully, but there are still
some unresolved issues that prevent to collect results.

1) Loading the database for 100 users takes aprox. 20 minutes. I
measured this time by observing the logs. I also tried to run the
dbloader.sh script manually, but it takes the same amount of time. Is
this a acceptable time for such operation? Is there a possibility of
some misconfiguration in the database?

2) I'm unable to pass the pass/fail result status, for a variety of
concurrent users: 25, 50, 100, 500. Some miscellaneous statistics
always fail, especially those related to images.
Average images references on Home Page  9.10    10      0.5     
            FAILED
Average images loaded per Home Page     3.27    >= 3            
        PASSED
Average image bytes received per Home Page      8108.02 >= 15000                
FAILED
Average images on Tag Search Results    3.22    >= 7            
         FAILED
Average images on Event Detail  0.92    >= 1            
           FAILED

Especially, "Average images on Tag Search Results" always fails.

My system comprises of two servers:

System1:
Ubuntu Server 7.10
JVM 1.6.0_11
Runs: (1) Faban master; (2) Geocoder

System2:
Xen VM: entire image resides on a NFS share.
Debian Etch
JVM 1.6.0_11
Runs: (1) PHP web app; (2) MySQL 5.0.32; (2) file store (on NFS).
The host machine is quite powerful, a Quad-core Xeon with 4GB of
memory. Network is Gigabit Ethernet.

Could someone please provide me some advice on which kind of
performance tuning could enhance my results? A full report for 100
concurrent users is attached.

Best regards,

William
Title: Web20Bench 0.4 Summary Report

Web20Bench 0.4
Summary Report


Web20Bench metric: 20.193 ops/sec
Benchmark Start:Fri Jan 16 17:11:35 EST 2009
Benchmark End:Fri Jan 16 17:17:35 EST 2009
Run ID:Web20Driver.3C
Pass/Fail:FAILED
Active Drivers:UIDriver

UIDriver


UIDriver metric:20.193 ops/sec
Driver start:Fri Jan 16 17:11:35 EST 2009
Driver end:Fri Jan 16 17:17:35 EST 2009
Total number of operations: 6058
Pass/Fail:FAILED

Operation Mix

TypeSuccess
Count		Failure
Count		MixRequired Mix
(2% deviation allowed)		Pass/Fail
HomePage1593026.3%26.15%PASSED
Login621010.25%10.22%PASSED
TagSearch1978032.65%33.45%PASSED
EventDetail1535025.34%24.68%PASSED
PersonDetail15102.49%2.61%PASSED
AddPerson580.96%.84%PASSED
AddEvent12202.01%2.04%PASSED

Response Times (seconds)

TypeAvgMax90th%Reqd. 90th%Pass/Fail
HomePage0.0160.7370.0201.000PASSED
Login0.0220.8100.0401.000PASSED
TagSearch0.0200.8440.0402.000PASSED
EventDetail0.0231.0040.0202.000PASSED
PersonDetail0.0460.6610.1002.000PASSED
AddPerson0.2490.7930.3603.000PASSED
AddEvent0.0290.5570.0404.000PASSED

Cycle/Think Times (seconds)

TypeTargeted AvgActual AvgMinMaxPass/Fail
HomePage4.8914.8860.00025.189PASSED
Login4.9094.9080.00025.003PASSED
TagSearch4.7274.7230.00025.011PASSED
EventDetail4.8954.8890.00025.135PASSED
PersonDetail5.3525.3480.06022.921PASSED
AddPerson5.1245.1190.08020.726PASSED
AddEvent4.2994.2950.02624.997PASSED

Miscellaneous Statistics

DescriptionResultsTargeted
Results		Allowed
Deviation		Pass/Fail
% EventDetail views where attendee added8.21>= 6PASSED
EventDetail count where attendee can be added1204
Average images references on Home Page9.10100.5FAILED
Average images loaded per Home Page3.27>= 3PASSED
Average image bytes received per Home Page8108.02>= 15000FAILED
Average images on Tag Search Results3.22>= 7FAILED
Average images on Event Detail0.92>= 1FAILED
Total successful AddEvent calls140
Total successful AddPerson calls69

Little's Law Verification

Number of users=100
Sum of Avg. RT * TPS for all Tx Types=96.5430

Reply via email to