Hi all,
Here are a few test that were run on jUDDI v3 out-of-the-box (with
Derby) and on jUDDI v3+ MySQL.
TDeleteBusinessPT: test case that either publishes a business to the
jUDDI node or deletes one. When it publishes, it retains the returned
BusinessEntity object from the save_business operation in a data pool.
The data pool is in turn queried for a BusinessEntity when the test
deletes a business from the node. This adds some randomness to the
deletions and makes it so that the node doesn't have to be preloaded
with a finite amount of deletable data.
TFindBusinessPT: test case that either publishes a business to the jUDDI
node or finds one. When it publishes, it retains the returned
BusinessEntity object from the save_business operation in a data pool.
The data pool is in turn queried for a BusinessEntity when the test
searches for a business. This adds some randomness to the searches and
makes it so that the node doesn't have to be preloaded with data.
TRegisterBusinessPT: test case that simply publishes businesses to the
jUDDI node under a unique name (name contains a uuid).
All test were run at an arrival rate of 1000 transactions/hour and a
maximum of 10 users each.
jUDDI 3.0.0.beta out-of-the-box
Date Scenario Arrival Rate Users Scheduled Length Actual Length
Reason for test stopping Comments jUDDI Test Suite Report
2009.08.12 TDeleteBusinessPT 1000 10 00:45:00 00:45:01 End of
run Started with an empty DB. SNAPSHOT
<http://people.apache.org/repo/m2-snapshot-repository/org/apache/juddi/juddi-portal-bundle/3.0.0.SNAPSHOT/juddi-portal-bundle-3.0.0.20090723.201427-7.zip>
test suite
<http://xlt.xceptance.de/download/results/juddi/testsuites/20090812-juddiTestSuite.zip>
report <http://xlt.xceptance.de/download/results/juddi/20090812-124530/>
TFindBusinessPT 1000 10 00:45:00 00:45:01
End of run
TRegisterBusinessPT 1000 10 00:45:00 00:45:01
End of run
jUDDI 3.0.0.beta using mySQL as DB
Date Scenario Arrival Rate Users Scheduled Length Actual Length
Reason for test stopping Comments jUDDI Test Suite Report
2009.08.12 TDeleteBusinessPT 1000 10 00:45:00 00:45:01 End of
run Started with an empty DB. SNAPSHOT
<http://people.apache.org/repo/m2-snapshot-repository/org/apache/juddi/juddi-portal-bundle/3.0.0.SNAPSHOT/juddi-portal-bundle-3.0.0.20090723.201427-7.zip>
test suite
<http://xlt.xceptance.de/download/results/juddi/testsuites/20090812-juddiTestSuite.zip>
report <http://xlt.xceptance.de/download/results/juddi/20090812-134739/>
TFindBusinessPT 1000 10 00:45:00 00:45:01
End of run
TRegisterBusinessPT 1000 10 00:45:00 00:45:01
End of run
Another report that illustrates the differences between the two can be
found here.
<http://xlt.xceptance.de/download/results/juddi/20090812-124530-vs-20090812-134739/>
Finally, here is a trend report that shows the evolution of several test
runs (report
<http://xlt.xceptance.de/download/results/juddi/trendreport-20090812-164923/>).
Differences in performance, either from one run to the next (relative
trend) or in contrast to the first run (absolute trend), are clearly
shown in varying shades of green for an increase in speed or red for a
decrease. The runs below are included in this trend report:
*Date* *Scenario* *Arrival Rate* *Users* *Scheduled Length* *Actual
Length* *Reason for test stopping* *Comments* *jUDDI* *Test Suite*
*Report*
2009.08.12 TDeleteBusinessPT 5000 30 02:00:00 00:42:57 End of
run Started with an empty MySQL DB. SNAPSHOT
<http://people.apache.org/repo/m2-snapshot-repository/org/apache/juddi/juddi-portal-bundle/3.0.0.SNAPSHOT/juddi-portal-bundle-3.0.0.20090723.201427-7.zip>
test suite
<http://xlt.xceptance.de/download/results/juddi/testsuites/20090812-juddiTestSuite.zip>
report <http://xlt.xceptance.de/download/results/juddi/20090812-111817/>
TFindBusinessPT 30,000 100 02:00:00 00:42:57
End of run
TRegisterBusinessPT 5000 30 02:00:00 00:42:57
End of run
2009.08.12 TDeleteBusinessPT 1000 10 00:45:00 00:45:01 End of
run Started with an empty Derby DB. SNAPSHOT
<http://people.apache.org/repo/m2-snapshot-repository/org/apache/juddi/juddi-portal-bundle/3.0.0.SNAPSHOT/juddi-portal-bundle-3.0.0.20090723.201427-7.zip>
test suite
<http://xlt.xceptance.de/download/results/juddi/testsuites/20090812-juddiTestSuite.zip>
report <http://xlt.xceptance.de/download/results/juddi/20090812-124530/>
TFindBusinessPT 1000 10 00:45:00 00:45:01
End of run
TRegisterBusinessPT 1000 10 00:45:00 00:45:01
End of run
2009.08.12 TDeleteBusinessPT 1000 10 00:45:00 00:45:01 End of
run Started with an empty MySQL DB. SNAPSHOT
<http://people.apache.org/repo/m2-snapshot-repository/org/apache/juddi/juddi-portal-bundle/3.0.0.SNAPSHOT/juddi-portal-bundle-3.0.0.20090723.201427-7.zip>
test suite
<http://xlt.xceptance.de/download/results/juddi/testsuites/20090812-juddiTestSuite.zip>
report <http://xlt.xceptance.de/download/results/juddi/20090812-134739/>
TFindBusinessPT 1000 10 00:45:00 00:45:01
End of run
TRegisterBusinessPT 1000 10 00:45:00 00:45:01
End of run
2009.08.12 TDeleteBusinessPT 2000 10 00:45:00 00:45:01 End of
run Started with an empty MySQL DB. SNAPSHOT
<http://people.apache.org/repo/m2-snapshot-repository/org/apache/juddi/juddi-portal-bundle/3.0.0.SNAPSHOT/juddi-portal-bundle-3.0.0.20090723.201427-7.zip>
test suite
<http://xlt.xceptance.de/download/results/juddi/testsuites/20090812-juddiTestSuite.zip>
report <http://xlt.xceptance.de/download/results/juddi/20090812-164635/>
TFindBusinessPT 2000 10 00:45:00 00:45:01
End of run
TRegisterBusinessPT 2000 10 00:45:00 00:45:01
End of run
