Hi all, I noticed in my tests with Jmeter 2.3 in a Windows XP machine with Java 1.6that the throughput of SOAP tests goes down by more than 50% after a few minutes and continues going down. I'm wondering if that's a sign of a problem such as memory leak in the tool or its libraries.
When I stop the test and then start it again, it starts from the last low-throughput number of the previous test, not from the original high number. But when I exit Jmeter and start it again, it starts from the high-throughput number and goes down again, the same pattern repeats. So it looks like that the problem is in Jmeter not in the server. Has anybody seen the same behavior? Any comment? Heres are some results: Jmeter running in a Windows XP machine using 5 threads, Java 1.6 ------------------ The current time is: 9:11:45.44 -------------------- Generate Summary Results + 7986 in 46.9s = 170.4/s Avg: 19 Min: 0 Max: 63 Err: 0 (0.00%) Generate Summary Results + 9589 in 60.0s = 159.8/s Avg: 20 Min: 0 Max: 251 Err: 0 (0.00%) Generate Summary Results = 17575 in 106.8s = 164.5/s Avg: 19 Min: 0 Max: 251 Err: 0 (0.00%) Generate Summary Results + 8964 in 60.0s = 149.3/s Avg: 20 Min: 0 Max: 313 Err: 0 (0.00%) Generate Summary Results = 26539 in 166.9s = 159.0/s Avg: 19 Min: 0 Max: 313 Err: 0 (0.00%) Generate Summary Results + 6101 in 60.0s = 101.7/s Avg: 20 Min: 0 Max: 157 Err: 0 (0.00%) Generate Summary Results = 32640 in 226.9s = 143.9/s Avg: 20 Min: 0 Max: 313 Err: 0 (0.00%) Generate Summary Results + 8407 in 60.0s = 140.1/s Avg: 19 Min: 0 Max: 126 Err: 0 (0.00%) Generate Summary Results = 41049 in 286.8s = 143.1/s Avg: 19 Min: 0 Max: 313 Err: 0 (0.00%) Generate Summary Results + 5165 in 59.8s = 86.4/s Avg: 22 Min: 0 Max: 672 Err: 0 (0.00%) Generate Summary Results = 46214 in 346.6s = 133.3/s Avg: 20 Min: 0 Max: 672 Err: 0 (0.00%) Generate Summary Results + 1792 in 60.3s = 29.7/s Avg: 52 Min: 0 Max: 657 Err: 0 (0.00%) Generate Summary Results = 48006 in 406.9s = 118.0/s Avg: 21 Min: 0 Max: 672 Err: 0 (0.00%) Generate Summary Results + 1655 in 60.2s = 27.5/s Avg: 53 Min: 0 Max: 876 Err: 0 (0.00%) Generate Summary Results = 49661 in 466.9s = 106.4/s Avg: 22 Min: 0 Max: 876 Err: 0 (0.00%) Generate Summary Results + 1675 in 60.1s = 27.8/s Avg: 50 Min: 0 Max: 1469 Err: 0 (0.00%) Generate Summary Results = 51336 in 526.8s = 97.4/s Avg: 23 Min: 0 Max: 1469 Err: 0 (0.00%) Generate Summary Results + 1546 in 60.3s = 25.6/s Avg: 52 Min: 0 Max: 876 Err: 0 (0.00%) Generate Summary Results = 52882 in 587.1s = 90.1/s Avg: 24 Min: 0 Max: 1469 Err: 0 (0.00%) Generate Summary Results + 1559 in 60.5s = 25.8/s Avg: 53 Min: 0 Max: 907 Err: 0 (0.00%) Generate Summary Results = 54441 in 647.0s = 84.1/s Avg: 25 Min: 0 Max: 1469 Err: 0 (0.00%) Generate Summary Results + 613 in 25.4s = 24.1/s Avg: 63 Min: 0 Max: 907 Err: 0 (0.00%) Generate Summary Results = 55054 in 672.0s = 81.9/s Avg: 25 Min: 0 Max: 1469 Err: 0 (0.00%) ---------------- The current time is: 9:23:18.21 ---------------- ---------------- Tests stopped and started again ----------------------- Generate Summary Results + 784 in 33.2s = 23.6/s Avg: 58 Min: 0 Max: 938 Err: 0 (0.00%) Generate Summary Results + 1266 in 60.1s = 21.1/s Avg: 61 Min: 0 Max: 516 Err: 0 (0.00%) Generate Summary Results = 2050 in 93.2s = 22.0/s Avg: 60 Min: 0 Max: 938 Err: 0 (0.00%) Generate Summary Results + 815 in 60.1s = 13.6/s Avg: 88 Min: 0 Max: 547 Err: 0 (0.00%) Generate Summary Results = 2865 in 153.3s = 18.7/s Avg: 68 Min: 0 Max: 938 Err: 0 (0.00%) Generate Summary Results + 555 in 60.2s = 9.2/s Avg: 123 Min: 0 Max: 688 Err: 0 (0.00%) Generate Summary Results = 3420 in 213.0s = 16.1/s Avg: 77 Min: 0 Max: 938 Err: 0 (0.00%) Generate Summary Results + 419 in 60.0s = 7.0/s Avg: 168 Min: 0 Max: 751 Err: 0 (0.00%) Generate Summary Results = 3839 in 273.0s = 14.1/s Avg: 87 Min: 0 Max: 938 Err: 0 (0.00%) Generate Summary Results + 285 in 59.5s = 4.8/s Avg: 233 Min: 0 Max: 578 Err: 0 (0.00%) Generate Summary Results = 4124 in 332.5s = 12.4/s Avg: 97 Min: 0 Max: 938 Err: 0 (0.00%) Generate Summary Results + 141 in 46.2s = 3.0/s Avg: 384 Min: 15 Max: 1062 Err: 0 (0.00%) Generate Summary Results = 4265 in 378.8s = 11.3/s Avg: 106 Min: 0 Max: 1062 Err: 0 (0.00%) ------------ Stop the test, exit Jmeter and start again ----------------- ------------ The current time is: 9:30:52.87 -------------------- Generate Summary Results + 7193 in 43.1s = 167.1/s Avg: 20 Min: 0 Max: 78 Err: 0 (0.00%) Generate Summary Results + 9703 in 60.0s = 161.7/s Avg: 20 Min: 0 Max: 250 Err: 0 (0.00%) Generate Summary Results = 16896 in 103.0s = 164.0/s Avg: 20 Min: 0 Max: 250 Err: 0 (0.00%) Generate Summary Results + 9145 in 60.0s = 152.3/s Avg: 19 Min: 0 Max: 296 Err: 0 (0.00%) Generate Summary Results = 26041 in 163.0s = 159.7/s Avg: 20 Min: 0 Max: 296 Err: 0 (0.00%) Generate Summary Results + 8702 in 60.1s = 144.9/s Avg: 19 Min: 0 Max: 110 Err: 0 (0.00%) Generate Summary Results = 34744 in 223.1s = 155.8/s Avg: 20 Min: 0 Max: 296 Err: 0 (0.00%) Generate Summary Results + 8068 in 60.0s = 134.5/s Avg: 19 Min: 0 Max: 641 Err: 0 (0.00%) Generate Summary Results = 42812 in 283.0s = 151.3/s Avg: 19 Min: 0 Max: 641 Err: 0 (0.00%) Generate Summary Results + 2557 in 20.5s = 124.5/s Avg: 19 Min: 0 Max: 531 Err: 0 (0.00%) Generate Summary Results = 45369 in 303.5s = 149.5/s Avg: 19 Min: 0 Max: 641 Err: 0 (0.00%) ------------------ Test stopped. The current time is: 9:38:36.23------------------- Joe
