Re: Jmeter Deviation
For the thread. I ran through some tests on this and for V2.4.20110513 I get consistent and accurate results for stdev. and avg. across all relevant listeners. The Test: One thread group using a single dummy sampler. Run with two threads each making 2 iterations. Results: Response Times 1. 833 2. 410 3. 597 4. 98 JMeter Listeners Aggregate Report Avg. - 484 Aggregate Graph Avg. - 484 View Results in Table Avg. - 484 View Results in Table Stdev. - 268 Summary Report Avg. - 484 Summary Report Stdev. - 268.81 Open Office stdevp() - 268.81 average() - 484 Conclusion: V2.4 of JMeter correctly calculates both average and standard deviation values. The only potential bug here is that the stdev value for the View Results in Table listener does not get rounded up (268.81 is displayed as 268 and not 269). - http://www.http503.com/ -- View this message in context: http://jmeter.512774.n5.nabble.com/Jmeter-Deviation-tp4758154p4767340.html Sent from the JMeter - User mailing list archive at Nabble.com. - To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org
Re: Jmeter Deviation
thanks for the reply, but can you help me to get the right data ? last time i followed some steps i found on the web, so can you just guide me how i can get the right data On Sat, Sep 3, 2011 at 4:37 PM, sebb wrote: > There are only 20 top-level entries in the data file you sent; the > average is 73 and std.dev is 50. > > 15 of the samples are redirects, which have 2 child entries, so in > fact there were 35 individual samples originally. > When processed as such (I removed the parent samples from the file), > the average is 41 and the deviation is 41 > > Neither interpretation bears any relation to the question you asked > (40 samples, average 142) > Did you send the wrong file? > > If you want people to help, you have to provide relevant and accurate data. > > On 2 September 2011 19:37, Sherif Amer wrote: > > Kindly find the attached raw data, i am so sorry but actually i need help > > and i am new with jmeter :( > > > > On Fri, Sep 2, 2011 at 4:46 PM, sebb wrote: > >> > >> On 2 September 2011 16:25, Sherif Amer > wrote: > >> > i got the values from the graph and i calculated it and i got the > >> > population > >> > standard deviation, it is totally different from the values which the > >> > table > >> > shows, can you try it please ? > >> > >> No, I cannot try it. > >> > >> You have not provided the raw data. > >> > >> > On Fri, Sep 2, 2011 at 3:51 PM, sebb wrote: > >> > > >> >> On 2 September 2011 15:08, Sherif Amer > >> >> wrote: > >> >> > thanks very much for the response, regarding "The aggregate graph > >> >> > does > >> >> not > >> >> > display the deviation" i calculated it manually :) and it is not > the > >> >> > same > >> >> > one shown in the table. > >> >> > >> >> So what has the aggregate graph got to do with it then? > >> >> > >> >> And did you use the appropriate calculation, i.e. population standard > >> >> deviation? > >> >> > >> >> > regarding the bugzilla and the JTL can elaborate more details as it > >> >> > is my > >> >> > first time here :) > >> >> > >> >> Bugzilla: http://jakarta.apache.org/jmeter/issues.html > >> >> > >> >> JTL is the sample output file; may be in CSV or XML format. > >> >> > >> >> Without the sample data it's impossible to provide further help. > >> >> > >> >> > On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: > >> >> > > >> >> >> On 2 September 2011 13:07, Sherif Amer > > >> >> wrote: > >> >> >> > Hello, i re test the full test plan again and i got strange > >> >> >> > results > >> >> for > >> >> >> > the average and for the deviation > >> >> >> > i have 4 pages and i made 10 request per page so the result is > 40 > >> >> request > >> >> >> > when i show the result in table i got the Average = 142 and the > >> >> deviation > >> >> >> = > >> >> >> > 93 > >> >> >> > when i show the result in aggregate graph and i calculated the > >> >> >> > average > >> >> >> and > >> >> >> > the deviation the results were different from the results on > the > >> >> table > >> >> >> !!! > >> >> >> > >> >> >> The aggregate graph does not display the deviation, so I don't > >> >> >> understand what you mean. > >> >> >> > >> >> >> > in the graph the Average = 140 and the deviation = 41. > >> >> >> > any idea why the results are different even it is same number of > >> >> requests > >> >> >> > and the same test plan !!? > >> >> >> > >> >> >> Please provide the JTL results file - but do not send it to the > >> >> >> list. > >> >> >> > >> >> >> Create a bugzilla issue and attach the JTL file to that. > >> >> >> Make sure you explain what you see in the listeners and what you > >> >> >> expected to see. > >> >> >> > >> >> >> > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: > >> >> >> >> > >> >> >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions > that > >> >> >> >> calculate the two different versions of std. dev.; I imagine > >> >> >> >> Excel > >> >> has > >> >> >> >> similar functions. > >> >> >> >> > >> >> >> >> On 1 September 2011 16:06, Sherif Amer > >> >> >> >> > >> >> >> wrote: > >> >> >> >> > Thanks very much for the clarification, i will re create the > >> >> >> >> > full > >> >> test > >> >> >> >> > scenario and update you. > >> >> >> >> > > >> >> >> >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb > wrote: > >> >> >> >> > > >> >> >> >> >> On 1 September 2011 15:17, Sherif Amer > >> >> >> >> >> >> >> > > >> >> >> >> >> wrote: > >> >> >> >> >> > view result in *table* > >> >> >> >> >> > >> >> >> >> >> OK, I see - you mean the figure in red at the bottom of the > >> >> screen. > >> >> >> >> >> > >> >> >> >> >> I have just written a test using the Java sampler so I can > >> >> >> >> >> ensure > >> >> >> that > >> >> >> >> >> the correct times are created. > >> >> >> >> >> > >> >> >> >> >> I get the same average, but the deviation is calculated as > >> >> >> >> >> 280, > >> >> not > >> >> >> 581 > >> >> >> >> >> or > >> >> >> >> >> 323. > >> >> >> >> >> Same if I use the Summary Listener. > >> >> >> >> >> > >> >> >> >> >> The JMeter value agrees with the "popul
Re: Jmeter Deviation
There are only 20 top-level entries in the data file you sent; the average is 73 and std.dev is 50. 15 of the samples are redirects, which have 2 child entries, so in fact there were 35 individual samples originally. When processed as such (I removed the parent samples from the file), the average is 41 and the deviation is 41 Neither interpretation bears any relation to the question you asked (40 samples, average 142) Did you send the wrong file? If you want people to help, you have to provide relevant and accurate data. On 2 September 2011 19:37, Sherif Amer wrote: > Kindly find the attached raw data, i am so sorry but actually i need help > and i am new with jmeter :( > > On Fri, Sep 2, 2011 at 4:46 PM, sebb wrote: >> >> On 2 September 2011 16:25, Sherif Amer wrote: >> > i got the values from the graph and i calculated it and i got the >> > population >> > standard deviation, it is totally different from the values which the >> > table >> > shows, can you try it please ? >> >> No, I cannot try it. >> >> You have not provided the raw data. >> >> > On Fri, Sep 2, 2011 at 3:51 PM, sebb wrote: >> > >> >> On 2 September 2011 15:08, Sherif Amer >> >> wrote: >> >> > thanks very much for the response, regarding "The aggregate graph >> >> > does >> >> not >> >> > display the deviation" i calculated it manually :) and it is not the >> >> > same >> >> > one shown in the table. >> >> >> >> So what has the aggregate graph got to do with it then? >> >> >> >> And did you use the appropriate calculation, i.e. population standard >> >> deviation? >> >> >> >> > regarding the bugzilla and the JTL can elaborate more details as it >> >> > is my >> >> > first time here :) >> >> >> >> Bugzilla: http://jakarta.apache.org/jmeter/issues.html >> >> >> >> JTL is the sample output file; may be in CSV or XML format. >> >> >> >> Without the sample data it's impossible to provide further help. >> >> >> >> > On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: >> >> > >> >> >> On 2 September 2011 13:07, Sherif Amer >> >> wrote: >> >> >> > Hello, i re test the full test plan again and i got strange >> >> >> > results >> >> for >> >> >> > the average and for the deviation >> >> >> > i have 4 pages and i made 10 request per page so the result is 40 >> >> request >> >> >> > when i show the result in table i got the Average = 142 and the >> >> deviation >> >> >> = >> >> >> > 93 >> >> >> > when i show the result in aggregate graph and i calculated the >> >> >> > average >> >> >> and >> >> >> > the deviation the results were different from the results on the >> >> table >> >> >> !!! >> >> >> >> >> >> The aggregate graph does not display the deviation, so I don't >> >> >> understand what you mean. >> >> >> >> >> >> > in the graph the Average = 140 and the deviation = 41. >> >> >> > any idea why the results are different even it is same number of >> >> requests >> >> >> > and the same test plan !!? >> >> >> >> >> >> Please provide the JTL results file - but do not send it to the >> >> >> list. >> >> >> >> >> >> Create a bugzilla issue and attach the JTL file to that. >> >> >> Make sure you explain what you see in the listeners and what you >> >> >> expected to see. >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: >> >> >> >> >> >> >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that >> >> >> >> calculate the two different versions of std. dev.; I imagine >> >> >> >> Excel >> >> has >> >> >> >> similar functions. >> >> >> >> >> >> >> >> On 1 September 2011 16:06, Sherif Amer >> >> >> >> >> >> >> wrote: >> >> >> >> > Thanks very much for the clarification, i will re create the >> >> >> >> > full >> >> test >> >> >> >> > scenario and update you. >> >> >> >> > >> >> >> >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: >> >> >> >> > >> >> >> >> >> On 1 September 2011 15:17, Sherif Amer >> >> >> >> >> > >> > >> >> >> >> >> wrote: >> >> >> >> >> > view result in *table* >> >> >> >> >> >> >> >> >> >> OK, I see - you mean the figure in red at the bottom of the >> >> screen. >> >> >> >> >> >> >> >> >> >> I have just written a test using the Java sampler so I can >> >> >> >> >> ensure >> >> >> that >> >> >> >> >> the correct times are created. >> >> >> >> >> >> >> >> >> >> I get the same average, but the deviation is calculated as >> >> >> >> >> 280, >> >> not >> >> >> 581 >> >> >> >> >> or >> >> >> >> >> 323. >> >> >> >> >> Same if I use the Summary Listener. >> >> >> >> >> >> >> >> >> >> The JMeter value agrees with the "population standard >> >> >> >> >> deviation", >> >> >> >> >> where the sum of square diffs is divided by the number of >> >> >> >> >> values >> >> >> (i.e. >> >> >> >> >> 4) before taking the square root. >> >> >> >> >> >> >> >> >> >> The value 323 results from dividing the sum of squares diffs >> >> >> >> >> by 3 >> >> (= >> >> >> >> >> 4-1) and then taking the square root. >> >> >> >> >> This is the "sample standard deviation". >> >> >> >> >> >> >> >> >> >> Both are valid interpretations of sta
Re: Jmeter Deviation
dears, any update ? On Fri, Sep 2, 2011 at 7:37 PM, Sherif Amer wrote: > Kindly find the attached raw data, i am so sorry but actually i need help > and i am new with jmeter :( > > > On Fri, Sep 2, 2011 at 4:46 PM, sebb wrote: > >> On 2 September 2011 16:25, Sherif Amer wrote: >> > i got the values from the graph and i calculated it and i got the >> population >> > standard deviation, it is totally different from the values which the >> table >> > shows, can you try it please ? >> >> No, I cannot try it. >> >> You have not provided the raw data. >> >> > On Fri, Sep 2, 2011 at 3:51 PM, sebb wrote: >> > >> >> On 2 September 2011 15:08, Sherif Amer >> wrote: >> >> > thanks very much for the response, regarding "The aggregate graph >> does >> >> not >> >> > display the deviation" i calculated it manually :) and it is not the >> same >> >> > one shown in the table. >> >> >> >> So what has the aggregate graph got to do with it then? >> >> >> >> And did you use the appropriate calculation, i.e. population standard >> >> deviation? >> >> >> >> > regarding the bugzilla and the JTL can elaborate more details as it >> is my >> >> > first time here :) >> >> >> >> Bugzilla: http://jakarta.apache.org/jmeter/issues.html >> >> >> >> JTL is the sample output file; may be in CSV or XML format. >> >> >> >> Without the sample data it's impossible to provide further help. >> >> >> >> > On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: >> >> > >> >> >> On 2 September 2011 13:07, Sherif Amer >> >> wrote: >> >> >> > Hello, i re test the full test plan again and i got strange >> results >> >> for >> >> >> > the average and for the deviation >> >> >> > i have 4 pages and i made 10 request per page so the result is 40 >> >> request >> >> >> > when i show the result in table i got the Average = 142 and the >> >> deviation >> >> >> = >> >> >> > 93 >> >> >> > when i show the result in aggregate graph and i calculated the >> average >> >> >> and >> >> >> > the deviation the results were different from the results on the >> >> table >> >> >> !!! >> >> >> >> >> >> The aggregate graph does not display the deviation, so I don't >> >> >> understand what you mean. >> >> >> >> >> >> > in the graph the Average = 140 and the deviation = 41. >> >> >> > any idea why the results are different even it is same number of >> >> requests >> >> >> > and the same test plan !!? >> >> >> >> >> >> Please provide the JTL results file - but do not send it to the >> list. >> >> >> >> >> >> Create a bugzilla issue and attach the JTL file to that. >> >> >> Make sure you explain what you see in the listeners and what you >> >> >> expected to see. >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: >> >> >> >> >> >> >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that >> >> >> >> calculate the two different versions of std. dev.; I imagine >> Excel >> >> has >> >> >> >> similar functions. >> >> >> >> >> >> >> >> On 1 September 2011 16:06, Sherif Amer < >> sherif.moh.a...@gmail.com> >> >> >> wrote: >> >> >> >> > Thanks very much for the clarification, i will re create the >> full >> >> test >> >> >> >> > scenario and update you. >> >> >> >> > >> >> >> >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: >> >> >> >> > >> >> >> >> >> On 1 September 2011 15:17, Sherif Amer < >> sherif.moh.a...@gmail.com >> >> > >> >> >> >> >> wrote: >> >> >> >> >> > view result in *table* >> >> >> >> >> >> >> >> >> >> OK, I see - you mean the figure in red at the bottom of the >> >> screen. >> >> >> >> >> >> >> >> >> >> I have just written a test using the Java sampler so I can >> ensure >> >> >> that >> >> >> >> >> the correct times are created. >> >> >> >> >> >> >> >> >> >> I get the same average, but the deviation is calculated as >> 280, >> >> not >> >> >> 581 >> >> >> >> >> or >> >> >> >> >> 323. >> >> >> >> >> Same if I use the Summary Listener. >> >> >> >> >> >> >> >> >> >> The JMeter value agrees with the "population standard >> deviation", >> >> >> >> >> where the sum of square diffs is divided by the number of >> values >> >> >> (i.e. >> >> >> >> >> 4) before taking the square root. >> >> >> >> >> >> >> >> >> >> The value 323 results from dividing the sum of squares diffs >> by 3 >> >> (= >> >> >> >> >> 4-1) and then taking the square root. >> >> >> >> >> This is the "sample standard deviation". >> >> >> >> >> >> >> >> >> >> Both are valid interpretations of standard deviation. Perhaps >> >> JMeter >> >> >> >> >> should have used the latter, but it does not. >> >> >> >> >> >> >> >> >> >> I don't understand where the value 581 comes from. >> >> >> >> >> If you still have the raw sample data, perhaps you can create >> a >> >> >> >> >> Bugzilla issue and attach the JTL file with a screenshot of >> the >> >> Table >> >> >> >> >> Listener. >> >> >> >> >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb >> wrote: >> >> >> >> >> > >> >> >> >> >> >> On 1 September 2011 15:06, Sherif Amer < >> >> sherif.moh.a...@gmail.com >> >> >> > >> >> >> >>
Re: Jmeter Deviation
Kindly find the attached raw data, i am so sorry but actually i need help and i am new with jmeter :( On Fri, Sep 2, 2011 at 4:46 PM, sebb wrote: > On 2 September 2011 16:25, Sherif Amer wrote: > > i got the values from the graph and i calculated it and i got the > population > > standard deviation, it is totally different from the values which the > table > > shows, can you try it please ? > > No, I cannot try it. > > You have not provided the raw data. > > > On Fri, Sep 2, 2011 at 3:51 PM, sebb wrote: > > > >> On 2 September 2011 15:08, Sherif Amer > wrote: > >> > thanks very much for the response, regarding "The aggregate graph does > >> not > >> > display the deviation" i calculated it manually :) and it is not the > same > >> > one shown in the table. > >> > >> So what has the aggregate graph got to do with it then? > >> > >> And did you use the appropriate calculation, i.e. population standard > >> deviation? > >> > >> > regarding the bugzilla and the JTL can elaborate more details as it is > my > >> > first time here :) > >> > >> Bugzilla: http://jakarta.apache.org/jmeter/issues.html > >> > >> JTL is the sample output file; may be in CSV or XML format. > >> > >> Without the sample data it's impossible to provide further help. > >> > >> > On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: > >> > > >> >> On 2 September 2011 13:07, Sherif Amer > >> wrote: > >> >> > Hello, i re test the full test plan again and i got strange results > >> for > >> >> > the average and for the deviation > >> >> > i have 4 pages and i made 10 request per page so the result is 40 > >> request > >> >> > when i show the result in table i got the Average = 142 and the > >> deviation > >> >> = > >> >> > 93 > >> >> > when i show the result in aggregate graph and i calculated the > average > >> >> and > >> >> > the deviation the results were different from the results on the > >> table > >> >> !!! > >> >> > >> >> The aggregate graph does not display the deviation, so I don't > >> >> understand what you mean. > >> >> > >> >> > in the graph the Average = 140 and the deviation = 41. > >> >> > any idea why the results are different even it is same number of > >> requests > >> >> > and the same test plan !!? > >> >> > >> >> Please provide the JTL results file - but do not send it to the list. > >> >> > >> >> Create a bugzilla issue and attach the JTL file to that. > >> >> Make sure you explain what you see in the listeners and what you > >> >> expected to see. > >> >> > >> >> > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: > >> >> >> > >> >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that > >> >> >> calculate the two different versions of std. dev.; I imagine Excel > >> has > >> >> >> similar functions. > >> >> >> > >> >> >> On 1 September 2011 16:06, Sherif Amer > > >> >> wrote: > >> >> >> > Thanks very much for the clarification, i will re create the > full > >> test > >> >> >> > scenario and update you. > >> >> >> > > >> >> >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: > >> >> >> > > >> >> >> >> On 1 September 2011 15:17, Sherif Amer < > sherif.moh.a...@gmail.com > >> > > >> >> >> >> wrote: > >> >> >> >> > view result in *table* > >> >> >> >> > >> >> >> >> OK, I see - you mean the figure in red at the bottom of the > >> screen. > >> >> >> >> > >> >> >> >> I have just written a test using the Java sampler so I can > ensure > >> >> that > >> >> >> >> the correct times are created. > >> >> >> >> > >> >> >> >> I get the same average, but the deviation is calculated as 280, > >> not > >> >> 581 > >> >> >> >> or > >> >> >> >> 323. > >> >> >> >> Same if I use the Summary Listener. > >> >> >> >> > >> >> >> >> The JMeter value agrees with the "population standard > deviation", > >> >> >> >> where the sum of square diffs is divided by the number of > values > >> >> (i.e. > >> >> >> >> 4) before taking the square root. > >> >> >> >> > >> >> >> >> The value 323 results from dividing the sum of squares diffs by > 3 > >> (= > >> >> >> >> 4-1) and then taking the square root. > >> >> >> >> This is the "sample standard deviation". > >> >> >> >> > >> >> >> >> Both are valid interpretations of standard deviation. Perhaps > >> JMeter > >> >> >> >> should have used the latter, but it does not. > >> >> >> >> > >> >> >> >> I don't understand where the value 581 comes from. > >> >> >> >> If you still have the raw sample data, perhaps you can create a > >> >> >> >> Bugzilla issue and attach the JTL file with a screenshot of the > >> Table > >> >> >> >> Listener. > >> >> >> >> > >> >> >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb > wrote: > >> >> >> >> > > >> >> >> >> >> On 1 September 2011 15:06, Sherif Amer < > >> sherif.moh.a...@gmail.com > >> >> > > >> >> >> >> wrote: > >> >> >> >> >> > Which sampler were you using? > >> >> >> >> >> > *HTTP request* > >> >> >> >> >> > >> >> >> >> >> Sorry, I meant - which Listener were you using? > >> >> >> >> >> > >> >> >> >> >> > Which version of JMeter? > >> >> >> >> >> > *2.4* > >> >> >
Re: Jmeter Deviation
On 2 September 2011 16:25, Sherif Amer wrote: > i got the values from the graph and i calculated it and i got the population > standard deviation, it is totally different from the values which the table > shows, can you try it please ? No, I cannot try it. You have not provided the raw data. > On Fri, Sep 2, 2011 at 3:51 PM, sebb wrote: > >> On 2 September 2011 15:08, Sherif Amer wrote: >> > thanks very much for the response, regarding "The aggregate graph does >> not >> > display the deviation" i calculated it manually :) and it is not the same >> > one shown in the table. >> >> So what has the aggregate graph got to do with it then? >> >> And did you use the appropriate calculation, i.e. population standard >> deviation? >> >> > regarding the bugzilla and the JTL can elaborate more details as it is my >> > first time here :) >> >> Bugzilla: http://jakarta.apache.org/jmeter/issues.html >> >> JTL is the sample output file; may be in CSV or XML format. >> >> Without the sample data it's impossible to provide further help. >> >> > On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: >> > >> >> On 2 September 2011 13:07, Sherif Amer >> wrote: >> >> > Hello, i re test the full test plan again and i got strange results >> for >> >> > the average and for the deviation >> >> > i have 4 pages and i made 10 request per page so the result is 40 >> request >> >> > when i show the result in table i got the Average = 142 and the >> deviation >> >> = >> >> > 93 >> >> > when i show the result in aggregate graph and i calculated the average >> >> and >> >> > the deviation the results were different from the results on the >> table >> >> !!! >> >> >> >> The aggregate graph does not display the deviation, so I don't >> >> understand what you mean. >> >> >> >> > in the graph the Average = 140 and the deviation = 41. >> >> > any idea why the results are different even it is same number of >> requests >> >> > and the same test plan !!? >> >> >> >> Please provide the JTL results file - but do not send it to the list. >> >> >> >> Create a bugzilla issue and attach the JTL file to that. >> >> Make sure you explain what you see in the listeners and what you >> >> expected to see. >> >> >> >> > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: >> >> >> >> >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that >> >> >> calculate the two different versions of std. dev.; I imagine Excel >> has >> >> >> similar functions. >> >> >> >> >> >> On 1 September 2011 16:06, Sherif Amer >> >> wrote: >> >> >> > Thanks very much for the clarification, i will re create the full >> test >> >> >> > scenario and update you. >> >> >> > >> >> >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: >> >> >> > >> >> >> >> On 1 September 2011 15:17, Sherif Amer > > >> >> >> >> wrote: >> >> >> >> > view result in *table* >> >> >> >> >> >> >> >> OK, I see - you mean the figure in red at the bottom of the >> screen. >> >> >> >> >> >> >> >> I have just written a test using the Java sampler so I can ensure >> >> that >> >> >> >> the correct times are created. >> >> >> >> >> >> >> >> I get the same average, but the deviation is calculated as 280, >> not >> >> 581 >> >> >> >> or >> >> >> >> 323. >> >> >> >> Same if I use the Summary Listener. >> >> >> >> >> >> >> >> The JMeter value agrees with the "population standard deviation", >> >> >> >> where the sum of square diffs is divided by the number of values >> >> (i.e. >> >> >> >> 4) before taking the square root. >> >> >> >> >> >> >> >> The value 323 results from dividing the sum of squares diffs by 3 >> (= >> >> >> >> 4-1) and then taking the square root. >> >> >> >> This is the "sample standard deviation". >> >> >> >> >> >> >> >> Both are valid interpretations of standard deviation. Perhaps >> JMeter >> >> >> >> should have used the latter, but it does not. >> >> >> >> >> >> >> >> I don't understand where the value 581 comes from. >> >> >> >> If you still have the raw sample data, perhaps you can create a >> >> >> >> Bugzilla issue and attach the JTL file with a screenshot of the >> Table >> >> >> >> Listener. >> >> >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: >> >> >> >> > >> >> >> >> >> On 1 September 2011 15:06, Sherif Amer < >> sherif.moh.a...@gmail.com >> >> > >> >> >> >> wrote: >> >> >> >> >> > Which sampler were you using? >> >> >> >> >> > *HTTP request* >> >> >> >> >> >> >> >> >> >> Sorry, I meant - which Listener were you using? >> >> >> >> >> >> >> >> >> >> > Which version of JMeter? >> >> >> >> >> > *2.4* >> >> >> >> >> > >> >> >> >> >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb >> wrote: >> >> >> >> >> > >> >> >> >> >> >> On 1 September 2011 13:56, Sherif Amer >> >> >> >> >> >> >> >> >> >> >> wrote: >> >> >> >> >> >> > i made load test for 4 pages and the sample time was >> >> >> >> >> 426,1093,1127,921 >> >> >> >> >> >> and >> >> >> >> >> >> > when i showed the result in table >> >> >> >> >> >> > >> >> >> >> >> >> > The average was 892 which is ok >> >> >> >> >> >> >> >
Re: Jmeter Deviation
i got the values from the graph and i calculated it and i got the population standard deviation, it is totally different from the values which the table shows, can you try it please ? On Fri, Sep 2, 2011 at 3:51 PM, sebb wrote: > On 2 September 2011 15:08, Sherif Amer wrote: > > thanks very much for the response, regarding "The aggregate graph does > not > > display the deviation" i calculated it manually :) and it is not the same > > one shown in the table. > > So what has the aggregate graph got to do with it then? > > And did you use the appropriate calculation, i.e. population standard > deviation? > > > regarding the bugzilla and the JTL can elaborate more details as it is my > > first time here :) > > Bugzilla: http://jakarta.apache.org/jmeter/issues.html > > JTL is the sample output file; may be in CSV or XML format. > > Without the sample data it's impossible to provide further help. > > > On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: > > > >> On 2 September 2011 13:07, Sherif Amer > wrote: > >> > Hello, i re test the full test plan again and i got strange results > for > >> > the average and for the deviation > >> > i have 4 pages and i made 10 request per page so the result is 40 > request > >> > when i show the result in table i got the Average = 142 and the > deviation > >> = > >> > 93 > >> > when i show the result in aggregate graph and i calculated the average > >> and > >> > the deviation the results were different from the results on the > table > >> !!! > >> > >> The aggregate graph does not display the deviation, so I don't > >> understand what you mean. > >> > >> > in the graph the Average = 140 and the deviation = 41. > >> > any idea why the results are different even it is same number of > requests > >> > and the same test plan !!? > >> > >> Please provide the JTL results file - but do not send it to the list. > >> > >> Create a bugzilla issue and attach the JTL file to that. > >> Make sure you explain what you see in the listeners and what you > >> expected to see. > >> > >> > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: > >> >> > >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that > >> >> calculate the two different versions of std. dev.; I imagine Excel > has > >> >> similar functions. > >> >> > >> >> On 1 September 2011 16:06, Sherif Amer > >> wrote: > >> >> > Thanks very much for the clarification, i will re create the full > test > >> >> > scenario and update you. > >> >> > > >> >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: > >> >> > > >> >> >> On 1 September 2011 15:17, Sherif Amer > > >> >> >> wrote: > >> >> >> > view result in *table* > >> >> >> > >> >> >> OK, I see - you mean the figure in red at the bottom of the > screen. > >> >> >> > >> >> >> I have just written a test using the Java sampler so I can ensure > >> that > >> >> >> the correct times are created. > >> >> >> > >> >> >> I get the same average, but the deviation is calculated as 280, > not > >> 581 > >> >> >> or > >> >> >> 323. > >> >> >> Same if I use the Summary Listener. > >> >> >> > >> >> >> The JMeter value agrees with the "population standard deviation", > >> >> >> where the sum of square diffs is divided by the number of values > >> (i.e. > >> >> >> 4) before taking the square root. > >> >> >> > >> >> >> The value 323 results from dividing the sum of squares diffs by 3 > (= > >> >> >> 4-1) and then taking the square root. > >> >> >> This is the "sample standard deviation". > >> >> >> > >> >> >> Both are valid interpretations of standard deviation. Perhaps > JMeter > >> >> >> should have used the latter, but it does not. > >> >> >> > >> >> >> I don't understand where the value 581 comes from. > >> >> >> If you still have the raw sample data, perhaps you can create a > >> >> >> Bugzilla issue and attach the JTL file with a screenshot of the > Table > >> >> >> Listener. > >> >> >> > >> >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: > >> >> >> > > >> >> >> >> On 1 September 2011 15:06, Sherif Amer < > sherif.moh.a...@gmail.com > >> > > >> >> >> wrote: > >> >> >> >> > Which sampler were you using? > >> >> >> >> > *HTTP request* > >> >> >> >> > >> >> >> >> Sorry, I meant - which Listener were you using? > >> >> >> >> > >> >> >> >> > Which version of JMeter? > >> >> >> >> > *2.4* > >> >> >> >> > > >> >> >> >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb > wrote: > >> >> >> >> > > >> >> >> >> >> On 1 September 2011 13:56, Sherif Amer > >> >> >> >> >> > >> >> >> >> wrote: > >> >> >> >> >> > i made load test for 4 pages and the sample time was > >> >> >> >> 426,1093,1127,921 > >> >> >> >> >> and > >> >> >> >> >> > when i showed the result in table > >> >> >> >> >> > > >> >> >> >> >> > The average was 892 which is ok > >> >> >> >> >> > >> >> >> >> >> Agreed. > >> >> >> >> >> > >> >> >> >> >> > And the deviation was 581 which is totally wrong, if you > >> >> >> >> >> > calculate > >> >> >> it > >> >> >> >> >> > yourself the result will simply will be 323. > >> >> >> >> >> > >> >> >>
Re: Jmeter Deviation
On 2 September 2011 15:08, Sherif Amer wrote: > thanks very much for the response, regarding "The aggregate graph does not > display the deviation" i calculated it manually :) and it is not the same > one shown in the table. So what has the aggregate graph got to do with it then? And did you use the appropriate calculation, i.e. population standard deviation? > regarding the bugzilla and the JTL can elaborate more details as it is my > first time here :) Bugzilla: http://jakarta.apache.org/jmeter/issues.html JTL is the sample output file; may be in CSV or XML format. Without the sample data it's impossible to provide further help. > On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: > >> On 2 September 2011 13:07, Sherif Amer wrote: >> > Hello, i re test the full test plan again and i got strange results for >> > the average and for the deviation >> > i have 4 pages and i made 10 request per page so the result is 40 request >> > when i show the result in table i got the Average = 142 and the deviation >> = >> > 93 >> > when i show the result in aggregate graph and i calculated the average >> and >> > the deviation the results were different from the results on the table >> !!! >> >> The aggregate graph does not display the deviation, so I don't >> understand what you mean. >> >> > in the graph the Average = 140 and the deviation = 41. >> > any idea why the results are different even it is same number of requests >> > and the same test plan !!? >> >> Please provide the JTL results file - but do not send it to the list. >> >> Create a bugzilla issue and attach the JTL file to that. >> Make sure you explain what you see in the listeners and what you >> expected to see. >> >> > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: >> >> >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that >> >> calculate the two different versions of std. dev.; I imagine Excel has >> >> similar functions. >> >> >> >> On 1 September 2011 16:06, Sherif Amer >> wrote: >> >> > Thanks very much for the clarification, i will re create the full test >> >> > scenario and update you. >> >> > >> >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: >> >> > >> >> >> On 1 September 2011 15:17, Sherif Amer >> >> >> wrote: >> >> >> > view result in *table* >> >> >> >> >> >> OK, I see - you mean the figure in red at the bottom of the screen. >> >> >> >> >> >> I have just written a test using the Java sampler so I can ensure >> that >> >> >> the correct times are created. >> >> >> >> >> >> I get the same average, but the deviation is calculated as 280, not >> 581 >> >> >> or >> >> >> 323. >> >> >> Same if I use the Summary Listener. >> >> >> >> >> >> The JMeter value agrees with the "population standard deviation", >> >> >> where the sum of square diffs is divided by the number of values >> (i.e. >> >> >> 4) before taking the square root. >> >> >> >> >> >> The value 323 results from dividing the sum of squares diffs by 3 (= >> >> >> 4-1) and then taking the square root. >> >> >> This is the "sample standard deviation". >> >> >> >> >> >> Both are valid interpretations of standard deviation. Perhaps JMeter >> >> >> should have used the latter, but it does not. >> >> >> >> >> >> I don't understand where the value 581 comes from. >> >> >> If you still have the raw sample data, perhaps you can create a >> >> >> Bugzilla issue and attach the JTL file with a screenshot of the Table >> >> >> Listener. >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: >> >> >> > >> >> >> >> On 1 September 2011 15:06, Sherif Amer > > >> >> >> wrote: >> >> >> >> > Which sampler were you using? >> >> >> >> > *HTTP request* >> >> >> >> >> >> >> >> Sorry, I meant - which Listener were you using? >> >> >> >> >> >> >> >> > Which version of JMeter? >> >> >> >> > *2.4* >> >> >> >> > >> >> >> >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: >> >> >> >> > >> >> >> >> >> On 1 September 2011 13:56, Sherif Amer >> >> >> >> >> >> >> >> >> wrote: >> >> >> >> >> > i made load test for 4 pages and the sample time was >> >> >> >> 426,1093,1127,921 >> >> >> >> >> and >> >> >> >> >> > when i showed the result in table >> >> >> >> >> > >> >> >> >> >> > The average was 892 which is ok >> >> >> >> >> >> >> >> >> >> Agreed. >> >> >> >> >> >> >> >> >> >> > And the deviation was 581 which is totally wrong, if you >> >> >> >> >> > calculate >> >> >> it >> >> >> >> >> > yourself the result will simply will be 323. >> >> >> >> >> >> >> >> >> >> Which sampler were you using? >> >> >> >> >> >> >> >> >> >> Which version of JMeter? >> >> >> >> >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb >> wrote: >> >> >> >> >> > >> >> >> >> >> >> On 1 September 2011 13:43, Sherif Amer >> >> >> >> >> >> > >> >> > >> >> >> >> >> wrote: >> >> >> >> >> >> > hello !! >> >> >> >> >> >> > >> >> >> >> >> >> > i have question :) does Jmeter calculating the the >> deviation >> >> >> >> >> incorrectly >> >> >> >> >> >> in >> >> >> >> >> >> > the listener like the table and graphic s
Re: Jmeter Deviation
thanks very much for the response, regarding "The aggregate graph does not display the deviation" i calculated it manually :) and it is not the same one shown in the table. regarding the bugzilla and the JTL can elaborate more details as it is my first time here :) On Fri, Sep 2, 2011 at 1:53 PM, sebb wrote: > On 2 September 2011 13:07, Sherif Amer wrote: > > Hello, i re test the full test plan again and i got strange results for > > the average and for the deviation > > i have 4 pages and i made 10 request per page so the result is 40 request > > when i show the result in table i got the Average = 142 and the deviation > = > > 93 > > when i show the result in aggregate graph and i calculated the average > and > > the deviation the results were different from the results on the table > !!! > > The aggregate graph does not display the deviation, so I don't > understand what you mean. > > > in the graph the Average = 140 and the deviation = 41. > > any idea why the results are different even it is same number of requests > > and the same test plan !!? > > Please provide the JTL results file - but do not send it to the list. > > Create a bugzilla issue and attach the JTL file to that. > Make sure you explain what you see in the listeners and what you > expected to see. > > > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: > >> > >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that > >> calculate the two different versions of std. dev.; I imagine Excel has > >> similar functions. > >> > >> On 1 September 2011 16:06, Sherif Amer > wrote: > >> > Thanks very much for the clarification, i will re create the full test > >> > scenario and update you. > >> > > >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: > >> > > >> >> On 1 September 2011 15:17, Sherif Amer > >> >> wrote: > >> >> > view result in *table* > >> >> > >> >> OK, I see - you mean the figure in red at the bottom of the screen. > >> >> > >> >> I have just written a test using the Java sampler so I can ensure > that > >> >> the correct times are created. > >> >> > >> >> I get the same average, but the deviation is calculated as 280, not > 581 > >> >> or > >> >> 323. > >> >> Same if I use the Summary Listener. > >> >> > >> >> The JMeter value agrees with the "population standard deviation", > >> >> where the sum of square diffs is divided by the number of values > (i.e. > >> >> 4) before taking the square root. > >> >> > >> >> The value 323 results from dividing the sum of squares diffs by 3 (= > >> >> 4-1) and then taking the square root. > >> >> This is the "sample standard deviation". > >> >> > >> >> Both are valid interpretations of standard deviation. Perhaps JMeter > >> >> should have used the latter, but it does not. > >> >> > >> >> I don't understand where the value 581 comes from. > >> >> If you still have the raw sample data, perhaps you can create a > >> >> Bugzilla issue and attach the JTL file with a screenshot of the Table > >> >> Listener. > >> >> > >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: > >> >> > > >> >> >> On 1 September 2011 15:06, Sherif Amer > > >> >> wrote: > >> >> >> > Which sampler were you using? > >> >> >> > *HTTP request* > >> >> >> > >> >> >> Sorry, I meant - which Listener were you using? > >> >> >> > >> >> >> > Which version of JMeter? > >> >> >> > *2.4* > >> >> >> > > >> >> >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: > >> >> >> > > >> >> >> >> On 1 September 2011 13:56, Sherif Amer > >> >> >> >> > >> >> >> wrote: > >> >> >> >> > i made load test for 4 pages and the sample time was > >> >> >> 426,1093,1127,921 > >> >> >> >> and > >> >> >> >> > when i showed the result in table > >> >> >> >> > > >> >> >> >> > The average was 892 which is ok > >> >> >> >> > >> >> >> >> Agreed. > >> >> >> >> > >> >> >> >> > And the deviation was 581 which is totally wrong, if you > >> >> >> >> > calculate > >> >> it > >> >> >> >> > yourself the result will simply will be 323. > >> >> >> >> > >> >> >> >> Which sampler were you using? > >> >> >> >> > >> >> >> >> Which version of JMeter? > >> >> >> >> > >> >> >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb > wrote: > >> >> >> >> > > >> >> >> >> >> On 1 September 2011 13:43, Sherif Amer > >> >> >> >> >> >> >> > > >> >> >> >> wrote: > >> >> >> >> >> > hello !! > >> >> >> >> >> > > >> >> >> >> >> > i have question :) does Jmeter calculating the the > deviation > >> >> >> >> incorrectly > >> >> >> >> >> in > >> >> >> >> >> > the listener like the table and graphic shapes ? > >> >> >> >> >> > >> >> >> >> >> No. > >> >> >> >> >> > >> >> >> >> >> What makes you think the calculations are wrong? > >> >> >> >> >> > >> >> >> >> >> Please provide some evidence. > >> >> >> >> >> > >> >> >> >> >> > Regards, > >> >> >> >> >> > > >> >> >> >> >> > Sherif Amer > >> >> >> >> >> > > >> >> >> >> >> > >> >> >> >> >> > >> >> - > >> >> >> >> >> To unsubscribe, e-mail: > >> >> jmeter-user-unsubscr...@jakarta.apa
Re: Jmeter Deviation
On 2 September 2011 13:07, Sherif Amer wrote: > Hello, i re test the full test plan again and i got strange results for > the average and for the deviation > i have 4 pages and i made 10 request per page so the result is 40 request > when i show the result in table i got the Average = 142 and the deviation = > 93 > when i show the result in aggregate graph and i calculated the average and > the deviation the results were different from the results on the table !!! The aggregate graph does not display the deviation, so I don't understand what you mean. > in the graph the Average = 140 and the deviation = 41. > any idea why the results are different even it is same number of requests > and the same test plan !!? Please provide the JTL results file - but do not send it to the list. Create a bugzilla issue and attach the JTL file to that. Make sure you explain what you see in the listeners and what you expected to see. > On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: >> >> Note that OpenOffice.org Calc has STDEV and STDEVP functions that >> calculate the two different versions of std. dev.; I imagine Excel has >> similar functions. >> >> On 1 September 2011 16:06, Sherif Amer wrote: >> > Thanks very much for the clarification, i will re create the full test >> > scenario and update you. >> > >> > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: >> > >> >> On 1 September 2011 15:17, Sherif Amer >> >> wrote: >> >> > view result in *table* >> >> >> >> OK, I see - you mean the figure in red at the bottom of the screen. >> >> >> >> I have just written a test using the Java sampler so I can ensure that >> >> the correct times are created. >> >> >> >> I get the same average, but the deviation is calculated as 280, not 581 >> >> or >> >> 323. >> >> Same if I use the Summary Listener. >> >> >> >> The JMeter value agrees with the "population standard deviation", >> >> where the sum of square diffs is divided by the number of values (i.e. >> >> 4) before taking the square root. >> >> >> >> The value 323 results from dividing the sum of squares diffs by 3 (= >> >> 4-1) and then taking the square root. >> >> This is the "sample standard deviation". >> >> >> >> Both are valid interpretations of standard deviation. Perhaps JMeter >> >> should have used the latter, but it does not. >> >> >> >> I don't understand where the value 581 comes from. >> >> If you still have the raw sample data, perhaps you can create a >> >> Bugzilla issue and attach the JTL file with a screenshot of the Table >> >> Listener. >> >> >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: >> >> > >> >> >> On 1 September 2011 15:06, Sherif Amer >> >> wrote: >> >> >> > Which sampler were you using? >> >> >> > *HTTP request* >> >> >> >> >> >> Sorry, I meant - which Listener were you using? >> >> >> >> >> >> > Which version of JMeter? >> >> >> > *2.4* >> >> >> > >> >> >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: >> >> >> > >> >> >> >> On 1 September 2011 13:56, Sherif Amer >> >> >> >> >> >> >> wrote: >> >> >> >> > i made load test for 4 pages and the sample time was >> >> >> 426,1093,1127,921 >> >> >> >> and >> >> >> >> > when i showed the result in table >> >> >> >> > >> >> >> >> > The average was 892 which is ok >> >> >> >> >> >> >> >> Agreed. >> >> >> >> >> >> >> >> > And the deviation was 581 which is totally wrong, if you >> >> >> >> > calculate >> >> it >> >> >> >> > yourself the result will simply will be 323. >> >> >> >> >> >> >> >> Which sampler were you using? >> >> >> >> >> >> >> >> Which version of JMeter? >> >> >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: >> >> >> >> > >> >> >> >> >> On 1 September 2011 13:43, Sherif Amer >> >> >> >> >> > >> > >> >> >> >> wrote: >> >> >> >> >> > hello !! >> >> >> >> >> > >> >> >> >> >> > i have question :) does Jmeter calculating the the deviation >> >> >> >> incorrectly >> >> >> >> >> in >> >> >> >> >> > the listener like the table and graphic shapes ? >> >> >> >> >> >> >> >> >> >> No. >> >> >> >> >> >> >> >> >> >> What makes you think the calculations are wrong? >> >> >> >> >> >> >> >> >> >> Please provide some evidence. >> >> >> >> >> >> >> >> >> >> > Regards, >> >> >> >> >> > >> >> >> >> >> > Sherif Amer >> >> >> >> >> > >> >> >> >> >> >> >> >> >> >> >> >> - >> >> >> >> >> To unsubscribe, e-mail: >> >> jmeter-user-unsubscr...@jakarta.apache.org >> >> >> >> >> For additional commands, e-mail: >> >> jmeter-user-h...@jakarta.apache.org >> >> >> >> >> >> >> >> >> >> >> >> >> >> > >> >> >> >> >> >> >> >> >> >> >> >> - >> >> >> >> To unsubscribe, e-mail: >> >> >> >> jmeter-user-unsubscr...@jakarta.apache.org >> >> >> >> For additional commands, e-mail: >> >> >> >> jmeter-user-h...@jakarta.apache.org >> >> >> >> >> >> >> >> >> >> >> > >> >> >> >> >> >> >> >> >> - >> >> >> To unsubsc
Re: Jmeter Deviation
Hello, i re test the full test plan again and i got strange results for the average and for the deviation i have 4 pages and i made 10 request per page so the result is 40 request when i show the result in table i got the Average = 142 and the deviation = 93 when i show the result in aggregate graph and i calculated the average and the deviation the results were different from the results on the table !!! in the graph the Average = 140 and the deviation = 41. any idea why the results are different even it is same number of requests and the same test plan !!? On Thu, Sep 1, 2011 at 4:11 PM, sebb wrote: > Note that OpenOffice.org Calc has STDEV and STDEVP functions that > calculate the two different versions of std. dev.; I imagine Excel has > similar functions. > > On 1 September 2011 16:06, Sherif Amer wrote: > > Thanks very much for the clarification, i will re create the full test > > scenario and update you. > > > > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: > > > >> On 1 September 2011 15:17, Sherif Amer > wrote: > >> > view result in *table* > >> > >> OK, I see - you mean the figure in red at the bottom of the screen. > >> > >> I have just written a test using the Java sampler so I can ensure that > >> the correct times are created. > >> > >> I get the same average, but the deviation is calculated as 280, not 581 > or > >> 323. > >> Same if I use the Summary Listener. > >> > >> The JMeter value agrees with the "population standard deviation", > >> where the sum of square diffs is divided by the number of values (i.e. > >> 4) before taking the square root. > >> > >> The value 323 results from dividing the sum of squares diffs by 3 (= > >> 4-1) and then taking the square root. > >> This is the "sample standard deviation". > >> > >> Both are valid interpretations of standard deviation. Perhaps JMeter > >> should have used the latter, but it does not. > >> > >> I don't understand where the value 581 comes from. > >> If you still have the raw sample data, perhaps you can create a > >> Bugzilla issue and attach the JTL file with a screenshot of the Table > >> Listener. > >> > >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: > >> > > >> >> On 1 September 2011 15:06, Sherif Amer > >> wrote: > >> >> > Which sampler were you using? > >> >> > *HTTP request* > >> >> > >> >> Sorry, I meant - which Listener were you using? > >> >> > >> >> > Which version of JMeter? > >> >> > *2.4* > >> >> > > >> >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: > >> >> > > >> >> >> On 1 September 2011 13:56, Sherif Amer > > >> >> wrote: > >> >> >> > i made load test for 4 pages and the sample time was > >> >> 426,1093,1127,921 > >> >> >> and > >> >> >> > when i showed the result in table > >> >> >> > > >> >> >> > The average was 892 which is ok > >> >> >> > >> >> >> Agreed. > >> >> >> > >> >> >> > And the deviation was 581 which is totally wrong, if you > calculate > >> it > >> >> >> > yourself the result will simply will be 323. > >> >> >> > >> >> >> Which sampler were you using? > >> >> >> > >> >> >> Which version of JMeter? > >> >> >> > >> >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: > >> >> >> > > >> >> >> >> On 1 September 2011 13:43, Sherif Amer < > sherif.moh.a...@gmail.com > >> > > >> >> >> wrote: > >> >> >> >> > hello !! > >> >> >> >> > > >> >> >> >> > i have question :) does Jmeter calculating the the deviation > >> >> >> incorrectly > >> >> >> >> in > >> >> >> >> > the listener like the table and graphic shapes ? > >> >> >> >> > >> >> >> >> No. > >> >> >> >> > >> >> >> >> What makes you think the calculations are wrong? > >> >> >> >> > >> >> >> >> Please provide some evidence. > >> >> >> >> > >> >> >> >> > Regards, > >> >> >> >> > > >> >> >> >> > Sherif Amer > >> >> >> >> > > >> >> >> >> > >> >> >> >> > >> - > >> >> >> >> To unsubscribe, e-mail: > >> jmeter-user-unsubscr...@jakarta.apache.org > >> >> >> >> For additional commands, e-mail: > >> jmeter-user-h...@jakarta.apache.org > >> >> >> >> > >> >> >> >> > >> >> >> > > >> >> >> > >> >> >> > - > >> >> >> To unsubscribe, e-mail: > jmeter-user-unsubscr...@jakarta.apache.org > >> >> >> For additional commands, e-mail: > jmeter-user-h...@jakarta.apache.org > >> >> >> > >> >> >> > >> >> > > >> >> > >> >> - > >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >> >> > >> >> > >> > > >> > >> - > >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >> > >> > > > > - > To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache
Re: Jmeter Deviation
Note that OpenOffice.org Calc has STDEV and STDEVP functions that calculate the two different versions of std. dev.; I imagine Excel has similar functions. On 1 September 2011 16:06, Sherif Amer wrote: > Thanks very much for the clarification, i will re create the full test > scenario and update you. > > On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: > >> On 1 September 2011 15:17, Sherif Amer wrote: >> > view result in *table* >> >> OK, I see - you mean the figure in red at the bottom of the screen. >> >> I have just written a test using the Java sampler so I can ensure that >> the correct times are created. >> >> I get the same average, but the deviation is calculated as 280, not 581 or >> 323. >> Same if I use the Summary Listener. >> >> The JMeter value agrees with the "population standard deviation", >> where the sum of square diffs is divided by the number of values (i.e. >> 4) before taking the square root. >> >> The value 323 results from dividing the sum of squares diffs by 3 (= >> 4-1) and then taking the square root. >> This is the "sample standard deviation". >> >> Both are valid interpretations of standard deviation. Perhaps JMeter >> should have used the latter, but it does not. >> >> I don't understand where the value 581 comes from. >> If you still have the raw sample data, perhaps you can create a >> Bugzilla issue and attach the JTL file with a screenshot of the Table >> Listener. >> >> > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: >> > >> >> On 1 September 2011 15:06, Sherif Amer >> wrote: >> >> > Which sampler were you using? >> >> > *HTTP request* >> >> >> >> Sorry, I meant - which Listener were you using? >> >> >> >> > Which version of JMeter? >> >> > *2.4* >> >> > >> >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: >> >> > >> >> >> On 1 September 2011 13:56, Sherif Amer >> >> wrote: >> >> >> > i made load test for 4 pages and the sample time was >> >> 426,1093,1127,921 >> >> >> and >> >> >> > when i showed the result in table >> >> >> > >> >> >> > The average was 892 which is ok >> >> >> >> >> >> Agreed. >> >> >> >> >> >> > And the deviation was 581 which is totally wrong, if you calculate >> it >> >> >> > yourself the result will simply will be 323. >> >> >> >> >> >> Which sampler were you using? >> >> >> >> >> >> Which version of JMeter? >> >> >> >> >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: >> >> >> > >> >> >> >> On 1 September 2011 13:43, Sherif Amer > > >> >> >> wrote: >> >> >> >> > hello !! >> >> >> >> > >> >> >> >> > i have question :) does Jmeter calculating the the deviation >> >> >> incorrectly >> >> >> >> in >> >> >> >> > the listener like the table and graphic shapes ? >> >> >> >> >> >> >> >> No. >> >> >> >> >> >> >> >> What makes you think the calculations are wrong? >> >> >> >> >> >> >> >> Please provide some evidence. >> >> >> >> >> >> >> >> > Regards, >> >> >> >> > >> >> >> >> > Sherif Amer >> >> >> >> > >> >> >> >> >> >> >> >> >> - >> >> >> >> To unsubscribe, e-mail: >> jmeter-user-unsubscr...@jakarta.apache.org >> >> >> >> For additional commands, e-mail: >> jmeter-user-h...@jakarta.apache.org >> >> >> >> >> >> >> >> >> >> >> > >> >> >> >> >> >> - >> >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> >> >> >> >> >> >> > >> >> >> >> - >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> >> >> >> > >> >> - >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> > - To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org
Re: Jmeter Deviation
Thanks very much for the clarification, i will re create the full test scenario and update you. On Thu, Sep 1, 2011 at 3:37 PM, sebb wrote: > On 1 September 2011 15:17, Sherif Amer wrote: > > view result in *table* > > OK, I see - you mean the figure in red at the bottom of the screen. > > I have just written a test using the Java sampler so I can ensure that > the correct times are created. > > I get the same average, but the deviation is calculated as 280, not 581 or > 323. > Same if I use the Summary Listener. > > The JMeter value agrees with the "population standard deviation", > where the sum of square diffs is divided by the number of values (i.e. > 4) before taking the square root. > > The value 323 results from dividing the sum of squares diffs by 3 (= > 4-1) and then taking the square root. > This is the "sample standard deviation". > > Both are valid interpretations of standard deviation. Perhaps JMeter > should have used the latter, but it does not. > > I don't understand where the value 581 comes from. > If you still have the raw sample data, perhaps you can create a > Bugzilla issue and attach the JTL file with a screenshot of the Table > Listener. > > > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: > > > >> On 1 September 2011 15:06, Sherif Amer > wrote: > >> > Which sampler were you using? > >> > *HTTP request* > >> > >> Sorry, I meant - which Listener were you using? > >> > >> > Which version of JMeter? > >> > *2.4* > >> > > >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: > >> > > >> >> On 1 September 2011 13:56, Sherif Amer > >> wrote: > >> >> > i made load test for 4 pages and the sample time was > >> 426,1093,1127,921 > >> >> and > >> >> > when i showed the result in table > >> >> > > >> >> > The average was 892 which is ok > >> >> > >> >> Agreed. > >> >> > >> >> > And the deviation was 581 which is totally wrong, if you calculate > it > >> >> > yourself the result will simply will be 323. > >> >> > >> >> Which sampler were you using? > >> >> > >> >> Which version of JMeter? > >> >> > >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: > >> >> > > >> >> >> On 1 September 2011 13:43, Sherif Amer > > >> >> wrote: > >> >> >> > hello !! > >> >> >> > > >> >> >> > i have question :) does Jmeter calculating the the deviation > >> >> incorrectly > >> >> >> in > >> >> >> > the listener like the table and graphic shapes ? > >> >> >> > >> >> >> No. > >> >> >> > >> >> >> What makes you think the calculations are wrong? > >> >> >> > >> >> >> Please provide some evidence. > >> >> >> > >> >> >> > Regards, > >> >> >> > > >> >> >> > Sherif Amer > >> >> >> > > >> >> >> > >> >> >> > - > >> >> >> To unsubscribe, e-mail: > jmeter-user-unsubscr...@jakarta.apache.org > >> >> >> For additional commands, e-mail: > jmeter-user-h...@jakarta.apache.org > >> >> >> > >> >> >> > >> >> > > >> >> > >> >> - > >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >> >> > >> >> > >> > > >> > >> - > >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >> > >> > > > > - > To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >
Re: Jmeter Deviation
On 1 September 2011 15:17, Sherif Amer wrote: > view result in *table* OK, I see - you mean the figure in red at the bottom of the screen. I have just written a test using the Java sampler so I can ensure that the correct times are created. I get the same average, but the deviation is calculated as 280, not 581 or 323. Same if I use the Summary Listener. The JMeter value agrees with the "population standard deviation", where the sum of square diffs is divided by the number of values (i.e. 4) before taking the square root. The value 323 results from dividing the sum of squares diffs by 3 (= 4-1) and then taking the square root. This is the "sample standard deviation". Both are valid interpretations of standard deviation. Perhaps JMeter should have used the latter, but it does not. I don't understand where the value 581 comes from. If you still have the raw sample data, perhaps you can create a Bugzilla issue and attach the JTL file with a screenshot of the Table Listener. > On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: > >> On 1 September 2011 15:06, Sherif Amer wrote: >> > Which sampler were you using? >> > *HTTP request* >> >> Sorry, I meant - which Listener were you using? >> >> > Which version of JMeter? >> > *2.4* >> > >> > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: >> > >> >> On 1 September 2011 13:56, Sherif Amer >> wrote: >> >> > i made load test for 4 pages and the sample time was >> 426,1093,1127,921 >> >> and >> >> > when i showed the result in table >> >> > >> >> > The average was 892 which is ok >> >> >> >> Agreed. >> >> >> >> > And the deviation was 581 which is totally wrong, if you calculate it >> >> > yourself the result will simply will be 323. >> >> >> >> Which sampler were you using? >> >> >> >> Which version of JMeter? >> >> >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: >> >> > >> >> >> On 1 September 2011 13:43, Sherif Amer >> >> wrote: >> >> >> > hello !! >> >> >> > >> >> >> > i have question :) does Jmeter calculating the the deviation >> >> incorrectly >> >> >> in >> >> >> > the listener like the table and graphic shapes ? >> >> >> >> >> >> No. >> >> >> >> >> >> What makes you think the calculations are wrong? >> >> >> >> >> >> Please provide some evidence. >> >> >> >> >> >> > Regards, >> >> >> > >> >> >> > Sherif Amer >> >> >> > >> >> >> >> >> >> - >> >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> >> >> >> >> >> >> > >> >> >> >> - >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> >> >> >> > >> >> - >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> > - To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org
Re: Jmeter Deviation
view result in *table* On Thu, Sep 1, 2011 at 3:13 PM, sebb wrote: > On 1 September 2011 15:06, Sherif Amer wrote: > > Which sampler were you using? > > *HTTP request* > > Sorry, I meant - which Listener were you using? > > > Which version of JMeter? > > *2.4* > > > > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: > > > >> On 1 September 2011 13:56, Sherif Amer > wrote: > >> > i made load test for 4 pages and the sample time was > 426,1093,1127,921 > >> and > >> > when i showed the result in table > >> > > >> > The average was 892 which is ok > >> > >> Agreed. > >> > >> > And the deviation was 581 which is totally wrong, if you calculate it > >> > yourself the result will simply will be 323. > >> > >> Which sampler were you using? > >> > >> Which version of JMeter? > >> > >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: > >> > > >> >> On 1 September 2011 13:43, Sherif Amer > >> wrote: > >> >> > hello !! > >> >> > > >> >> > i have question :) does Jmeter calculating the the deviation > >> incorrectly > >> >> in > >> >> > the listener like the table and graphic shapes ? > >> >> > >> >> No. > >> >> > >> >> What makes you think the calculations are wrong? > >> >> > >> >> Please provide some evidence. > >> >> > >> >> > Regards, > >> >> > > >> >> > Sherif Amer > >> >> > > >> >> > >> >> - > >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >> >> > >> >> > >> > > >> > >> - > >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >> > >> > > > > - > To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >
Re: Jmeter Deviation
On 1 September 2011 15:06, Sherif Amer wrote: > Which sampler were you using? > *HTTP request* Sorry, I meant - which Listener were you using? > Which version of JMeter? > *2.4* > > On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: > >> On 1 September 2011 13:56, Sherif Amer wrote: >> > i made load test for 4 pages and the sample time was 426,1093,1127,921 >> and >> > when i showed the result in table >> > >> > The average was 892 which is ok >> >> Agreed. >> >> > And the deviation was 581 which is totally wrong, if you calculate it >> > yourself the result will simply will be 323. >> >> Which sampler were you using? >> >> Which version of JMeter? >> >> > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: >> > >> >> On 1 September 2011 13:43, Sherif Amer >> wrote: >> >> > hello !! >> >> > >> >> > i have question :) does Jmeter calculating the the deviation >> incorrectly >> >> in >> >> > the listener like the table and graphic shapes ? >> >> >> >> No. >> >> >> >> What makes you think the calculations are wrong? >> >> >> >> Please provide some evidence. >> >> >> >> > Regards, >> >> > >> >> > Sherif Amer >> >> > >> >> >> >> - >> >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> >> >> >> > >> >> - >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> > - To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org
Re: Jmeter Deviation
Which sampler were you using? *HTTP request* Which version of JMeter? *2.4* On Thu, Sep 1, 2011 at 2:21 PM, sebb wrote: > On 1 September 2011 13:56, Sherif Amer wrote: > > i made load test for 4 pages and the sample time was 426,1093,1127,921 > and > > when i showed the result in table > > > > The average was 892 which is ok > > Agreed. > > > And the deviation was 581 which is totally wrong, if you calculate it > > yourself the result will simply will be 323. > > Which sampler were you using? > > Which version of JMeter? > > > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: > > > >> On 1 September 2011 13:43, Sherif Amer > wrote: > >> > hello !! > >> > > >> > i have question :) does Jmeter calculating the the deviation > incorrectly > >> in > >> > the listener like the table and graphic shapes ? > >> > >> No. > >> > >> What makes you think the calculations are wrong? > >> > >> Please provide some evidence. > >> > >> > Regards, > >> > > >> > Sherif Amer > >> > > >> > >> - > >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >> > >> > > > > - > To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >
Re: Jmeter Deviation
On 1 September 2011 13:56, Sherif Amer wrote: > i made load test for 4 pages and the sample time was 426,1093,1127,921 and > when i showed the result in table > > The average was 892 which is ok Agreed. > And the deviation was 581 which is totally wrong, if you calculate it > yourself the result will simply will be 323. Which sampler were you using? Which version of JMeter? > On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: > >> On 1 September 2011 13:43, Sherif Amer wrote: >> > hello !! >> > >> > i have question :) does Jmeter calculating the the deviation incorrectly >> in >> > the listener like the table and graphic shapes ? >> >> No. >> >> What makes you think the calculations are wrong? >> >> Please provide some evidence. >> >> > Regards, >> > >> > Sherif Amer >> > >> >> - >> To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org >> For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org >> >> > - To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org
Re: Jmeter Deviation
i made load test for 4 pages and the sample time was 426,1093,1127,921 and when i showed the result in table The average was 892 which is ok And the deviation was 581 which is totally wrong, if you calculate it yourself the result will simply will be 323. On Thu, Sep 1, 2011 at 1:48 PM, sebb wrote: > On 1 September 2011 13:43, Sherif Amer wrote: > > hello !! > > > > i have question :) does Jmeter calculating the the deviation incorrectly > in > > the listener like the table and graphic shapes ? > > No. > > What makes you think the calculations are wrong? > > Please provide some evidence. > > > Regards, > > > > Sherif Amer > > > > - > To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org > For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org > >
Re: Jmeter Deviation
On 1 September 2011 13:43, Sherif Amer wrote: > hello !! > > i have question :) does Jmeter calculating the the deviation incorrectly in > the listener like the table and graphic shapes ? No. What makes you think the calculations are wrong? Please provide some evidence. > Regards, > > Sherif Amer > - To unsubscribe, e-mail: jmeter-user-unsubscr...@jakarta.apache.org For additional commands, e-mail: jmeter-user-h...@jakarta.apache.org