[Zope-dev] Wrong length for http requests!
Hi! I am getting the following results from an ab (Apache benchmark) run against a Zope site: Concurrency Level: 20 Time taken for tests: 11.862 seconds Complete requests: 40 Failed requests:23 (Connect: 0, Length: 23, Exceptions: 0) Total transferred: 1517831 bytes HTML transferred: 1504991 bytes Requests per second:3.37 Transfer rate: 127.96 kb/s received Connnection Times (ms) min avg max Connect:0 2 8 Processing: 326 4525 5953 Total:326 4527 5961 The failed requests are due to a length error. When I look at the detailed log, I see differing lengths for requests to exactly the same page: B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html I 161954188 2002-06-07T20:55:01 0 A 162098188 2002-06-07T20:55:01 200 37947 E 162098188 2002-06-07T20:55:01 B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html I 159004660 2002-06-07T20:55:01 0 A 159706548 2002-06-07T20:55:01 200 37963 E 159706548 2002-06-07T20:55:01 B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html I 158147100 2002-06-07T20:55:01 0 A 159649356 2002-06-07T20:55:02 200 37923 E 159649356 2002-06-07T20:55:02 Does anybody know where that might come from? I will get into more detail on how the page is generated if you need to know. But I'd need a first hint where to look at first because there is lot of code involved ... Cheers Joachim ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Wrong length for http requests!
Maybe the headers are different? Try to increase the verbosity level for ab to get the output of the headers and the payload. Maybe you can find something there. -aj - Original Message - From: Joachim Werner [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Friday, June 07, 2002 15:03 Subject: [Zope-dev] Wrong length for http requests! Hi! I am getting the following results from an ab (Apache benchmark) run against a Zope site: Concurrency Level: 20 Time taken for tests: 11.862 seconds Complete requests: 40 Failed requests:23 (Connect: 0, Length: 23, Exceptions: 0) Total transferred: 1517831 bytes HTML transferred: 1504991 bytes Requests per second:3.37 Transfer rate: 127.96 kb/s received Connnection Times (ms) min avg max Connect:0 2 8 Processing: 326 4525 5953 Total:326 4527 5961 The failed requests are due to a length error. When I look at the detailed log, I see differing lengths for requests to exactly the same page: B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html I 161954188 2002-06-07T20:55:01 0 A 162098188 2002-06-07T20:55:01 200 37947 E 162098188 2002-06-07T20:55:01 B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html I 159004660 2002-06-07T20:55:01 0 A 159706548 2002-06-07T20:55:01 200 37963 E 159706548 2002-06-07T20:55:01 B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html I 158147100 2002-06-07T20:55:01 0 A 159649356 2002-06-07T20:55:02 200 37923 E 159649356 2002-06-07T20:55:02 Does anybody know where that might come from? I will get into more detail on how the page is generated if you need to know. But I'd need a first hint where to look at first because there is lot of code involved ... Cheers Joachim ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Wrong length for http requests!
- Original Message - From: Joachim Werner [EMAIL PROTECTED] To: Andreas Jung [EMAIL PROTECTED] Sent: Friday, June 07, 2002 9:31 PM Subject: Re: [Zope-dev] Wrong length for http requests! Hi! I tried with more verbosity. The result is that the headers' Content_Length differs. I now have a first guess on what happens: The page that is delivered is not really static, but has a rotating news box. From a pool of news, random news items are chosen and displayed. I use the random method to generate the random numbers. Is it possible that the length calculation for the header uses a different random number than the method that selects the news? Maybe because the method is called twice, once to calculate the length and once to actually serve the data? If yes, is there a workaround or fix? Cheers Joachim - Original Message - From: Andreas Jung [EMAIL PROTECTED] To: Joachim Werner [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Friday, June 07, 2002 9:11 PM Subject: Re: [Zope-dev] Wrong length for http requests! Maybe the headers are different? Try to increase the verbosity level for ab to get the output of the headers and the payload. Maybe you can find something there. -aj - Original Message - From: Joachim Werner [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Friday, June 07, 2002 15:03 Subject: [Zope-dev] Wrong length for http requests! Hi! I am getting the following results from an ab (Apache benchmark) run against a Zope site: Concurrency Level: 20 Time taken for tests: 11.862 seconds Complete requests: 40 Failed requests:23 (Connect: 0, Length: 23, Exceptions: 0) Total transferred: 1517831 bytes HTML transferred: 1504991 bytes Requests per second:3.37 Transfer rate: 127.96 kb/s received Connnection Times (ms) min avg max Connect:0 2 8 Processing: 326 4525 5953 Total:326 4527 5961 The failed requests are due to a length error. When I look at the detailed log, I see differing lengths for requests to exactly the same page: B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html I 161954188 2002-06-07T20:55:01 0 A 162098188 2002-06-07T20:55:01 200 37947 E 162098188 2002-06-07T20:55:01 B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html I 159004660 2002-06-07T20:55:01 0 A 159706548 2002-06-07T20:55:01 200 37963 E 159706548 2002-06-07T20:55:01 B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html I 158147100 2002-06-07T20:55:01 0 A 159649356 2002-06-07T20:55:02 200 37923 E 159649356 2002-06-07T20:55:02 Does anybody know where that might come from? I will get into more detail on how the page is generated if you need to know. But I'd need a first hint where to look at first because there is lot of code involved ... Cheers Joachim ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Wrong length for http requests!
When I run ab with -v20 it prints out the complete headers for *every* HTTP request including the payload. Redirect the output and as first step I would grep for 'Content-Length'. They should be the same for every single request... -aj - Original Message - From: Joachim Werner [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Friday, June 07, 2002 15:32 Subject: Re: [Zope-dev] Wrong length for http requests! - Original Message - From: Joachim Werner [EMAIL PROTECTED] To: Andreas Jung [EMAIL PROTECTED] Sent: Friday, June 07, 2002 9:31 PM Subject: Re: [Zope-dev] Wrong length for http requests! Hi! I tried with more verbosity. The result is that the headers' Content_Length differs. I now have a first guess on what happens: The page that is delivered is not really static, but has a rotating news box. From a pool of news, random news items are chosen and displayed. I use the random method to generate the random numbers. Is it possible that the length calculation for the header uses a different random number than the method that selects the news? Maybe because the method is called twice, once to calculate the length and once to actually serve the data? If yes, is there a workaround or fix? Cheers Joachim - Original Message - From: Andreas Jung [EMAIL PROTECTED] To: Joachim Werner [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Friday, June 07, 2002 9:11 PM Subject: Re: [Zope-dev] Wrong length for http requests! Maybe the headers are different? Try to increase the verbosity level for ab to get the output of the headers and the payload. Maybe you can find something there. -aj - Original Message - From: Joachim Werner [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Friday, June 07, 2002 15:03 Subject: [Zope-dev] Wrong length for http requests! Hi! I am getting the following results from an ab (Apache benchmark) run against a Zope site: Concurrency Level: 20 Time taken for tests: 11.862 seconds Complete requests: 40 Failed requests:23 (Connect: 0, Length: 23, Exceptions: 0) Total transferred: 1517831 bytes HTML transferred: 1504991 bytes Requests per second:3.37 Transfer rate: 127.96 kb/s received Connnection Times (ms) min avg max Connect:0 2 8 Processing: 326 4525 5953 Total:326 4527 5961 The failed requests are due to a length error. When I look at the detailed log, I see differing lengths for requests to exactly the same page: B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html I 161954188 2002-06-07T20:55:01 0 A 162098188 2002-06-07T20:55:01 200 37947 E 162098188 2002-06-07T20:55:01 B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html I 159004660 2002-06-07T20:55:01 0 A 159706548 2002-06-07T20:55:01 200 37963 E 159706548 2002-06-07T20:55:01 B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html I 158147100 2002-06-07T20:55:01 0 A 159649356 2002-06-07T20:55:02 200 37923 E 159649356 2002-06-07T20:55:02 Does anybody know where that might come from? I will get into more detail on how the page is generated if you need to know. But I'd need a first hint where to look at first because there is lot of code involved ... Cheers Joachim ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Wrong length for http requests!
Hi! I finally got it: It's not Zope that causes any trouble, it's ab. It seems to expect identical sizes for the pages retrieved. What I checked was commit a change to a test page (which was absolutely static) in the middle of an ab run. The result was almost 55% failed requests ... Cheers Joachim ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )