[Zope-dev] Wrong length for http requests!

2002-06-07 Thread Joachim Werner

Hi!

I am getting the following results from an ab (Apache benchmark) run against
a Zope site:

Concurrency Level:  20
Time taken for tests:   11.862 seconds
Complete requests:  40
Failed requests:23
   (Connect: 0, Length: 23, Exceptions: 0)
Total transferred:  1517831 bytes
HTML transferred:   1504991 bytes
Requests per second:3.37
Transfer rate:  127.96 kb/s received

Connnection Times (ms)
  min   avg   max
Connect:0 2 8
Processing:   326  4525  5953
Total:326  4527  5961

The failed requests are due to a length error. When I look at the detailed
log, I see differing lengths for requests to exactly the same page:

B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html
I 161954188 2002-06-07T20:55:01 0
A 162098188 2002-06-07T20:55:01 200 37947
E 162098188 2002-06-07T20:55:01
B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html
I 159004660 2002-06-07T20:55:01 0
A 159706548 2002-06-07T20:55:01 200 37963
E 159706548 2002-06-07T20:55:01
B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html
I 158147100 2002-06-07T20:55:01 0
A 159649356 2002-06-07T20:55:02 200 37923
E 159649356 2002-06-07T20:55:02

Does anybody know where that might come from? I will get into more detail on
how the page is generated if you need to know. But I'd need a first hint
where to look at first because there is lot of code involved ...

Cheers

Joachim







___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Wrong length for http requests!

2002-06-07 Thread Andreas Jung

Maybe the headers are different? Try to increase the verbosity level
for ab to get the output of the headers and the payload. Maybe you can
find something there.

-aj
- Original Message -
From: Joachim Werner [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Sent: Friday, June 07, 2002 15:03
Subject: [Zope-dev] Wrong length for http requests!


 Hi!

 I am getting the following results from an ab (Apache benchmark) run
against
 a Zope site:

 Concurrency Level:  20
 Time taken for tests:   11.862 seconds
 Complete requests:  40
 Failed requests:23
(Connect: 0, Length: 23, Exceptions: 0)
 Total transferred:  1517831 bytes
 HTML transferred:   1504991 bytes
 Requests per second:3.37
 Transfer rate:  127.96 kb/s received

 Connnection Times (ms)
   min   avg   max
 Connect:0 2 8
 Processing:   326  4525  5953
 Total:326  4527  5961

 The failed requests are due to a length error. When I look at the detailed
 log, I see differing lengths for requests to exactly the same page:

 B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html
 I 161954188 2002-06-07T20:55:01 0
 A 162098188 2002-06-07T20:55:01 200 37947
 E 162098188 2002-06-07T20:55:01
 B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html
 I 159004660 2002-06-07T20:55:01 0
 A 159706548 2002-06-07T20:55:01 200 37963
 E 159706548 2002-06-07T20:55:01
 B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html
 I 158147100 2002-06-07T20:55:01 0
 A 159649356 2002-06-07T20:55:02 200 37923
 E 159649356 2002-06-07T20:55:02

 Does anybody know where that might come from? I will get into more detail
on
 how the page is generated if you need to know. But I'd need a first hint
 where to look at first because there is lot of code involved ...

 Cheers

 Joachim







 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists -
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Wrong length for http requests!

2002-06-07 Thread Joachim Werner


- Original Message -
From: Joachim Werner [EMAIL PROTECTED]
To: Andreas Jung [EMAIL PROTECTED]
Sent: Friday, June 07, 2002 9:31 PM
Subject: Re: [Zope-dev] Wrong length for http requests!


 Hi!

 I tried with more verbosity. The result is that the headers'
Content_Length
 differs.

 I now have a first guess on what happens: The page that is delivered is
not
 really static, but has a rotating news box. From a pool of news, random
news
 items are chosen and displayed.

 I use the random method to generate the random numbers. Is it possible
that
 the length calculation for the header uses a different random number than
 the method that selects the news? Maybe because the method is called
twice,
 once to calculate the length and once to actually serve the data?

 If yes, is there a workaround or fix?

 Cheers

 Joachim


 - Original Message -
 From: Andreas Jung [EMAIL PROTECTED]
 To: Joachim Werner [EMAIL PROTECTED]; [EMAIL PROTECTED]
 Sent: Friday, June 07, 2002 9:11 PM
 Subject: Re: [Zope-dev] Wrong length for http requests!


  Maybe the headers are different? Try to increase the verbosity level
  for ab to get the output of the headers and the payload. Maybe you can
  find something there.
 
  -aj
  - Original Message -
  From: Joachim Werner [EMAIL PROTECTED]
  To: [EMAIL PROTECTED]
  Sent: Friday, June 07, 2002 15:03
  Subject: [Zope-dev] Wrong length for http requests!
 
 
   Hi!
  
   I am getting the following results from an ab (Apache benchmark) run
  against
   a Zope site:
  
   Concurrency Level:  20
   Time taken for tests:   11.862 seconds
   Complete requests:  40
   Failed requests:23
  (Connect: 0, Length: 23, Exceptions: 0)
   Total transferred:  1517831 bytes
   HTML transferred:   1504991 bytes
   Requests per second:3.37
   Transfer rate:  127.96 kb/s received
  
   Connnection Times (ms)
 min   avg   max
   Connect:0 2 8
   Processing:   326  4525  5953
   Total:326  4527  5961
  
   The failed requests are due to a length error. When I look at the
 detailed
   log, I see differing lengths for requests to exactly the same page:
  
   B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html
   I 161954188 2002-06-07T20:55:01 0
   A 162098188 2002-06-07T20:55:01 200 37947
   E 162098188 2002-06-07T20:55:01
   B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html
   I 159004660 2002-06-07T20:55:01 0
   A 159706548 2002-06-07T20:55:01 200 37963
   E 159706548 2002-06-07T20:55:01
   B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html
   I 158147100 2002-06-07T20:55:01 0
   A 159649356 2002-06-07T20:55:02 200 37923
   E 159649356 2002-06-07T20:55:02
  
   Does anybody know where that might come from? I will get into more
 detail
  on
   how the page is generated if you need to know. But I'd need a first
hint
   where to look at first because there is lot of code involved ...
  
   Cheers
  
   Joachim
  
  
  
  
  
  
  
   ___
   Zope-Dev maillist  -  [EMAIL PROTECTED]
   http://lists.zope.org/mailman/listinfo/zope-dev
   **  No cross posts or HTML encoding!  **
   (Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope )
  
 
 




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Wrong length for http requests!

2002-06-07 Thread Andreas Jung

When I run ab with -v20 it prints out the complete
headers for *every* HTTP request including the payload.
Redirect the output and as first step I would
grep for 'Content-Length'. They should be the same for
every single request...

-aj
- Original Message -
From: Joachim Werner [EMAIL PROTECTED]
To: [EMAIL PROTECTED]
Sent: Friday, June 07, 2002 15:32
Subject: Re: [Zope-dev] Wrong length for http requests!



 - Original Message -
 From: Joachim Werner [EMAIL PROTECTED]
 To: Andreas Jung [EMAIL PROTECTED]
 Sent: Friday, June 07, 2002 9:31 PM
 Subject: Re: [Zope-dev] Wrong length for http requests!


  Hi!
 
  I tried with more verbosity. The result is that the headers'
 Content_Length
  differs.
 
  I now have a first guess on what happens: The page that is delivered is
 not
  really static, but has a rotating news box. From a pool of news, random
 news
  items are chosen and displayed.
 
  I use the random method to generate the random numbers. Is it possible
 that
  the length calculation for the header uses a different random number
than
  the method that selects the news? Maybe because the method is called
 twice,
  once to calculate the length and once to actually serve the data?
 
  If yes, is there a workaround or fix?
 
  Cheers
 
  Joachim
 
 
  - Original Message -
  From: Andreas Jung [EMAIL PROTECTED]
  To: Joachim Werner [EMAIL PROTECTED]; [EMAIL PROTECTED]
  Sent: Friday, June 07, 2002 9:11 PM
  Subject: Re: [Zope-dev] Wrong length for http requests!
 
 
   Maybe the headers are different? Try to increase the verbosity level
   for ab to get the output of the headers and the payload. Maybe you can
   find something there.
  
   -aj
   - Original Message -
   From: Joachim Werner [EMAIL PROTECTED]
   To: [EMAIL PROTECTED]
   Sent: Friday, June 07, 2002 15:03
   Subject: [Zope-dev] Wrong length for http requests!
  
  
Hi!
   
I am getting the following results from an ab (Apache benchmark) run
   against
a Zope site:
   
Concurrency Level:  20
Time taken for tests:   11.862 seconds
Complete requests:  40
Failed requests:23
   (Connect: 0, Length: 23, Exceptions: 0)
Total transferred:  1517831 bytes
HTML transferred:   1504991 bytes
Requests per second:3.37
Transfer rate:  127.96 kb/s received
   
Connnection Times (ms)
  min   avg   max
Connect:0 2 8
Processing:   326  4525  5953
Total:326  4527  5961
   
The failed requests are due to a length error. When I look at the
  detailed
log, I see differing lengths for requests to exactly the same page:
   
B 161954188 2002-06-07T20:55:01 GET /instances/KU/index_html
I 161954188 2002-06-07T20:55:01 0
A 162098188 2002-06-07T20:55:01 200 37947
E 162098188 2002-06-07T20:55:01
B 159004660 2002-06-07T20:55:01 GET /instances/KU/index_html
I 159004660 2002-06-07T20:55:01 0
A 159706548 2002-06-07T20:55:01 200 37963
E 159706548 2002-06-07T20:55:01
B 158147100 2002-06-07T20:55:01 GET /instances/KU/index_html
I 158147100 2002-06-07T20:55:01 0
A 159649356 2002-06-07T20:55:02 200 37923
E 159649356 2002-06-07T20:55:02
   
Does anybody know where that might come from? I will get into more
  detail
   on
how the page is generated if you need to know. But I'd need a first
 hint
where to look at first because there is lot of code involved ...
   
Cheers
   
Joachim
   
   
   
   
   
   
   
___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )
   
  
  
 



 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists -
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )




___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] Wrong length for http requests!

2002-06-07 Thread Joachim Werner

Hi!

I finally got it:

It's not Zope that causes any trouble, it's ab. It seems to expect identical
sizes for the pages retrieved. What I checked was commit a change to a test
page (which was absolutely static) in the middle of an ab run. The result
was almost 55% failed requests ...

Cheers

Joachim



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )