Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Arno Garrels
Fastream Technologies wrote:
 I suspect it could be a critical section issue since we use
 multi-threads and multi-clients/thread.

Please be more specific, what critical section are you talking
about? The critical sections in OverbyteIcsWndControl.pas are
required.

 I wonder if there is limit imposed by the design.

I do not think so.

-- 
Arno Garrels

--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Fastream Technologies
Hello Arno,

On Thu, Nov 11, 2010 at 11:33 AM, Arno Garrels arno.garr...@gmx.de wrote:

 Fastream Technologies wrote:
  I suspect it could be a critical section issue since we use
  multi-threads and multi-clients/thread.

 Please be more specific, what critical section are you talking
 about? The critical sections in OverbyteIcsWndControl.pas are
 required.

  I wonder if there is limit imposed by the design.

 I do not think so.

 --
 Arno Garrels

 --
 To unsubscribe or change your settings for TWSocket mailing list
 please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
 Visit our website at http://www.overbyte.be


With reconfiguring (turning off HTML translation) via our program GUI, I
have been able to get 3X speed up to 1500 keep-alive requests/sec (when
cache is off and this is a web proxy server). So it's getting better but it
uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our
ICS-based process uses only 10% in task manager! What may be preventing it
to use 100%? We have at least number of CPU-cores of worker threads!

Regards,

SZ
--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Arno Garrels
Fastream Technologies wrote:

 So
 it's getting better but it uses less than 20% CPU overall (only 1 of
 4 cores is utilized) and our ICS-based process uses only 10% in task
 manager! What may be preventing it to use 100%? 

Looks like your instances are running all in the same thread
context, means the hidden ICS window(s) has been created in the same
thread context.

-- 
Arno Garrels


--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Fastream Technologies
On Thu, Nov 11, 2010 at 12:16 PM, Arno Garrels arno.garr...@gmx.de wrote:

 Fastream Technologies wrote:

  So
  it's getting better but it uses less than 20% CPU overall (only 1 of
  4 cores is utilized) and our ICS-based process uses only 10% in task
  manager! What may be preventing it to use 100%?

 Looks like your instances are running all in the same thread
 context, means the hidden ICS window(s) has been created in the same
 thread context.

 --
 Arno Garrels


I don't think so. Even if they were all running on the same thread, it
should be using 25% CPU (100% / 4 cores) in task manager. I will try this on
Win2008R2 to see if client Windows has any limit.

Regards,

SZ
--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Arno Garrels
Fastream Technologies wrote:
 On Thu, Nov 11, 2010 at 12:16 PM, Arno Garrels arno.garr...@gmx.de
 wrote: 
 
 Fastream Technologies wrote:
 
 So
 it's getting better but it uses less than 20% CPU overall (only 1 of
 4 cores is utilized) and our ICS-based process uses only 10% in task
 manager! What may be preventing it to use 100%?
 
 Looks like your instances are running all in the same thread
 context, means the hidden ICS window(s) has been created in the same
 thread context.
 
 I don't think so. 

This is easy to check with GetCurrentThreadID from some event handler.

 Even if they were all running on the same thread, it
 should be using 25% CPU (100% / 4 cores) in task manager. 

Depends on the the load, or maybe THttpCli's throttle is active?

-- 
Arno Garrels
--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread A Drent

Ok.

T.a.v. het betalen op rekening, kun je t.a.v. het 'ontwerp' hier nu verder 
mee?


vr.gr. Albert

- Original Message - 
From: Arno Garrels arno.garr...@gmx.de

To: ICS support mailing twsocket@elists.org
Sent: Thursday, November 11, 2010 11:16 AM
Subject: Re: [twsocket] Concurrency of multiple THttpCli instances



Fastream Technologies wrote:


So
it's getting better but it uses less than 20% CPU overall (only 1 of
4 cores is utilized) and our ICS-based process uses only 10% in task
manager! What may be preventing it to use 100%?


Looks like your instances are running all in the same thread
context, means the hidden ICS window(s) has been created in the same
thread context.

--
Arno Garrels


--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be



--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Francois PIETTE



With reconfiguring (turning off HTML translation) via our program GUI, I
have been able to get 3X speed up to 1500 keep-alive requests/sec (when
cache is off and this is a web proxy server). So it's getting better but 
it

uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our
ICS-based process uses only 10% in task manager! What may be preventing it
to use 100%? We have at least number of CPU-cores of worker threads!


Isn't the network I/O which bound the overall speed ? Or maybe disk I/O ?

--
francois.pie...@overbyte.be
http://www.overbyte.be

--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Fastream Technologies
Hello,

On Thu, Nov 11, 2010 at 2:21 PM, Francois PIETTE
francois.pie...@skynet.bewrote:


  With reconfiguring (turning off HTML translation) via our program GUI, I
 have been able to get 3X speed up to 1500 keep-alive requests/sec (when
 cache is off and this is a web proxy server). So it's getting better but
 it
 uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our
 ICS-based process uses only 10% in task manager! What may be preventing it
 to use 100%? We have at least number of CPU-cores of worker threads!


 Isn't the network I/O which bound the overall speed ? Or maybe disk I/O ?

 --
 francois.pie...@overbyte.be
 http://www.overbyte.be


 --
 To unsubscribe or change your settings for TWSocket mailing list
 please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
 Visit our website at http://www.overbyte.be


The URL is IIS folder listing and there is no caching on IQP including disk
cache. When I stress test directly to IIS7.5, it can answer with 6000
requests/sec. When I put our proxy server in between and when I turn off
HTML translation it is barely 1500 requests/sec. I wish it was at least 2500
(slightly less than half of IIS measured directly)!

These are all localhost-to-localhost.

Regards,

SZ
--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread A Drent

Sorry for this post, I was replying the wrong mail.

albert
- Original Message - 
From: A Drent albert.dr...@rug.nl

To: ICS support mailing twsocket@elists.org
Sent: Thursday, November 11, 2010 11:19 AM
Subject: Re: [twsocket] Concurrency of multiple THttpCli instances



Ok.

T.a.v. het betalen op rekening, kun je t.a.v. het 'ontwerp' hier nu verder 
mee?


vr.gr. Albert

- Original Message - 
From: Arno Garrels arno.garr...@gmx.de

To: ICS support mailing twsocket@elists.org
Sent: Thursday, November 11, 2010 11:16 AM
Subject: Re: [twsocket] Concurrency of multiple THttpCli instances



Fastream Technologies wrote:


So
it's getting better but it uses less than 20% CPU overall (only 1 of
4 cores is utilized) and our ICS-based process uses only 10% in task
manager! What may be preventing it to use 100%?


Looks like your instances are running all in the same thread
context, means the hidden ICS window(s) has been created in the same
thread context.

--
Arno Garrels


--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be



--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be



--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-11 Thread Hein du Plessis
Ek het so gehoop jy het ons nou heeltemal deurmekaar gemaak ;)

-Original Message-
From: twsocket-boun...@elists.org [mailto:twsocket-boun...@elists.org] On
Behalf Of A Drent
Sent: 11 November 2010 15:02
To: ICS support mailing
Subject: Re: [twsocket] Concurrency of multiple THttpCli instances

Sorry for this post, I was replying the wrong mail.

albert
- Original Message - 
From: A Drent albert.dr...@rug.nl
To: ICS support mailing twsocket@elists.org
Sent: Thursday, November 11, 2010 11:19 AM
Subject: Re: [twsocket] Concurrency of multiple THttpCli instances


 Ok.

 T.a.v. het betalen op rekening, kun je t.a.v. het 'ontwerp' hier nu verder

 mee?

 vr.gr. Albert

 - Original Message - 
 From: Arno Garrels arno.garr...@gmx.de
 To: ICS support mailing twsocket@elists.org
 Sent: Thursday, November 11, 2010 11:16 AM
 Subject: Re: [twsocket] Concurrency of multiple THttpCli instances


 Fastream Technologies wrote:

 So
 it's getting better but it uses less than 20% CPU overall (only 1 of
 4 cores is utilized) and our ICS-based process uses only 10% in task
 manager! What may be preventing it to use 100%?

 Looks like your instances are running all in the same thread
 context, means the hidden ICS window(s) has been created in the same
 thread context.

 -- 
 Arno Garrels


 --
 To unsubscribe or change your settings for TWSocket mailing list
 please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
 Visit our website at http://www.overbyte.be


 --
 To unsubscribe or change your settings for TWSocket mailing list
 please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
 Visit our website at http://www.overbyte.be
 

--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be


Re: [twsocket] Concurrency of multiple THttpCli instances

2010-11-10 Thread Fastream Technologies
I suspect it could be a critical section issue since we use multi-threads
and multi-clients/thread.

SZ

On Wed, Nov 10, 2010 at 5:39 PM, Fastream Technologies
ga...@fastream.comwrote:

 Hello,

 I wonder if there is limit imposed by the design. The issue I saw during
 our tests is when the cache is disabled (when one THttpCli's instance is
 used by the proxy server connection socket), and when the file size is small
 (1-10KB), the proxy server cannot use more than one CPU core! When I enable
 cache (THttpConnection's only) and/or raise file size to 500KB-1MB, it can
 use the 4 cores. Hence I believe there ought to be a critical section
 somewhere for the entire client sockets.

 Any solution to this?

 Best Regards,

 SZ

--
To unsubscribe or change your settings for TWSocket mailing list
please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket
Visit our website at http://www.overbyte.be