Re: [twsocket] Concurrency of multiple THttpCli instances
Ek het so gehoop jy het ons nou heeltemal deurmekaar gemaak ;) -Original Message- From: twsocket-boun...@elists.org [mailto:twsocket-boun...@elists.org] On Behalf Of A Drent Sent: 11 November 2010 15:02 To: ICS support mailing Subject: Re: [twsocket] Concurrency of multiple THttpCli instances Sorry for this post, I was replying the wrong mail. albert - Original Message - From: "A Drent" To: "ICS support mailing" Sent: Thursday, November 11, 2010 11:19 AM Subject: Re: [twsocket] Concurrency of multiple THttpCli instances > Ok. > > T.a.v. het betalen op rekening, kun je t.a.v. het 'ontwerp' hier nu verder > mee? > > vr.gr. Albert > > - Original Message - > From: "Arno Garrels" > To: "ICS support mailing" > Sent: Thursday, November 11, 2010 11:16 AM > Subject: Re: [twsocket] Concurrency of multiple THttpCli instances > > >> Fastream Technologies wrote: >> >>> So >>> it's getting better but it uses less than 20% CPU overall (only 1 of >>> 4 cores is utilized) and our ICS-based process uses only 10% in task >>> manager! What may be preventing it to use 100%? >> >> Looks like your instances are running all in the same thread >> context, means the hidden ICS window(s) has been created in the same >> thread context. >> >> -- >> Arno Garrels >> >> >> -- >> To unsubscribe or change your settings for TWSocket mailing list >> please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket >> Visit our website at http://www.overbyte.be >> > > -- > To unsubscribe or change your settings for TWSocket mailing list > please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket > Visit our website at http://www.overbyte.be > -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
Sorry for this post, I was replying the wrong mail. albert - Original Message - From: "A Drent" To: "ICS support mailing" Sent: Thursday, November 11, 2010 11:19 AM Subject: Re: [twsocket] Concurrency of multiple THttpCli instances Ok. T.a.v. het betalen op rekening, kun je t.a.v. het 'ontwerp' hier nu verder mee? vr.gr. Albert - Original Message - From: "Arno Garrels" To: "ICS support mailing" Sent: Thursday, November 11, 2010 11:16 AM Subject: Re: [twsocket] Concurrency of multiple THttpCli instances Fastream Technologies wrote: So it's getting better but it uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our ICS-based process uses only 10% in task manager! What may be preventing it to use 100%? Looks like your instances are running all in the same thread context, means the hidden ICS window(s) has been created in the same thread context. -- Arno Garrels -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
Hello, On Thu, Nov 11, 2010 at 2:21 PM, Francois PIETTE wrote: > > With reconfiguring (turning off HTML translation) via our program GUI, I >> have been able to get 3X speed up to 1500 keep-alive requests/sec (when >> cache is off and this is a web proxy server). So it's getting better but >> it >> uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our >> ICS-based process uses only 10% in task manager! What may be preventing it >> to use 100%? We have at least number of CPU-cores of worker threads! >> > > Isn't the network I/O which bound the overall speed ? Or maybe disk I/O ? > > -- > francois.pie...@overbyte.be > http://www.overbyte.be > > > -- > To unsubscribe or change your settings for TWSocket mailing list > please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket > Visit our website at http://www.overbyte.be > The URL is IIS folder listing and there is no caching on IQP including disk cache. When I stress test directly to IIS7.5, it can answer with 6000 requests/sec. When I put our proxy server in between and when I turn off HTML translation it is barely 1500 requests/sec. I wish it was at least 2500 (slightly less than half of IIS measured directly)! These are all localhost-to-localhost. Regards, SZ -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
With reconfiguring (turning off HTML translation) via our program GUI, I have been able to get 3X speed up to 1500 keep-alive requests/sec (when cache is off and this is a web proxy server). So it's getting better but it uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our ICS-based process uses only 10% in task manager! What may be preventing it to use 100%? We have at least number of CPU-cores of worker threads! Isn't the network I/O which bound the overall speed ? Or maybe disk I/O ? -- francois.pie...@overbyte.be http://www.overbyte.be -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
Ok. T.a.v. het betalen op rekening, kun je t.a.v. het 'ontwerp' hier nu verder mee? vr.gr. Albert - Original Message - From: "Arno Garrels" To: "ICS support mailing" Sent: Thursday, November 11, 2010 11:16 AM Subject: Re: [twsocket] Concurrency of multiple THttpCli instances Fastream Technologies wrote: So it's getting better but it uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our ICS-based process uses only 10% in task manager! What may be preventing it to use 100%? Looks like your instances are running all in the same thread context, means the hidden ICS window(s) has been created in the same thread context. -- Arno Garrels -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
Fastream Technologies wrote: > On Thu, Nov 11, 2010 at 12:16 PM, Arno Garrels > wrote: > >> Fastream Technologies wrote: >> >>> So >>> it's getting better but it uses less than 20% CPU overall (only 1 of >>> 4 cores is utilized) and our ICS-based process uses only 10% in task >>> manager! What may be preventing it to use 100%? >> >> Looks like your instances are running all in the same thread >> context, means the hidden ICS window(s) has been created in the same >> thread context. >> > I don't think so. This is easy to check with GetCurrentThreadID from some event handler. > Even if they were all running on the same thread, it > should be using 25% CPU (100% / 4 cores) in task manager. Depends on the the load, or maybe THttpCli's throttle is active? -- Arno Garrels -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
On Thu, Nov 11, 2010 at 12:16 PM, Arno Garrels wrote: > Fastream Technologies wrote: > > > So > > it's getting better but it uses less than 20% CPU overall (only 1 of > > 4 cores is utilized) and our ICS-based process uses only 10% in task > > manager! What may be preventing it to use 100%? > > Looks like your instances are running all in the same thread > context, means the hidden ICS window(s) has been created in the same > thread context. > > -- > Arno Garrels > > I don't think so. Even if they were all running on the same thread, it should be using 25% CPU (100% / 4 cores) in task manager. I will try this on Win2008R2 to see if client Windows has any limit. Regards, SZ -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
Fastream Technologies wrote: > So > it's getting better but it uses less than 20% CPU overall (only 1 of > 4 cores is utilized) and our ICS-based process uses only 10% in task > manager! What may be preventing it to use 100%? Looks like your instances are running all in the same thread context, means the hidden ICS window(s) has been created in the same thread context. -- Arno Garrels -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
Hello Arno, On Thu, Nov 11, 2010 at 11:33 AM, Arno Garrels wrote: > Fastream Technologies wrote: > > I suspect it could be a critical section issue since we use > > multi-threads and multi-clients/thread. > > Please be more specific, what critical section are you talking > about? The critical sections in OverbyteIcsWndControl.pas are > required. > > >> I wonder if there is limit imposed by the design. > > I do not think so. > > -- > Arno Garrels > > -- > To unsubscribe or change your settings for TWSocket mailing list > please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket > Visit our website at http://www.overbyte.be > With reconfiguring (turning off HTML translation) via our program GUI, I have been able to get 3X speed up to 1500 keep-alive requests/sec (when cache is off and this is a web proxy server). So it's getting better but it uses less than 20% CPU overall (only 1 of 4 cores is utilized) and our ICS-based process uses only 10% in task manager! What may be preventing it to use 100%? We have at least number of CPU-cores of worker threads! Regards, SZ -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
Fastream Technologies wrote: > I suspect it could be a critical section issue since we use > multi-threads and multi-clients/thread. Please be more specific, what critical section are you talking about? The critical sections in OverbyteIcsWndControl.pas are required. >> I wonder if there is limit imposed by the design. I do not think so. -- Arno Garrels -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
Re: [twsocket] Concurrency of multiple THttpCli instances
I suspect it could be a critical section issue since we use multi-threads and multi-clients/thread. SZ On Wed, Nov 10, 2010 at 5:39 PM, Fastream Technologies wrote: > Hello, > > I wonder if there is limit imposed by the design. The issue I saw during > our tests is when the cache is disabled (when one THttpCli's instance is > used by the proxy server connection socket), and when the file size is small > (1-10KB), the proxy server cannot use more than one CPU core! When I enable > cache (THttpConnection's only) and/or raise file size to 500KB-1MB, it can > use the 4 cores. Hence I believe there ought to be a critical section > somewhere for the entire client sockets. > > Any solution to this? > > Best Regards, > > SZ > -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
[twsocket] Concurrency of multiple THttpCli instances
Hello, I wonder if there is limit imposed by the design. The issue I saw during our tests is when the cache is disabled (when one THttpCli's instance is used by the proxy server connection socket), and when the file size is small (1-10KB), the proxy server cannot use more than one CPU core! When I enable cache (THttpConnection's only) and/or raise file size to 500KB-1MB, it can use the 4 cores. Hence I believe there ought to be a critical section somewhere for the entire client sockets. Any solution to this? Best Regards, SZ -- To unsubscribe or change your settings for TWSocket mailing list please goto http://lists.elists.org/cgi-bin/mailman/listinfo/twsocket Visit our website at http://www.overbyte.be
