RE: FW: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-27 Thread Arshiya Shariff
Hi all, Thanks for the update Christopher. I tried modifying our application as below i.e by adding a read Listener and processing the requests after all the data is read (onDataAvailable()) . But I can still see the StackOverFlow Error printed . AsyncContext asyncContext =

Re: FW: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-21 Thread Christopher Schultz
Arshiya, On 10/21/20 00:34, Arshiya Shariff wrote: > Hi, > > Christopher, Please find the answer in-line: > How... exactly? > private String getRequestBody(HttpServletRequest request) throws IOException > { > StringBuilder sb = new StringBuilder(); >

RE: FW: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-20 Thread Arshiya Shariff
Hi, Christopher, Please find the answer in-line: How... exactly? private String getRequestBody(HttpServletRequest request) throws IOException { StringBuilder sb = new StringBuilder(); BufferedReader reader = request.getReader(); try

Re: FW: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-14 Thread Christopher Schultz
Arshiya, On 10/14/20 01:23, Arshiya Shariff wrote: > Please find the answers in-line Mark. > > Http2 requests with message payload of 34KB are pumped from JMeter > at 20 TPS with 700 connections to an application with Embedded tomcat > - 9.0.39 (max-Threads : 200, all other values are the

FW: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-13 Thread Arshiya Shariff
Hi , Please find the answers in-line Mark. Http2 requests with message payload of 34KB are pumped from JMeter at 20 TPS with 700 connections to an application with Embedded tomcat - 9.0.39 (max-Threads : 200, all other values are the tomcat defaults) What does that URL do with the POSTed

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-12 Thread Mark Thomas
On 12/10/2020 08:02, Arshiya Shariff wrote: > Hi Mark , > > The issue is reproduced with version 9.0.39 as well. Max threads in Tomcat is > 200. > > Please find the case: > Client:JMeter 5.2.1 (With http2 plugin) > TPS: around 20 > No of users from JMeter : 700 > Message payload size: 6 KB to

RE: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-12 Thread Arshiya Shariff
Hi Mark , The issue is reproduced with version 9.0.39 as well. Max threads in Tomcat is 200. Please find the case: Client:JMeter 5.2.1 (With http2 plugin) TPS: around 20 No of users from JMeter : 700 Message payload size: 6 KB to 34 KB Loop: Infinite We let the loop run infinitely and see the

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-09 Thread Mark Thomas
On 09/10/2020 12:32, Arshiya Shariff wrote: > Hi, > > Mark , with the test runs that I performed over clean 9.0.x branch I was not > able to reproduce this. Good. But I'd really like to understand why... > But with 9.0.38 and the jars built from 9.0.x with hash: >

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-09 Thread Martin Grigorov
Hi Arshiya, On Fri, Oct 9, 2020 at 2:33 PM Arshiya Shariff wrote: > Hi, > > Mark , with the test runs that I performed over clean 9.0.x branch I was > not able to reproduce this. But with 9.0.38 and the jars built from 9.0.x > with hash: c8ec2d4cde3a31b0e9df9a30e7915d77ba725545 , with 700 or

RE: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-09 Thread Arshiya Shariff
Hi, Mark , with the test runs that I performed over clean 9.0.x branch I was not able to reproduce this. But with 9.0.38 and the jars built from 9.0.x with hash: c8ec2d4cde3a31b0e9df9a30e7915d77ba725545 , with 700 or 1000 users (connections) and on sending 1000 Requests per second (or even

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-05 Thread Mark Thomas
On 05/10/2020 10:56, Arshiya Shariff wrote: > Hi All, > > Thank you so much Mark . > We tested the jars built from latest 9.0.x with 2000 / 5000 users > (connections) from JMeter , We see a very good improvement with the heap > usage Good news. As is the fact that the other errors have

RE: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-05 Thread Arshiya Shariff
Hi All, Thank you so much Mark . We tested the jars built from latest 9.0.x with 2000 / 5000 users (connections) from JMeter , We see a very good improvement with the heap usage . But I see this exception printed multiple times , I am not sure why this occurs : Exception in thread

RE: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-01 Thread Arshiya Shariff
Thank you so much Mark . We will test and keep you posted . Thanks and Regards Arshiya Shariff -Original Message- From: Mark Thomas Sent: Thursday, October 1, 2020 2:59 PM To: users@tomcat.apache.org Subject: Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-01 Thread Martin Grigorov
On Thu, Oct 1, 2020 at 12:29 PM Mark Thomas wrote: > On 30/09/2020 18:47, Martin Grigorov wrote: > > On Wed, Sep 30, 2020 at 7:47 PM Mark Thomas wrote: > >> On 30/09/2020 16:17, Mark Thomas wrote: > > > > >>> That is helpful. Looks like you have found a way to reproduce the > buffer > >>>

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-10-01 Thread Mark Thomas
On 30/09/2020 18:47, Martin Grigorov wrote: > On Wed, Sep 30, 2020 at 7:47 PM Mark Thomas wrote: >> On 30/09/2020 16:17, Mark Thomas wrote: >>> That is helpful. Looks like you have found a way to reproduce the buffer >>> issues reported in https://bz.apache.org/bugzilla/show_bug.cgi?id=64710

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Martin Grigorov
On Wed, Sep 30, 2020 at 7:47 PM Mark Thomas wrote: > On 30/09/2020 16:17, Mark Thomas wrote: > > On 30/09/2020 13:53, Martin Grigorov wrote: > >> On Wed, Sep 30, 2020 at 12:50 PM Martin Grigorov > > > > > > > > > >> When I load test HTTP2 with POST (with big bodies) there are many errors > >>

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Mark Thomas
On 30/09/2020 16:17, Mark Thomas wrote: > On 30/09/2020 13:53, Martin Grigorov wrote: >> On Wed, Sep 30, 2020 at 12:50 PM Martin Grigorov > > > > >> When I load test HTTP2 with POST (with big bodies) there are many errors >> like: >> >> 1) >> Exception in thread "https-jsse-nio-8080-exec-5"

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Mark Thomas
On 30/09/2020 09:32, Arshiya Shariff wrote: > Thank you for the response Mark , > >>> Are you able to test with a custom Tomcat build and/or build Tomcat 9 from >>> source for testing? > Yes Mark , we will be able to test with the jars built from Tomcat 9 source > for testing . The reduced

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Mark Thomas
On 30/09/2020 13:53, Martin Grigorov wrote: > On Wed, Sep 30, 2020 at 12:50 PM Martin Grigorov > When I load test HTTP2 with POST (with big bodies) there are many errors > like: > > 1) > Exception in thread "https-jsse-nio-8080-exec-5" > java.nio.BufferOverflowException > at

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Martin Grigorov
On Wed, Sep 30, 2020 at 12:50 PM Martin Grigorov wrote: > Hi, > > On Wed, Sep 30, 2020 at 11:35 AM Mark Thomas wrote: > >> On 30/09/2020 06:42, Arshiya Shariff wrote: >> > Hi Martin , >> > >> > Thank you for the response. >> > >> > With a payload of 200 bytes we were able to send 20K

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Martin Grigorov
Hi, On Wed, Sep 30, 2020 at 11:35 AM Mark Thomas wrote: > On 30/09/2020 06:42, Arshiya Shariff wrote: > > Hi Martin , > > > > Thank you for the response. > > > > With a payload of 200 bytes we were able to send 20K requests/sec with > 200 users from Jmeter without any memory issue . On

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Mark Thomas
On 30/09/2020 06:42, Arshiya Shariff wrote: > Hi Martin , > > Thank you for the response. > > With a payload of 200 bytes we were able to send 20K requests/sec with 200 > users from Jmeter without any memory issue . On increasing the payload to 5Kb > and the number of users to 1000 in Jmeter

RE: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread Arshiya Shariff
Thank you for the response Mark , >> Are you able to test with a custom Tomcat build and/or build Tomcat 9 from >> source for testing? Yes Mark , we will be able to test with the jars built from Tomcat 9 source for testing . Thanks and Regards Arshiya Shariff -Original Message- From:

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-30 Thread tomcat/perl
On 30.09.2020 07:42, Arshiya Shariff wrote: Hi Martin , Thank you for the response. With a payload of 200 bytes we were able to send 20K requests/sec with 200 users from Jmeter without any memory issue . On increasing the payload to 5Kb and the number of users to 1000 in Jmeter and sending

RE: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-29 Thread Arshiya Shariff
Hi Martin , Thank you for the response. With a payload of 200 bytes we were able to send 20K requests/sec with 200 users from Jmeter without any memory issue . On increasing the payload to 5Kb and the number of users to 1000 in Jmeter and sending 1000 requests per second , the heap of 20GB

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-28 Thread Mark Thomas
On 28/09/2020 17:58, Arshiya Shariff wrote: > Hi All, > With 200 threads(users) , ramp up duration of 2 seconds , loop count 80 and > by sending 1000 http2 requests/sec from JMeter Client to an embedded tomcat > application we did not observe any memory issue , but on sending 1000 http2 >

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-28 Thread Martin Grigorov
Hi Arshiya, On Mon, Sep 28, 2020 at 7:59 PM Arshiya Shariff wrote: > Hi All, > With 200 threads(users) , ramp up duration of 2 seconds , loop count 80 > and by sending 1000 http2 requests/sec from JMeter Client to an embedded > tomcat application we did not observe any memory issue , but on

Re: HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-28 Thread Christopher Schultz
Arshiya, On 9/28/20 12:58, Arshiya Shariff wrote: > With 200 threads(users) , ramp up duration of 2 seconds , loop count > 80 and by sending 1000 http2 requests/sec from JMeter Client to an > embedded tomcat application we did not observe any memory issue , but > on sending 1000 http2

HTTP2: memory filled up fast on increasing the connections to 1000/2000 (Embedded tomcat 9.0.38)

2020-09-28 Thread Arshiya Shariff
Hi All, With 200 threads(users) , ramp up duration of 2 seconds , loop count 80 and by sending 1000 http2 requests/sec from JMeter Client to an embedded tomcat application we did not observe any memory issue , but on sending 1000 http2 requests/sec with 2000 or 1000 users from JMeter , the