On Thu, 2018-11-15 at 13:19 -0700, Gary Gregory wrote:
> Hi Oleg,
> 
> I was able to reproduce the problem with the git master code and my
> results
> are saved in the branch *ggregory-async-reverse-proxy-problem*:
> 
> - The test stack is the same as my original email.
> - In this current version of *AsyncReverseProxyExampleNoLogging*, the
> IO
> Reactor configurations no longer has the "silly" settings.
> - The last line in the JMeter output file
> *AsyncReverseProxyExampleNoLogging-run0/OneByteHttpCore.csv* shows
> the same
> problem:
> 1542311760223,10016,One Byte HttpCore,Non HTTP response code:
> org.apache.http.ConnectionClosedException,Non HTTP response message:
> *Premature
> end of Content-Length delimited message body (expected: 1; received:
> 0*,Thread
> Group 1-1,text,false,,1330,0,1,1,
> http://localhost:9094/one-byte.txt,0,0,1
> - The proxy's console is captured
> in AsyncReverseProxyExampleNoLogging-run0/console-out.txt and shows
> the
> usual side-effect: java.net.SocketTimeoutException: 10 SECONDS.
> - The results of running the plain old *AsyncReverseProxyExample *is
> stored
> in the *AsyncReverseProxyExample-run0* folder and does not show a
> "*Premature
> end of Content-Length"* error but a different unhelpful error BUT it
> does
> show the socket timeout in the proxy's console output.
> 
> Please advise,
> Gary
> 

Hi Gary

I am sorry but I am unable to reproduce the problem locally. I ran
several tests with 1 Mio requests and all message exchanges completed
correctly. 
---

oleg@ok2c:~/temp$ ab -c 1 -n 1000000 -k  http://localhost:9094/one-byte.txt
This is ApacheBench, Version 2.3 <$Revision: 1807734 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Server Software:        ecstatic-3.3.0
Server Hostname:        localhost
Server Port:            9094

Document Path:          /one-byte.txt
Document Length:        1 bytes

Concurrency Level:      1
Time taken for tests:   667.319 seconds
Complete requests:      1000000
Failed requests:        0
Keep-Alive requests:    1000000
Total transferred:      286000000 bytes
HTML transferred:       1000000 bytes
Requests per second:    1498.53 [#/sec] (mean)
Time per request:       0.667 [ms] (mean)
Time per request:       0.667 [ms] (mean, across all concurrent requests)
Transfer rate:          418.54 [Kbytes/sec] received

> 
> On Thu, Nov 15, 2018 at 10:31 AM Gary Gregory <[email protected]
> >
> wrote:
> 
> > On Thu, Nov 15, 2018 at 8:59 AM Gary Gregory <
> > [email protected]>
> > wrote:
> > 
> > > On Thu, Nov 15, 2018 at 8:45 AM Oleg Kalnichevski <
> > > [email protected]>
> > > wrote:
> > > 
> > > > On Sun, 2018-11-11 at 18:30 -0700, Gary Gregory wrote:
> > > > > Hi All:
> > > > > 
> > > > 
> > > > ...
> > > > 
> > > > > I am looking for guidance here. I suppose this could be a bug
> > > > > in the
> > > > > example, or in the core, or that the example could/should be
> > > > > adjusted
> > > > > to
> > > > > avoid this unfortunate sequence. Again, the IO rector
> > > > > parameters I
> > > > > used are
> > > > > only to demonstrate the problem. In my set up, I use the
> > > > > default
> > > > > select
> > > > > timeout of 1 second and reactor IO thread counts of 2.
> > > > > 
> > > > > Thank you,
> > > > > Gary
> > > > 
> > > > 
> > > > Oh, it was a nasty one. It is just sheer luck that the problem
> > > > was much
> > > > easier to reproduce with non-persistent connections and out of
> > > > laziness
> > > > I opted for AB (which uses non-persistent HTTP/1.0 by default)
> > > > instead
> > > > of JMeter.
> > > > 
> > > > I believe the culprit was this race condition:
> > > > 
> > > > 
> > > > 
https://github.com/apache/httpcomponents-core/commit/f5590e471f46892787df01fca2a6e8faf26fd454
> > > > 
> > > > I also fixed incorrect handling of incoming HTTP/1.0 requests
> > > > by the
> > > > reverse proxy example.
> > > > 
> > > > Please test the latest snapshot with your application and let
> > > > me know
> > > > the outcome.
> > > > 
> > > 
> > > Thank you Oleg, I am testing... My initial app test failed (I
> > > made the
> > > same change to my app as you made to the sample to use a distinct
> > > HttpContext for outgoing message exchanges) so I will review and
> > > try to
> > > reproduce with the example...
> > > 
> > 
> > Hi Oleg,
> > 
> > Using the previous example I posted called
> > "AsyncReverseProxyExampleNoLogging" which I updated to use a
> > distinct
> > HttpContext for outgoing message exchanges (just like the updated
> > example),
> > and JMeter, I can send over 285K requests but it fails on the
> > 285,032th
> > request with a different error. The last line in the resulting
> > JMeter
> > output file OneByteHttpCore.csv is:
> > 
> > 1542298828472,10053,One Byte HttpCore,Non HTTP response code:
> > org.apache.http.NoHttpResponseException,Non HTTP response message:
> > localhost:9094 failed to respond,Thread Group 1-
> > 1,text,false,,2090,0,1,1,
> > http://localhost:9094/one-byte.txt,0,0,1
> > 
> > Which does not tell us much sadly. BUT, perhaps more tellingly, the
> > console for the proxy (running from Eclipse), shows:
> > 
> > Reverse proxy to http://localhost:8080
> > Listening on port 9094
> > java.net.SocketTimeoutException: 10 SECONDS
> > at
> > org.apache.hc.core5.io.SocketTimeoutExceptionFactory.create(SocketT
> > imeoutExceptionFactory.java:50)
> > at
> > org.apache.hc.core5.http.impl.nio.AbstractHttp1StreamDuplexer.onTim
> > eout(AbstractHttp1StreamDuplexer.java:416)
> > at
> > org.apache.hc.core5.http.impl.nio.AbstractHttp1IOEventHandler.timeo
> > ut(AbstractHttp1IOEventHandler.java:81)
> > at
> > org.apache.hc.core5.http.impl.nio.ServerHttp1IOEventHandler.timeout
> > (ServerHttp1IOEventHandler.java:40)
> > at
> > org.apache.hc.core5.reactor.InternalDataChannel.onTimeout(InternalD
> > ataChannel.java:184)
> > at
> > org.apache.hc.core5.reactor.InternalChannel.checkTimeout(InternalCh
> > annel.java:67)
> > at
> > org.apache.hc.core5.reactor.SingleCoreIOReactor.checkTimeout(Single
> > CoreIOReactor.java:232)
> > at
> > org.apache.hc.core5.reactor.SingleCoreIOReactor.validateActiveChann
> > els(SingleCoreIOReactor.java:165)
> > at
> > org.apache.hc.core5.reactor.SingleCoreIOReactor.doExecute(SingleCor
> > eIOReactor.java:127)
> > at
> > org.apache.hc.core5.reactor.AbstractSingleCoreIOReactor.execute(Abs
> > tractSingleCoreIOReactor.java:80)
> > at
> > org.apache.hc.core5.reactor.IOReactorWorker.run(IOReactorWorker.jav
> > a:44)
> > at java.lang.Thread.run(Thread.java:745)
> > 
> > Which would indicate that the problem is the same as before.
> > 
> > I will try with different parameters to see if I can make it fail
> > faster.
> > 
> > FTR, the JMeter output is:
> > 
> > C:\Java\apache-jmeter-5.0\bin>rmdir /q/s c:\test\jmeter-
> > OneByteHttpCore &
> > del /F c:\test\OneByteHttpCore.csv & jmeter -n -t
> > C:\Users\ggregory\Downloads\OneByteHttpCore.jmx -l
> > c:\test\OneByteHttpCore.csv -e -o c:\test\jmeter-OneByteHttpCore
> > Creating summariser <summary>
> > Created the tree successfully using
> > C:\Users\ggregory\Downloads\OneByteHttpCore.jmx
> > Starting the test @ Thu Nov 15 08:50:25 MST 2018 (1542297025377)
> > Waiting for possible Shutdown/StopTestNow/Heapdump message on port
> > 4445
> > summary +    424 in 00:00:04 =  100.4/s Avg:     8 Min:     4
> > Max:   228
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary +   4903 in 00:00:30 =  163.5/s Avg:     5 Min:     4
> > Max:    56
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =   5327 in 00:00:34 =  155.7/s Avg:     6 Min:     4
> > Max:   228
> > Err:     0 (0.00%)
> > summary +   5257 in 00:00:30 =  175.2/s Avg:     5 Min:     3
> > Max:   110
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  10584 in 00:01:04 =  164.8/s Avg:     5 Min:     3
> > Max:   228
> > Err:     0 (0.00%)
> > summary +   5646 in 00:00:30 =  188.2/s Avg:     5 Min:     3
> > Max:    45
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  16230 in 00:01:34 =  172.2/s Avg:     5 Min:     3
> > Max:   228
> > Err:     0 (0.00%)
> > summary +   5776 in 00:00:30 =  192.6/s Avg:     4 Min:     3
> > Max:    51
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  22006 in 00:02:04 =  177.1/s Avg:     5 Min:     3
> > Max:   228
> > Err:     0 (0.00%)
> > summary +   3738 in 00:00:30 =  124.6/s Avg:     7 Min:     3
> > Max:  9818
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  25744 in 00:02:34 =  166.9/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5633 in 00:00:30 =  187.7/s Avg:     5 Min:     3
> > Max:    64
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  31377 in 00:03:04 =  170.3/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5631 in 00:00:30 =  187.8/s Avg:     5 Min:     3
> > Max:    61
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  37008 in 00:03:34 =  172.8/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5736 in 00:00:30 =  191.2/s Avg:     5 Min:     3
> > Max:    19
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  42744 in 00:04:04 =  175.0/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5240 in 00:00:30 =  174.7/s Avg:     5 Min:     3
> > Max:   474
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  47984 in 00:04:34 =  175.0/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4498 in 00:00:30 =  149.9/s Avg:     6 Min:     3
> > Max:   387
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  52482 in 00:05:04 =  172.5/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5099 in 00:00:30 =  169.8/s Avg:     5 Min:     3
> > Max:   340
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  57581 in 00:05:34 =  172.3/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   3838 in 00:00:30 =  128.0/s Avg:     7 Min:     3
> > Max:  1403
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  61419 in 00:06:04 =  168.6/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4413 in 00:00:30 =  147.1/s Avg:     6 Min:     3
> > Max:  4468
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  65832 in 00:06:34 =  167.0/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4901 in 00:00:30 =  163.3/s Avg:     5 Min:     3
> > Max:    95
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  70733 in 00:07:04 =  166.7/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5136 in 00:00:30 =  171.2/s Avg:     5 Min:     3
> > Max:    60
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  75869 in 00:07:34 =  167.0/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5126 in 00:00:30 =  170.9/s Avg:     5 Min:     3
> > Max:    81
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  80995 in 00:08:04 =  167.3/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4996 in 00:00:30 =  166.5/s Avg:     5 Min:     3
> > Max:    82
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  85991 in 00:08:34 =  167.2/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4781 in 00:00:30 =  159.4/s Avg:     6 Min:     3
> > Max:    81
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  90772 in 00:09:04 =  166.8/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5136 in 00:00:30 =  171.2/s Avg:     5 Min:     3
> > Max:    53
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary =  95908 in 00:09:34 =  167.0/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5342 in 00:00:30 =  178.1/s Avg:     5 Min:     3
> > Max:   189
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 101250 in 00:10:04 =  167.6/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4895 in 00:00:30 =  163.1/s Avg:     5 Min:     3
> > Max:   235
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 106145 in 00:10:34 =  167.4/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5124 in 00:00:30 =  170.8/s Avg:     5 Min:     3
> > Max:    68
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 111269 in 00:11:04 =  167.5/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5587 in 00:00:30 =  186.2/s Avg:     5 Min:     3
> > Max:    51
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 116856 in 00:11:34 =  168.3/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4987 in 00:00:30 =  166.2/s Avg:     5 Min:     3
> > Max:   221
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 121843 in 00:12:04 =  168.2/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   3699 in 00:00:30 =  123.3/s Avg:     7 Min:     3
> > Max:   147
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 125542 in 00:12:34 =  166.5/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5499 in 00:00:30 =  183.3/s Avg:     5 Min:     3
> > Max:   102
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 131041 in 00:13:04 =  167.1/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5684 in 00:00:30 =  189.5/s Avg:     5 Min:     3
> > Max:    29
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 136725 in 00:13:34 =  167.9/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4898 in 00:00:30 =  163.3/s Avg:     5 Min:     3
> > Max:    66
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 141623 in 00:14:04 =  167.8/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5506 in 00:00:30 =  183.5/s Avg:     5 Min:     3
> > Max:    37
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 147129 in 00:14:34 =  168.3/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5388 in 00:00:30 =  179.6/s Avg:     5 Min:     3
> > Max:    60
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 152517 in 00:15:04 =  168.7/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4588 in 00:00:32 =  143.9/s Avg:     6 Min:     3
> > Max:  5522
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 157105 in 00:15:36 =  167.8/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5083 in 00:00:28 =  180.7/s Avg:     5 Min:     3
> > Max:    64
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 162188 in 00:16:04 =  168.2/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5208 in 00:00:30 =  173.6/s Avg:     5 Min:     3
> > Max:    62
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 167396 in 00:16:34 =  168.4/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   5420 in 00:00:30 =  180.7/s Avg:     5 Min:     3
> > Max:    35
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 172816 in 00:17:04 =  168.7/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4802 in 00:00:30 =  160.1/s Avg:     6 Min:     3
> > Max:    88
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 177618 in 00:17:34 =  168.5/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   3879 in 00:00:30 =  129.3/s Avg:     7 Min:     3
> > Max:   128
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 181497 in 00:18:04 =  167.4/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   3410 in 00:00:30 =  113.7/s Avg:     8 Min:     4
> > Max:    99
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 184907 in 00:18:34 =  166.0/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   3960 in 00:00:30 =  132.0/s Avg:     7 Min:     3
> > Max:   106
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 188867 in 00:19:04 =  165.1/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   3977 in 00:00:30 =  132.6/s Avg:     7 Min:     4
> > Max:    74
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 192844 in 00:19:34 =  164.2/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4564 in 00:00:30 =  152.1/s Avg:     6 Min:     3
> > Max:    35
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 197408 in 00:20:04 =  163.9/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4576 in 00:00:30 =  152.5/s Avg:     6 Min:     3
> > Max:    43
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 201984 in 00:20:34 =  163.7/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4216 in 00:00:30 =  140.5/s Avg:     6 Min:     3
> > Max:   113
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 206200 in 00:21:04 =  163.1/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4485 in 00:00:30 =  149.5/s Avg:     6 Min:     3
> > Max:    68
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 210685 in 00:21:34 =  162.8/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4698 in 00:00:30 =  156.6/s Avg:     6 Min:     3
> > Max:    52
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 215383 in 00:22:04 =  162.6/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4463 in 00:00:30 =  148.7/s Avg:     6 Min:     3
> > Max:    62
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 219846 in 00:22:34 =  162.3/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4353 in 00:00:30 =  145.2/s Avg:     6 Min:     3
> > Max:   598
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 224199 in 00:23:04 =  162.0/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4333 in 00:00:30 =  144.4/s Avg:     6 Min:     3
> > Max:   827
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 228532 in 00:23:34 =  161.6/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4983 in 00:00:30 =  166.1/s Avg:     5 Min:     3
> > Max:    26
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 233515 in 00:24:04 =  161.7/s Avg:     5 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4066 in 00:00:30 =  135.5/s Avg:     7 Min:     4
> > Max:    81
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 237581 in 00:24:34 =  161.2/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4282 in 00:00:30 =  142.8/s Avg:     6 Min:     3
> > Max:    73
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 241863 in 00:25:04 =  160.8/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4486 in 00:00:30 =  149.5/s Avg:     6 Min:     4
> > Max:    66
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 246349 in 00:25:34 =  160.6/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4244 in 00:00:30 =  141.5/s Avg:     6 Min:     4
> > Max:    48
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 250593 in 00:26:04 =  160.2/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   3691 in 00:00:30 =  123.1/s Avg:     7 Min:     3
> > Max:   118
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 254284 in 00:26:34 =  159.5/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4155 in 00:00:30 =  138.5/s Avg:     7 Min:     3
> > Max:    69
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 258439 in 00:27:04 =  159.1/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4305 in 00:00:30 =  143.5/s Avg:     6 Min:     3
> > Max:    55
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 262744 in 00:27:34 =  158.8/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4218 in 00:00:30 =  140.6/s Avg:     6 Min:     3
> > Max:    60
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 266962 in 00:28:04 =  158.5/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4255 in 00:00:30 =  141.8/s Avg:     6 Min:     3
> > Max:    85
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 271217 in 00:28:34 =  158.2/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4452 in 00:00:30 =  148.4/s Avg:     6 Min:     3
> > Max:    39
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 275669 in 00:29:04 =  158.0/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4803 in 00:00:30 =  160.0/s Avg:     6 Min:     3
> > Max:    78
> > Err:     0 (0.00%) Active: 1 Started: 1 Finished: 0
> > summary = 280472 in 00:29:34 =  158.1/s Avg:     6 Min:     3
> > Max:  9818
> > Err:     0 (0.00%)
> > summary +   4559 in 00:00:39 =  118.3/s Avg:     8 Min:     3 Max:
> > 10053
> > Err:     1 (0.02%) Active: 0 Started: 1 Finished: 1
> > summary = 285031 in 00:30:13 =  157.2/s Avg:     6 Min:     3 Max:
> > 10053
> > Err:     1 (0.00%)
> > Tidying up ...    @ Thu Nov 15 09:20:38 MST 2018 (1542298838562)
> > ... end of run
> > 
> > Gary
> > 
> > 
> > 
> > 
> > 
> > > Gary
> > > 
> > > 
> > > > 
> > > > Cheers
> > > > 
> > > > Oleg
> > > > 
> > > > 
> > > > -------------------------------------------------------------
> > > > --------
> > > > To unsubscribe, e-mail: [email protected]
> > > > For additional commands, e-mail: [email protected]
> > > > 
> > > > 


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to