Folks, I've been using Tomcat for a long time but am new-ish to NIO (Tomcat 8.5.) It seems that one of the big benefits of NIO is decoupling the worker threads from the client connections. I can now have a large number of open connections without a corresponding large number of threads.
I know the acceptCount parameter will stop incoming connection requests if the server is overloaded. However, suppose I have 1000 open connections and 100 of those connections have a request in flight, using all 100 of the threads I've allocated. Now what happens if the other 900 connections suddenly send me requests? Does acceptCount play any role? Is there some other mechanism that I can use to fail fast (by sending back a 503, for example?) Thanks John