oliverisaac opened a new issue #3948: 2.3.0 Broker Gets "Insufficient configured threads" URL: https://github.com/apache/pulsar/issues/3948 **Describe the bug** I am running Pulsar in a kubernetes cluster. When I upgrade to 2.3.0 I am unable to get it to listen for https requests. Jetty throws an insufficient threads error: ''' 20:02:06.036 [main] ERROR org.apache.pulsar.broker.PulsarService - java.lang.IllegalStateException: Insufficient configured threads: required=4 < max=4 for WebExecutorThreadPool[etp1373646877]@51e0301d{STARTED,4<=4<=4,i=2,q=0,ReservedThreadExecutor@221ca495{s=0/1,p=0}} org.apache.pulsar.broker.PulsarServerException: java.lang.IllegalStateException: Insufficient configured threads: required=4 < max=4 for WebExecutorThreadPool[etp1373646877]@51e0301d{STARTED,4<=4<=4,i=2,q=0,ReservedThreadExecutor@221ca495{s=0/1,p=0}} at org.apache.pulsar.broker.web.WebService.start(WebService.java:192) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:427) [org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] at org.apache.pulsar.PulsarBrokerStarter$BrokerStarter.start(PulsarBrokerStarter.java:239) [org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] at org.apache.pulsar.PulsarBrokerStarter.main(PulsarBrokerStarter.java:293) [org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] Caused by: java.lang.IllegalStateException: Insufficient configured threads: required=4 < max=4 for WebExecutorThreadPool[etp1373646877]@51e0301d{STARTED,4<=4<=4,i=2,q=0,ReservedThreadExecutor@221ca495{s=0/1,p=0}} at org.eclipse.jetty.util.thread.ThreadPoolBudget.check(ThreadPoolBudget.java:155) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.thread.ThreadPoolBudget.leaseTo(ThreadPoolBudget.java:129) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.thread.ThreadPoolBudget.leaseFrom(ThreadPoolBudget.java:181) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:281) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:81) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:235) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.Server.doStart(Server.java:395) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.apache.pulsar.broker.web.WebService.start(WebService.java:188) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] ... 3 more 20:02:06.044 [main] ERROR org.apache.pulsar.PulsarBrokerStarter - Failed to start pulsar service. org.apache.pulsar.broker.PulsarServerException: org.apache.pulsar.broker.PulsarServerException: java.lang.IllegalStateException: Insufficient configured threads: required=4 < max=4 for WebExecutorThreadPool[etp1373646877]@51e0301d{STARTED,4<=4<=4,i=2,q=0,ReservedThreadExecutor@221ca495{s=0/1,p=0}} at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:448) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] at org.apache.pulsar.PulsarBrokerStarter$BrokerStarter.start(PulsarBrokerStarter.java:239) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] at org.apache.pulsar.PulsarBrokerStarter.main(PulsarBrokerStarter.java:293) [org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] Caused by: org.apache.pulsar.broker.PulsarServerException: java.lang.IllegalStateException: Insufficient configured threads: required=4 < max=4 for WebExecutorThreadPool[etp1373646877]@51e0301d{STARTED,4<=4<=4,i=2,q=0,ReservedThreadExecutor@221ca495{s=0/1,p=0}} at org.apache.pulsar.broker.web.WebService.start(WebService.java:192) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:427) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] ... 2 more Caused by: java.lang.IllegalStateException: Insufficient configured threads: required=4 < max=4 for WebExecutorThreadPool[etp1373646877]@51e0301d{STARTED,4<=4<=4,i=2,q=0,ReservedThreadExecutor@221ca495{s=0/1,p=0}} at org.eclipse.jetty.util.thread.ThreadPoolBudget.check(ThreadPoolBudget.java:155) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.thread.ThreadPoolBudget.leaseTo(ThreadPoolBudget.java:129) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.thread.ThreadPoolBudget.leaseFrom(ThreadPoolBudget.java:181) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:281) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:81) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:235) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.server.Server.doStart(Server.java:395) ~[org.eclipse.jetty-jetty-server-9.4.12.v20180830.jar:9.4.12.v20180830] at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) ~[org.eclipse.jetty-jetty-util-9.4.12.v20180830.jar:9.4.12.v20180830] at org.apache.pulsar.broker.web.WebService.start(WebService.java:188) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] at org.apache.pulsar.broker.PulsarService.start(PulsarService.java:427) ~[org.apache.pulsar-pulsar-broker-2.3.0.jar:2.3.0] ... 2 more ''' **To Reproduce** Steps to reproduce the behavior: 1. Configure broker: ``` webServicePortTls: "8443" brokerServicePortTls: "6651" ``` 2. Run the pulsar:2.3.0 release. **Expected behavior** Should be able to use `pulsar-admin clusters list` with TLS AND should be able to curl http://<BROKER_URL>:<HTTP_PORT>/metrics/ **Additional context** This configuration works in 2.2.1.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
