devinbost edited a comment on issue #6151: Intermittent 500's from Admin CLI and Zookeeper exceptions in broker logs URL: https://github.com/apache/pulsar/issues/6151#issuecomment-579065977 We're also seeing timeouts on `persistent://public/functions/assignments`. (I tried to format them to make them easier to read.) ``` 03:41:05.812 [pulsar-client-io-48-1] ERROR org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/functions/assignments] [null] Failed to create producer: 5 lookup request timedout after ms 30000 03:41:05.812 [pulsar-client-io-48-1] WARN org.apache.pulsar.client.impl.ClientCnx - [id: 0x73becd94, L:/10.120.69.14:43564 - R:host10.example.domain.com/10.120.69.20:6650] request 5 timed out after 30000 ms ``` We also found these exceptions: ``` 03:43:56.654 [main] ERROR org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Unable to create znode - [/loadbalance/brokers/host04.example.domain.com:8080] for load balance on zookeeper03:43:56.654 [main] ERROR org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Broker znode - [/loadbalance/brokers/host04.example.domain.com:8080] is own by different zookeeper-ssession 288441566245486803 03:43:56.654 [main] ERROR org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Unable to create znode - [/loadbalance/brokers/host04.example.domain.com:8080] for load balance on zookeeper org.apache.pulsar.broker.PulsarServerException: Broker-znode owned by different zk-session 288441566245486803 ``` ``` Jan 27 21:31:09 host12 ebef80ff4b7b: 04:31:09.267 [pulsar-backlog-quota-checker-29-1] ERROR org.apache.pulsar.broker.service.BacklogQuotaManager - Failed to read policies data, will apply the default backlog quota: namespace=tenant23/taps ``` ``` Jan 27 21:31:09 host12 ebef80ff4b7b: 04:31:09.267 [ForkJoinPool.commonPool-worker-50] ERROR org.apache.pulsar.broker.web.PulsarWebResource - Failed to validate global cluster configuration : cluster=pulsar-pcdc1 ns=feeds/namespace30 emsg=org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss ``` ``` Jan 27 21:31:09 host07 19f9cf33ad1d: 04:31:09.620 [pulsar-web-33-26] ERROR org.apache.pulsar.functions.worker.MembershipManager - Failed to get status of coordinate topic persistent://public/functions/coordinate ``` ``` Jan 27 21:31:09 host10 6b1b2e58da7d: 04:31:09.900 [pulsar-web-33-56] ERROR org.apache.pulsar.broker.web.PulsarWebResource - Failed to get tenant admin data for tenant public ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
