lhotari commented on PR #22586: URL: https://github.com/apache/pulsar/pull/22586#issuecomment-2077871792
There are more problems. Using heap dump from https://github.com/apache/pulsar/actions/runs/8835173621/attempts/1?pr=22583 ```sql select toString(this['stack.fn.arg$1']), count(*) from java.util.concurrent.CompletableFuture where this['stack.fn'] is not null group by 1 order by 2 desc ``` ``` EXPR$0 | EXPR$1 ------------------------------------------------------------------------------------------------------------------------- org.apache.pulsar.broker.service.persistent.SystemTopic @ 0x100031c173f8 | 435,961 org.apache.pulsar.broker.resources.NamespaceResources$PartitionedTopicResources @ 0x10002b285920 | 56,647 | 144 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x10000a69cfe0 | 17 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x100011873a80 | 17 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x100007eb5af8 | 13 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x100018f4fd48 | 13 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x10002b0e1900 | 12 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x10001c039270 | 12 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x10003be7e448 | 11 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x10003bfa8e60 | 11 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x10000c4b8f78 | 9 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient @ 0x10000c439b80 | 9 org.apache.pulsar.client.impl.BinaryProtoLookupService @ 0x10002d78f820 | 7 org.apache.pulsar.broker.service.persistent.PersistentTopic @ 0x1000281e0380 | 6 org.apache.pulsar.client.impl.PulsarClientImpl @ 0x10002d78dd90 | 5 org.apache.pulsar.client.impl.ConnectionHandler @ 0x10002d60cfc8 | 4 org.apache.pulsar.client.impl.ConnectionHandler @ 0x10002d619f28 | 4 org.apache.pulsar.client.impl.ConnectionHandler @ 0x100024745fc8 | 4 ASSIGN | 4 org.apache.pulsar.client.impl.ConnectionHandler @ 0x10002a0f8390 | 4 org.apache.pulsar.client.impl.ConnectionHandler @ 0x10002d6132f8 | 4 org.apache.pulsar.client.impl.ConnectionHandler @ 0x10002d796090 | 4 org.apache.pulsar.broker.namespace.OwnershipCache$OwnedServiceUnitCacheLoader @ 0x10001c0314e8 | 3 org.apache.pulsar.broker.namespace.OwnershipCache$OwnedServiceUnitCacheLoader @ 0x10003be76ef8 | 2 org.apache.pulsar.broker.service.persistent.GeoPersistentReplicator @ 0x1003f30fc0c8 | 2 org.apache.pulsar.metadata.impl.ZKMetadataStore @ 0x1003ef17fef0 | 2 org.apache.pulsar.client.impl.TableViewImpl @ 0x10002725bb30 | 2 org.apache.pulsar.client.impl.TableViewImpl @ 0x10002a1bf700 | 2 org.apache.pulsar.client.impl.TableViewImpl @ 0x10002d6684a0 | 2 org.apache.pulsar.broker.service.SystemTopicBasedTopicPoliciesService @ 0x1000182bb060 | 2 org.apache.pulsar.broker.systopic.TopicPoliciesSystemTopicClient @ 0x1003f0a66de0 | 2 org.apache.pulsar.broker.namespace.OwnershipCache$OwnedServiceUnitCacheLoader @ 0x10000c5040b0 | 2 org.apache.pulsar.broker.namespace.OwnershipCache$OwnedServiceUnitCacheLoader @ 0x100018f47fb0 | 2 java.util.concurrent.CompletableFuture @ 0x1003ed849b98 | 1 persistent://pulsar/global/removeClusterTest/__change_events | 1 org.apache.pulsar.client.impl.ReaderImpl @ 0x10002a0f22f0 | 1 java.util.concurrent.CompletableFuture @ 0x1003ef194a50 | 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1000234ce2b8| 1 org.apache.pulsar.client.impl.ConnectionPool @ 0x10002d78e760 | 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003eb48e700| 1 org.apache.pulsar.client.impl.ReaderImpl @ 0x10002d613e88 | 1 org.apache.pulsar.metadata.coordination.impl.LockManagerImpl @ 0x100011873a20 | 1 org.apache.pulsar.metadata.coordination.impl.LockManagerImpl @ 0x10003be700d0 | 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003fda42068| 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1000234ce410| 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003eb4dbbc0| 1 org.apache.pulsar.client.impl.ReaderImpl @ 0x1003fbf276b0 | 1 java.util.concurrent.CompletableFuture @ 0x100011edcc18 | 1 org.apache.pulsar.client.impl.ReaderImpl @ 0x10002d60d258 | 1 org.apache.pulsar.broker.service.persistent.SystemTopic @ 0x100011877ef0 | 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003fdae3248| 1 org.apache.pulsar.metadata.coordination.impl.LockManagerImpl @ 0x10001c02a548 | 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x100023429888| 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003fda421c0| 1 org.apache.pulsar.compaction.StrategicTwoPhaseCompactor @ 0x1000392ec5a0 | 1 java.util.concurrent.CompletableFuture @ 0x1003f0a67038 | 1 org.apache.pulsar.metadata.coordination.impl.LockManagerImpl @ 0x10000c4f6a20 | 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1000234fcbe8| 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1000234fca90| 1 org.apache.pulsar.metadata.coordination.impl.LockManagerImpl @ 0x100018f40f28 | 1 java.util.concurrent.CompletableFuture @ 0x100039d71458 | 1 org.apache.pulsar.broker.service.SystemTopicBasedTopicPoliciesService @ 0x10002a0a3ae8 | 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1000234299e0| 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003fdae39b8| 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003eb48e858| 1 org.apache.pulsar.metadata.bookkeeper.PulsarRegistrationClient$$Lambda$3215+0x00007f588ce12e20 @ 0x1003eb4dba68| 1 Total: 67 entries | 492,978 ------------------------------------------------------------------------------------------------------------------------- ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
