Hi all, I've opened a PIP to reduce retry/DLQ producer count on partitioned-topic subscriptions from N×P×2 to N×2:
PR: https://github.com/apache/pulsar/pull/27129 Rendered: https://github.com/zjxxzjwang/pulsar-wzj/blob/master-retry-producer-pip/pip/pip-498.md Short summary: - Problem: one retryLetterProducer + one deadLetterProducer are created per partition sub-consumer, even though they all target the same *-RETRY / *-DLQ topic. For a 32-partition × 10-pod subscription this amounts to 640 broker-side producers for 2 destination topics. - Proposal: move producer ownership one layer up to MultiTopicsConsumerImpl and share it across all partition sub-consumers of the same subscription-level topic. Opt-out via ConsumerConfigurationData#shareRetryAndDeadLetterProducers (default true). Looking forward to your feedback. Thanks, zhenJiangWang
