wangjialing218 commented on issue #11962: URL: https://github.com/apache/pulsar/issues/11962#issuecomment-914995316
@BewareMyPower Just a idea. Current there is one ManagedLedger(ledger) associated with `PersistentTopic`. Could we add another ManagedLedger(kafkaLedger) associated with the topic. 1. Pulsar producer -> ledger 2. Kafka producer -> kafkaLedger 3. ledger -> Pulsar consumer 4. kafkaLedger-> Kafka consumer 5. ledger -> convert from pulsar format to kafka -> kopLedger 6. kopLedger -> convert from kafka format to pulsar -> ledger 5 and 6 are running in background task, so the conversion is done only once asynchronously. It will cost more disk space but improve performace of message throughput. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
