lizhimins opened a new issue, #5091: URL: https://github.com/apache/rocketmq/issues/5091
RocketMQ Store Module Improvement If you want more information, please visit https://github.com/apache/rocketmq/issues/5087 - [x] [Store-A] Speed up startup by concurrently loading ConsumeQueue during Broker initialization - [x] [Store-B] Support automatic deletion of ConsumeQueue files without valid data to save disk space - [ ] [Store-C] WIP Store-A: When the number of ConsumeQueues on the Broker is large, the startup speed is very slow and the recovery time is long. After testing, it takes about 150 seconds to "cold boot" 200,000 ConsumeQueue files in a virtual machine (16C 32G 1T SSD) environment. After using this optimization, it only takes 48 seconds, saving 2/3 of the startup time. Store-B: There are a large number of topics (include RETRY and DLQ) that are no longer used on the Broker node, as well as retries. The ConsumeQueue of the dead letter queue occupies a lot of disk space. We use scheduled tasks to delete these index files, but after deleting the ConsumeQueue, the offset will start from 0 again. There are some side effects for subscription groups that consume using pull mode. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
