[GitHub] [pulsar] ericsyh opened a new issue #12759: [bug](indeviduallyDeleteMessage): slow rate consumer but ask in order will get indeviduallyDeleteMessage

[GitBox]

ericsyh opened a new issue #12759:
URL: https://github.com/apache/pulsar/issues/12759


   **Describe the bug**
   In my current test found, if i create a producer to produce with no dispatch 
limit while create a consumer to consumer with slow rate (set a 1 second sleep 
in message receive), although the the consumer acks in order but there is 
indeviduallyDeleteMessage in the topic. 
   
   And the weird thing is if i remove the 1 second sleep in consumer or i move 
the 1 second sleep from consumer to producer, there is no 
indeviduallyDeleteMessage in the topics. It looks like when the consumer is 
much slower than the producer, this issue will come.
   
   This is the consume code i used, i add a delay for 1 second but the ack 
should be in order. 
   
   ```
   for true {
                msg, err := consumer.Receive(context.Background())
                if err != nil {
                        log.Fatal(err)
                }
                fmt.Printf("Received message msgId: %#v -- content: '%s'\n",
                        msg.ID(), string(msg.Payload()))
                consumer.Ack(msg)
   
                time.Sleep(time.Duration(1) * time.Second)
        }
   ```
   
   **To Reproduce**
   Steps to reproduce the behavior:
   1. Start the producer without dispatch limit
   2. Start the consumer with 1 second limit to consume
   3. Stop the consumer after several consumes and acks are sent.
   4. Check the topic stats-internal and there is some 
indeviduallyDeleteMessage.
   
   **Expected behavior**
   The ack is in order, there is no indeviduallyDeleteMessage in the topic. 
   
   **Screenshots**
   I use golang-client to produce and consume
   ![截屏2021-11-12 上午12 36 
32](https://user-images.githubusercontent.com/10498732/141335526-ad052030-5f16-4cf8-9385-d72bf3f03ea1.png)
   
   keep on producing and stop the consumer after several consume with acks
   <img width="1440" alt="截屏2021-11-12 上午12 37 05" 
src="https://user-images.githubusercontent.com/10498732/141335595-f612f3e5-aa54-4319-a4f2-4bae795b4300.png";>
   
   Check the topic stats-internal and there is some indeviduallyDeleteMessage.
   <img width="1293" alt="截屏2021-11-12 上午12 38 36" 
src="https://user-images.githubusercontent.com/10498732/141335725-3b4f5f65-faee-4b62-965d-4711ed0e8760.png";>
   
   The test code i used
   
[pulsar-client-go-demo.zip](https://github.com/apache/pulsar/files/7521899/pulsar-client-go-demo.zip)
   
   **Additional context**
   golang client and java client both tested with this issue. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org