Rockyyost edited a comment on issue #10390:
URL: https://github.com/apache/pulsar/issues/10390#issuecomment-831232921
I'm not setting priorities, that I'm aware of. How would I do that? Looking
at the Python doc, I don't see a way however, in another doc, I see if it's not
set then 0 is the default.
Setting the receiver_queue_size worked once. It was great to see all the
consumer working at the same time, getting messages and bring down the backlog
size. However, when trying it a second time, it regresses back to only a few of
the consumer getting messages and all others sit idle. Overtime, they will all
go idle while messages will remain in the queue.
I pulled the last few lines of logs from one of the consumers that have gone
idle. The log starts after it completed the last message it received. To me it
looks normal, not sure if there are any insights you can pull. Here it is:
`2021-05-03 12:16:08.471 INFO [140082804930304] ConsumerStatsImpl:65 |
Consumer [persistent://public/default/InferForecast, InferForecastWorker, 0] ,
ConsumerStatsImpl (numBytesRecieved_ = 112243, totalNumBytesRecieved_ = 112243,
receivedMsgMap_ = {[Key: Ok, Value: 25], }, ackedMsgMap_ = {[Key: {Result: Ok,
ackType: 0}, Value: 24], }, totalReceivedMsgMap_ = {[Key: Ok, Value: 25], },
totalAckedMsgMap_ = {[Key: {Result: Ok, ackType: 0}, Value: 24], })
2021-05-03 12:26:08.472 INFO [140082804930304] ConsumerStatsImpl:65 |
Consumer [persistent://public/default/InferForecast, InferForecastWorker, 0] ,
ConsumerStatsImpl (numBytesRecieved_ = 0, totalNumBytesRecieved_ = 112243,
receivedMsgMap_ = {}, ackedMsgMap_ = {}, totalReceivedMsgMap_ = {[Key: Ok,
Value: 25], }, totalAckedMsgMap_ = {[Key: {Result: Ok, ackType: 0}, Value: 24],
})
2021-05-03 12:36:08.473 INFO [140082804930304] ConsumerStatsImpl:65 |
Consumer [persistent://public/default/InferForecast, InferForecastWorker, 0] ,
ConsumerStatsImpl (numBytesRecieved_ = 0, totalNumBytesRecieved_ = 112243,
receivedMsgMap_ = {}, ackedMsgMap_ = {}, totalReceivedMsgMap_ = {[Key: Ok,
Value: 25], }, totalAckedMsgMap_ = {[Key: {Result: Ok, ackType: 0}, Value: 24],
})
`
For my second issue, yes, I can confirm that both exist.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
