Hello,
sorry for the late reply, I got quite significantly side-tracked :) And thanks
for the answer!
> If all your messages were delivered to the first queue specified by your
> producers, for sure only one consumer may consume messages.
Hm, I'm sending all messages to a single topic: mqperf. Does that mean only a
single consumer will receive the messages? That would explain the behaviour I
am seeing.
But you also wrote:
> No. If the message model is CLUSTERING, messages are automatically
> load-balanced among consumers of the same consumer group. There is nothing
> more to do.
which would suggest that if there are multiple consumers for a given topic, all
consumers will receive the same number of messages?
Here's the output of the commands you advised running:
[ec2-user@rocketmq_broker_master bin]$ ./mqadmin consumerConnection -g
mqperf_consumer_group -n 172.22.1.197:9876
OpenJDK 64-Bit Server VM warning: ignoring option PermSize=128m; support was
removed in 8.0
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was
removed in 8.0
001 172.22.1.35@instance594 172.22.1.35:57196 JAVA
V4_1_0_SNAPSHOT
002 172.22.1.33@instance667 172.22.1.33:56618 JAVA
V4_1_0_SNAPSHOT
Below is subscription:001 Topic: mqperf
SubExpression: *
002 Topic: %RETRY%mqperf_consumer_group SubExpression: *
ConsumeType: CONSUME_PASSIVELY
MessageModel: CLUSTERING
ConsumeFromWhere: CONSUME_FROM_FIRST_OFFSET
[ec2-user@rocketmq_broker_master bin]$ ./mqadmin consumerProgress -g
mqperf_consumer_group -n 172.22.1.197:9876
OpenJDK 64-Bit Server VM warning: ignoring option PermSize=128m; support was
removed in 8.0
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support was
removed in 8.0
#Topic #Broker Name #QID
#Broker Offset #Consumer Offset #Client IP #Diff
#LastTime
%RETRY%mqperf_consumer_group mqperf 0 0
0 172.22.1.33 0
1970-01-01 00:00:00
mqperf mqperf 0
2539542 2276359 172.22.1.33 263183
2017-11-14 12:34:39
Consume TPS: 3343.25
Diff Total: 263183
[ec2-user@rocketmq_broker_master bin]$
So there are two consumers (as there should be), but only one is making
progress? Any ideas why that could be?
By the way, here's the full code I'm using for sending/receiving messages:
https://github.com/softwaremill/mqperf/blob/master/src/main/scala/com/softwaremill/mqperf/mq/RocketMq.scala
Thanks!
Adam
--
Adam Warski
http://www.softwaremill.com
http://twitter.com/#!/adamwarski
