场景:公司在测试环境做mq性能压测,服务意外挂掉后重启不可用
现象:服务不可用,控制台无broker的任务信息
日志:storeerror.log:大量刷如下的日志
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911520 currentLogicOffset: 1581160 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911540 currentLogicOffset: 1581180 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911560 currentLogicOffset: 1581200 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911580 currentLogicOffset: 1581220 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911600 currentLogicOffset: 1581240 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911620 currentLogicOffset: 1581260 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911640 currentLogicOffset: 1581280 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911660 currentLogicOffset: 1581300 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911680 currentLogicOffset: 1581320 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911700 currentLogicOffset: 1581340 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911720 currentLogicOffset: 1581360 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911740 currentLogicOffset: 1581380 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911760 currentLogicOffset: 1581400 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911780 currentLogicOffset: 1581420 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911800 currentLogicOffset: 1581440 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1911820 currentLogicOffset: 1581460 Topic: BenchmarkTest
QID: 720 Diff: 330360
2022-09-09 23:28:15 WARN main - [BUG]logic queue order maybe wrong,
expectLogicOffset: 1934440 currentLogicOffset: 1608560 Topic: BenchmarkTest
QID: 228 Diff: 325880

store.log
2022-09-09 21:43:11 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000021474836480
2022-09-09 21:48:51 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000022548578304
2022-09-09 22:07:02 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000023622320128
2022-09-09 22:48:00 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000024696061952
2022-09-09 22:48:18 INFO FlushIndexFileThread - flush index file elapsed
time(ms) 1431
2022-09-09 22:51:32 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000025769803776
2022-09-09 22:54:58 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000026843545600
2022-09-09 22:58:41 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000027917287424
2022-09-09 23:04:27 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000028991029248
2022-09-09 23:20:00 INFO main - recover next physics file,
/alidata1/admin/rmq/rmq-m/commitlog/00000000030064771072

做了哪些操作:
日志中提到的topic是BenchmarkTest
为了让集群恢复
1.停止压测,断开所有的外部链接
2.删除该topic
sh mqadmin deleteTopic -c brokerIp -n nameserverIp -t BenchmarkTest
3.重启集群多次

集群依然不可用,storeerror.log依然在不断的滚动
onsumequeue中BenchmarkTest目录下队列在不断重复创建和删除

各位大佬,该怎么解决

Reply via email to