[INFO] Announcing Apache RocketMQ as a TLP

2017-10-09 Thread yukon
Hi folks, Apache RocketMQ project has been graduated on 2017-09-20, all the graduation common tasks are mostly done. RocketMQ couldn't graduate smoothly without everyone's efforts. Congratulations and thanks, everybody. There are some details need our attention: ## RocketMQ Repos All the

Re: [INFO] Announcing Apache RocketMQ as a TLP

2017-10-09 Thread Von Gosling
Yukon, well done ~ thanks @yukon and @burce for this infra migration. I have double checked it. @All, If anyone find the incubator texts are transferred to TLP, please let us know :-) Best Regards, Von Gosling > 在 2017年10月9日,05:44,yukon 写道: > > Hi folks, > > Apache

Re: Trying to set up a RocketMQ cluster

2017-10-02 Thread Adam Warski
> I'm trying to set up a RocketMQ cluster, with a single name server, 1 > slave and 2 masters. But, I'm running into some problems. > That's of course 2 slaves, 1 master :) Adam

Re: contribute windows cpp code to rocketmq-cpp

2017-09-28 Thread dongeforever
Nice. Thanks qiwei.wqw 's work. BTW, the content of the email will look better if the links could be put in the end and numbered with [1] [2] ... Best Regards dongeforever 2017-09-28 10:54 GMT+08:00 王启伟(孝孺) : > Hi dev, Not long ago , we

:what does warmup do in AllocateMappedFileService do?

2017-10-23 Thread superheizai
Hi All,    . Want to know the actually effect in MappedFile.warmMappedFile ?     And in this function, there is a clause with comments "prevent gc". Wanto to know, what does this clause do?     thanks       Liu Jiangang temp4cj.png Description: Binary data

[STARTUP]Apache RocketMQ Shenzhen Meetup

2017-11-27 Thread Von Gosling
Dear Apache RocketMQ Community, I am excited to call for the second meetup in Shenzhen, China at Dec. 16 pm., 2018. Please have a look at your schedule, and consider submitting a talk to the community. The overarching message about this meetup is “Apache RocketMQ: Messaging and Streaming’s

Re: 消费方日志

2018-05-22 Thread chuenfai
Hi ALL, 问两个比较奇怪的问题,我本地搭建了一个主从集群, 1 Slave启动时(初始时Master和Slave的数据目录都是空的,且没有向集群发过任何消息),会在commitLog创建两个文件,而且显示文件特别大,不清楚这个是怎么来的。 2 测试时发现Slave无法从Master同步到commitlog消息,但是消费记录等配置可以同步到 我的配置环境是:Rocketmq-4.2, Java1.8, Master的角色是ASYNC_MASTER 不知道有没有朋友遇到过相似的问题~

ServiceThread apache版本的一些疑问?

2018-06-10 Thread 卢松
各位大佬好。 有个疑问,apache版本ServiceThread是这么实现的: protected final CountDownLatch2 waitPoint = new CountDownLatch2(1); protected void waitForRunning(long interval) { if (hasNotified.compareAndSet(true, false)) { this.onWaitEnd(); return; } //entry to

[GSoC]Start the evaluation for the RocketMQ-Related Projects

2018-06-11 Thread Von Gosling
Hi, First Evaluations will be open June 11 and are DUE before June 15, 16:00 UTC. Our projects listing in here will be involved in the evaluation, are you ready? please note: only one mentor can complete the evaluation. Once the evaluation has been submitted it can not be edited, so be sure

【ConsumeQueue刷盘错误】

2018-06-11 Thread 杨春晖
storeerror.log出现ConsumeQueue刷盘错误的日志信息,有朋友了解是什么情况吗~ 版本是4.2.0 -- Best wishes! Chunhui Yang Institute of Network Technology Beijing University of Post and Telecommunications Email: chuenf...@163.com Telephone: +86 188 1179 3568

Re: ServiceThread apache版本的一些疑问?

2018-06-11 Thread Zhanhui Li
object.wait会导致死锁吗?不会, Java Object锁本身还是偏重的操作. 没有CAS这种原子操作轻量. 或者不会从睡眠中醒来? 2018-06-11 15:28 GMT+08:00 卢松 : > 你好,zhanhui, > > 我说的不同不是AtomicBoolean那块,如下: > > apache版本使用的是这个对象 CountDownLatch2 waitPoint = new CountDownLatch2(1); > 做的wait操作。 > > 而alibaba版本使用的object的wait操作, > > 这两种实现有什么区别? >

Re: 消费方日志

2018-06-07 Thread chuenfai
非常感谢回复,如醍醐灌顶! > 在 2018年6月6日,16:57,亓杨 写道: > > Hi,我说下自己的理解 > > > 1).brokerIP2和haMasterAddress分别是两个不同的用处,broker会定时拉取新的haServerAddress去更新haMasterAddress。这里是正确的,但是broker拉取的haServerAddress是master > >

Re: hi

2018-06-18 Thread ????
-- Original -- From: "Xiao Zongyang"; Date: Sun, Jun 17, 2018 05:51 PM To: "users"; Subject: hi hi

?????? Quick Start: No route info of this topic, TopicTest

2018-06-18 Thread ????????
Thanks. 1. auto create topic already true by default, but not sure why ask create topic manually. 2. I already create topic before send message. -- -- ??: "??"<1026203...@qq.com>; : 2018??6??15??(??) 6:07 ??: "users"; :

Re: 回复: CONSUME_FROM_LAST_OFFSET issue

2018-06-13 Thread 卢松
可以使用mqadmin中的resetOffsetByTime命令来跳过某一个时间点之前的消息。 这样就把老的消息跳过了。 虞开元 于2018年6月13日周三 下午4:17写道: > > 这个问题我之前有提交过patch,有需要可以参考一下。 > > https://issues.apache.org/jira/browse/ROCKETMQ-248 > > > > > > 虞开元 > > > > From: 萨尔卡 <1026203...@qq.com> > Sent: Wednesday, June 13, 2018 2:02 PM > To: users ;

Re: [GSoC]Start the evaluation for the RocketMQ-Related Projects

2018-06-13 Thread Sergio Esteves
Hi Von, Thanks! I have started working at full steam on the beam integration. I will report on my progress as often as possible. Best, Sergio. On Wed, Jun 13, 2018 at 10:35 AM, Von Gosling wrote: > Hi > > I have finished the first evaluation for two projects: AMQP and Beam > Integration. All

About batch messages cause many slow logs

2018-06-14 Thread Jason Joo
Hello, We have a cluster with 2m-2s architecture. TPS is between 1000 to 6000 and about 200 million messages in 24 hours typically. The commit log size is about 200GB and can be cached in memory fully. Our server(one rocketmq each, 4 servers in this cluster): 6 core Xeon-E5-2620 x 2 (24 thread

hi

2018-06-17 Thread Xiao Zongyang
hi

Re: ServiceThread apache版本的一些疑问?

2018-06-10 Thread Zhanhui Li
主要是缩小了锁的粒度. pls, 原子变量比对象锁效率好一点. > 在 2018年6月10日,下午3:25,卢松 写道: > > 各位大佬好。 > 有个疑问,apache版本ServiceThread是这么实现的: > >protected final CountDownLatch2 waitPoint = new CountDownLatch2(1); > > protected void waitForRunning(long interval) { >if (hasNotified.compareAndSet(true, false)) { >

Re: About batch messages cause many slow logs

2018-06-14 Thread dongeforever
*Hi:* Here is my understanding, hope it useful to you: 1. Batch sending is recommend for data collecting, such as website activity tracking or log aggregation, which requires high throughput and could tolerate some latency. On the contrary, simple sending is good for message delivery in

Quick Start: No route info of this topic, TopicTest

2018-06-15 Thread ????????
Hi, I follow http://rocketmq.apache.org/docs/quick-start/ to setup RocketMQ and test message sending. Environment: # cat /etc/redhat-release Red Hat Enterprise Linux Server release 7.4 (Maipo) # java -version java version "1.8.0_65" Java(TM) SE Runtime Environment (build 1.8.0_65-b17) Java

Re: Quick Start: No route info of this topic, TopicTest

2018-06-15 Thread Jason Joo
maybe you forgot to set the ENV: export NAMESRV_ADDR=172.24.150.158:9876 best regards, Jason > On Jun 15, 2018, at 15:15, 鳞波微步 <371887...@qq.com> wrote: > > Hi, > > I follow http://rocketmq.apache.org/docs/quick-start/ to setup RocketMQ and > test message sending. > > Environment: > > #

?????? Quick Start: No route info of this topic, TopicTest

2018-06-15 Thread ????????
I already set the NAMESRV_ADDR. -- -- ??: "Jason Joo"; : 2018??6??15??(??) 3:20 ??: "users"; : Re: Quick Start: No route info of this topic, TopicTest maybe you forgot to set the ENV: export

Re: clusterList和statsAll统计数据疑问

2018-05-28 Thread Zhanhui Li
1. 这两个统计, 都不是原子型的. 获取的数值时间有微小的差别. 但不应该出现你观察到的这么大的差别. 2. 统计这个地方的代码, 最近Fix了计数上的bug: https://github.com/apache/rocketmq/commit/97322eaf8e939e6835b90198bc411572c29a536a 你可以backport到你的版本. 3. 如果你愿意分享你的stats.log,

Re: transientStorePool的好处

2018-06-04 Thread Zhanhui Li
Hi Liu, This generally involves show Linux manages memory and its reclaiming strategy. Please refer to this document for a detailed explanation: https://events.static.linuxfound.org/sites/events/files/lcjp13_moriya.pdf

Re: Hi,您好,我想请教您几个rocketmq的问题,不知道您方便么?

2018-06-04 Thread Zhanhui Li
> 龚皓你好, 如果有大量的consume queue, 对系统确实还是有一些影响的. 下面解释下为什么这个影响可控. 1. 每一条消息, 对应的consume queue entry大小只有20字节. 也就是说, 一个queue里面, 发送200多条消息, 才需要一次IO去存储. 2. 由于consume queue完全可以从commit log中构造出来, consume queue的刷盘策略, 可以配置的更松弛一些, 比如每隔T刷盘一次. 这样可以进一步减少随机IO的量. 当然, 这里涉及内存和IO的一个平衡. 3. 实际生产上, 经常会把consume

Re: 关于ROCKETMQ的死信队列

2018-06-04 Thread 卢松
DLQ的默认读权限是不开的,所以在console上打开DLQ的读权限就可以了 在 2018年6月5日 上午9:10,李承霖 写道: > > > Hi, > > 我在代码中声明了一个DefaultMQPushConsumer尝试监听死信队列里的消息,却在代码中获得如下异常 > > > 08:33:30.588 [RebalanceService] ERROR RocketmqClient - > AllocateMessageQueueStrategy.allocate Exception. > allocateMessageQueueStrategyName=AVG >

Re: 关于ROCKETMQ的死信队列

2018-06-04 Thread Zhanhui Li
正解, 赞 > 在 2018年6月5日,下午12:29,卢松 写道: > > DLQ的默认读权限是不开的,所以在console上打开DLQ的读权限就可以了 > > 在 2018年6月5日 上午9:10,李承霖 写道: >> >> >> Hi, >> >> 我在代码中声明了一个DefaultMQPushConsumer尝试监听死信队列里的消息,却在代码中获得如下异常 >> >> >> 08:33:30.588 [RebalanceService] ERROR RocketmqClient - >>

Fwd: 关于ROCKETMQ的死信队列

2018-06-04 Thread 李承霖
> > Hi, > > 我在代码中声明了一个DefaultMQPushConsumer尝试监听死信队列里的消息,却在代码中获得如下异常 > > > 08:33:30.588 [RebalanceService] ERROR RocketmqClient - > AllocateMessageQueueStrategy.allocate Exception. > allocateMessageQueueStrategyName=AVG > java.lang.IllegalArgumentException: mqAll is null or mqAll empty

Error while starting broker

2018-06-06 Thread Kasthuriraajan Ratnasingam
Hi all, I am using rocketmq in ubuntu 16.04. I am following the guidelines from http://rocketmq.apache.org/docs/quick-start/ . When I try to start the broker I have got the following error. 2018-04-05 09:56:29 WARN ShutdownHook - unregisterBroker Exception, localhost:9876

Re: rocketmq支持内外网自动分离

2018-07-02 Thread Jason Joo
will, 首先我觉得这样的场景并不常见,因为broker并不适合直接公网暴露,容易造成安全问题,所以不知您这是基于什么场景,是否需要变换。 如果场景是异地机房互联,那么可以考虑走一个内网打通,类似ipsec/tunnel相关的方式。 best regards, Jason > On Jul 2, 2018, at 14:10, 王伟 wrote: > > 您好 >首先,非常感谢您百忙之中这么及时的回复。 >Tcp proxy之前我们有考虑过,但是由于broker的ip是由namesrv返回的,所以这里一直想不通tcp >

Re: rocketmq支持内外网自动分离

2018-07-02 Thread 王伟
您好 首先,非常感谢您百忙之中这么及时的回复。 Tcp proxy之前我们有考虑过,但是由于broker的ip是由namesrv返回的,所以这里一直想不通tcp proxy怎么处理这一块,请原谅我知识的浅溥,能麻烦你说一下详细的方案吗? 谢谢! Best regards。 > 在 2018年7月2日,上午11:47,Jason Joo mailto:hblz...@163.com>> 写道: > > tcp proxy > > > best regards, > > Jason > >> On Jul 2, 2018, at 11:30,

Re: rocketMQ 灰度方案

2018-07-01 Thread kai Ye
感谢提供的建议 我的想法是: 1、借助蓝绿部署的思想,部署两套rocketmq集群B和G 2、应用升级时,切换到B 3、验证完毕,切换回G yuzhou li 于2018年6月20日周三 上午11:01写道: > 可以搭建多套集群,按照集群重要程度,安排上线周期, 前面几套集群就当做灰度了; > 或者在nameserver和客户端做文章,每次上线都搭建一套新集群,然后把部分流量切过来做验证,有问题也可以回滚 > > kai Ye 于2018年6月20日周三 上午10:28写道: > >> 版本: 4.2 >> >> 请教一下大家,有没有做过rocketmq

rocketmq支持内外网自动分离

2018-07-01 Thread will . happy . willing
hi,各位rocketmq的大大位,先简单描述一下应用场景: 我们使用的模式是 外网生产数据,内网消费数据,这样 broker与 namesrv配置外网IP,是可以解决我们的使用场景的,但是,我们的consumer与 broker及 namesrv是在同一内网环境的,由于数据量较大,我们想 生产的时候使用外网ip,消费的时候使用内网,但是当前broker的配置并不支持这样的模式。 请问有什么方法可以解决我上述说的情况吗?我相信应该有很多场都与我上述描述的一样,并且阿里内部应该也有用到这样的场景吧。 以上是我的问题,非常感谢您在百忙之中抽空回复,谢谢。

Re: rocketmq支持内外网自动分离

2018-07-01 Thread Jason Joo
tcp proxy best regards, Jason > On Jul 2, 2018, at 11:30, will.happy.will...@gmail.com wrote: > > hi,各位rocketmq的大大位,先简单描述一下应用场景: > > 我们使用的模式是 外网生产数据,内网消费数据,这样 broker与 namesrv配置外网IP,是可以解决我们的使用场景的,但是,我们的consumer与 > broker及 namesrv是在同一内网环境的,由于数据量较大,我们想 >

Re: rocketmq支持内外网自动分离

2018-07-02 Thread 王伟
hi, jason 我们的服务是分布式布署接收客户端的请求并作响应(移动终端),服务端在收集到数据后发往rocketmq(内网布署,提供外网ip),然后内部程序(内网布署)消费rocketmq拿去数据做后续分析处理,由于数据量较大,所以想尽可能的多利用内网资源以节流量,所以才有这个问题的提出,看看你们是否有这方面成功的方法可分享。 感谢您的回复。 best wishs。 will. On 2018/07/02 06:23:48, Jason Joo wrote: > will, > >

Re: rocketmq支持内外网自动分离

2018-07-02 Thread 王伟
您好   首先,非常感谢您百忙之中这么及时的回复。   Tcp proxy之前我们有考虑过,但是由于broker的ip是由namesrv返回的,所以这里一直想不通tcp proxy怎么处理这一块,请原谅我知识的浅溥,能麻烦你说一下详细的方案吗?   谢谢!Best regards。在 2018年7月2日,上午11:47,Jason Joo 写道:tcp proxy best regards,Jason On Jul 2, 2018, at 11:30, will.happy.will...@gmail.com

Re: rocketmq支持内外网自动分离

2018-07-02 Thread Jason Joo
hi, will 所以实际上是这么个链路: clients <(internet)-> app servers <-(internet)> rocketmq <--(intranet)--> consumers app servers是部署了多地机房吗?如果部署了多地,可考虑ipsec内网互通,如果并没有,那么直接就是内网环境。 另外如果是因为其它原因导致多地部署,还可考虑各自在对应的内网部署整套的环境,最后在consumer层做下初处理和压缩,再加一步数据归集即可。 best regards,

Re: 【ConsumeQueue刷盘错误】

2018-06-19 Thread chyang...@163.com
是使用的默认配置,没有做过修改,偶尔会在某个节点出现这个问题,好奇怪。 > 在 2018年6月20日,10:37,kai Ye 写道: > > mapedFileSizeConsumeQueue

Apache RocketMQ Meetup 2018 schedule is now live.

2018-07-02 Thread Von Gosling
Dear Apache RocketMQ Enthusiast, I am pleased to announce our schedule for ApacheRocketMQ Meetup 2018. The first meetup will be held July 29 at the Shenzhen, China. We will be featuring 6 sessions on Apache RocketMQ. The concrete schedule will be coming soon. Now, the CFP for the meetup is

关于nameserver 的KV config

2018-07-02 Thread kai Ye
请教一下各位朋友,nameserver 里的KVconfig有个namespace的概念,这个是用来做什么用的,一般用于哪些场景 [image: image.png]

???????? Apache RocketMQ Meetup ????????

2018-07-02 Thread ????
?? ?? https://mp.weixin.qq.com/s/DXbzGz6ba7eMOqjBNLz6jQ https://mp.weixin.qq.com/s/ig5WOycipybrMVvlHhXr2w

Re: Apache RocketMQ Meetup 2018 schedule is now live.

2018-07-02 Thread 王伟
Hi, Von I’m so glad to knew this message, thank you! There is my info below here: 1 session: how to fix separation of internal and external traffic in rocketmq. 2 my name is wangle, live in Shenzhen. My job is program. Thank you again for this meet up. Best regards, Will > 在

Re: [ANNOUNCE] Congrats, CSoC Start !

2018-05-02 Thread yukon
Hi, Do you have any plan for the project? And we can use slack for communication. We are GMT+8. On Sun, Apr 29, 2018 at 9:32 AM, Ratnasingam Kasthuriraajan < kasthuriraaja...@gmail.com> wrote: > Hi Von, yukon, > > What would be the plan until May 14th? What would be the medium that we > will

Re: [ANNOUNCE] Congrats, CSoC Start !

2018-05-02 Thread Ratnasingam Kasthuriraajan
Hi yukon, Thanks for the information. Do you have any plan for the project? > Still I don't have any specific plans rather than which are mentioned in the proposal. But I am learning the technical stuffs related to the projects. I wold like to discuss any corrections or suggestion on my

Re: [ANNOUNCE] Congrats, CSoC Start !

2018-04-26 Thread Sergio Esteves
Hi, I have subscribed now with this email address that I am currently using. Thanks, Sergio. On Thu, Apr 26, 2018 at 9:42 AM, Von Gosling wrote: > Hi, > > GSoC guys, have you subscribed our dev and user email list, I have > received some unauthorized mails from your

Re: [ANNOUNCE] Congrats, CSoC Start !

2018-04-26 Thread yukon
Hi Guys, Congratulations on getting these GSoC projects, though that it's too late. Looking forward to working with you guys this summer. ``` I would like to ask why Yukon isn't listed in the mentors list assigned to my project? ``` I am, but the listed name is `Xinyu Zhou` which is my full

Re: [ANNOUNCE] Congrats, CSoC Start !

2018-04-28 Thread Ratnasingam Kasthuriraajan
Hi Von, yukon, What would be the plan until May 14th? What would be the medium that we will use for our chats during the project time? Do we have a daily scrum? Also what about the time zones? I am in GMT+5.30 zone. Thanks. Best Regards R.Kasthuriraajan. On Tue, Apr 24, 2018 at 7:51 AM, Von

答复: RocketMQ部署问题

2018-07-03 Thread shen hui
请教一下各位,在生产环境下使用RocketMQ,部署方面有什么经验可以参考,包括以下几个方面: 1. 集群容量,一个集群最多能支撑多少broker set;以及一个集群namesrv一般是几台 2. broker机器选型,主要是cpu、内存和磁盘,对于ssd是不是有非常强烈的需求,单个broker实例需要多少core和内存才能充分发挥性能 3. 如果一台机器挂多个磁盘,是否推荐起多个实例 利用多个磁盘  发件人: shen hui 发送时间: 2018年7月4日 10:47 收件人:

Re: RocketMQ offset getting difference between broker and consumer

2018-01-23 Thread yukon
Hi, There are two offsets for a queue/partition: * broker min offset: the minimum message offset in the current broker, which points to the earliest message. * broker max offset: the maximum message offset in the current broker, which points to the newest message. As for consumer, should

Re: RocketMQ offset getting difference between broker and consumer

2018-01-25 Thread Sachin Singh
Thanks Yukon, Very frequently we are getting difference between consumer offset and Broker max offset for few partition within same topic,we are explicitly resetting offset for that topic, nothing found much from code, any idea please help. On Jan 23, 2018 5:35 PM, "yukon"

?????? need help on RocketMQ data flow Map (with a question :)

2018-02-10 Thread ????
Hi , Yukon shared us a data flow map with a question. I have tried all my power reading the map without getting a specfic answer. Does anyone have idea with making it a new interesting incubator version! Really appreciate your "bit Data" source for helping on feeding it up! Sorry for any rude

Re: 回复: 回复: 回复:rep eat logging error when using openmessaging

2018-02-11 Thread 朱蔚林
你好: HI: 我提的问题不是针对Pull客户端,也不是针对openmessaging标准,而是针对 rmq-4.2.0 中的openmessaging实现。 Actually I'm not confusing about the pull-client, nor about the openmessaging protocol, but the implementation of the openmessaging protocol in rmq-4.2.0.

回复: 回复:repeat logging error when using openmessaging

2018-02-11 Thread 朱蔚林
你好! Hi, 多谢分析! Thanks for your attention. 实际上,offset是由openmessaging内部的定时任务来维护的(在报错的错误栈中有调用顺序),所以我想知道的是,是否有人能用过openmessaging的包,该包是否有坑。 Acturally, the offset of rmq is set by openmessaging-implementation. What I would like to know is that if there is anyone who has tried

?????? ?????? ??????rep eat logging error when using openmessaging

2018-02-11 Thread ????
?? openmesseg??pull??pull??offset pulloffset??offset??0rocketmq??

repeat logging error when using openmessaging

2018-02-11 Thread 朱蔚林
Hi all,     I meet a problem when pulling data from rocketmq using openmessaging implementation.     During my usage, I did get data, but at the same time I also got error message in my log file. I got a 70GB error log per day.     In my error log file, the same error repeated like this:     

Re: subscriptiongroup missed after broker restart in 4.1

2018-02-09 Thread liu  justin
Sorry for made a mistake. Subscription info did not  exist in subscriptionGroup.json, but existed in consumerOffset.json。 -- Justin Liu 发件人: liu justin 答复: 日期: 2018年2月10日 星期六 上午9:46 至: 主题:

?????? ??????repeat logging error when using openmessaging

2018-02-11 Thread ????
?? rocketmq??clientpushoffset??pull??offset pushoffset??broker

RocketMQ 3.5.8????????

2018-02-08 Thread 752832634
Hi ??docker??3.5.8??mq??jdk1.73??broker??1m1smaster ??namesrv??jvm??4gbroker??tps100??put message 1000ms

大流量情况下rocketmq是否会出现消息发送后,下发给消费者过慢的情况呢?

2018-06-19 Thread yuzhou li
今天读了rocketmq普通消费者拉取消息以及rocektmq生成consumerQueue相关部分的源码,现在consumerQueue的生成是起了一条线程ReputMessageService,从commitLog的randomAccessFile里读取数据,生成consumerQueue以及indexFile;randomAccessFile的写入在高并发情况下耗时会很高,进而会影响消费者拉取消息;不知道我这种理解是不是有问题呢?樂樂

????RocketMQ????????????????

2018-06-22 Thread /dyKillua/db
Hi?? ?? ?? ??rocketmq 4.1.0

Re: 答复: 求助:broker的message store在AllocateMappedFile之后写入TPS急剧下降

2018-07-28 Thread dongeforever
Hi: 你使用了 transientStorePoolEnable,这个模式的效果是先写内存(Buffer),再写到PageCache,如果触发了Buffer没有及时归还,会导致写性能急剧下降。 建议改下配置压下: transientStorePoolEnable=false useReentrantLockWhenPutMessage=true sendMessageThreadPoolNums=32(核数乘以2) 压测时观察下broker.log里面的dispatch behind日志。 Best Regards dongeforever 在 2018年7月26日

Re: 求助:broker的message store在AllocateMappedFile之后写入TPS急剧下降

2018-07-26 Thread 骆志杰
1.其实属于一种服务端保护机制,压测的场景下很容易出现,解决方案有两种,一个是增强写入能力,另一个是放宽安全限制。 2.增强写入能力:可以增加master分摊流量或者调整可以增加broker写入的参数 3.放宽限制:设大osPageCacheBusyTimeOutMills,waitTimeMillsInSendQueue,sendThreadPoolQueueCapacity等参数 4.我自己测试过调整3中的参数以后没有再出现这个异常 > 在 2018年7月26日,17:00,张凯 写道: > > 网络有问题么 > > shen hui

Re: rocketmq支持鉴权

2018-07-30 Thread zuhouhuwj49...@touna.cn
rocketmq就没有这方面的 祖厚虎 运维 技术部 深圳市福田区香蜜湖香梅路中投国际商务大厦A栋3-5楼 Mobile: 13410182353 发件人: will.happy.will...@gmail.com 发送时间: 2018-07-30 14:47 收件人: users@rocketmq.apache.org 主题: rocketmq支持鉴权 Hi, 各位大神,请问rocketmq怎么支持鉴权机制,查了很多资料都是说的tls数据加密的方式的,没有涉及用户名密码这类的认证机制。 Best regards will

rocketmq支持鉴权

2018-07-30 Thread will . happy . willing
Hi, 各位大神,请问rocketmq怎么支持鉴权机制,查了很多资料都是说的tls数据加密的方式的,没有涉及用户名密码这类的认证机制。 Best regards will

rocketmq支持鉴权机制。

2018-07-30 Thread 王伟
Hi, 大神你们好。 当前我们使用的rocketmq是 4.2的,因为涉及不同部门业务数据的交互,所以需要用到鉴权的功能(用户名、密码),但是研究发现当前不支持鉴权,只支持数据级别的加密(tls),但是对性能损耗比较严重。所以想问计划什么时候支持鉴权的功能或有什么好的方案建议,谢谢。 Best regards. will.

Re: rocketmq支持鉴权

2018-07-30 Thread dongeforever
目前没有直接支持,但是在客户端和服务端都提供了一个Hook机制,可以方便地对接第三方鉴权系统。 可以看下源码了解下。 dongeforever Best Regards 在 2018年7月30日 下午3:12,王伟 写道: > 那以后有没有计划支持呢? > > 在 2018年7月30日,下午2:48,zuhouhuwj49...@touna.cn 写道: > > rocketmq就没有这方面的 > > -- > 祖厚虎 > 运维 技术部 > 深圳市福田区香蜜湖香梅路中投国际商务大厦A栋3-5楼 > Mobile:

Re: rocketmq支持鉴权

2018-07-30 Thread 王伟
那以后有没有计划支持呢? > 在 2018年7月30日,下午2:48,zuhouhuwj49...@touna.cn 写道: > > rocketmq就没有这方面的 > > 祖厚虎 > 运维 技术部 > 深圳市福田区香蜜湖香梅路中投国际商务大厦A栋3-5楼 > Mobile: 13410182353 > > > 发件人: will.happy.will...@gmail.com > 发送时间: 2018-07-30 14:47 > 收件人: users@rocketmq.apache.org

Re: rocketmq支持鉴权

2018-07-30 Thread 王伟
目前没有支持,那后续有没有支持的计划?因为对接第三方的鉴权系统,涉及到所有类型的客户端的修改(go,py,c++,java的)相对麻烦一些。 感谢您的回复。 Best regards. Will > 在 2018年7月30日,下午3:36,dongeforever 写道: > > 目前没有直接支持,但是在客户端和服务端都提供了一个Hook机制,可以方便地对接第三方鉴权系统。 > 可以看下源码了解下。 > > dongeforever > Best Regards > > 在 2018年7月30日 下午3:12,王伟

????????????RocketMQ broker01????cpu??????????????

2018-07-25 Thread hooligan
??broker01??sendMessageThreadPoolNums=2 ??sendMessageThreadPoolNums=1 2018-07-25 18:01:12 INFO StoreStatsService - put_tps 7737.515093346543 2018-07-25 18:01:12 INFO

Re: [DISCUSS] Introduce RocketMQ Improvement Proposal

2018-08-09 Thread Xiao Zongyang
Sorry for adding wrong receivers! I'm sorry for disturbing you guys. Zongyang

Introduce RocketMQ Improvement Proposal

2018-08-09 Thread Zongyang Xiao
Dear Apache RocketMQ Community When we want the Apache RocketMQ project we propose an ISSUE with feature request on Github. It's a nice way for a request but not very formal and easy to trace and manage. So I suggest that we should introduce the RIP(RocketMQ Improvement Proposal) mechanism to

[DISCUSS] Introduce RocketMQ Improvement Proposal

2018-08-09 Thread Xiao Zongyang
Dear Apache RocketMQ Community When we want the Apache RocketMQ project we propose an ISSUE with feature request on Github. It's a nice way for request but not very formal and easy to trace and manage. So I suggest that we should introduce the RIP(RocketMQ Improvement Proposal) mechanism to

[DISCUSS] Introduce RocketMQ Improvement Proposal

2018-08-09 Thread Xiao Zongyang
Dear Apache RocketMQ Community When we want the Apache RocketMQ project we propose an ISSUE with feature request on Github. It's a nice way for request but not very formal and easy to trace and manage. So I suggest that we should introduce the RIP(RocketMQ Improvement Proposal) mechanism to

[STARTUP]Apache RocketMQ Beijing Meetup

2018-08-08 Thread dongeforever
Dear Apache RocketMQ Community, I am excited to call for the second meetup in Beijing, China at Sep. 1 pm., 2018. Please have a look at your schedule, and consider submitting a talk to the community, just reply to this email. The overarching message about this meetup is “Apache RocketMQ:

Re: [STARTUP]Apache RocketMQ Beijing Meetup

2018-08-08 Thread Xin Wang
Hi devs, I'd like to share a topic, Streaming Processing with Apache RocketMQ, in this meetup. This topic includes: * RocketMQ streaming ecosystem * Streaming systems data fault-tolerant & How to build a connector between MQ and streaming engine * Integrating RocketMQ with streaming

Re: Introduce RocketMQ Improvement Proposal

2018-08-16 Thread Zongyang Xiao
Hi Apache RocketMQ Community, I'm going to propose a new module `MQTT Bridge for Apache RocketMQ`, which connects existing IoT devices to the RocketMQ eco-system through MQTT protocol. The IoT programs are able to send to or receive from RocketMQ broker without modifying even one line of code.

Re: [STARTUP]Apache RocketMQ Beijing Meetup

2018-08-13 Thread @Nandan@
*Hi Von,* Thanks for your reply. Right now, I am still testing RocketMQ in my test environment. Right now more test needs to be done before the move to Production ready environment. But if meet up will be in English, then I would like to attend and get more in-depth and in-sight about RocketMQ.

Re: [STARTUP]Apache RocketMQ Beijing Meetup

2018-08-12 Thread Von Gosling
Hi, Nandan Cool, I would like to ask if you could share a topic related to RocketMQ in English. I am glad to help you if you hope to share us something about RocketMQ in Apache RocketMQ Beijing, China :-) Best Regards, Von Gosling > 在 2018年8月13日,09:01,@Nandan@ 写道: > > Hi All, > I am a

Re: [STARTUP]Apache RocketMQ Beijing Meetup

2018-08-12 Thread @Nandan@
Hi All, I am a non-Chinese speaker, working in Beijing. Are these meetup going to organize in Chinese language or Chinese as well as English? Please update me then I can able to attend it. Best Wishes, Nandan On Sun, Aug 12, 2018 at 8:21 PM Haiting Jiang wrote: > Dear all, > I'd like to share

?????? [STARTUP]Apache RocketMQ Beijing Meetup

2018-08-14 Thread Xiao Zongyang
Hi RocketMQ Community, I'd like to share a topic `MQTT Bridge for Apache RocketMQ` in this meetup. Concerned users or developers can communicate with me on the mailing list. Best Regards, Zongyang -- -- ??: "@Nandan@"; :

Re: [DISCUSS] Introduce RocketMQ Improvement Proposal

2018-08-22 Thread Von Gosling
Hi, I hate so helpful community proposal sinked :-) Thanks @Zongyang, IMO, it’s time to introduce more effective feature request mechanism for Apache RocketMQ. I will make more comments on the proposal and very glad to hear other PMCs sounds. Has anyone issued XXIP for other Apache TLP

??????RocketMQ broker01????cpu??????????????

2018-07-18 Thread hooligan
hi?? all

????????????RocketMQ broker01????cpu??????????????

2018-07-19 Thread A-Yu
??24??CPUCAS | | A-Yu | | ??plz...@163.com | ?? ??2018??07??19?? 14:08??hooligan ??

????????????RocketMQ broker01????cpu??????????????

2018-07-19 Thread hooligan
??broker02sendMessageThreadPoolNums24?? -- hooligan -- -- ??: "duhengforever"; : 2018??7??19??(??) 2:06

回复:求助,RocketMQ broker01主机cpu异常飙高问题!

2018-07-19 Thread duhengforever
从日志来看,是因为大量SendMessageThread竞争锁导致CAS时产生CPU空转,尝试将sendMessageThreadPoolNums设置为5试下。 发自网易邮箱大师 在2018年07月19日 13:59,hooligan<79015...@qq.com> 写道: hi,

?????????? RocketMQ Master????????????????????????????

2018-07-16 Thread hooligan
?? -- hooligan -- -- ??: "404828407"<404828...@qq.com>; : 2018??4??2??(??) 12:06 ??: "users"; :

?????????? RocketMQ Master????????????????????????????

2018-07-16 Thread 404828407
cool @hooligan -- -- ??: "hooligan"<79015...@qq.com>; : 2018??7??16??(??) 11:46 ??: "users"; : ?? RocketMQ Master

Re: [DISCUSS] Introduce RocketMQ Improvement Proposal

2018-09-06 Thread Zongyang Xiao
Hi Apache RocketMQ Community, As mentioned before, the RIP for MQTT Bridge is coming, see [1] for more details. In this RIP, I'm intended to bring the IoT ability to the Apache RocketMQ, at the same, enable the IoT devices to leverage the Apache RocketMQ's features. Suggestions and comments are

回复:Apache RocketMQ Meetup 2018 schedule is now live.

2018-07-05 Thread 李维军
Hi, I am Li Weijun, so glad to received the meetup message, and I'd like to share something about the CI environment of the Apache RocketMQ and rules to help us commit efficiently. Best Regards, Li Weijun -- 发件人:heng du

Re: RocketMQ部署问题

2018-07-04 Thread Jason Joo
hi, shen hui 关于namesvrFetching,具体补充一下 首先设置方法比较简单,无论是命令行用-D还是如下的创建实例前临时环境变量设置: System.setProperty("rocketmq.namesrv.domain", "rocketmq.x.org"); System.setProperty("rocketmq.namesrv.domain.subgroup", "nsaddr"); 对应的地址:http://rocketmq.x.org:8080/rocketmq/nsaddr

Re: [GSoC]Start the evaluation for the RocketMQ-Related Projects

2018-07-10 Thread Kasthuriraajan Ratnasingam
Hi all, I have completed my second evaluation of my mentor. Thank you! Best regards, R.Kasthuriraajan. On Mon, Jun 11, 2018 at 11:58 AM, Von Gosling wrote: > Hi, > > First Evaluations will be open June 11 and are DUE before June 15, 16:00 > UTC. Our projects listing in here will be involved

Re: 关于nameserver 的KV config

2018-07-11 Thread kai Ye
谢谢,了解了 Zhanhui Li 于2018年7月4日周三 下午3:24写道: > 预留的扩展点. 做k-v对的隔离. > > 可以通过运维执行修改Name Server上的K-V, 做定制化的操作. > > 举个例子, 在name-server上, 增加这样一个Entry: blocklist/(CG_Example, 172.0.0.1/24) > 客户端定期尝试获取这个路径上的kv, 检查自己的消费组和IP地址是否在指定范围内. 如果在的话, 就不参加消息消费的负载均衡. > 这种模式, 可以实现应用的优雅下线, 故障隔离等. > > > 在

Re: Apache RocketMQ Meetup 2018 schedule is now live.

2018-07-09 Thread Von Gosling
Thanks for everyone enthusiasm. We have contacted the sponsor to help us to live broadcast, the poster will be ready this week. See you in Shenzhen :-) Best Regards, Von Gosling > 在 2018年7月3日,09:52,Von Gosling 写道: > > Dear Apache RocketMQ Enthusiast, > > I am pleased to announce our

Re: Apache RocketMQ Meetup 2018 schedule is now live.

2018-07-04 Thread heng du
I am Du Heng and you can call me henry, and I am from Alibaba, so glad to received this message,thanks. Due to the upcoming transaction message feature of Apache rocketMQ, I hope to share some design and practical experience related to distributed transactions,especially in terms of the eventual

RocketMQ offset getting difference between broker and consumer

2018-01-22 Thread Sachin Singh
Hi all, Recently we observed that, RocketMQ offset getting difference between broker offset and consumer offset,e.g. I have created topic with 4 partitions, whenever message coming to partition whose broker offset not matches to consumer offset messages not getting picked up, Not sure why getting

Re: Difference in broker offset and consumer offset

2018-01-22 Thread Sachin Singh
Hi, I am using RocketMQ 4.1 incubator version, Recently we observed that, RocketMQ offset getting difference between broker offset and consumer offset,e.g. I have created topic with 4 partitions, whenever message coming to partition whose broker offset not matches to consumer offset messages not

转发:[ANNOUNCE] Github Issue has been enabled for Apache RocketMQ(add a CN word.)

2018-03-07 Thread 智齿
Hi guys, By reading the article "vongosling"; published on the "Apache Blogging in Action". My friend and I feel excited , then add a CN word for his nice Article: https://blogs.apache.org/foundation/entry/success-at-apache-open-innovation His core idea: "Address how to

Re: [ANNOUNCE] Github Issue has been enabled for Apache RocketMQ(add a CN word.)

2018-03-11 Thread Ratnasingam Kasthuriraajan
Hi Yukon and Vongosling, I'm so much impressed on RocketMQ. I would like to chose a project for GSOC2018 from RocketMQ and I discuss about it in the jira too. But I would like to contribute for the RocketMQ community appart from that GSOC2018 project also since I'm an opensource software

Re: [ANNOUNCE][MESSAGE] 1.How to migrate existing JIRA issues to Github Issue_CN_v0.1

2018-03-11 Thread 智齿
Hi guys, 见信如唔  以下文本为指导手册草案,为用户或是学生制定(FOR USER,FOR STUDENTS) 非阿里、APACHE - ROCKET官方/商业用途; 允许转载、请署名作者Jarvis -1️⃣.NONE Bussiness.alibaba or ROCKET.gov SPEAKING >MAIL PROSAL: [HOW] TO MIGRATE IRA issues Into Github for students >REPLY the topic: Re: [ANNOUNCE] Github Issue

  1   2   3   4   5   6   7   8   9   10   >