回复: Kafka broker failed to work when migrating the broker to another machine

2015-03-02 Thread YuanJia Li
Zhongjing, can you show some server.log ? ie:broker 4 or the leader of topic log_error. 发件人: 俞忠静 发送时间: 2015-03-02 18:37 收件人: users@kafka.apache.org 抄送: 吴红芳; 邵宏亮; 方超超 主题: Kafka broker failed to work when migrating the broker to another machine Hi, I set up a Kafka cluster with 5 brokers, with

delete log file

2015-01-22 Thread YuanJia Li
Regards YuanJia Li

Re: Re: delete log file

2015-01-22 Thread YuanJia Li
. Thanks Regards YuanJia Li From: Yang Fang Date: 2015-01-23 12:15 To: users Subject: Re: delete log file YuanJia, I want to know why your broker's disk is almost full . Maybe your issue is the same with mine. Is it one broker out of service for a long time, then it fails back, at first it looks good

how to order message between different partition

2015-01-08 Thread YuanJia Li
Hi all, I have a topic with 3 partitions, and each partion has its sequency in kafka. How to order message between different partion? Anyone has experiences about that, thanks. Thanks Regards YuanJia Li

Re: kafka monitoring system

2014-12-22 Thread YuanJia Li
Hi Sa Li, You can try to use jmxtrans+opentsdb to monitor kafka. Jmxtrans is collecting data with JMX and sending to opentsdb. Opentsdb is graphing and alerting. YuanJia Li From: Sa Li Date: 2014-12-23 08:41 To: users Subject: kafka monitoring system Hi, all I am thinking to make

Re: Reuse ConsumerConnector

2014-12-10 Thread YuanJia Li
hi Chen, Maybe you can take some tips from kafka.tools.KafkaMigrationTool.java, it's also a multi-threads using case. Reusing the same ConsumerConnector every time is ok. If you create ConsumerConnector repeatedly with the same consumer.id, the conflict will happen in ZK. Yuanjia Li From

Pagecache cause OffsetOutOfRangeException

2014-12-02 Thread YuanJia Li
to kernel's pagecache and not flush to the file yet,while I'm consuming new messages from the file? How to fix it? Thanks, Yuanjia Li

Re: Re: How to push metrics to graphite - jmxtrans does not work

2014-12-02 Thread YuanJia Li
Jmxtrans should connect to the jmxremote port. Try to run ps -aux |grep kafka, and find the process contain -Dcom.sun.management.jmxremote.port or not. If not, try to edit kafka-server-start.sh, add export JMX_PORT=.

Re: Re: Pagecache cause OffsetOutOfRangeException

2014-12-02 Thread YuanJia Li
Hi Guozhang, My kafka works in product environment, a large messages are produced or consumed. So it is not easy to get the accurate offset through the GetOffset tool when an OffsetOutOfRangeException happens.But in my application, I have coded comparing the consuming offset with the latest