Hi,
I observed some error messages / exceptions while running partition
reassignment on kafka 0.8.1.1 cluster. Being fairly new to this system I'm
not sure if these indicate serious failures or transient problems, or if
manual intervention is needed.
I used kafka-reassign-partitions.sh to
I think you are printing the class Message instead of MessageAndMetadata.
The output you got was from Message.toString.
Can you just try something like below?
...
ConsumeIterator iter = consumerStream.iterator(); // assuming you have got
a consumer stream.
MessageAndMetadata messageAndMetadta =
We are currently discussing a last-minute API change to the new java
producer. We have also accumulated a few more 0.8.2 blockers.
No, hasNext will return immediately if data is available. The consumer
timeout is only helpful if your application can't safely block on the
iterator indefinitely.
-Ewen
On Sat, Nov 29, 2014, at 08:35 PM, Rahul Amaram wrote:
Yes, I have configured consumer timeout config.
Let me put my query
We don't have such an api on the broker right now.
Thanks,
Jun
On Sun, Nov 30, 2014 at 6:33 AM, Mo Firouz mo.fir...@visualdna.com wrote:
Hi guys,
I was wondering if I could get a list of consumers / consumer groups from
Kafka directly without the use of Zookeeper?
Bonus point goes if I
+1 for doing a 0.8.2 final before the December break.
On Mon, Dec 1, 2014 at 8:40 AM, Jun Rao jun...@gmail.com wrote:
We are currently discussing a last-minute API change to the new java
producer. We have also accumulated a few more 0.8.2 blockers.
If we can have a build ready by Dec 26th I think that is feasible. I could
prepare and post that if we think we have the votes and a stable version.
/***
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
I unfortunately do not have any specific logs from these events but I will try
and describe the events as accurately as possible to give an idea of the
problem I saw.
The odd behavior manifested itself when I bounced all of the kafka processes on
each of the servers in a 12 node cluster. A few
Thank you so much Jiangle. I got it working.
I have another problem the consumer doesnt receive message if it is big:
When the producer sends 256kb messages to broker, consumer is able to
retrieve it, but when producer sends 10MB messages to the broker, the
consumer doesn’t receive any message.
Hi all,
Consumer doesnt receive message if it is big: When the producer sends
256kb messages to broker, consumer is able to retrieve it, but when
producer sends 10MB messages to the broker, the consumer doesn’t receive
any message.
Please tell me how to make the consumer receive 10MB messages.
have you set fetch.message.max.bytes to 10mb or more in your consumer
config.
-Harsha
On Mon, Dec 1, 2014, at 07:27 PM, Palur Sandeep wrote:
Hi all,
Consumer doesnt receive message if it is big: When the producer sends
256kb messages to broker, consumer is able to retrieve it, but when
Yeah I did. I made the following changes to server.config:
message.max.bytes=10485800
replica.fetch.max.bytes=104858000
replica.fetch.wait.max.ms=2000
On Mon, Dec 1, 2014 at 10:03 PM, Harsha ka...@harsha.io wrote:
have you set fetch.message.max.bytes to 10mb or more in your consumer
config.
Hi,
We have a kafka cluster that runs Kafka 0.8.1 that we are considering
upgrade to 0.8.1.1. The Kafka documentation
http://kafka.apache.org/documentation.html#upgrade mentions upgrading
from 0.8 to 0.8.1, but not from 0.8.1 to 0.8.1.1. Will doing one broker at
a time by brining the broker
13 matches
Mail list logo
