[
https://issues.apache.org/jira/browse/KAFKA-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikumar resolved KAFKA-3793.
------------------------------
Resolution: Cannot Reproduce
{color:#000000}Closing inactive issue. Please reopen if you think the issue
still exists{color}
> Kafka Python Consumer library messages gets truncated
> -----------------------------------------------------
>
> Key: KAFKA-3793
> URL: https://issues.apache.org/jira/browse/KAFKA-3793
> Project: Kafka
> Issue Type: Bug
> Reporter: Rahul
> Priority: Major
>
> Snippet code is below:
> from kafka import KafkaConsumer
> from kafka.client import KafkaClient
> from kafka.consumer import SimpleConsumer
> consumer = KafkaConsumer('eventdetails_ingestion' ,
> group_id='1',bootstrap_servers=‘xxxx:9092',
> max_partition_fetch_bytes=10555555)
> for msg in consumer:
> try:
> jValue = json.loads(str(msg.value))
> except ValueError:
> fileErr.write(str(msg.value)+"\n")
> Steps:
> We send/produce large sets of messages to Kafka of around 20 to 30 KB size
> each messages in JSON format and producing around 200 messages / sec for 1
> hour duration. We have 3 Kafka Brokers running and I am trying to consume the
> messages from these 3 Kafka Brokers from the same topic using the above code.
> The problem is that sometimes some of the messages gets truncated, I am not
> sure why it happen ?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
