about java.io.EOFException / java.lang.ClassNotFoundException: kafka.common.OffsetOutOfRangeException

2017-03-17 Thread Selina Tech
Hi: I am processing on a new Kafka topic with Spark and then I got error below. I google this questions, looks like I lot of people having similar problems before. But I have not got clue yet. Is any one know how to fix this issue? Sincerely. Selina 00:39:58,004 WARN - 2017-03-18

Re: Avro vs Protocol buffer for Kafka message

2015-11-18 Thread Selina Tech
18, 2015 at 3:49 PM, Selina Tech <swucaree...@gmail.com> wrote: > Dear All: > > I need to generate some data by Samza to Kafka and then write to > Parquet formate file. I was asked why I choose Avro type as my Samza > output to Kafka instead of Protocol Buffer. Sin

Avro vs Protocol buffer for Kafka message

2015-11-18 Thread Selina Tech
Dear All: I need to generate some data by Samza to Kafka and then write to Parquet formate file. I was asked why I choose Avro type as my Samza output to Kafka instead of Protocol Buffer. Since currently our data on Kafka are all Protocol buffer type message. I explained that Avro

Re: Getting error while reading message

2015-10-20 Thread Selina Tech
I got same error when I send message to Kafka. generally it caused by deserializer as Hemant mentioned. You need to check how the data was send to Kafka, and how is your consumer deserializer defined. And you need to check for both Key and value. the data is the topic might be byte[] type

Re: Kafka - Rest api query

2015-10-20 Thread Selina Tech
Could you write a consumer at your rest server? On Tue, Oct 20, 2015 at 1:18 PM, Kudumula, Surender < surender.kudum...@hpe.com> wrote: > Thanks for the reply. Iam looking to know if its possible to route binary > objects messages to rest api service from kafka. If so please let me know. >