The Hadoop consumer uses an offsets file to know which partitions to consume and from which offset. How does you offsets file look like ?
Thanks, Neha On Fri, Aug 10, 2012 at 7:06 AM, Fredrik Emilsson <fredrik.emils...@mblox.com> wrote: > Hello, > > > > I have a topic that have two partitions. I have one broker. Adding > events is working well, there are events both in the 0 and 1 partition. > The problem arise when I try to import it into Hadoop. It seems that > only the events in partition 0 is imported. I am using a script (found > here: > http://felixgv.com/post/69/automating-incremental-imports-with-the-kafka > -hadoop-consumer/) to import it. > > > > Does anyone know what the problem could be? > > > > Regards, > > Fredrik > > > > > > > NOTICE - This message and any attached files may contain information that is > confidential and/or subject of legal privilege intended only for use by the > intended recipient. If you are not the intended recipient or the person > responsible for delivering the message to the intended recipient, be advised > that you have received this message in error and that any dissemination, > copying or use of this message or attachment is strictly forbidden, as is the > disclosure of the information therein. If you have received this message in > error please notify the sender immediately and delete the message.
