RE: Strange Topic ...

2018-02-04 Thread adrien ruffie
__ De : Ted Yu Envoyé : dimanche 4 février 2018 20:37:59 À : users@kafka.apache.org Objet : Re: Strange Topic ... Which Kafka version are you using ? Older versions of kafka (0.10 and prior) had some bugs in the log-cleaner thread that might sometimes cause it to crash. Please check the log-cleane

Re: Strange Topic ...

2018-02-04 Thread naresh Goud
This is the topic used and created by Kafka internally to store consumer offsets while use consumer programs running. Thank you, Naresh On Sun, Feb 4, 2018 at 1:38 PM Ted Yu wrote: > Which Kafka version are you using ? > Older versions of kafka (0.10 and prior) had some bugs in the log-cleaner

Re: Strange Topic ...

2018-02-04 Thread Ted Yu
Which Kafka version are you using ? Older versions of kafka (0.10 and prior) had some bugs in the log-cleaner thread that might sometimes cause it to crash. Please check the log-cleaner.log file to see if there was some clue. Cheers On Sun, Feb 4, 2018 at 11:14 AM, adrien ruffie wrote: > Hello

Strange Topic ...

2018-02-04 Thread adrien ruffie
Hello all, I'm a beginner in Kafka and this morning when I try some tests and when running this following cmd: ./bin kafka-topics.sh --zookeeper localhost:2181 --describe I understand my 3 created topic like "customer-topic", "streams-plaintext-input", and "streams-wordcount-output" But I

Re: Strange topic-corruption issue?

2014-08-17 Thread Steve Miller
Odd -- I copied and pasted what you'd asked me to run: /opt/kafka/bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files .log and I just re-ran it and the output looks the same as what I'd put up for people to grab. I also ran: /opt/kafka/bin/kafka-run-class.sh k

Re: Strange topic-corruption issue?

2014-08-15 Thread Jun Rao
What's in there seems to be still the output for deep iteration. For shallow iteration, the compression codec for each message should be Snappy. Thanks, Jun On Fri, Aug 15, 2014 at 5:27 AM, Steve Miller wrote: >Oh, yeah, sorry about that. I threw a copy of that up at: > > https:/

Re: Strange topic-corruption issue?

2014-08-15 Thread Steve Miller
Oh, yeah, sorry about that. I threw a copy of that up at: https://newbie.idrathernotsay.com/full.txt.gz (you'll get a cert error, for the four times I put something on the home website each year, I didn't feel like getting a real cert (-: ). If that doesn't work I'm sure I can fi

Re: Strange topic-corruption issue?

2014-08-14 Thread Neha Narkhede
Apache doesn't allow attachments. Could you send maybe a pastebin or something? On Thu, Aug 14, 2014 at 2:11 PM, Steve Miller wrote: >I've attached the full output. The only other thing it produced was > our old favorite: > > Non-secutive offsets in :/home/steve/mytopic-9/0

Re: Strange topic-corruption issue?

2014-08-14 Thread Steve Miller
I've attached the full output. The only other thing it produced was our old favorite: Non-secutive offsets in :/home/steve/mytopic-9/.log 1327 is followed by 1327 For the first time, earlier today, we've seen this happen from one of our other producers; offhand I'm

Re: Strange topic-corruption issue?

2014-08-14 Thread Jun Rao
What's the output of the following command? /opt/kafka/bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files .log Thanks, Jun On Wed, Aug 13, 2014 at 11:40 AM, Steve Miller wrote: >Sure. I ran: > > /opt/kafka/bin/kafka-run-class.sh kafka.tools.Du

Re: Strange topic-corruption issue?

2014-08-13 Thread Steve Miller
Sure. I ran: /opt/kafka/bin/kafka-run-class.sh kafka.tools.DumpLogSegments --files .log --deep-iteration and got (in addition to the same non-secutive offsets error): [ ... ] offset: 1320 position: 344293 isvalid: true payloadsize: 208 magic: 0 compresscodec: N

Re: Strange topic-corruption issue?

2014-08-13 Thread Jun Rao
Interesting, could you run DumpLogSegments with and w/o deep-iteration and send the output around offset 1327? Thanks, Jun On Tue, Aug 12, 2014 at 5:42 PM, Steve Miller wrote: > [ "Aha!", you say, "now I know why this guy's been doing so much tshark > stuff!" (-: ] > >Hi. I'm running int

Strange topic-corruption issue?

2014-08-12 Thread Steve Miller
[ "Aha!", you say, "now I know why this guy's been doing so much tshark stuff!" (-: ] Hi. I'm running into a strange situation, in which more or less all of the topics on our Kafka server behave exactly as expected... but the data produced by one family of applications is producing fairly