Re: RocksDB error when running Kafka with a larger data set

2017-02-15 Thread Sabarish Sasidharan
Sometimes this happens because the lock file is not cleared. Did you look for the .lock file? Regards Sab On 15 Feb 2017 8:59 p.m., "Frank Lyaruu" wrote: > No, it sure isn't... The log file doesn't seem to have been touched for > hours. The whole log file seems to be of the

Re: RocksDB error when running Kafka with a larger data set

2017-02-15 Thread Frank Lyaruu
No, it sure isn't... The log file doesn't seem to have been touched for hours. The whole log file seems to be of the same millisecond, but hours before the stack trace (The stack trace is from 15:25). It seems to have barfed out of nowhere without logging anything. 2017/02/15-12:38:07.061758

Re: RocksDB error when running Kafka with a larger data set

2017-02-15 Thread Damian Guy
Hi Frank, Very hard to say from the stack trace. The exception isn't the most informative! Is there anything obvious in the RocksDB LOG? Thanks, Damian On Wed, 15 Feb 2017 at 06:38 Frank Lyaruu wrote: > Hi Kafka crew, > > I'm rolling out a Kafka Streams application on a

RocksDB error when running Kafka with a larger data set

2017-02-15 Thread Frank Lyaruu
Hi Kafka crew, I'm rolling out a Kafka Streams application on a pretty large dataset, and I see some exceptions that worry me, which I haven't seen with smaller data sets (Using Kafka streams trunk of a few days ago) 2017-02-15 15:25:14,431 | INFO | StreamThread-42 | StreamTask | 86