Hey, thank you for the report. This looks like a bug in the Collector.
Can you please open an issue over at GitHub? https://github.com/Graylog2/collector/issues Can you also please add a few example log lines from the files in the directory to that issue? This makes it easier to reproduce, thank you! Regards, Bernd [email protected] [Thu, Sep 03, 2015 at 02:00:05AM -0700] wrote: >Hi >I have a problem with collector. >In few minutes after start it fails with error > >> Exception in thread "ChunkProcessor" java.lang.IndexOutOfBoundsException: >> readerIndex(0) + length(1182) exceeds writerIndex(1156): >> UnpooledUnsafeDirectByteBuf(ridx: 0, widx: 1156, cap: 1156/1156) >> at >> io.netty.buffer.AbstractByteBuf.checkReadableBytes(AbstractByteBuf.java:1166) >> at io.netty.buffer.AbstractByteBuf.skipBytes(AbstractByteBuf.java:741) >> at >> org.graylog.collector.file.splitters.PatternChunkSplitter$1$1.computeNext(PatternChunkSplitter.java:75) >> at >> org.graylog.collector.file.splitters.PatternChunkSplitter$1$1.computeNext(PatternChunkSplitter.java:40) >> at >> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143) >> at >> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138) >> at >> org.graylog.collector.file.ChunkProcessor.createMessages(ChunkProcessor.java:89) >> at >> org.graylog.collector.file.ChunkProcessor.process(ChunkProcessor.java:85) >> at org.graylog.collector.file.ChunkProcessor.run(ChunkProcessor.java:51) >> at >> com.google.common.util.concurrent.AbstractExecutionThreadService$1$2.run(AbstractExecutionThreadService.java:60) >> at com.google.common.util.concurrent.Callables$3.run(Callables.java:95) >> at java.lang.Thread.run(Thread.java:745) > > >Just before fail it sends logs to server successfully. > >Here is my collector.conf. Version is 0.4.0 > >> server-url = "http://log20:12900"; >> message-buffer-size = 12144 >> collector-id = "file:/etc/graylog/collector/collector-id" >> metrics { >> enable-logging = false >> log-duration = 60s >> } >> inputs { >> local-apilog { >> type = "file" >> path-glob-root = "/var/log/api/" >> path-glob-pattern = "*log" >> charset = "utf-8" >> reader-interval = "1s" >> content-splitter = "PATTERN" >> content-splitter-pattern = "^\\d{4}-\\d{2}-\\d{2} \\d{2}:\\d{2}:\\d{2}" >> } >> } >> outputs { >> gelf-tcp { >> type = "gelf" >> protocol = "tcp" >> host = "graylog" >> port = "52304" >> client-queue-size = 5120 >> client-send-buffer-size = 65536 >> } >> } > > >In /var/log/api I have more than 6000 files, which match pattern *.log >I've tried to increase Xmx of java process till 1024Mb, client-queue-size, >client-send-buffer-size and message-buffer-size. > >Could somebody explain me what the problem is and how to fix it? >Thank you in advance. > >-- >You received this message because you are subscribed to the Google Groups >"Graylog Users" group. >To unsubscribe from this group and stop receiving emails from it, send an >email to [email protected]. >To view this discussion on the web visit >https://groups.google.com/d/msgid/graylog2/d568334c-29c8-4868-85f5-a457b55f5a93%40googlegroups.com. >For more options, visit https://groups.google.com/d/optout. -- Developer Tel.: +49 (0)40 609 452 077 Fax.: +49 (0)40 609 452 078 TORCH GmbH - A Graylog company Steckelhörn 11 20457 Hamburg Germany Commercial Reg. (Registergericht): Amtsgericht Hamburg, HRB 125175 Geschäftsführer: Lennart Koopmann (CEO) -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/20150904105800.GA30031%40tumbler.torch.local. For more options, visit https://groups.google.com/d/optout.
