Hi
I have a problem with collector.
In few minutes after start it fails with error

> Exception in thread "ChunkProcessor" java.lang.IndexOutOfBoundsException: 
> readerIndex(0) + length(1182) exceeds writerIndex(1156): 
> UnpooledUnsafeDirectByteBuf(ridx: 0, widx: 1156, cap: 1156/1156)
> at 
> io.netty.buffer.AbstractByteBuf.checkReadableBytes(AbstractByteBuf.java:1166)
> at io.netty.buffer.AbstractByteBuf.skipBytes(AbstractByteBuf.java:741)
> at 
> org.graylog.collector.file.splitters.PatternChunkSplitter$1$1.computeNext(PatternChunkSplitter.java:75)
> at 
> org.graylog.collector.file.splitters.PatternChunkSplitter$1$1.computeNext(PatternChunkSplitter.java:40)
> at 
> com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:143)
> at 
> com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:138)
> at 
> org.graylog.collector.file.ChunkProcessor.createMessages(ChunkProcessor.java:89)
> at 
> org.graylog.collector.file.ChunkProcessor.process(ChunkProcessor.java:85)
> at org.graylog.collector.file.ChunkProcessor.run(ChunkProcessor.java:51)
> at 
> com.google.common.util.concurrent.AbstractExecutionThreadService$1$2.run(AbstractExecutionThreadService.java:60)
> at com.google.common.util.concurrent.Callables$3.run(Callables.java:95)
> at java.lang.Thread.run(Thread.java:745)


Just before fail it sends logs to server successfully.

Here is my collector.conf. Version is 0.4.0

> server-url = "http://log20:12900";
> message-buffer-size = 12144
> collector-id = "file:/etc/graylog/collector/collector-id"
> metrics {
>   enable-logging = false
>   log-duration = 60s
> }
> inputs {
>   local-apilog {
>     type = "file"
>     path-glob-root = "/var/log/api/"
>     path-glob-pattern = "*log"
>     charset = "utf-8"
>     reader-interval = "1s"
>     content-splitter = "PATTERN"
>     content-splitter-pattern = "^\\d{4}-\\d{2}-\\d{2} \\d{2}:\\d{2}:\\d{2}"
>   }
> }
> outputs {
>   gelf-tcp {
>     type = "gelf"
>     protocol = "tcp"
>     host = "graylog"
>     port = "52304"
>     client-queue-size = 5120
>     client-send-buffer-size = 65536
>   }
> }

 
In /var/log/api I have more than 6000 files, which match pattern *.log
I've tried to increase Xmx of java process till 1024Mb,  client-queue-size, 
client-send-buffer-size and message-buffer-size.

Could somebody explain me what the problem is and how to fix it?
Thank you in advance.

-- 
You received this message because you are subscribed to the Google Groups 
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/graylog2/d568334c-29c8-4868-85f5-a457b55f5a93%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to