Re: [graylog2] Re: OutOfMemoryError for Beats plugin

2017-02-06 Thread Jochen Schalanda 
Hi Richard,

depending on the number and size of messages, 512 MiB of heap memory might 
be too little for Graylog 2.1.x.

Please assign at least 1 GiB of heap memory using the -Xms and -Xmx JVM 
parameters.

On a side note, the OutOfMemoryError occurring in the code of the Beats 
plugin doesn't necessarily imply a problem there, but it was simply the 
place where the JVM memory was exhausted already.

Cheers,
Jochen

On Monday, 6 February 2017 12:32:36 UTC+1, Richard S. Westmoreland wrote:
>
> 2.1, it is the Beats Input that came with that version of GL, 2G ram 1 
> core, 512mb assigned to heap.
>

-- 
You received this message because you are subscribed to the Google Groups 
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to graylog2+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/graylog2/b87bb35b-decc-4b67-a17f-2be94a75ee05%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Re: [graylog2] Re: OutOfMemoryError for Beats plugin

2017-02-06 Thread Richard S. Westmoreland 
2.1, it is the Beats Input that came with that version of GL, 2G ram 1 core, 
512mb assigned to heap.


> On Feb 6, 2017, at 5:35 PM, Jochen Schalanda  wrote:
> 
> Hi Richard,
> 
> Which version of the Graylog Beats plugin are you using?
> Which version of Graylog are you using?
> What are the hardware specs of the machine(s) running Graylog?
> 
> Cheers,
> Jochen
> 
>> On Monday, 6 February 2017 09:03:09 UTC+1, Richard S. Westmoreland wrote:
>> I'm getting this error in my server.log:
>> 
>> 2017-02-06T07:55:17.016Z ERROR [NettyTransport] Error in Input 
>> [Beats/58785c6a57fe51420e73e1ea] (channel [id: 0x8183ee45, /127.0.0.1:52554 
>> :> /127.0.0.1:5051])
>> java.lang.OutOfMemoryError: Java heap space
>> at 
>> org.graylog.plugins.beats.BeatsFrameDecoder.processCompressedFrame(BeatsFrameDecoder.java:201)
>>  ~[?:?]
>> at 
>> org.graylog.plugins.beats.BeatsFrameDecoder.decode(BeatsFrameDecoder.java:120)
>>  ~[?:?]
>> at 
>> org.graylog.plugins.beats.BeatsFrameDecoder.decode(BeatsFrameDecoder.java:49)
>>  ~[?:?]
>> at 
>> org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500)
>>  ~[graylog.jar:?]
>> at 
>> org.jboss.netty.handler.codec.replay.ReplayingDecoder.cleanup(ReplayingDecoder.java:554)
>>  ~[graylog.jar:?]
>> at 
>> org.jboss.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:365)
>>  ~[graylog.jar:?]
>> at 
>> org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102)
>>  ~[graylog.jar:?]
>> at 
>> org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>>  ~[graylog.jar:?]
>> at 
>> org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>>  ~[graylog.ja
>> r:?]
>> ...etc...
>> 
>> The thing is, my heap is fine when this happens.  I can watch it on the 
>> Nodes page, and with a min and slightly higher max set, I never see it grow 
>> beyond the original min.  Why would this happen?
>> 
>> 
> 
> -- 
> You received this message because you are subscribed to the Google Groups 
> "Graylog Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to graylog2+unsubscr...@googlegroups.com.
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/graylog2/d3e8440d-5ec0-4ea6-b937-589856664a57%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to graylog2+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/graylog2/B7F09007-00F6-4C1C-A4C6-E5E68436A372%40gmail.com.
For more options, visit https://groups.google.com/d/optout.

[graylog2] Re: OutOfMemoryError for Beats plugin

2017-02-06 Thread Jochen Schalanda 
Hi Richard,

Which version of the Graylog Beats plugin are you using?
Which version of Graylog are you using?
What are the hardware specs of the machine(s) running Graylog?

Cheers,
Jochen

On Monday, 6 February 2017 09:03:09 UTC+1, Richard S. Westmoreland wrote:
>
> I'm getting this error in my server.log:
>
> 2017-02-06T07:55:17.016Z ERROR [NettyTransport] Error in Input 
> [Beats/58785c6a57fe51420e73e1ea] (channel [id: 0x8183ee45, /
> 127.0.0.1:52554 :> /127.0.0.1:5051])
> *java.lang.OutOfMemoryError: Java heap space*
> at 
> org.graylog.plugins.beats.BeatsFrameDecoder.processCompressedFrame(BeatsFrameDecoder.java:201)
>  
> ~[?:?]
> at 
> org.graylog.plugins.beats.BeatsFrameDecoder.decode(BeatsFrameDecoder.java:120)
>  
> ~[?:?]
> at 
> org.graylog.plugins.beats.BeatsFrameDecoder.decode(BeatsFrameDecoder.java:49) 
> ~[?:?]
> at 
> org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:500)
>  
> ~[graylog.jar:?]
> at 
> org.jboss.netty.handler.codec.replay.ReplayingDecoder.cleanup(ReplayingDecoder.java:554)
>  
> ~[graylog.jar:?]
> at 
> org.jboss.netty.handler.codec.frame.FrameDecoder.channelDisconnected(FrameDecoder.java:365)
>  
> ~[graylog.jar:?]
> at 
> org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:102)
>  
> ~[graylog.jar:?]
> at 
> org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
>  
> ~[graylog.jar:?]
> at 
> org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
>  
> ~[graylog.ja
> r:?]
> ...etc...
>
> The thing is, my heap is fine when this happens.  I can watch it on the 
> Nodes page, and with a min and slightly higher max set, I never see it grow 
> beyond the original min.  Why would this happen?
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to graylog2+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/graylog2/d3e8440d-5ec0-4ea6-b937-589856664a57%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.