[graylog2] Graylog2 classify Network device type?

2015-01-04 Thread yanda . suzhou
Hello expert, Happly new year! J. We used Graylog2 0.92.3 plus SLES syslog-ng to received network devices logs,Network devices sending their logs via UPD port to SLES syslog-ng server, Graylog2 used syslog udp input to receive the network device messages. Well, you know there have many

[graylog2] Re: How to fix Nodes with too long GC pauses issues in my cluster.

2015-01-04 Thread Arie
Hi Joseph, If you are going to hit 2000/msg/sec take a look at this config for ES: index.refresh_interval: 5s Just read about to get familiar what is is about. I think the "output_flush_interval = 1" in the graylog.conf file is to get the same result as the es configuration. Op zondag 4 jan

Re: [graylog2] Re: How to log from a java application using logback to a file in a way that won't need grok filtering before getting to graylog

2015-01-04 Thread Joseph DJOMEDA
Thanks Jochen >From your suggestion I understand that I can leverage on this logback json appender to write logs that would meet graylogs gelf specifications as in make sure the gelf required fields are part of each entry and that the custom fields have a prepending underscore. Correct me if you

[graylog2] Re: Kibana 4.0 Problem

2015-01-04 Thread Alexander Reynolds
You can cheat Kibana's version check to get around this issue. Edit the index.js file with the kibana.jar file (kibana/public) and change 'minimumElasticsearchVersion' from '1.4.0' to '1.3.4'. I haven't done much testing with this yet, but it does allow you to search through your indices at lea

[graylog2] Re: How to log from a java application using logback to a file in a way that won't need grok filtering before getting to graylog

2015-01-04 Thread Jochen Schalanda
Hello Joseph, you can use the Logback JSON encoder for Logstash ( https://github.com/logstash/logstash-logback-encoder) with any Logback appender to write JSON which is compatible with logstash. Cheers, Jochen On Saturday, 3 January 2015 15:17:10 UTC+1, Joseph DJOMEDA wrote: > > > Hello All,

[graylog2] Re: How to fix Nodes with too long GC pauses issues in my cluster.

2015-01-04 Thread Joseph DJOMEDA
Hello Arie, Thank you for your pointers. I am currently seeing something like 600msg/s. But that's just 3 boxes, I am expecting at the end of the migration something like 2000msg/s On Saturday, January 3, 2015 10:32:11 PM UTC, Arie wrote: > > check on memory usage by ES, in my case the ES_HEAP_