Hi Matthew,

I have used Graylog in my job about a month and everything was going fine 
with the following setup:

Graylog-server and Graylog-web Graylog in a single VM (ESXi 5.5, Dell R910) 
with
2 cores
4GB RAM
20GB HDD
Graylog-server JVM 2GB
Graylog-web    JVM default
Elasticsearch  JVM 256MB


Elasticsearch cluster with 3 nodes on 3 Dell T320
4 cores
8GB RAM
HDD 1TB SATA
Elasticsearch   JVM 6GB

**All servers are running CentOS 7.1 and OpenJDK 8. All packages were 
installed with repositories.

I have a lot of inputs, extractors and dashboards.

I'm collecting logs of some servers and some network assets. The device who 
generates more log is our Cisco ASA 5520. I configured the ASA to send logs 
from level 5 (notification) because level 6 (informational) generates a lot 
of unnecessary information. Yesterday my boss asked to measure ASA traffic 
in Graylog and I started to collect four new event level 6 (built and 
teardown, tcp / udp).
We jump from 2.5k messages per minute to about 20k. The load average of VM 
jumped above 9.0, hours later. At a given time, I had 32k unprocessed 
messages in journal queue, 

At night, I turned off the VM, increase its setting to 4 core and start it 
again. Now, everything is run like a charm with a load average between 3 
and 4.

Cheers,
Emerson

On Monday, November 23, 2015 at 7:55:48 AM UTC-2, Matthew Simon wrote:
>
> Hi Guys 
>
>
> I have a problem!
>
>
> I receive large amounts of logs to my Graylog2 server and i feel that the 
> server cant keep up with the incoming logs, Is there a way that I can 
> optimize my configuration to handle large amounts of LOGS. 
>
>
> Please see the image bellow.
>
>
> Thanks in advance.
>
>
>
>
> <https://lh3.googleusercontent.com/-n91LHSZ_HtQ/VlLhwvs-sKI/AAAAAAAAAqU/dXnmzSAQFCg/s1600/image1.png>
>
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/graylog2/7e3954fd-2eec-463d-b0a4-df5378ab4e86%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to