[graylog2] Graylog System Sizing Problem?

2016-04-14 Thread Drew Miranda
I don't believe there is any relation between hard disk space and available cpu 
for graylog.

To understand what your requirement are for hardware we need to answer two 
questions:

1. How many messages per second do you want to process. Depending on the 
message size and complexity of steam and extractor rules, a few cpus (e.g. 4) 
can process a thousand or so messages a second. This does vary on CPU type sure 
but I'm basing this off of a virtual machine on a shared host.

2. How long do we want to reattain processed messages. This also somewhat 
depends on your message per second count. I don't think 20gb is much space 
considering how cheap storage is. I recommend a few hundred GB if you can spare 
it. I find it helpful to be able to search back easily through historical logs.

Hope that helps! If you have any specific questions I'll be happy to try and 
answer them.

-- 
You received this message because you are subscribed to the Google Groups 
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to graylog2+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/graylog2/92542704-eaf1-4888-adfa-39e7de7f915f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


[graylog2] Graylog System Sizing Problem?

2016-03-30 Thread Dinh Manh
Hello everyone, I have some problem in sizing graylog system to deloy. I 
read Graylog config file and receive some infomation : 

Elasticsearch_max_number_of_indices = 20 
and elasticsearch_max_size_per_index = 1GB, it mean the maximum data size 
that graylog can recevice is : 20 x 1GB = 20GB.
And the processbuffer_processors : 5 + outputbuffer_processors : 3 = 8 CPU 
(following config file). Should i know that the stadard system should have 
8 CPU for 20GB data (1 CPU for 2,5GB)? 

I hope some people in here who have many experiences about sizing Graylog 
system can answer me, many thanks!

-- 
You received this message because you are subscribed to the Google Groups 
"Graylog Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to graylog2+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/graylog2/332dd06d-9c0d-4a44-afba-43edd61fa680%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.