Thanks Guys
Regards Matthew Simon On Tue, Nov 24, 2015 at 8:11 PM, HockeyFan0000 <[email protected]> wrote: > Initially, I used the OVA as well and I got horrendous performance. I > pointed only two file servers and two domain controllers to that > installation and the VM was so busy the web interface would hang > constantly. I created another VM and installed Graylog using these > instructions > <http://www.itzgeek.com/how-tos/linux/ubuntu-how-tos/how-to-install-graylog2-on-ubuntu-14-04.html> > and got great performance, even with the same memory and CPU core count. > Once I got Graylog working on the VM, I used the same instructions to > install it on a physical server. So far, I've collected almost 400 million > log events in 11 days and the highest I've seen the CPU usage has been 14% > with only 16GB of RAM. My suggestion is to ditch the OVA altogether. > > > > > > > On Monday, November 23, 2015 at 6:38:50 AM UTC-5, Matthew Simon wrote: >> >> Hi Jochen >> >> I installed Graylog2 via the OVA I downloaded off the Site. >> >> It can fluctuate you see there are specials that run on the website which >> can cause massive amounts of traffic so it can be fine one week then within >> the span of 2 days I can get anything from 1million messages to 4 million >> messages. Common story is that it cant keep up with that influx of messages. >> >> Grok patterns that I use. Please see attachment Grokpatternsfile.txt >> >> Extractors please see attachment Extractors.txt >> >> I have not setup dashboards or streams as of yet. >> >> Purpose of Graylog is im trying to extract WAF logs (so if there is a >> better way of doing this please help.) >> >> If there is more info you want please let me know and I do appreciate >> your help in advance. >> >> Thanks >> >> >> On Monday, November 23, 2015 at 12:58:45 PM UTC+2, Jochen Schalanda wrote: >>> >>> Hi Matthew, >>> >>> to not duplicate the information you already gave on Twitter ( >>> https://twitter.com/Malfufi/status/668724729629556736): >>> >>>> heap 1.4G (changeability?) no local configuration has been made to >>>> optimize,85mill and CPU 100% RAM 100% >>> >>> >>> The heap size of Graylog can be changed quite easily. How did you >>> install Graylog in the first place (OVA, DEB packages, RPM packages, >>> tarball…)? >>> >>> "85 mill" what exactly? Messages per second/minute/hour/day/week/month? >>> Are you running any extractors (e. g. RegEx or Grok extractors) or defined >>> streams with relatively complicated regular expression rules? >>> >>> >>> Cheers, >>> Jochen >>> >>> On Monday, 23 November 2015 10:55:48 UTC+1, Matthew Simon wrote: >>>> >>>> Hi Guys >>>> >>>> >>>> I have a problem! >>>> >>>> >>>> I receive large amounts of logs to my Graylog2 server and i feel that >>>> the server cant keep up with the incoming logs, Is there a way that I can >>>> optimize my configuration to handle large amounts of LOGS. >>>> >>>> >>>> Please see the image bellow. >>>> >>>> >>>> Thanks in advance. >>>> >>>> >>>> >>>> >>>> <https://lh3.googleusercontent.com/-n91LHSZ_HtQ/VlLhwvs-sKI/AAAAAAAAAqU/dXnmzSAQFCg/s1600/image1.png> >>>> >>>> >>>> >>>> -- > You received this message because you are subscribed to a topic in the > Google Groups "Graylog Users" group. > To unsubscribe from this topic, visit > https://groups.google.com/d/topic/graylog2/BZFAy7NJ0lI/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/graylog2/a2179e59-3d64-48f3-9a62-a395f7d14751%40googlegroups.com > <https://groups.google.com/d/msgid/graylog2/a2179e59-3d64-48f3-9a62-a395f7d14751%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/CABKxNKfyMUBxGzFdnMbi8qAoV5su8S2SMEuqWSu%3DAFge7%2BVnDA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
