Re: Tips tricks about using mysql under OpenBSD

2015-04-03 Thread C.L. Martinez

On 04/01/2015 12:51 PM, C.L. Martinez wrote:

Hi all,

  In the following weeks, I need to install a syslog collector server
using mysql as a backend to store all logs (and I would like to use
OpenBSD 5.7 to accomplish that).

  I expect +/- 5k-6k EPS from our servers (unix, linux, windows). As a
syslog process I will use syslog-ng or rsyslog. But my question is about
using mysql under OpenBSD.

  Due to the log volume, I will need to do, probably, some type of
tuning in mysql side.

  Somebody uses mysql in production environments with a respectable
amount of inserts under OpenBSD? Tips  tricks about what options to use
under fstab where mysql stores all data, memory limits, etc?

Thanks.


Please, any inputs?



Re: Tips tricks about using mysql under OpenBSD

2015-04-03 Thread John Merriam
On Fri, 3 Apr 2015, C.L. Martinez wrote:
 On 04/01/2015 12:51 PM, C.L. Martinez wrote:
  Hi all,
  
In the following weeks, I need to install a syslog collector server
  using mysql as a backend to store all logs (and I would like to use
  OpenBSD 5.7 to accomplish that).
  
I expect +/- 5k-6k EPS from our servers (unix, linux, windows). As a
  syslog process I will use syslog-ng or rsyslog. But my question is about
  using mysql under OpenBSD.
  
Due to the log volume, I will need to do, probably, some type of
  tuning in mysql side.
  
Somebody uses mysql in production environments with a respectable
  amount of inserts under OpenBSD? Tips  tricks about what options to use
  under fstab where mysql stores all data, memory limits, etc?
  
  Thanks.
 
 Please, any inputs?
 

I don't see why running MySQL on OpenBSD would be much different than on 
any other OS?

Set your settings in the MySQL config like you would on any other OS.  
Then look at the mount man page and see if there is anything there that 
you might want to change (my guess would be no...).

I do have the following in my /etc/login.conf:

mysqld:\
:openfiles-cur=1024:\
:openfiles-max=2048:\
:tc=daemon:

which I got from the mysql-* file in /usr/local/share/doc/pkg-readmes   
It's possible there might be more interesting things to mess with in 
login.conf for MySQL but I'm guessing probably not more than those two 
openfiles settings.

It sounds like this is a new project that you haven't done before?  If you 
have done this with this amount of load before then you should have some 
guess as to how it will work.  If not I would say start with the 
my-huge.cnf MySQL config and go from there.  Try to do some testing, 
particularly try to simulate the load before you go to production.  I'm 
thinking fast CPUs and fast disks will be your best friends on this 
project.

-- 

John Merriam



Tips tricks about using mysql under OpenBSD

2015-04-01 Thread C.L. Martinez

Hi all,

 In the following weeks, I need to install a syslog collector server 
using mysql as a backend to store all logs (and I would like to use 
OpenBSD 5.7 to accomplish that).


 I expect +/- 5k-6k EPS from our servers (unix, linux, windows). As a 
syslog process I will use syslog-ng or rsyslog. But my question is about 
using mysql under OpenBSD.


 Due to the log volume, I will need to do, probably, some type of 
tuning in mysql side.


 Somebody uses mysql in production environments with a respectable 
amount of inserts under OpenBSD? Tips  tricks about what options to use 
under fstab where mysql stores all data, memory limits, etc?


Thanks.