Hi Peter,
Elements to calculate the values are documented in docs/INTERNALS
chapter V ("Communications between core process and plugins"). Let
me know if that helps, otherwise we can follow up privately (so
that new guidelines can be added to the doc for future reference).
Cheers,
Paolo
On Wed, Nov 12, 2014 at 10:46:03AM +0000, Peter Bosgraaf wrote:
> Hi,
>
> Lately I'm running into problems with my pmacct instance which I can't seem
> to pinpoint.
> I've been running pmacct for a couple of years now, but lately with increased
> traffic load these error messages started popping up.
>
> Nov 12 11:20:19 traffic-tap02 pmacctd[10959]: ERROR ( in/mysql ): We are
> missing data.
> Nov 12 11:20:19 traffic-tap02 pmacctd[10959]: If you see this message once in
> a while, discard it. Otherwise some solutions follow:
> Nov 12 11:20:19 traffic-tap02 pmacctd[10959]: - increase shared memory size,
> 'plugin_pipe_size'; now: '65536000'.
> Nov 12 11:20:19 traffic-tap02 pmacctd[10959]: - increase buffer size,
> 'plugin_buffer_size'; now: '32768'.
> Nov 12 11:20:19 traffic-tap02 pmacctd[10959]: - increase system maximum
> socket size.#012
>
> I tried increasing the parameters in the error message but nothing seems to
> help.
>
> I'm new to the list, hoping someone can help me or had similar problems.
> Is there a formula to calculate the ideal values for these parameters under a
> certain load?
>
> My setup:
>
> Two 10gig interfaces.
> Interface1: About 1Gbit traffic and 1239374 packets /sec
> Interface2: About 1Gbit traffic and 874745 packets /sec
>
> The load on the Linux box is really low, never passing 1.0
>
> My pmacct configuration for interface1:
>
> !
> ! pmacct: Out (Traffic from the DC to Internet)
> !
> debug: true
> daemonize: true
> interface: eth1
> plugin_buffer_size: 32768
> plugin_pipe_size: 131072000
> pidfile: /var/run/pmacctd-out.pid
> syslog: local6
> post_tag: 1
> !
> plugins: mysql[out]
> !
> networks_file[out]: /usr/local/pmacct/etc/networks.def
> aggregate[out]: tag,src_host
> !
> sql_host[out]: x.x.x.x
> sql_user[out]: pmacct
> sql_passwd[out]: password
> sql_db[out]: pmacct
> sql_recovery_backup_host[out]: 127.0.0.1
> !
> sql_table[out]: acct_v2_out_%Y%m%d
> sql_optimize_clauses[out]: true
> sql_table_schema[out]: /usr/local/pmacct/etc/acct_custom_out.schema
> !
> sql_history[out]: 5m
> sql_history_roundoff[out]: m
> sql_refresh_time[out]: 300
> sql_dont_try_update[out]: true
> sql_multi_values[out]: 16000000
>
>
> Hope anyone can help.
>
> Regards,
> Peter
>
>
>
>
> _______________________________________________
> pmacct-discussion mailing list
> http://www.pmacct.net/#mailinglists
_______________________________________________
pmacct-discussion mailing list
http://www.pmacct.net/#mailinglists
