Hi, Do you see any of the pmacct processes hitting 100% of the CPU? Also, how many CPU cores do you have available? For a better spread of the load i'd recommend four, given your configuration. Enough memory available to sustain the two circular buffers (and the SQL cache and the memory table)? Assuming all is good on that side, and you are running a self-compiled recent pmacct release, I recommend to focus on a single plugin at a time to avoid incurring in a domino effect (ie. only one of the two is problematic but both are affected if run in parallel); play not only with the size but also with the ratio of the two plugin_buffer_size and plugin_pipe_size values; last advice for this round: see if introducing a slight backlog is of any help ie. set plugin_pipe_backlog to 25%.
Cheers, Paolo On Tue, Dec 25, 2012 at 11:16:21AM +0200, [email protected] wrote: > Hello. > > 1. I have 2 x 1Gbps ports mirrored into another 1Gbps port. > Max traffic is about 600-700 Mbps and there are no drops at > destination port. > > However I get the following errors at the log: > > pmacctd[9159]: ERROR ( default/mysql ): We are missing data. > pmacctd[9159]: If you see this message once in a while, discard it. > Otherwise some solutions follow: > pmacctd[9159]: - increase shared memory size, 'plugin_pipe_size'; now: > '1128052324'. > pmacctd[9159]: - increase buffer size, 'plugin_buffer_size'; now: > '11280524'. > pmacctd[9159]: - increase system maximum socket size.#012 > > pmacctd[9160]: ERROR ( default/memory ): We are missing data. > ... > /the same errors as for mysql plugin/ > > As you can see above the limits are big enough. > What could be the problem at this case? > > 2. Also I get Resource temporarily unavailable error after > approx. 15-20 minutes of run: > > pmacctd[9157]: WARN: Failed during write: Resource temporarily unavailable > > Sure there is no any mysql inserts after this. > mysqld has also very high limits (max_connections, > max_user_connections, max_allowed_packet, etc) > > > 3. Here is my pmacctd.conf for investigation: > > debug: true > interface: eth1 > daemonize: true > promisc: true > aggregate: src_host,dst_host > plugins: mysql,memory > imt_mem_pools_number: 20 > imt_mem_pools_size: 2097152000 > plugin_pipe_size: 1128052324 > plugin_buffer_size: 11280524 > sql_db: pmacct > sql_table: acct > sql_table_version: 1 > sql_passwd: Zwjbwkbj129 > sql_user: pmacct > sql_refresh_time: 300 > sql_history: 5m > sql_history_roundoff: m > sql_dont_try_update: true > sql_optimize_clauses: true > sql_recovery_logfile: /var/log/pmacct_recovery.log > sql_max_writers: 99 > sql_cache_entries: 524288 > sql_multi_values: 1073741824 > syslog: daemon > > I will appreciate ANY help on this problem. > pmacct is a really great tool and I'd like to use it. > > Sincerely, > Gleb. > > > _______________________________________________ > pmacct-discussion mailing list > http://www.pmacct.net/#mailinglists _______________________________________________ pmacct-discussion mailing list http://www.pmacct.net/#mailinglists
