Re: [pmacct-discussion] ipv4 conversion to int

2018-04-19 Thread Yann Belin
As far as I know it doesn't but if you use nfacctd, you can easily define your own primitives to do the same job: name=src_host_intfield_type=8 len=4 semantics=u_int name=dst_host_intfield_type=12len=4 semantics=u_int Then, you can use those primitives instead

Re: [pmacct-discussion] pmacct 1.7.0, can't connect to mysql

2017-11-02 Thread Yann Belin
Hi Nicholas, How is your MySQL user defined, xxx@'localhost'? Yann On Thu, Nov 2, 2017, 17:54 Nicholas Geovanis wrote: > Hi - > I have pmacct 1.7.0 installed from source on an Ubuntu 17.10 system > running MySQL 5.7. Just experimenting so far. I have specified both > sql_user and sql_passwd (a

Re: [pmacct-discussion] nfacctd and amqp_multi_values

2017-09-19 Thread Yann Belin
> amount of messages you want to batch before sending to the broker) or > queue.buffering.max.ms (queue for some given amount of time, if for > example latency is the constraint) offered by librdkafka. > > Paolo > > On Thu, Sep 14, 2017 at 04:12:45PM +0200, Yann Belin wrote: >

[pmacct-discussion] nfacctd and amqp_multi_values

2017-09-14 Thread Yann Belin
Hello, Does anyone know if there is a way to control the maximum number of rows sent in an AMQP message? amqp_multi_values allows me to do that in an approximate way (row_size/message_size) but I need to have a finer control on that, which is not dependent of variations of row size. Thanks in ad

Re: [pmacct-discussion] Load balancing nfacctd

2017-09-04 Thread Yann Belin
h, if anyone has a suggestion. Cheers, Yann On Mon, Aug 21, 2017 at 4:02 PM, Aaron Finney wrote: > Hi Yann > > We use Consul for this, it works very well. > > https://www.consul.io > > > Aaron > > > > On Aug 21, 2017 6:44 AM, "Yann Belin" wrote: &

[pmacct-discussion] Best way to output ip addresses as integers

2017-09-04 Thread Yann Belin
Hello, I need to run some checks / manipulate source/destination IP addresses that I am getting from nfacctd, and for that purpose it makes much more sense to output hose IPs in their inetger form, rather than in their human-readable (x.x.x.x) form. In order to do that, I created custom primitive

[pmacct-discussion] Load balancing nfacctd

2017-08-21 Thread Yann Belin
Hello, I have been looking into solutions to achieve reliable load balancing of my incoming flows across multiple nfacctd servers / daemons. Basic load balancing is relatively easy (see Nginx configuration below), but *reliable* load balancing (only sending flows to servers that have a running nf

Re: [pmacct-discussion] Dynamic Labelling from Exporters IP Address.

2017-07-21 Thread Yann Belin
Hi Harry, Unless I am mistaken, the IP of the flow exporter can be obtained by adding 'peer_src_ip' in your aggregate list. Kind regards, Yann On Fri, Jul 21, 2017 at 4:06 PM, Harry Foster wrote: > Hi all > > I've been trying to figure out recently if it's at all possible to write the > flow e

[pmacct-discussion] Strange behavior with protocol field on nfacctd

2017-06-14 Thread Yann Belin
Hello, I am experiencing a strange behavior on nfacctd. * On version 1.6.1, flows with protocol field set to 6 (TCP) will not show up at all. * On version 1.6.2, flows with protocol field set to 6 (TCP) will show up, but ip_src and ip_dst will be empty. In both cases, flows with protocol field s

Re: [pmacct-discussion] Matching data to options with nfacctd

2017-06-07 Thread Yann Belin
D. So, given the current functionality, it sounds you are > doing the right thing saving both and correlating it afterwards as part > of your post-processing. It would be great to know - here or via unicast > email - what kind of correlation you are doing. > > Paolo > > > O

[pmacct-discussion] Matching data to options with nfacctd

2017-06-06 Thread Yann Belin
Hi, I was reading trough recent issues on GitHub, and #137 [see link below] got my attention. The last comment from Paolo leads me to think that nfacctd can be configured to (try to) automatically match flow data to option table(s). Is it the case, or am I misreading something? Until now, I have

Re: [pmacct-discussion] New to pmacct - Need help with Netflow

2017-01-18 Thread Yann Belin
Hi Luc, Did you try to enable debug mode on nfacctd (-d)? It will show you when the flows are received, as well any potential errors when sending it to db. Also, keep in mind that if you use NetflowV9/IPfix, nfacctd wont be able to process incoming flows until a template is received. Cheers, Ya

Re: [pmacct-discussion] Centralizing data from multiple nfacct collectors

2017-01-05 Thread Yann Belin
Thanks all! I spent a couple of hours trough RabbitMQ docs/specs and it seems to be exactly what I need. On Thu, Jan 5, 2017 at 3:15 PM Karl O. Pinc wrote: On Thu, 5 Jan 2017 10:57:01 +0100 Yann Belin wrote: > Not strictly a pmacct/nfacct question, but I was wondering if anyone > ever b

[pmacct-discussion] Centralizing data from multiple nfacct collectors

2017-01-05 Thread Yann Belin
Hello, Not strictly a pmacct/nfacct question, but I was wondering if anyone ever built a similar setup. I have multiple sites that need to gather netflow data. Because network constraints (mostly latency) it is not possible to write directly to a central location so the collectors have to store (

Re: [pmacct-discussion] pretag_map with multiple option records

2016-12-22 Thread Yann Belin
ions_iface]: 200 aggregate[options_iface]: peer_src_ip, in_iface, iface_short, iface_long sql_table[options_iface]: pmacct_options_iface !(...) Cheers, Yann On Wed, Dec 21, 2016 at 4:54 PM Yann Belin wrote: > Hello, > > After following the

[pmacct-discussion] pretag_map with multiple option records

2016-12-21 Thread Yann Belin
Hello, After following the examples in pmacct documentation, I was able to assign different tags to flow and option records (respectively 100 and 200) , but I cannot figure out how to assign different tags to different "types" of option records in order to store their data in different SQL tables.

Re: [pmacct-discussion] Reporting on additional primitives

2016-12-21 Thread Yann Belin
work]). What i may > suggest as workaround is to use the aggregate_primitives framework you > have today and make the averages yourself by post-processing the output. > > Cheers, > Paolo > > On Thu, Dec 15, 2016 at 01:44:16PM +0100, Yann Belin wrote: > > Hello, > > > > I a

[pmacct-discussion] Reporting on additional primitives

2016-12-15 Thread Yann Belin
Hello, I am looking for a way to report on additional primitives with nfacct. It does by default with bytes and packets but I cannot find how to add extra fields. Am I missing something? What I want to include in reports is application performance information (rtd, packet-loss, etc.) from Cisco d

Re: [pmacct-discussion] nfacctd and NBAR

2016-12-14 Thread Yann Belin
> CONFIG-KEYS which, in turn, points you to an example). > > Cheers, > Paolo > > On Mon, Dec 12, 2016 at 01:38:29PM +0100, Yann Belin wrote: >> Hello, >> >> I am trying to use the NBAR "application ID" field (#95) in nfacctd >> aggregation but I cann

Re: [pmacct-discussion] Configure with MySQL / MariaDB support

2016-12-13 Thread Yann Belin
1 exit status Kind regards, Yann On Tue, Dec 13, 2016 at 11:01 AM Yann Belin wrote: > Hi Mehul, > > Yes I thought it could be the issue too but the softlinks look fine on FS > level. > > [root@ pmacct]# ll /usr/lib64/libmysqlclient.* > -rw-r--r-- 1 root root 438

Re: [pmacct-discussion] Configure with MySQL / MariaDB support

2016-12-13 Thread Yann Belin
per .so file ? > > > -Original Message- > From: pmacct-discussion [mailto:pmacct-discussion-boun...@pmacct.net] On > Behalf Of Yann Belin > Sent: Tuesday, December 13, 2016 3:07 PM > To: pmacct-discussion@pmacct.net > Subject: Re: [pmacct-discussion] Configure with

Re: [pmacct-discussion] Configure with MySQL / MariaDB support

2016-12-13 Thread Yann Belin
/usr/lib64/ > > -Original Message- > From: pmacct-discussion [mailto:pmacct-discussion-boun...@pmacct.net] On > Behalf Of Yann Belin > Sent: Tuesday, December 13, 2016 2:47 PM > To: pmacct-discussion@pmacct.net > Subject: [pmacct-discussion] Configure with MySQL / MariaDB su

[pmacct-discussion] Configure with MySQL / MariaDB support

2016-12-13 Thread Yann Belin
Hello, I am trying to install pmacct with MySQL / MariaDB support but [./configure --enable-mysql] fails with the message below. *-*-*-*-* (...) checking for mysql_init in -lmysqlclient... no configure: error: ERROR: missing MySQL client library *-*-*-*-* I have proper libraries and devel packag

[pmacct-discussion] nfacctd and NBAR

2016-12-12 Thread Yann Belin
Hello, I am trying to use the NBAR "application ID" field (#95) in nfacctd aggregation but I cannot figure out how to do that. My situation is very similar to what Olaf encountered a couple of years ago (see link below) but unfortunately that thread did not reach a conclusion (at least on its publ