Re: [pmacct-discussion] Easiest way to ingest nfacctd data into python?

2022-05-03 Thread Paolo Lucente
Hi Rich, While i don't have actual examples and while supporting the answers you already received, i may propose you the following architectural tips: * Write stuff into files with the 'print' plugin; using print_latest_file to point always to the latest finalized file and

Re: [pmacct-discussion] Easiest way to ingest nfacctd data into python?

2022-05-03 Thread Luca Cilloni
Hi, I believe that the easiest way is using the json output over a linux pipe, or if you prefer over stdin/stdout, which eventually behave like a pipe. Here an example with pipe: Python script: if __name__ == '__main__': os.mkfifo(path_to_fifo, mode=0o666) while True: # One loop == one

Re: [pmacct-discussion] Easiest way to ingest nfacctd data into python?

2022-05-03 Thread Tim Jackson
I've done similar with the IMT and Perl years ago: https://houstongrackles.com/~tjackson/flows_to_es/ Relevant part in Perl: sub retrieve_flows { my $pipe = shift; my $primitive = shift; my $filter = shift; my @flows = `/usr/local/bin/pmacct -p $pipe -l -O json

Re: [pmacct-discussion] Easiest way to ingest nfacctd data into python?

2022-05-03 Thread Karl O. Pinc
On Tue, 3 May 2022 18:19:50 + "Compton, Rich A" wrote: > Hi, I’m trying to take the netflow records from nfacctd and process > them with a python script. Can someone suggest how I can do this > with python without having nfacctd put them into a database and then > have my python script read