I asked a similar question a couple years ago. I was directed toward this, but sadly never got around to trying it out.
https://github.com/toringe/flows /Ryan Ryan Harden Research and Advanced Networking Architect University of Chicago - ASN160 P: 773.834.5441 > On Oct 8, 2015, at 4:55 AM, Luuk Hendriks <luuk+nfd...@luukhendriks.eu> wrote: > > Hi Nikolay, > > First of all I'm not a developer, but I have faced the same kind of problem. > One thing that you could look into, is doing the parallelization using GNU > parallel[0]. This will not be a > solution in every scenario, but if yours allows querying individual > nfcapd-files, and combining/processing > the results afterwards (think Map/Reduce), it could be of use to you. > > Again, it will require some more thinking, but in my experience it's well > worth the effort. > > > HTH, > Luuk Hendriks > University of Twente > > > > On Thu 8 Oct 2015, 17:33, Николай Кинаш wrote: >> Hi all. >> I have a very large sequence of files from nfcapd.. I want to get fast TOP >> 30 flows ordered by bytes via nfdump. Right now, i can get them in 30 >> minutes. I wonder about parallelize of nfdump. Have developers tried to >> create the parallel nfdump?(maybe there is some architecture restriction, >> in which parallel version can't be done) >> Are developers plan to create the parallel nfdump? Is it possible? >> >> >> Regards, >> Nikolay > >> ------------------------------------------------------------------------------ > >> _______________________________________________ >> Nfdump-discuss mailing list >> Nfdump-discuss@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/nfdump-discuss > > > ------------------------------------------------------------------------------ > _______________________________________________ > Nfdump-discuss mailing list > Nfdump-discuss@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/nfdump-discuss ------------------------------------------------------------------------------ _______________________________________________ Nfdump-discuss mailing list Nfdump-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfdump-discuss
