Hi, We have a fairly large setup for nfsen here and as part of the reports we run daily are finding top uploader and downloader subnets and some other stats. There are ~4000 address blocks as well as ~4000 link addresses to these blocks and as such we are running nfdump about 16000 times to generate these reports. This is taking about 22 hours.
I plan on hacking the nfdump source to allow it to run all filters on the files in a single pass. Am I looking a 2 ways of doing it. 1) Brute force: Create a Filter_Engine for each filter and run each one on each record. Not sure if this will gain me much in the way of performance. 2) Modify Filter_Engine: Modify the filter engine to have load different filters and to store the filter number in onTrue so that it is returned to the record processor. Most likely there is a vastly superior 3rd option but I'm not sure what it is. Any guidance would be much appreciated. Paul.
pgpIAkomq62zo.pgp
Description: PGP signature
------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys-and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________ Nfdump-discuss mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nfdump-discuss
