Hi Peter, On 08/23/2013 08:39 AM, Peter Haag wrote: > I have no experience with hundreds or thousands of profiles. I know of an > installation with a few hundreds of profiles. > The operator told me, it performs ok.
Thanks for the insight. > The critical point is I/O on a server. If you can split live data and profile > data on different storage, you can scale > up pretty much up to 100k flows/s. Well I came to that point too but with the current way nfcapd "renames" the files the live flow files must be on the same device as the "historical" flow data. I didn't find a way around it so far (maybe I missed something). 100k flows/s is a good number that we fortunately don't reach yet. Looks like there is some headroom left. > As for profiles: Shadow Profiles only need read performance - little to no > writes. You can also specify the number of > profilers in nfsen.conf for more parallel profiling. The profiler itself > reads once, and writes for each channel. Alerts > are considered as channels. In the end, profiles is a matter of write I/O > throughput as CPU is not the issue, as > filtering and compressing is very efficient. In any case use compression. > That reduces the required write bandwidth. We use shadow profiles and have set the profiles in nfsen.conf to the number of cores available and compression is on. Lets see how far we can get with that :) >> @Peter: The roadmap for NfSen 2.0 looks nice. Is there any chance that you >> give >> us a rough estimate when there could be a release? Do you need testers or >> feedback? > > I always need testers and will let you know, as soon as there is such a > release. > I can not give any date so far - sorry for that. Thanks. And thanks for your work for nfdump/nfsen! Regards, Axel -- Axel Fischer Network Engineer 1&1 Internet AG Brauerstrasse 48 D-76135 Karlsruhe http://www.1und1.de (AS8560) Hauptsitz Montabaur, Amtsgericht Montabaur, HRB 6484 Vorstand: Ralph Dommermuth, Frank Einhellinger, Robert Hoffmann, Andreas Hofmann, Markus Huhn, Hans-Henning Kettler, Uwe Lamnek, Jan Oetjen, Christian Würst Aufsichtsratsvorsitzender: Michael Scheeren Member of United Internet Diese E-Mail kann vertrauliche und/oder gesetzlich geschützte Informationen enthalten. Wenn Sie nicht der bestimmungsgemäße Adressat sind oder diese E-Mail irrtümlich erhalten haben, unterrichten Sie bitte den Absender und vernichten Sie diese Email. Anderen als dem bestimmungsgemäßen Adressaten ist untersagt, diese E-Mail zu speichern, weiterzuleiten oder ihren Inhalt auf welche Weise auch immer zu verwenden. This E-Mail may contain confidential and/or privileged information. If you are not the intended recipient of this E-Mail, you are hereby notified that saving, distribution or use of the content of this E-Mail in any way is prohibited. If you have received this E-Mail in error, please notify the sender and delete the E-Mail. ------------------------------------------------------------------------------ Introducing Performance Central, a new site from SourceForge and AppDynamics. Performance Central is your source for news, insights, analysis and resources for efficient Application Performance Management. Visit us today! http://pubads.g.doubleclick.net/gampad/clk?id=48897511&iu=/4140/ostg.clktrk _______________________________________________ Nfsen-discuss mailing list Nfsen-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nfsen-discuss
