On Fri, Jul 22, 2005 at 11:04:00AM +0200, doof scratched on the wall: > I use flow-capture/flowscan to make bandwidth graph with rrdtool. Since one > week, i have a big problem. I have too much data and flow-capture/flowscan > is too slow > > 400 Mbits/s > 90000 packets/s > 10000 flows/s > > The server has Bi-xeon 2.40Ghz and RAM 2Go
There's something weird going on here. While we very rarely see flow rates that are that high, we regularly run at around 4000 flows/sec in the heat of the day (at least when the students are in session; right now it is more like 2800 flows/sec). That type of data rate is just not that big of a deal. Even at 10 K-flows/sec, you're still only looking at ~500 KB/sec of export data, or about 4 Mb/sec of export traffic. That isn't that big of a deal. Heck, up until about four months ago, the machine that did all our collection, storage, stats analysis, and generated all our pretty graphs was a five or six year old Sun E-250 with "blazing fast" dual 400MHz UltraSPRAC CPUs and 512MB of RAM. Things usually ran at about 25% on that machine. We only recently upgraded to Apple Xserve systems running dual 2.0GHz G5s. Those machines run about 4% load. Then again, I must admit that we don't use the flow-capture suite of tools. We have our own set of internal tools that were developed from day one with massive data streams in mind. I'd assume the flow-capture stuff is reasonably efficient, however. I would think that it could keep up with this kind of data rate with ease. I'd be looking at your server loads and utilization. If you've got *really* slow storage, or something like that, it might be an issue. Otherwise these numbers strike me as large, but not absurdly so. Yeah, I know, that didn't really solve your problem. BTW, our pretty graphs: http://rogun.cites.uiuc.edu/graphs/campus/ -j -- Jay A. Kreibich | CommTech, Emrg Net Tech Svcs [EMAIL PROTECTED] | Campus IT & Edu Svcs <http://www.uiuc.edu/~jak> | University of Illinois at U/C _______________________________________________ Flow-tools mailing list [EMAIL PROTECTED] http://mailman.splintered.net/mailman/listinfo/flow-tools
