Re: [Flow-tools] issues with flow-capture

2014-06-12 Thread Joe Loiacono
flow-tools-boun...@list.splintered.net wrote on 06/11/2014 01:06:45 PM: From: Christoper Holland christ...@skyviewtech.com To: flow-tools@list.splintered.net Date: 06/12/2014 03:52 AM Subject: [Flow-tools] issues with flow-capture Sent by: flow-tools-boun...@list.splintered.net New to

Re: [Flow-tools] General usage : Queries and Reports across multiple collections.

2013-07-03 Thread Joe Loiacono
flow-tools-boun...@list.splintered.net wrote on 07/01/2013 11:36:27 AM: From: Donnelly, Michael (ITS) michael.donne...@its.ny.gov To: flow-tools@list.splintered.net flow-tools@list.splintered.net Date: 07/02/2013 09:47 AM Subject: [Flow-tools] General usage : Queries and Reports across

[Flow-tools] Announcement: FlowViewer 4.1

2013-06-21 Thread Joe Loiacono
FlowViewer 4.1 provides a convenient web-based user interface to two popular netflow collector/analyzers: flow-tools and SiLK. After a long wait, SiLK v3.7.1 was released to the general public this week. The inclusion of the underlying SiLK tool set enables FlowViewer users to continue to use

Re: [Flow-tools] http flow request not displaying flows

2013-05-07 Thread Joe Loiacono
flow-tools-boun...@list.splintered.net wrote on 05/06/2013 04:49:07 PM: In March I rebooted the Ubuntu system running the flow-tools installation. After the reboot an http request for flow information returns no data although the apache service seems to be running fine. I can also see flows

Re: [Flow-tools] Netflow v5 pretty much dead what is everyone migrating to?

2012-10-08 Thread Joe Loiacono
FlowViewer version 4.0 will work with IPFIX/v9 provided you can get a copy of SiLK v3.0. SiLK has been developed by the NetSA group at Carnegie Mellon and it's previous versions (prior v3.0) are freely available. The manager of the SiLK software, Chris Inacio, has told me in emails he is

Re: [Flow-tools] how get flow fith flow-nfilter for incoming and outgoing traffic per some net?

2012-07-20 Thread Joe Loiacono
Konstantin, You could also let FlowViewer handle this for you in the user interface. You can graph it and track it (via rrdtool) as well. http://ensight.eos.nasa.gov/FlowViewer/ Joe Loiacono From: Konstantin V. Krotov k...@insysnet.ru To: flow-tools@list.splintered.net Date: 07/20

Re: [Flow-tools] Where did the community go?

2012-04-11 Thread Joe Loiacono
Dave, Ironically I am finishing up testing for FlowViewer v 4.0. It now supports both flow-tools (for legacy) and SiLK v 3.0 (which supports Cisco's v9 and IPFIX.) Version 4.0 also has a new user interface (but preserves all existing Trackings, etc.) NASA (as govt.) was eligible for a beta

Re: [Flow-tools] IPFIX

2012-02-10 Thread Joe Loiacono
Yep, I've got a feeling flow-tools may not be upgraded for IPFIX. However, we're (FlowViewer) working on an IPFIX solution. Stay tuned ... Joe Loiacono From: Mark Boolootian boo...@ucsc.edu To: Drew Weaver drew.wea...@thenap.com Cc: flow-tools@list.splintered.net flow-tools

Re: [Flow-tools] transform netflow file to rrd file using flow-tool

2012-01-05 Thread Joe Loiacono
I've never used it, but there is a tool called flow-rpt2rrd: The flow-rpt2rrd utility processes the CSV output of flow-report into RRDtool format. The aggregates for a key are each stored as a DS in RRD filename {rrd_path,/,key,rrd_postfix,.rrd}. By default a DS is created for flows, octets,

Re: [Flow-tools] how can I create a new netflow file to save these filter flow ?

2011-12-27 Thread Joe Loiacono
Hi, You might try FlowViewer, a web-based front-end to flow-tools. It provides for easy reports and adjusting of filters, graphing filtered data, and maintaining long-term graph sets (ala MRTG) for specified filters. And, with respect to your question, the ability to preserve filters for future

Re: [Flow-tools] load of connections to ephemeral ports from TCP source port 3389(probably virus)

2011-10-27 Thread Joe Loiacono
flow-tools-boun...@list.splintered.net wrote on 10/26/2011 07:56:14 PM: srcIPdstIPprot srcPort dstPort octets packets I.I.P.P192.168.2.1966 3389 3799 55 1 I.I.P.P192.168.2.1966 3389 4465 40 1 I.I.P.P

Re: [Flow-tools] flow data exported volume

2011-06-16 Thread Joe Loiacono
flow-tools-boun...@list.splintered.net wrote on 06/16/2011 10:46:14 AM: Thank you very much! That works fine, and FlowViewer gives me the same report if I had just looked at the right thing! Now the next question, is there a nice way to plot this over time? Can you set an individual

Re: [Flow-tools] Converting bytes/octets to bits per second (rough estimate

2011-01-31 Thread Joe Loiacono
flow-tools-boun...@list.splintered.net wrote on 01/29/2011 03:46:05 PM: Math seems sound. 300 seconds is a function of exporter interval and collector file rotation. Most flows are shorter. Some will be longer if the exporter interval (active flow timeout) isn't configured properly.

Re: [Flow-tools] NetFlow v9 support in flow-tools?

2010-05-19 Thread Joe Loiacono
Craig, Thanks for the 'flowd2ft' script to enable conversion between flowd V9 captures and flow-tools ft files ( http://mailman.splintered.net/pipermail/flow-tools/2009-March/003765.html ) From your accompanying email message of Mar 13, 2009: Naturally it only supports for V5 fields (use

Re: [Flow-tools] Flow-stat vs MRTG

2010-05-04 Thread Joe Loiacono
When you apply flow-stat to a single ft file, you're getting the average rate over the length of time associated with the file. My ft files are typically 15 minutes long. If we assume yours are 15 minutes also, you are comparing a 15 minute average with an MRTG 5-minute SNMP sample of all

Re: [Flow-tools] Flow-stat vs MRTG

2010-05-04 Thread Joe Loiacono
talking about, I wouldn't sample at all. It's not a very heavy load, and you'll be happier with the results. You don't have to change the ft file times. Joe From: Jacky Chan bigserp...@gmail.com To: Joe Loiacono/USA/c...@csc Cc: flow-tools@list.splintered.net Date: 05/04/2010 11:30 AM Subject: Re

Re: [Flow-tools] Flow- Tools help on configuration.

2010-03-04 Thread Joe Loiacono
Uttam, FlowViewer, an easy-install web companion tool for flow-tools, has an option to view results adjusted for sampling. http://ensight.eos.nasa.gov/FlowViewer Joe Loiacono Network Engineering, Sr. Principal Leader CSC 7900 Harkins Road, Lanham, MD 20706 IT Infrastructure Solutions | p: +1

Re: [Flow-tools] Finding useful information from collected data

2010-02-23 Thread Joe Loiacono
Why don't you use FlowViewer? It is a web companion tool for flow-tools, and meets your requirements. Check out: http://ensight.eos.nasa.gov/FlowViewer Look through the screenshots, and read through the User's Guide. Joe | | From: | |

Re: [Flow-tools] new install

2010-01-08 Thread Joe Loiacono
Also make sure there is no firewall (iptables) blocking things. the f/w blocks packets after tcpdump. Joe Loiacono | | From

Re: [Flow-tools] new install

2010-01-08 Thread Joe Loiacono
have flows being written. I did also disable iptables and ip6tables (?) per Craig and Joe. I will test now if those are getting in the way too. Many thanks to al Kirk On Fri, Jan 8, 2010 at 12:20 PM, Joe Loiacono jloia...@csc.com wrote: Also make sure there is no firewall (iptables) blocking

RE: [Flow-tools] Empty flow files

2009-04-20 Thread Joe Loiacono
flow-capture logs for me to: /var/log/cflowd.log. Looks like cacti is intermediate and sending to system messages at /var/log/messages? My typical messages: 3076 Apr 20 15:15:17 dbcollect flow-capture[20686]: remove/2 2009/2009-03/2009-03-29/ft-v07.2009-03-29.234501+ 3077 Apr 20 15:16:37

RE: [Flow-tools] Problems installing floow-tools on debian from sourcecode....

2009-02-19 Thread Joe Loiacono
Yes - I've had flow-tools install instantly via apt-get. Sweet. Joe Andrew O'Brien andr...@oriel.com.au Sent by: flow-tools-boun...@list.splintered.net 02/18/2009 04:06 PM To Armin Garcia saintar...@gmail.com, flow-tools@list.splintered.net cc Subject RE: [Flow-tools] Problems installing

Re: [Flow-tools] Using flow-fanout with different interfaces

2009-01-06 Thread Joe Loiacono
Kai, This might help: http://ensight.eos.nasa.gov/FlowViewer/faq.html#27 Joe Zemke, Kai kai.ze...@smartnet.de Sent by: flow-tools-boun...@list.splintered.net 01/06/2009 10:44 AM To flow-tools@list.splintered.net cc Subject [Flow-tools] Using flow-fanout with different interfaces Hi,

Re: [Flow-tools] limit for number of filter elements

2008-10-29 Thread Joe Loiacono
I know I've never had trouble with hundreds of port numbers. Joe Maxim Kuleshov [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 10/28/2008 06:43 PM To flow-tools@list.splintered.net cc Subject [Flow-tools] limit for number of filter elements Hello! Is there any limitation for number of

[Flow-tools] Re: Question regarding flow time distribution

2008-08-06 Thread Joe Loiacono
mailing list where maybe someone can confirm it for you. Joe Huber AdrianTRAIL [EMAIL PROTECTED] 08/06/2008 03:38 PM To Joe Loiacono/CIV/[EMAIL PROTECTED] cc Subject Question regarding FlowViewer Hello! I’ve been spending some part of my morning trying to figure this one

Re: [Flow-tools] src prt = 0

2008-06-05 Thread Joe Loiacono
Hi Sarah, Ironically I saw that yesterday for the first time and was confused myself. I traced it back to some testing we were doing with different flow-masks. Turns out IOS v 12.1(12c)E2) does not have the set mls flow interface-full command I was hoping would allow us to see input and

[Flow-tools] Storing 6500 netflow

2008-05-21 Thread Joe Loiacono
I've started having trouble storing netflow from a 6509. Apparently when restarting flow-capture, depending on which of the MSFC or Supervisor sends the first packet, all data will be stored in that format (either v1 or v7). So, if I restart flow-capture, I may wind up with some files V1 and

Re: [Flow-tools] Printing raw netflow v5

2008-04-28 Thread Joe Loiacono
Curious how the netflow data got stored in those files originally? I.e., what format are they in? ASCII? Netflow data arrives at a collector as a series of UDP packets with PDUs in the v5 format. A typical collector breaks apart the payload and stores it in some format. If it is ASCII (or

Re: [Flow-tools] one report for all clients

2008-04-22 Thread Joe Loiacono
Dmitry, If you are using flow-tools to collect your netflow data, you could then use the FlowTracker component of FlowViewer to graphically track each user. The graph would be a 'group' graph with Input above the x-axis, and Output below the x-axis (for example). You could even stack multiple

Re: [Flow-tools] flow-cat reads all files in all subdirs of the specified root flow dir?

2008-02-28 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 02/28/2008 03:01:21 AM: We have `flow-capture' running for (looking at the `top' output) about 300 hours and pretty many flow. We used the following command: /usr/bin/flow-cat -t 2008/02/13 14:00:00 -T 2008/02/13 14:29:59 /usr/local/sflow/ft | customParser to

Re: [Flow-tools] getting fprobe and flowtools working together

2008-02-27 Thread Joe Loiacono
You'll probably have fprobe send to 127.0.0.1 port nnn. Then start flow-capture ( http://www.splintered.net/sw/flow-tools/docs/flow-capture.html ) probably something like: flow-capture -p /flows/pids/flowtool.pid -w /flows/router_1 -E2000M -S5 0/0/nnn E2000 would limit space used up to 2

Re: [Flow-tools] Newbie asking for help

2008-01-04 Thread Joe Loiacono
You might try nprobe from the NTOP group: http://www.ntop.org/nProbe.html Web site indicates that universities can get it for no cost. fprobe is another option. http://sourceforge.net/projects/fprobe GPL license without a fee, I believe. These convert captured IP packets into netflow data and

[Flow-tools] flow-tools make problems on Red Hat

2007-12-28 Thread Joe Loiacono
Having problems getting flow-capture to create directories and add files. Netflow UDP v5 packets are arriving (though they have skimpy data) but flow-capture is not doing anything. So we thought we'd build flow-tools by hand on Red Hat (wondering if perhaps the RPM was faulty). But the gmake

Re: [Flow-tools] what's the fix/workaround for the following error?

2007-12-27 Thread Joe Loiacono
The authors can chime in, but I think this was fixed in 0.68.2. Might as well go to 0.68.3: http://flow-tools.googlecode.com/files/flow-tools-0.68.3.tar.bz2 Joe Christian Vo [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 12/27/2007 01:01 PM To flow-tools@list.splintered.net cc Subject

RE: [Flow-tools] killed all flow-capture processes, but can't restart on previously specified port...(?)

2007-12-20 Thread Joe Loiacono
Maybe the port got bound up somehow. Can you try a 'netstat -an'? If port 2055 is listed then somehow you got to kill it off. You could try the flow-capture command using a different port and see what results. Joe Christian Vo [EMAIL PROTECTED] 12/20/2007 12:12 PM To Joe Loiacono/CIV

Re: [Flow-tools] Traffic through multiple routers

2007-11-02 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 11/01/2007 09:54:57 PM: Would flow-tools server A+B have identical traffic for this traffic flow?(i.e. Src IP/Dst IP/ Octets etc) Yes. - Or would Flow-tools server A only see the total octets as the tail is directly connected to Router A? Each router will

Re: [Flow-tools] billing from netflow data?

2007-10-24 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 10/23/2007 11:20:04 PM: Hi all, Does anyone do that? We currently just have the mrtg 95th percentile hack, and I really can't verify it's accuracy. We've got the same data in flows, anyone run across a tool to pull usage data easily for a specific IP and/or

Re: [Flow-tools] Store data and graphing

2007-10-15 Thread Joe Loiacono
Hi Caio, Alot of this has been done already with FlowViewer, available as open-source. One of the FlowViewer tools, Flowtracker, uses RRDtool to maintain four MRTG-like graphs for any filtered subset the user defines. It also has a capability for grouping individual 'trackings' into a single

Re: [Flow-tools] (no subject)

2007-09-05 Thread Joe Loiacono
From Cisco http://cisco.com/en/US/products/sw/netmgtsw/ps1964/products_implementation_design_guide09186a00800d6a11.html Rules for expiring NetFlow cache entries include: •Flows which have been idle for a specified time are expired and removed from the cache •Long lived flows are expired and

Re: [Flow-tools] Flow-tools bugfix and enhancement project forked

2007-07-16 Thread Joe Loiacono
Great, Paul. And others. Thanks! I looked through the bug fixes, but I don't know enough about the specifics - did the 64-bit problem get solved? Was it the time_t/u_int32 problem? Thanks, Joe Paul P Komkoff Jr [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 07/15/2007 06:32 PM To

[Flow-tools] Make fails on SUSE 10

2007-06-06 Thread Joe Loiacono
Does this look like the 64-bit problem?ftio.c: In function âreadnâ: ftio.c:2270: error: invalid lvalue in assignmentAnything else?Thanks!JoeCSCNOC-Flowviewer:/home/msmit227/NetFlow/flow-tools-0.68 # make Making all in lib make[1]: Entering directory `/home/msmit227/NetFlow/flow-tools-0.68/lib'

Re: [Flow-tools] flows with no data

2007-04-19 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 04/19/2007 02:45:51 PM: 2007/04/19 14:30:26 working on file /var/netflow/ft-v05.2007-04-19.142823-0400... Does the following show anything? /var/netflow/flow-stat -f10 ft-v05.2007-04-19.142823-0400 Are the flow files populated? Looks like you're receiving alot of

Re: [Flow-tools] flow-capture going crazy (memory leak or something local?)

2007-02-28 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 02/28/2007 12:19:10 PM: I was troubleshooting an unrelated problem on our netflow cruncher this morning and discovered flow-capture chewing up RAM/Swap (to the point where it allocated all the swap on the box and was less-than-politely killed for doing so). This

Re: [Flow-tools] RE:Flow-tools] Question about netflow for campus network

2007-02-28 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 02/28/2007 03:58:47 PM: Hi Jason - Message: 3 I am fairly new to analyzing netflow data and was wondering if anyone could offer some suggestions. We are currently sending exports from a cisco router to an instance of flow-capture which is storing it for

Re: [Flow-tools] origin-AS vs peer-AS, matching CUGrapher's graphs with MRTG

2007-01-31 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 01/30/2007 11:56:13 PM: [snip] Lastly, can someone here suggest a way to know who is consuming the traffic we are seeing in our MRTG graphs? For example, our upstream provider A, at around 1:00 pm has reached 30M in MRTG scale. Given that the data source for this

[Flow-tools] FlowViewer 3.1 is now available

2006-12-22 Thread Joe Loiacono
FlowViewer 3.1 is now available. Upgrade includes: statistcal information (MAX, MIN, 95th PCT, AVG) with FlowGraphs introduces the ability to archive and restart trackings now permits queries longer than 30 days permits a range of port numbers (e.g. ports 1024:1048) on queries fixed a number of

RE: [Flow-tools] Flow-capture does not start

2006-12-05 Thread Joe Loiacono
[EMAIL PROTECTED] wrote on 12/05/2006 09:45:57 AM: Hi Alistair, When i run flow-capture -h, i have the same message: [EMAIL PROTECTED] bin]# /usr/local/netflow/bin/flow-capture -h Usage: /usr/local/netflow/bin/flow-capture { start | stop } [EMAIL PROTECTED] bin]# I use flow-capture from

Re: [Flow-tools] Re: compile error

2006-11-27 Thread Joe Loiacono
Renata, You could use the FlowViewer toolset, particularly FlowGrapher to be able to see graphs of netflow data. Also, FlowTracker, which use RRDtool, will create MRTG-like graphs over longer periods of time. The FlowViewer tools are a web front-end to many of the flow-tools capabilities.

Re: [Flow-tools] flow-capture dies immediately

2006-08-11 Thread Joe Loiacono
Everton da Silva Marques [EMAIL PROTECTED] wrote on 08/10/2006 03:51:11 PM: On Thu, Aug 10, 2006 at 02:22:24PM -0400, Joe Loiacono wrote: Having trouble getting flow-capture to stay up. It immediately dies after invoking it. I've tested flow-receive and it works fine. Anybody see

[Flow-tools] FlowGrapher speeds up

2006-04-21 Thread Joe Loiacono
Users of FlowGrapher from the FlowViewer web companion to flow-tools may want to upgrade to FlowViewer v2.3. Modifications have improved the processing time of FlowGrapher up to 10-fold. FlowViewer, with FlowGrapher, can be found at: http://ensight.eos.nasa.gov/FlowViewer Thanks, Joe (Didn't

Re: [Flow-tools] make it flexible

2006-04-13 Thread Joe Loiacono
You need to know the SNMP index for the interface in question (I guess this applies to virtual interfaces as well.) Here's an example of flows which are leaving the router interface identified by SNMP index 8: In a file called 'filter_file' include: filter-primitive dest_if type ifindex

RE: [Flow-tools] FlowViewer,Flow-tools, on Solaris

2006-01-31 Thread Joe Loiacono
This has come up before on long runs. I believe that while flow-tools is cranking, the web browser times-out waiting. Looks like this breaks the stdout redirection. Might need to do a 'fork' that keeps the redirection open by sending '... (dots)' or something to the browser showing progress. I'll

[Flow-tools] Announcement: FlowViewer 2.1 (some fixes)

2006-01-16 Thread Joe Loiacono
Caught a couple of bugs in FlowViewer 2.0 and released FlowViewer 2.1. The first problem could result in missing data at the beginning of a requested time period. The second problem would result in missing graph data if the request straddled the end of a year. I recommend users upgrade at their