Re: [c-nsp] Cisco 7206VXR with NPE-G1
Even with “ip options drop”, we are still seeing a fraction of packets being cpu switched (about 0.2% input and 1% output) even though we are using CEF. Looks like they are mostly door-knob packets destined for the router itself (which is ACL’d) or some other annoyance. We tuned the buffers to solve the cosmetic counter issue with input/output errors. Since we increased the buffers, the counters have been clean, and the “show buffers” did show a shortage of buffers, so even on the 7200 with particles, perhaps the CLI uses the buffers construct regardless. Maybe it was just a placebo effect. rtr-inet2#sh int gi0/1 stats GigabitEthernet0/1 Switching pathPkts In Chars In Pkts Out Chars Out Processor2824573 6774030572958521 196941357 Route cache 944226953 181329390 274701286 1591461341 Total 947051526 858732447 277659807 1788402698 rtr-inet2#sh ip cef switching statistics Path Reason Drop Punt Punt2Host RP LES Packet destined for us 04377823 0 RP LES Total 04377823 0 RP PAS No route3923 0 0 RP PAS Packet destined for us 04933417 8 RP PAS No adjacency3476 0 0 RP PAS Incomplete adjacency 1204250 0 0 RP PAS TTL expired0 02709278 RP PAS Routed to Null0392389023 0 0 RP PAS Features 151528682 0 22614 RP PAS IP redirects 0 0 12358 RP PAS Neighbor resolution req 399660 0 0 RP PAS Total 54552901449334172744258 AllTotal 54552901493112402744258 On Jul 8, 2015, at 4:13 AM, Lukas Tribus luky...@hotmail.commailto:luky...@hotmail.com wrote: on a 1. The 7200 uses particles, not buffers... Also, its not relevant for CEF-switched traffic. So unless your configuration requires fast-switching or process-switching, you don't need to worry about buffer/particle tuning at all. Lukas ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
on a 1. The 7200 uses particles, not buffers... Also, its not relevant for CEF-switched traffic. So unless your configuration requires fast-switching or process-switching, you don't need to worry about buffer/particle tuning at all. Lukas ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
On 8 July 2015 at 03:36, Mark Tinka mark.ti...@seacom.mu wrote: 15.2(4)S7. Solid. +1. James. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
Even with “ip options drop”, we are still seeing a fraction of packets being cpu switched (about 0.2% input and 1% output) even though we are using CEF. Looks like they are mostly door-knob packets destined for the router itself (which is ACL’d) or some other annoyance. Sure, but thats not customer traffic, like you said. Of course, its not nice to have those drops, all I'm saying is that customer traffic is supposed to be CEF switched and therefor bypassing particles. Lukas ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
Hi, On Tue, Jul 07, 2015 at 09:20:09PM +, Matthew Huff wrote: Basically, as I understand it, you can get input/output drops with a busy CPU on the 7200 not just with interface buffer overruns but generic queue buffers. The default values were set when T1s were the standard. The article shows how to see which buffers are being overrun and how to adjust them. on a 1. The 7200 uses particles, not buffers... gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany g...@greenie.muc.de fax: +49-89-35655025g...@net.informatik.tu-muenchen.de pgp26Fd2HUS3t.pgp Description: PGP signature ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
All, This is what I am seeing on 7206's with NPE-G1's running IOS 12.4(12b). Also I might add that I have quite a few of these in service (all with same rev of IOS, and all are variable traffic throughout a 24 hour timespan (50-300Mbps): 6#show int gig 0/1 GigabitEthernet0/1 is up, line protocol is up Hardware is BCM1250 Internal MAC, address is 0002.fcb7.f01b (bia 0002.fcb7.f01b) MTU 1500 bytes, BW 10 Kbit, DLY 100 usec, reliability 255/255, txload 158/255, rxload 163/255 Encapsulation ARPA, loopback not set Keepalive set (10 sec) Full-duplex, 100Mb/s, media type is RJ45 output flow-control is XON, input flow-control is XON ARP type: ARPA, ARP Timeout 04:00:00 Last input 00:00:00, output 00:00:00, output hang never Last clearing of show interface counters 17w6d Input queue: 0/75/1386/38826 (size/max/drops/flushes); Total output drops: 3120926 Queueing strategy: fifo Output queue: 0/1000 (size/max) 30 second input rate 64012000 bits/sec, 34831 packets/sec 30 second output rate 62212000 bits/sec, 36408 packets/sec 186758885336 packets input, 46288188866751 bytes, 0 no buffer Received 0 broadcasts, 0 runts, 0 giants, 0 throttles 8288 input errors, 0 CRC, 0 frame, 8288 overrun, 0 ignored 0 watchdog, 5778334 multicast, 0 pause input 0 input packets with dribble condition detected 206213751240 packets output, 49186222484144 bytes, 0 underruns 3 output errors, 0 collisions, 0 interface resets 0 babbles, 0 late collision, 0 deferred 3 lost carrier, 0 no carrier, 0 pause output 0 output buffer failures, 0 output buffers swapped out I've already swapped out GBICs, fiber, and had the Z-side of these interfaces troubleshooted and nothing indicates hardware issue, yet the input errors and overruns occur. Also when I do a show buffers this is what I am seeing: Buffer elements: 1851 in free list (1119 max allowed) 3838947704 hits, 0 misses, 619 created Public buffer pools: Small buffers, 104 bytes (total 69, permanent 50, peak 190 @ 7w0d): 58 in free list (20 min, 150 max allowed) 236662807 hits, 150799 misses, 119546 trims, 119565 created 31355 failures (0 no memory) Middle buffers, 600 bytes (total 34, permanent 25, peak 265 @ 7w0d): 32 in free list (10 min, 150 max allowed) 99477866 hits, 130600 misses, 75340 trims, 75349 created 34516 failures (0 no memory) Big buffers, 1536 bytes (total 50, permanent 50, peak 56 @ 7w0d): 50 in free list (5 min, 150 max allowed) 56218156 hits, 60 misses, 60 trims, 60 created 7 failures (0 no memory) VeryBig buffers, 4520 bytes (total 10, permanent 10): 10 in free list (0 min, 100 max allowed) 7 hits, 0 misses, 0 trims, 0 created 0 failures (0 no memory) Large buffers, 5024 bytes (total 0, permanent 0): 0 in free list (0 min, 10 max allowed) 0 hits, 0 misses, 0 trims, 0 created 0 failures (0 no memory) Huge buffers, 18024 bytes (total 1, permanent 0, peak 11 @ 7w0d): 1 in free list (0 min, 4 max allowed) 97561 hits, 334 misses, 2460 trims, 2461 created 0 failures (0 no memory) Interface buffer pools: Syslog ED Pool buffers, 600 bytes (total 150, permanent 150): 118 in free list (150 min, 150 max allowed) 679286 hits, 0 misses IPC buffers, 4096 bytes (total 2, permanent 2): 2 in free list (1 min, 8 max allowed) 0 hits, 0 fallbacks, 0 trims, 0 created 0 failures (0 no memory) Header pools: Header buffers, 0 bytes (total 1256, permanent 256, peak 1256 @ 7w0d): 1000 in free list (256 min, 1024 max allowed) 20360150 hits, 675 misses, 0 trims, 1000 created 0 failures (0 no memory) 256 max cache size, 256 in cache 3913285762 hits in cache, 20359979 misses in cache Particle Clones: 1024 clones, 780885 hits, 0 misses Public particle pools: F/S buffers, 128 bytes (total 512, permanent 512): 0 in free list (0 min, 512 max allowed) 512 hits, 0 misses, 0 trims, 0 created 0 failures (0 no memory) 512 max cache size, 512 in cache 780885 hits in cache, 0 misses in cache Normal buffers, 512 bytes (total 2048, permanent 2048): 2048 in free list (1024 min, 4096 max allowed) 215320690 hits, 96662 misses, 98827 trims, 98827 created 0 failures (0 no memory) Private particle pools: GigabitEthernet0/1 buffers, 512 bytes (total 1000, permanent 1000): 0 in free list (0 min, 1000 max allowed) 1000 hits, 0 fallbacks 1000 max cache size, 872 in cache 838175508 hits in cache, 0 misses in cache 14 buffer threshold, 0 threshold transitions GigabitEthernet0/2 buffers, 512 bytes (total 1000, permanent 1000): 0 in free list (0 min, 1000 max allowed) 1000 hits, 64151594 fallbacks 1000 max cache size, 870 in cache 662670440 hits in cache, 64151594 misses in cache 14 buffer threshold, 15169777 threshold transitions GigabitEthernet0/3 buffers, 512 bytes (total 1000, permanent 1000):
[c-nsp] Cisco 7206VXR with NPE-G1
Hello, I wanted to reach out to the list to see what is the current and trusted version of IOS for Cisco 7206VXR with NPE-G1? I know this hardware is EOL but we have a few still in use and wanted to get them up to a newer version of IOS. We are currently running 12.4(12b) which I think we are hitting a bug with this IOS (bug ID CSCsz97091) in relation to input errors and overruns when a show run is done. I am seeing on our error trend graphs every hour we take a burst of input errors, and they are timed exactly to 1 hour interval. It just so happens our RANCID implementation is fetching configs every hour, so I have strong suspicion we are hitting that bug on 12.4(12b).Was wondering what is the best IOS to run on this NPE-G1?We do OSPF/BGP and minor static routing. IPSEC would be nice but not necessary in our situation. Thanks for any IOS recommendations. Rich ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
I would strongly recommend picking up a refurb NPE-G2. They should be cheap and available. We are running 15.2(4)S7 on ours with BGP/EIGRP. Very stable. You might also want to bump up your buffers on the 72xx. http://www.cisco.com/c/en/us/support/docs/routers/1-series-routers/15091-buffertuning.html Matthew Huff | 1 Manhattanville Rd Director of Operations | Purchase, NY 10577 OTA Management LLC | Phone: 914-460-4039 aim: matthewbhuff | Fax: 914-694-5669 -Original Message- From: cisco-nsp [mailto:cisco-nsp-boun...@puck.nether.net] On Behalf Of Rich Davies Sent: Tuesday, July 7, 2015 3:07 PM To: cisco-nsp@puck.nether.net Subject: [c-nsp] Cisco 7206VXR with NPE-G1 Hello, I wanted to reach out to the list to see what is the current and trusted version of IOS for Cisco 7206VXR with NPE-G1? I know this hardware is EOL but we have a few still in use and wanted to get them up to a newer version of IOS. We are currently running 12.4(12b) which I think we are hitting a bug with this IOS (bug ID CSCsz97091) in relation to input errors and overruns when a show run is done. I am seeing on our error trend graphs every hour we take a burst of input errors, and they are timed exactly to 1 hour interval. It just so happens our RANCID implementation is fetching configs every hour, so I have strong suspicion we are hitting that bug on 12.4(12b).Was wondering what is the best IOS to run on this NPE-G1?We do OSPF/BGP and minor static routing. IPSEC would be nice but not necessary in our situation. Thanks for any IOS recommendations. Rich ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
Hi, On Tue, Jul 07, 2015 at 03:07:12PM -0400, Rich Davies wrote: I wanted to reach out to the list to see what is the current and trusted version of IOS for Cisco 7206VXR with NPE-G1? 15.1(4)M10 has been extraordinarily nice for us - and is about the only version which has bugfixes for *all* PSIRT advisories issued in the last few years. Watch out for memory requirements - 12.4 is happy with 256M, 15.1M wants 512M. (Got bitten by this recently on 7301s - I assumed they will always come with 1G, but we found a few with 256M...) gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany g...@greenie.muc.de fax: +49-89-35655025g...@net.informatik.tu-muenchen.de pgpxLBIvSKNAk.pgp Description: PGP signature ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
Hi, On Tue, Jul 07, 2015 at 07:16:10PM +, Matthew Huff wrote: I would strongly recommend picking up a refurb NPE-G2. They should be cheap and available. We are running 15.2(4)S7 on ours with BGP/EIGRP. Very stable. You might also want to bump up your buffers on the 72xx. http://www.cisco.com/c/en/us/support/docs/routers/1-series-routers/15091-buffertuning.html Never understood buffer tuning on 7200s, tbh. This feels like a relict from 7500 days, which had a totally different architecture... gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany g...@greenie.muc.de fax: +49-89-35655025g...@net.informatik.tu-muenchen.de pgpsBxIXHMc_v.pgp Description: PGP signature ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
Well ... Am 7. Juli 2015 22:28:12 schrieb Gert Doering g...@greenie.muc.de: Hi, On Tue, Jul 07, 2015 at 07:16:10PM +, Matthew Huff wrote: I would strongly recommend picking up a refurb NPE-G2. They should be cheap and available. We are running 15.2(4)S7 on ours with BGP/EIGRP. Very stable. You might also want to bump up your buffers on the 72xx. http://www.cisco.com/c/en/us/support/docs/routers/1-series-routers/15091-buffertuning.html Never understood buffer tuning on 7200s, tbh. This feels like a relict from 7500 days, which had a totally different architecture... how true. Had the same feeling when I read Silicone Switch Engine in that document *feeling nostalgic* Cheers Sascha ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
Basically, as I understand it, you can get input/output drops with a busy CPU on the 7200 not just with interface buffer overruns but generic queue buffers. The default values were set when T1s were the standard. The article shows how to see which buffers are being overrun and how to adjust them. On Jul 7, 2015, at 4:27 PM, Gert Doering g...@greenie.muc.de wrote: Hi, On Tue, Jul 07, 2015 at 07:16:10PM +, Matthew Huff wrote: I would strongly recommend picking up a refurb NPE-G2. They should be cheap and available. We are running 15.2(4)S7 on ours with BGP/EIGRP. Very stable. You might also want to bump up your buffers on the 72xx. http://www.cisco.com/c/en/us/support/docs/routers/1-series-routers/15091-buffertuning.html Never understood buffer tuning on 7200s, tbh. This feels like a relict from 7500 days, which had a totally different architecture... gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany g...@greenie.muc.de fax: +49-89-35655025g...@net.informatik.tu-muenchen.de ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR with NPE-G1
On 7/Jul/15 21:07, Rich Davies wrote: Hello, I wanted to reach out to the list to see what is the current and trusted version of IOS for Cisco 7206VXR with NPE-G1? I know this hardware is EOL but we have a few still in use and wanted to get them up to a newer version of IOS. We are currently running 12.4(12b) which I think we are hitting a bug with this IOS (bug ID CSCsz97091) in relation to input errors and overruns when a show run is done. I am seeing on our error trend graphs every hour we take a burst of input errors, and they are timed exactly to 1 hour interval. It just so happens our RANCID implementation is fetching configs every hour, so I have strong suspicion we are hitting that bug on 12.4(12b).Was wondering what is the best IOS to run on this NPE-G1?We do OSPF/BGP and minor static routing. IPSEC would be nice but not necessary in our situation. 15.2(4)S7. Solid. As you mention, the box is now EoL, so all recent releases (and any future ones) will be purely bug fixes. Mark. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
[c-nsp] Cisco 7206VXR NPE-G1 mGRE performance
Hello, I have a trouble understanding the problem I have with mGRE on 7206VXR with NPE-G1 on one side and Cisco ASR 1001 on another. The problem is random packet loss for example: 7206 - ASR Sending 1, 1300-byte ICMP Echos to 192.168.0.2, timeout is 2 seconds: !! !! !! !! !! !! !! .! !! !! !! !! !! !! !! .! !! !! !! !! !! !! !! !! !!!.!! !! !! !! !! !! !. Success rate is 99 percent (2154/2158), round-trip min/avg/max = 1/1/20 ms When I have a smaller packet size then drops are less frequent but still present. I tried every hack i know to understand why I lose packets but without success. CPU looks ok CPU utilization for five seconds: 39%/35%; one minute: 35%; five minutes: 34% PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process 4698193652 154896559633 3.91% 3.70% 3.62% 0 IP Input 136 72748 34815 2089 0.07% 0.00% 0.00% 0 BGP Scanner 2 380104377 3 0.00% 0.00% 0.00% 0 Load Meter 3 25852985428 26 0.00% 0.00% 0.00% 0 OSPF Hello 4 203288 52967 3838 0.00% 0.03% 0.00% 0 Check heaps 5 44 222198 0.00% 0.00% 0.00% 0 Pool Manager 6 0 2 0 0.00% 0.00% 0.00% 0 Timers 7 0 2 0 0.00% 0.00% 0.00% 0 Serial Backgroun 8 80104343 0 0.00% 0.00% 0.00% 0 ALARM_TRIGGER_SC And the amount of traffic on mGRE tunnel is about 20Mbps. Is this way to much for NPE-G1 considering there is no hw support for GRE? ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
[c-nsp] Cisco 7206VXR (NPE-G2) SRD4
Hi all, We recently has tried to update IOs version on our Cisco router 7206VXR (NPE-G2) up to SRD4 12.2 (33). But we observed trouble with bgp process. Some sessions had not risen or got down with following notifications May 25 07:28:29 router.name.net 118: May 25 07:28:29: %BGP-5-ADJCHANGE: neighbor Down BGP Notification sent May 25 07:28:29 router.name.net 119: May 25 07:28:29: %BGP-3-NOTIFICATION: sent to neighbor ip-address 4/0 (hold time expired) 0 bytes May 25 07:28:30 router.name.net 120: May 25 07:28:29: %BGP_SESSION-5-ADJCHANGE: neighbor ip-address VPNv4 Unicast topology base removed from session BGP Notification sent May 25 07:28:31 router.name.net May 25 07:29:38: %BGP_SESSION-5-ADJCHANGE: neighbor ip-address VPNv4 Unicast topology base removed from session Unknown path error The dampening was disabled and some sessions were in a up status and not got down. So we have made rollback. But this is situation very unpleasant. I have found nothing on cisco.com Please help me, if anyone had something similar. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR (NPE-G2) SRD4
On 25/05/2010 16:51, Anrey Teslenko wrote: Unknown path error Do you have a copy of the BGP configuration (removing the actual IP's) ? I have upgraded several devices to SRD4 and I am pretty happy with this software release. I am using IBGP/EBGP without any problems although I had yet to upgrade a NPE-G2 to SRD4. Did you grab any debug outputs at the time ? ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
[c-nsp] Cisco 7206VXR/NPE-G1 -- Cisco WS-C6506 (R7000)
We have a 7206 that is getting lots of input errors and overrun errors on the LAN side without CRC errors. On the WAN side we are getting all 3 but on a much smaller scale. Every couple of weeks the CPU goes through the roof but the box has never rebooted. Can anyone give me a detailed breakdown of what I should be looking for here? The 7200 runs: BGP for 200Mb/s provider MPLS circuit (not full BGP table) OSPF IP CEF QoS and you can see the two circuits below GigabitEthernet0/1 is up, line protocol is up Hardware is BCM1250 Internal MAC, address is 000c.8651.a41b (bia 000c.8651.a41b) Description: /* MPLS Cloud 200Mb Circuit */ Internet address is 192.168.0.1/30 MTU 1500 bytes, BW 20 Kbit, DLY 10 usec, reliability 255/255, txload 96/255, rxload 51/255 Encapsulation ARPA, loopback not set Keepalive set (10 sec) Full-duplex, 1000Mb/s, link type is force-up, media type is SX output flow-control is unsupported, input flow-control is unsupported ARP type: ARPA, ARP Timeout 04:00:00 Last input 00:00:00, output 00:00:00, output hang never Last clearing of show interface counters 3w4d Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0 Queueing strategy: fifo Output queue: 0/40 (size/max) 5 minute input rate 4068 bits/sec, 24149 packets/sec 5 minute output rate 75723000 bits/sec, 17103 packets/sec 22332749957 packets input, 4830970628076 bytes, 0 no buffer Received 1469 broadcasts, 0 runts, 145 giants, 0 throttles 2369 input errors, 145 CRC, 0 frame, 2079 overrun, 0 ignored 0 watchdog, 1098953 multicast, 0 pause input 0 input packets with dribble condition detected 16281373526 packets output, 10005249755343 bytes, 0 underruns 0 output errors, 0 collisions, 0 interface resets 0 babbles, 0 late collision, 0 deferred 0 lost carrier, 0 no carrier, 0 pause output 0 output buffer failures, 0 output buffers swapped out GigabitEthernet0/2 is up, line protocol is up Hardware is BCM1250 Internal MAC, address is 000c.8651.a41a (bia 000c.8651.a41a) Description: /* LAN -- 6506 G1/14 */ Internet address is 10.1.1.2/30 MTU 1500 bytes, BW 100 Kbit, DLY 10 usec, reliability 255/255, txload 10/255, rxload 19/255 Encapsulation ARPA, loopback not set Keepalive set (10 sec) Full-duplex, 1000Mb/s, link type is force-up, media type is SX output flow-control is unsupported, input flow-control is unsupported ARP type: ARPA, ARP Timeout 04:00:00 Last input 00:00:00, output 00:00:00, output hang never Last clearing of show interface counters 4d07h Input queue: 1/75/0/0 (size/max/drops/flushes); Total output drops: 0 Queueing strategy: fifo Output queue: 0/40 (size/max) 5 minute input rate 74788000 bits/sec, 17119 packets/sec 5 minute output rate 40998000 bits/sec, 24119 packets/sec 2828864945 packets input, 1765438465449 bytes, 0 no buffer Received 114406 broadcasts, 0 runts, 0 giants, 0 throttles 74552 input errors, 0 CRC, 0 frame, 74552 overrun, 0 ignored 0 watchdog, 114406 multicast, 0 pause input 0 input packets with dribble condition detected 3789379333 packets output, 884796178660 bytes, 0 underruns 0 output errors, 0 collisions, 0 interface resets 0 babbles, 0 late collision, 0 deferred 0 lost carrier, 0 no carrier, 0 pause output 0 output buffer failures, 0 output buffers swapped out Thanks in advance for your help! Jason ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR/NPE-G1 -- Cisco WS-C6506 (R7000)
The CPU may be freaking out as interfaces and routing protocols think as errors stack up quickly the link is flapping, causing a lot of SPF calculations or BGP table re-syncs. Once the errors die off the interfaces appear stable. With both interfaces receiving the same garbled packets, it's unlikely a set of optics have gone bad and impacted both the transmitter and receivers. So it sounds like you have dirty patch interfaces or a mangled patch cable. Clean each with 95% isopropyl alcohol and lint-free wipes and/or replace the patch cable(s). If that doesn't clear it up, swap GBICs. Are you using newer 1300nm GBICs with older 62.5/125um patch cables? -D We have a 7206 that is getting lots of input errors and overrun errors on the LAN side without CRC errors. On the WAN side we are getting all 3 but on a much smaller scale. Every couple of weeks the CPU goes through the roof but the box has never rebooted. Can anyone give me a detailed breakdown of what I should be looking for here? ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Hi, On Fri, Apr 25, 2008 at 01:12:14AM +0200, Sidney Boumendil wrote: (remember OIR ie hot swap of PA is not supported on 7200 platform)? 7200s perfectly well support PA OIR. Only the I/O-Board (and NPE) are not hot-swappable. gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany [EMAIL PROTECTED] fax: +49-89-35655025[EMAIL PROTECTED] pgpZmrxn11za7.pgp Description: PGP signature ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
I think the 7200 platform is the only one from Cisco where I have never had a OIR hiccup. Gert Doering wrote: 7200s perfectly well support PA OIR. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Hi, On Fri, Apr 25, 2008 at 10:55:35AM -0400, Jason Berenson wrote: Never had a hiccup? I'd say 70% of the time the router falls on its face... For 7500s, I can second that - but for the 7200, never ever any problem. (Non-VXRs VXRs, everything from NPE-150 to NPE-G1, IOS 11.1, 11.1CC to 12.3 - no 12.4, though) gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany [EMAIL PROTECTED] fax: +49-89-35655025[EMAIL PROTECTED] ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Gert Doering wrote: For 7500s, I can second that - but for the 7200, never ever any problem. On a 7500, if it was VIP based I would pretty much guarantee that the router would require a reload - Even manually forcing a bus stall rather than expecting the card insertion to do it right. The older CX stuff seemed to work better though. Not that 'better' in the context of 7500 OIR is considered much. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On 4/25/08, Gert Doering [EMAIL PROTECTED] wrote: 7200s perfectly well support PA OIR. My mistake :) Must have confused with modular routers and NM. Sidney ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Hi, On Fri, Apr 25, 2008 at 07:04:24PM +0200, Sidney Boumendil wrote: On 4/25/08, Gert Doering [EMAIL PROTECTED] wrote: 7200s perfectly well support PA OIR. My mistake :) Must have confused with modular routers and NM. Those are a bit funny indeed - 3660s actually support hot-swap, but *only* remove defective module, replace with same type, not insert something that wasn't present at boot time. gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany [EMAIL PROTECTED] fax: +49-89-35655025[EMAIL PROTECTED] pgpIwoZLxN2mD.pgp Description: PGP signature ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On Wed, Apr 23, 2008 at 5:18 AM, Jason Berenson [EMAIL PROTECTED] wrote: Greetings, For anyone that cares. It seems that the bad NPE-G1 was running 12.2.x bootstrap code. Once they sent me one that was running 12.3.x and 12.4.19 IOS everything worked like a charm. Thanks, Jason Hi, If you run into the same problem again, try to upgrade ROMMON to 12.3 code. http://www.cisco.com/cgi-bin/tablebuild.pl/72xxrommon http://www.cisco.com/en/US/docs/ios/12_0s/feature/guide/12S28FUR.html This could save you the hassle of a RMA. Sidney Boumendil ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Sidney, I already got the G1 replaced, it's working. I have an NPE-400 in a VXR chassis that was running fine with 12.3.x until I put 12.4.19 on it. It starts the boot process, shows the version of bootstrap (12.2.x) then shows the amount of memory (256M) then does this: rommon rommon rommon rommon rommon rommon ... It keeps scrolling rommon as if I had the enter key depressed. It even does this if I put a flash card in the controller card with JUST 12.3.x IOS on it. I've tried a few different controller cards a few different console cables and a few different computers. I'm running out of options. I was told to try upgrading to 12.4.22 but that version isn't on cisco's site. When I call them they insist I need a smartnet contract before I can speak to an engineer. They won't provide the new IOS. Any ideas? Thanks, Jason Sidney Boumendil wrote: On Wed, Apr 23, 2008 at 5:18 AM, Jason Berenson [EMAIL PROTECTED] wrote: Greetings, For anyone that cares. It seems that the bad NPE-G1 was running 12.2.x bootstrap code. Once they sent me one that was running 12.3.x and 12.4.19 IOS everything worked like a charm. Thanks, Jason Hi, If you run into the same problem again, try to upgrade ROMMON to 12.3 code. http://www.cisco.com/cgi-bin/tablebuild.pl/72xxrommon http://www.cisco.com/en/US/docs/ios/12_0s/feature/guide/12S28FUR.html This could save you the hassle of a RMA. Sidney Boumendil ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On Fri, Apr 25, 2008 at 12:48 AM, Jason Berenson [EMAIL PROTECTED] wrote: Sidney, I already got the G1 replaced, it's working. I have an NPE-400 in a VXR chassis that was running fine with 12.3.x until I put 12.4.19 on it. It starts the boot process, shows the version of bootstrap (12.2.x) then shows the amount of memory (256M) then does this: rommon rommon rommon rommon rommon rommon ... It keeps scrolling rommon as if I had the enter key depressed. It even does this if I put a flash card in the controller card with JUST 12.3.x IOS on it. I've tried a few different controller cards a few different console cables and a few different computers. I'm running out of options. I was told to try upgrading to 12.4.22 but that version isn't on cisco's site. When I call them they insist I need a smartnet contract before I can speak to an engineer. They won't provide the new IOS. Any ideas? Thanks, Jason What's happening if you boot the chassis without any PA inserted (remember OIR ie hot swap of PA is not supported on 7200 platform)? Sidney ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Sidney, Without the PAs it does the same thing up until it tells me how much memory it has, then it scrolls this non stop: monitor: command boot abo mon -Jason Sidney Boumendil wrote: On Fri, Apr 25, 2008 at 12:48 AM, Jason Berenson [EMAIL PROTECTED] wrote: Sidney, I already got the G1 replaced, it's working. I have an NPE-400 in a VXR chassis that was running fine with 12.3.x until I put 12.4.19 on it. It starts the boot process, shows the version of bootstrap (12.2.x) then shows the amount of memory (256M) then does this: rommon rommon rommon rommon rommon rommon ... It keeps scrolling rommon as if I had the enter key depressed. It even does this if I put a flash card in the controller card with JUST 12.3.x IOS on it. I've tried a few different controller cards a few different console cables and a few different computers. I'm running out of options. I was told to try upgrading to 12.4.22 but that version isn't on cisco's site. When I call them they insist I need a smartnet contract before I can speak to an engineer. They won't provide the new IOS. Any ideas? Thanks, Jason What's happening if you boot the chassis without any PA inserted (remember OIR ie hot swap of PA is not supported on 7200 platform)? Sidney ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Greetings, For anyone that cares. It seems that the bad NPE-G1 was running 12.2.x bootstrap code. Once they sent me one that was running 12.3.x and 12.4.19 IOS everything worked like a charm. Thanks, Jason e ninja wrote: On Mon, Apr 21, 2008 at 3:05 AM, Marko Milivojevic [EMAIL PROTECTED] wrote: *g* - GD is general deployment, which sort of means this IOS train has seen enough testing by customers and so we assume that there are not too many nasty bugs left, or so. Usually not that many useful new features, either ;-) remember, features ? bugs ;-) /eninja ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
12.4 will never be GD = Gerd Doering ? Ziv -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Gert Doering Sent: Saturday, April 19, 2008 12:16 AM To: Rodney Dunn Cc: cisco-nsp@puck.nether.net Subject: Re: [c-nsp] Cisco 7206VXR Hi, On Fri, Apr 18, 2008 at 02:55:54PM -0400, Rodney Dunn wrote: PS. 12.4 will never be GD. That program is retired. Hmmm? gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany [EMAIL PROTECTED] fax: +49-89-35655025[EMAIL PROTECTED] This footnote confirms that this email message has been scanned by PineApp Mail-SeCure for the presence of malicious code, vandals computer viruses. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Hi, On Mon, Apr 21, 2008 at 10:54:11AM +0300, Ziv Leyes wrote: 12.4 will never be GD = Gerd Doering ? *g* - GD is general deployment, which sort of means this IOS train has seen enough testing by customers and so we assume that there are not too many nasty bugs left, or so. gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany [EMAIL PROTECTED] fax: +49-89-35655025[EMAIL PROTECTED] pgpjQYbdv3Lhh.pgp Description: PGP signature ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
*g* - GD is general deployment, which sort of means this IOS train has seen enough testing by customers and so we assume that there are not too many nasty bugs left, or so. Usually not that many useful new features, either ;-) ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Gary reminded me it was already on CCO: http://www.cisco.com/en/US/prod/collateral/iosswrel/ps8802/ps6968/ps6350/product_bulletin_cisco_ios_software_gd_program_retirement.html On Fri, Apr 18, 2008 at 03:12:53PM -0400, Jason Berenson wrote: Rodney, I'm just going to try 12.3.22 (which is what we have running on an NPE-350 with T3 and OC3 cards installed) to see if it's stable. If not I'll try the other G1 I have sitting here. -Jason Rodney Dunn wrote: On Fri, Apr 18, 2008 at 02:57:42PM -0400, Jason Berenson wrote: Rodney, When I say pop in, I mean the router is booted and I put the card in. I've tried a hard reboot too, same results. It did generate a crashinfo, once I get our contract renewed I can open a TAC case. Do you have another G1 you could try? The decode appears to be where we are trying to read some information from the system controller over the PCI bus. I haven't dug deep in that code but that's what I see from a quick glance of the trace decode. What do you mean by 12.4 will never be GD? Can't elaborate at this point. Sorry. -Jason Rodney Dunn wrote: Elaborate what pop in means? OIR? Hard reboot with it installed? Did it generate a crashinfo? A TAC SR needs to be opened because it's a bug. Rodney PS. 12.4 will never be GD. That program is retired. On Fri, Apr 18, 2008 at 02:09:05PM -0400, Jason Berenson wrote: Greetings, I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: Router# *Oct 8 10:44:54.339: %OIR-6-INSCARD: Card inserted in slot 1, interfaces admini stratively shut down 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. -Traceback= 0x6098AAA0 0x6097F064 0x6097F5B4 0x6097E664 0x60996DB8 0x6084DF60 0x 6084DF44 Should I be running a different version of 12.4 or maybe just stick with 12.3 until 12.4 is GD? Thanks, Jason ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On Mon, Apr 21, 2008 at 3:05 AM, Marko Milivojevic [EMAIL PROTECTED] wrote: *g* - GD is general deployment, which sort of means this IOS train has seen enough testing by customers and so we assume that there are not too many nasty bugs left, or so. Usually not that many useful new features, either ;-) remember, features ∞ bugs ;-) /eninja ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On Fri, Apr 18, 2008 at 02:42:16PM -0700, Buhrmaster, Gary wrote: Cisco retired (is retiring) the GD/LD program (ED and DF continue, MD is a new designation): Still, I don't understand what the practical consequences are, except that images aren't called GD/LD anymore, but MD (which never had any relevance to me anyway, as the only thing I'm interested in is does it work or not). http://www.cisco.com/warp/public/417/109.html confirms that the designations are basically meaningless, except that Cisco thinks that the releases have reached some maturity. So, what's the bottom line, given that the announcement seems to state that there are no consequences for development, testing etc.? Best regards, Daniel -- CLUE-RIPE -- Jabber: [EMAIL PROTECTED] -- [EMAIL PROTECTED] -- PGP: 0xA85C8AA0 ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
[c-nsp] Cisco 7206VXR
Greetings, I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: Router# *Oct 8 10:44:54.339: %OIR-6-INSCARD: Card inserted in slot 1, interfaces admini stratively shut down 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. -Traceback= 0x6098AAA0 0x6097F064 0x6097F5B4 0x6097E664 0x60996DB8 0x6084DF60 0x 6084DF44 Should I be running a different version of 12.4 or maybe just stick with 12.3 until 12.4 is GD? Thanks, Jason ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On Fri, 18 Apr 2008, Jason Berenson wrote: I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. You can try another version of code and see if that works better. If not, your best bet is to open a case with the TAC. Does the router crash when you insert any other port adapters? Does the router crash regardless of which slot/bus you put the PA-MC-T3 in? Is it a PA-MC-T3, or a PA-MC-T3+? jms ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Justin M. Streiner wrote: Does the router crash when you insert any other port adapters? Does it crash when you insert the card, but boots happily if the card is already in when you power on? David ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Elaborate what pop in means? OIR? Hard reboot with it installed? Did it generate a crashinfo? A TAC SR needs to be opened because it's a bug. Rodney PS. 12.4 will never be GD. That program is retired. On Fri, Apr 18, 2008 at 02:09:05PM -0400, Jason Berenson wrote: Greetings, I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: Router# *Oct 8 10:44:54.339: %OIR-6-INSCARD: Card inserted in slot 1, interfaces admini stratively shut down 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. -Traceback= 0x6098AAA0 0x6097F064 0x6097F5B4 0x6097E664 0x60996DB8 0x6084DF60 0x 6084DF44 Should I be running a different version of 12.4 or maybe just stick with 12.3 until 12.4 is GD? Thanks, Jason ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Rodney, When I say pop in, I mean the router is booted and I put the card in. I've tried a hard reboot too, same results. It did generate a crashinfo, once I get our contract renewed I can open a TAC case. What do you mean by 12.4 will never be GD? -Jason Rodney Dunn wrote: Elaborate what pop in means? OIR? Hard reboot with it installed? Did it generate a crashinfo? A TAC SR needs to be opened because it's a bug. Rodney PS. 12.4 will never be GD. That program is retired. On Fri, Apr 18, 2008 at 02:09:05PM -0400, Jason Berenson wrote: Greetings, I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: Router# *Oct 8 10:44:54.339: %OIR-6-INSCARD: Card inserted in slot 1, interfaces admini stratively shut down 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. -Traceback= 0x6098AAA0 0x6097F064 0x6097F5B4 0x6097E664 0x60996DB8 0x6084DF60 0x 6084DF44 Should I be running a different version of 12.4 or maybe just stick with 12.3 until 12.4 is GD? Thanks, Jason ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On Fri, Apr 18, 2008 at 02:57:42PM -0400, Jason Berenson wrote: Rodney, When I say pop in, I mean the router is booted and I put the card in. I've tried a hard reboot too, same results. It did generate a crashinfo, once I get our contract renewed I can open a TAC case. Do you have another G1 you could try? The decode appears to be where we are trying to read some information from the system controller over the PCI bus. I haven't dug deep in that code but that's what I see from a quick glance of the trace decode. What do you mean by 12.4 will never be GD? Can't elaborate at this point. Sorry. -Jason Rodney Dunn wrote: Elaborate what pop in means? OIR? Hard reboot with it installed? Did it generate a crashinfo? A TAC SR needs to be opened because it's a bug. Rodney PS. 12.4 will never be GD. That program is retired. On Fri, Apr 18, 2008 at 02:09:05PM -0400, Jason Berenson wrote: Greetings, I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: Router# *Oct 8 10:44:54.339: %OIR-6-INSCARD: Card inserted in slot 1, interfaces admini stratively shut down 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. -Traceback= 0x6098AAA0 0x6097F064 0x6097F5B4 0x6097E664 0x60996DB8 0x6084DF60 0x 6084DF44 Should I be running a different version of 12.4 or maybe just stick with 12.3 until 12.4 is GD? Thanks, Jason ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Rodney, I'm just going to try 12.3.22 (which is what we have running on an NPE-350 with T3 and OC3 cards installed) to see if it's stable. If not I'll try the other G1 I have sitting here. -Jason Rodney Dunn wrote: On Fri, Apr 18, 2008 at 02:57:42PM -0400, Jason Berenson wrote: Rodney, When I say pop in, I mean the router is booted and I put the card in. I've tried a hard reboot too, same results. It did generate a crashinfo, once I get our contract renewed I can open a TAC case. Do you have another G1 you could try? The decode appears to be where we are trying to read some information from the system controller over the PCI bus. I haven't dug deep in that code but that's what I see from a quick glance of the trace decode. What do you mean by 12.4 will never be GD? Can't elaborate at this point. Sorry. -Jason Rodney Dunn wrote: Elaborate what pop in means? OIR? Hard reboot with it installed? Did it generate a crashinfo? A TAC SR needs to be opened because it's a bug. Rodney PS. 12.4 will never be GD. That program is retired. On Fri, Apr 18, 2008 at 02:09:05PM -0400, Jason Berenson wrote: Greetings, I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: Router# *Oct 8 10:44:54.339: %OIR-6-INSCARD: Card inserted in slot 1, interfaces admini stratively shut down 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. -Traceback= 0x6098AAA0 0x6097F064 0x6097F5B4 0x6097E664 0x60996DB8 0x6084DF60 0x 6084DF44 Should I be running a different version of 12.4 or maybe just stick with 12.3 until 12.4 is GD? Thanks, Jason ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Are you using multiple 7206 chassis and multiple NPE-G1s for testing? Does it happen consistently across all of your devices? Only time I had a problem similar to this was with a flaky NPE or memory on the NPE. Jason Berenson wrote: Rodney, When I say pop in, I mean the router is booted and I put the card in. I've tried a hard reboot too, same results. It did generate a crashinfo, once I get our contract renewed I can open a TAC case. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Same issue with PID: PA-2FE-FX running on 12.4(19); crash dump on hard boot. Fixed by changing the image to 12.4(8d) - works like a charm. 12.4(17) should also work fine. HTH, Andrew -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jason Berenson Sent: Friday, April 18, 2008 1:52 PM To: Justin M. Streiner Cc: cisco-nsp@puck.nether.net Subject: Re: [c-nsp] Cisco 7206VXR Justin, David, It crashes when I put the card in and keeps crashing on a reboot. I did get it to boot with 12.3.26. When I put the PA-MC-T3 card in at that point it's ok but when I put the ATM OC3 card in it crashes. When I have this router configured with an NPE-400 and these two cards it seems to work just fine. I'm about to throw these 7206's out the window and watch them slam into the pavement 10 floors down. -Jason Justin M. Streiner wrote: On Fri, 18 Apr 2008, Jason Berenson wrote: I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. You can try another version of code and see if that works better. If not, your best bet is to open a case with the TAC. Does the router crash when you insert any other port adapters? Does the router crash regardless of which slot/bus you put the PA-MC-T3 in? Is it a PA-MC-T3, or a PA-MC-T3+? jms ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Andrew, It looks like it may be this G1. I'm testing another G1 with the T3 and OC3 card in it and it seems to be happy but it's running: :c7200-js-mz.123-4.T1.bin right now. I'm going to try c7200-is-mz.124-19.bin and see what happens. -Jason Tolstykh, Andrew wrote: Same issue with PID: PA-2FE-FX running on 12.4(19); crash dump on hard boot. Fixed by changing the image to 12.4(8d) - works like a charm. 12.4(17) should also work fine. HTH, Andrew -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jason Berenson Sent: Friday, April 18, 2008 1:52 PM To: Justin M. Streiner Cc: cisco-nsp@puck.nether.net Subject: Re: [c-nsp] Cisco 7206VXR Justin, David, It crashes when I put the card in and keeps crashing on a reboot. I did get it to boot with 12.3.26. When I put the PA-MC-T3 card in at that point it's ok but when I put the ATM OC3 card in it crashes. When I have this router configured with an NPE-400 and these two cards it seems to work just fine. I'm about to throw these 7206's out the window and watch them slam into the pavement 10 floors down. -Jason Justin M. Streiner wrote: On Fri, 18 Apr 2008, Jason Berenson wrote: I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. You can try another version of code and see if that works better. If not, your best bet is to open a case with the TAC. Does the router crash when you insert any other port adapters? Does the router crash regardless of which slot/bus you put the PA-MC-T3 in? Is it a PA-MC-T3, or a PA-MC-T3+? jms ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Hi, On Fri, Apr 18, 2008 at 02:55:54PM -0400, Rodney Dunn wrote: PS. 12.4 will never be GD. That program is retired. Hmmm? gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany [EMAIL PROTECTED] fax: +49-89-35655025[EMAIL PROTECTED] pgpiw9Ci3JvnX.pgp Description: PGP signature ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
That's what I say too... Gert Doering wrote: Hi, On Fri, Apr 18, 2008 at 02:55:54PM -0400, Rodney Dunn wrote: PS. 12.4 will never be GD. That program is retired. Hmmm? gert ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
On Fri, Apr 18, 2008 at 02:55:54PM -0400, Rodney Dunn wrote: PS. 12.4 will never be GD. That program is retired. Hmmm? Cisco retired (is retiring) the GD/LD program (ED and DF continue, MD is a new designation): http://www.cisco.com/en/US/prod/collateral/iosswrel/ps8802/ps6968/ps6350/product_bulletin_cisco_ios_software_gd_program_retirement.html Gary ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
http://www.cisco.com/en/US/prod/collateral/iosswrel/ps8802/ps6968/ps6350/product_bulletin_cisco_ios_software_gd_program_retirement.html -- Tassos Jason Berenson wrote on 19/4/2008 12:17 πμ: That's what I say too... Gert Doering wrote: Hi, On Fri, Apr 18, 2008 at 02:55:54PM -0400, Rodney Dunn wrote: PS. 12.4 will never be GD. That program is retired. Hmmm? gert ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR
Jason, My issue was 100% specific to 12.4(19) - confirmed on 1 x 7204VXR and 1 x 7206VXR. Both routers were unable to boot the 12.4(19) IOS with PA-2FE-FX card present (crash dump with the message that this code does not support the installed port adapter). Changing the code to 12.4(8d) resolved this issue on both routers. -Original Message- From: Jason Berenson [mailto:[EMAIL PROTECTED] Sent: Friday, April 18, 2008 2:33 PM To: Tolstykh, Andrew Cc: Justin M. Streiner; cisco-nsp@puck.nether.net Subject: Re: [c-nsp] Cisco 7206VXR Andrew, It looks like it may be this G1. I'm testing another G1 with the T3 and OC3 card in it and it seems to be happy but it's running: :c7200-js-mz.123-4.T1.bin right now. I'm going to try c7200-is-mz.124-19.bin and see what happens. -Jason Tolstykh, Andrew wrote: Same issue with PID: PA-2FE-FX running on 12.4(19); crash dump on hard boot. Fixed by changing the image to 12.4(8d) - works like a charm. 12.4(17) should also work fine. HTH, Andrew -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Jason Berenson Sent: Friday, April 18, 2008 1:52 PM To: Justin M. Streiner Cc: cisco-nsp@puck.nether.net Subject: Re: [c-nsp] Cisco 7206VXR Justin, David, It crashes when I put the card in and keeps crashing on a reboot. I did get it to boot with 12.3.26. When I put the PA-MC-T3 card in at that point it's ok but when I put the ATM OC3 card in it crashes. When I have this router configured with an NPE-400 and these two cards it seems to work just fine. I'm about to throw these 7206's out the window and watch them slam into the pavement 10 floors down. -Jason Justin M. Streiner wrote: On Fri, 18 Apr 2008, Jason Berenson wrote: I'm going to be upgrading a couple of 7206VXR NPE-350's to G1's tomorrow night. I'm testing right now with the latest IP plus software: c7200-is-mz.124-19.bin. When I pop in a PA-MC-T3 the router promptly crashes: 10:44:58 UTC Fri Oct 8 2004: Data Bus Error exception, CPU signal 10, PC = 0x60 98AAA0 Possible software fault. Upon reccurence, please collect crashinfo, show tech and contact Cisco Technical Support. You can try another version of code and see if that works better. If not, your best bet is to open a case with the TAC. Does the router crash when you insert any other port adapters? Does the router crash regardless of which slot/bus you put the PA-MC-T3 in? Is it a PA-MC-T3, or a PA-MC-T3+? jms ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
On Wed, Mar 12, 2008 at 11:31:22PM -0400, Jason Berenson wrote: We have 3 7206's used as edge routers. PA-MC-T3 in from our DAX and ethernet out to our transport. So there are a few adjacencies along with iBGP and eBGP. It seems like the router that goes down (flaps OSPF/BGP instance 1) is the only one that takes a hit out of all of them connected to the switches. I've seen one scenario where one router claims it can't hear any OSPF neighbors on an Ethernet, even though the other neighbors issue no complaints. In that case, the router was no longer receiving Ethernet packets, apparently due to an IOS bug. The router was still sending its HELO packets, and the other routers heard them, so they had nothing to complain about. I've seen HSRP (another broadcast-based protocol) get into a similar stuck state. However, you should not see behavior like that with BGP, which uses a TCP session. Both sides should issue alarms when the session flaps, though one side might take longer to report the event (i.e. it may not sense the event until a timeout occurs). I'm leaning away from thinking this is an ethernet issue, but I definitely could be wrong. Based on what you said above, I would say your problem router's Ethernet transmitting is OK (at least for broadcast packets). If you've got Netflow on the box, that would give you some hints as to how receiving is working. And of course, you need to check the switch port statuses. This is where something like Cricket/MRTG/Cacti comes in handy - if they show you that you've had zero errors on those ports going back the last 3 months, then you know the physical medium is probably OK. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR - IOS 12.4(12) - Bus Error Crash
Most likely problem can be solved if you switch to 12.4(latest). Werner Detter wrote: Hi again, crashed due to a bus error (bus error at PC 0x6013C4D8, address 0x64588700). skip What do you suggest? Any help or comments appreciated, Werner ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR - IOS 12.4(12) - Bus Error Crash
Hi again, Looks like we tried to read from a valid address. Thanks you for your comments. I suppose changing the memory isn't a bad idea. regards, Werner ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
No. Good idea to just turn off logging to the console via no logg con Rodney On Wed, Mar 12, 2008 at 05:35:12PM -0400, Jason Berenson wrote: Rodney, They connect back to a cisco switch. No errors anywhere along the ethernet and no packet loss. It also only flapped 3 times yesterday and 2 times 5 days ago, so it's not a constant flap. It hasn't flapped yet today, so I'll turn on debugging and setup a snoop and write back when I have something. About the debugging - will turning on the commands suggested (ospf event or ospf adj) have an averse affect on the routers performance? Thanks, Jason Rodney Dunn wrote: What is the physical topology? Is it back to back ethernet? On Wed, Mar 12, 2008 at 11:37:42AM -0400, Jason Berenson wrote: Joe, I checked the neighbors too. I do see the session flap there but again, no errors on the ethernet and nothing really obvious as to why it flapped. This just started in the past few days. I do see some CPU spikes to 100% but it doesn't correlate exactly to when the flap occurred. -Jason Joe Freeman wrote: If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, *Jason Berenson* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR - IOS 12.4(12) - Bus Error Crash
Hi again, crashed due to a bus error (bus error at PC 0x6013C4D8, address 0x64588700). As described in the Cisco document Troubleshooting Bus Error Crashes [1] I've tried to figure out to which memory location the address 0x64588700 corresponds to. 'show region' shows, that the address 0x64588700 is within the following range: Region Manager: Start End Size(b) Class Media Name 0x644B95A0 0x64A8357F 6070240 IBss R/W main:bss As i understand this output, it means that the router was accessing a valid address, but the hardware corresponding to that address is not responding properly and there may be a hardware problem. Main corresponds to main memory or dynamic RAM (DRAM) but what exaclty stands main:bss for? What do you suggest? Any help or comments appreciated, Werner [1] http://www.cisco.com/en/US/products/sw/iosswrel/ps1831/products_tech_note09186a00800cdd51.shtml ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, Jason Berenson [EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
Joe, I checked the neighbors too. I do see the session flap there but again, no errors on the ethernet and nothing really obvious as to why it flapped. This just started in the past few days. I do see some CPU spikes to 100% but it doesn't correlate exactly to when the flap occurred. -Jason Joe Freeman wrote: If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, *Jason Berenson* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
What is the physical topology? Is it back to back ethernet? On Wed, Mar 12, 2008 at 11:37:42AM -0400, Jason Berenson wrote: Joe, I checked the neighbors too. I do see the session flap there but again, no errors on the ethernet and nothing really obvious as to why it flapped. This just started in the past few days. I do see some CPU spikes to 100% but it doesn't correlate exactly to when the flap occurred. -Jason Joe Freeman wrote: If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, *Jason Berenson* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
Rodney, They connect back to a cisco switch. No errors anywhere along the ethernet and no packet loss. It also only flapped 3 times yesterday and 2 times 5 days ago, so it's not a constant flap. It hasn't flapped yet today, so I'll turn on debugging and setup a snoop and write back when I have something. About the debugging - will turning on the commands suggested (ospf event or ospf adj) have an averse affect on the routers performance? Thanks, Jason Rodney Dunn wrote: What is the physical topology? Is it back to back ethernet? On Wed, Mar 12, 2008 at 11:37:42AM -0400, Jason Berenson wrote: Joe, I checked the neighbors too. I do see the session flap there but again, no errors on the ethernet and nothing really obvious as to why it flapped. This just started in the past few days. I do see some CPU spikes to 100% but it doesn't correlate exactly to when the flap occurred. -Jason Joe Freeman wrote: If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, *Jason Berenson* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR - IOS 12.4(12) - Bus Error Crash
Good analysis. Looks like we tried to read from a valid address. main:text,(r/o), main:data (r/w) and main:bss (r/w) are subregions of the local memory used for IOS. main:heap is what is left after IOS image is loaded. main:bss contains uninitialized variables. /eninja On Wed, Mar 12, 2008 at 2:04 AM, Werner Detter [EMAIL PROTECTED] wrote: Hi again, crashed due to a bus error (bus error at PC 0x6013C4D8, address 0x64588700). As described in the Cisco document Troubleshooting Bus Error Crashes [1] I've tried to figure out to which memory location the address 0x64588700 corresponds to. 'show region' shows, that the address 0x64588700 is within the following range: Region Manager: Start End Size(b) Class Media Name 0x644B95A0 0x64A8357F 6070240 IBss R/W main:bss As i understand this output, it means that the router was accessing a valid address, but the hardware corresponding to that address is not responding properly and there may be a hardware problem. Main corresponds to main memory or dynamic RAM (DRAM) but what exaclty stands main:bss for? What do you suggest? Any help or comments appreciated, Werner [1] http://www.cisco.com/en/US/products/sw/iosswrel/ps1831/products_tech_note09186a00800cdd51.shtml ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
Are any other hosts affected off the switch during this period aswell? Ben On 13/03/2008, at 8:05 AM, Jason Berenson wrote: Rodney, They connect back to a cisco switch. No errors anywhere along the ethernet and no packet loss. It also only flapped 3 times yesterday and 2 times 5 days ago, so it's not a constant flap. It hasn't flapped yet today, so I'll turn on debugging and setup a snoop and write back when I have something. About the debugging - will turning on the commands suggested (ospf event or ospf adj) have an averse affect on the routers performance? Thanks, Jason Rodney Dunn wrote: What is the physical topology? Is it back to back ethernet? On Wed, Mar 12, 2008 at 11:37:42AM -0400, Jason Berenson wrote: Joe, I checked the neighbors too. I do see the session flap there but again, no errors on the ethernet and nothing really obvious as to why it flapped. This just started in the past few days. I do see some CPU spikes to 100% but it doesn't correlate exactly to when the flap occurred. -Jason Joe Freeman wrote: If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, *Jason Berenson* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
Ben, We have 3 7206's used as edge routers. PA-MC-T3 in from our DAX and ethernet out to our transport. So there are a few adjacencies along with iBGP and eBGP. It seems like the router that goes down (flaps OSPF/BGP instance 1) is the only one that takes a hit out of all of them connected to the switches. I'm leaning away from thinking this is an ethernet issue, but I definitely could be wrong. Are there any helpful outputs I could include? Thanks, Jason Ben Steele wrote: Are any other hosts affected off the switch during this period aswell? Ben On 13/03/2008, at 8:05 AM, Jason Berenson wrote: Rodney, They connect back to a cisco switch. No errors anywhere along the ethernet and no packet loss. It also only flapped 3 times yesterday and 2 times 5 days ago, so it's not a constant flap. It hasn't flapped yet today, so I'll turn on debugging and setup a snoop and write back when I have something. About the debugging - will turning on the commands suggested (ospf event or ospf adj) have an averse affect on the routers performance? Thanks, Jason Rodney Dunn wrote: What is the physical topology? Is it back to back ethernet? On Wed, Mar 12, 2008 at 11:37:42AM -0400, Jason Berenson wrote: Joe, I checked the neighbors too. I do see the session flap there but again, no errors on the ethernet and nothing really obvious as to why it flapped. This just started in the past few days. I do see some CPU spikes to 100% but it doesn't correlate exactly to when the flap occurred. -Jason Joe Freeman wrote: If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, *Jason Berenson* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR OSPF
Going by the fact you see nothing obvious in the logs on the routers I was just curious to see whether it may be something on the switch like someone randomly plugging in a cable or interface that is causing a brief SPT loop or other various layer 2 issue, nothing in the switch logs I assume that correlates with the times? On 13/03/2008, at 2:01 PM, Jason Berenson wrote: Ben, We have 3 7206's used as edge routers. PA-MC-T3 in from our DAX and ethernet out to our transport. So there are a few adjacencies along with iBGP and eBGP. It seems like the router that goes down (flaps OSPF/BGP instance 1) is the only one that takes a hit out of all of them connected to the switches. I'm leaning away from thinking this is an ethernet issue, but I definitely could be wrong. Are there any helpful outputs I could include? Thanks, Jason Ben Steele wrote: Are any other hosts affected off the switch during this period aswell? Ben On 13/03/2008, at 8:05 AM, Jason Berenson wrote: Rodney, They connect back to a cisco switch. No errors anywhere along the ethernet and no packet loss. It also only flapped 3 times yesterday and 2 times 5 days ago, so it's not a constant flap. It hasn't flapped yet today, so I'll turn on debugging and setup a snoop and write back when I have something. About the debugging - will turning on the commands suggested (ospf event or ospf adj) have an averse affect on the routers performance? Thanks, Jason Rodney Dunn wrote: What is the physical topology? Is it back to back ethernet? On Wed, Mar 12, 2008 at 11:37:42AM -0400, Jason Berenson wrote: Joe, I checked the neighbors too. I do see the session flap there but again, no errors on the ethernet and nothing really obvious as to why it flapped. This just started in the past few days. I do see some CPU spikes to 100% but it doesn't correlate exactly to when the flap occurred. -Jason Joe Freeman wrote: If OSPF is flapping, you should see it on the neighbor attached to that interface as well, so you might look there for issues. Joe On 3/12/08, *Jason Berenson* [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote: Rodney, The interface is clean. No errors/drops at all. I think I'll have to snoop that segment like you suggested and wait for it to flap again. Thanks, Jason Rodney Dunn wrote: Look for intput drops on the 'sh int'. If you don't see any you probably need a sniffer trace on the ethernet segment. On Tue, Mar 11, 2008 at 03:53:30PM -0400, Jason Berenson wrote: Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net mailto:cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
[c-nsp] Cisco 7206VXR OSPF
Greetings, We have a few 7206's running OSPF/BGP for routing. All of the routers are fine except for one - I noticed a few times in the past week where OSPF/BGP flapped and came back right away. I checked CPU and noticed it peaked in the past hour but that doesn't really correlate to the time the routing sessions flapped. I also didn't see the ethernet connection go down and I don't see any errors on either side of the ethernet. If there are any outputs anyone would expect please let me know and I'll promptly reply. This is the first time I'm faced with a problem like this so I'm not really sure where to look other then the things I've already tried. Much thanks in advance, Jason Berenson ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR Configuration issue
Keith Madara wrote: I have been using a 7206VXR for many years now to provide DSL Services. We are running this unit utilizing PPPoE. Recently, we attempted to insert a PA-MC-T3 card into the unit and program a Multilink PPP connection for a Customer with 3 T1's bonded together. While the individual serial interfaces went up/down, I could not get the PPP to establish as I believe it was attempting to become PPPoE. I placed ppp username/passwords on each Serial Interface for authentication/authorization with no luck. Does anyone know of a work around for this type of situation? Try something like: aaa authorization network PTP none Then under your multilink interface something like: ppp authorization PTP You may need the ppp authorization PTP under each PPP serial link, it's been a while. -- Robert Blayzor, BOFH INOC, LLC rblayzor\@(inoc.net|gmail.com) PGP: 0x66F90BFC @ http://pgp.mit.edu Key fingerprint = 6296 F715 038B 44C1 2720 292A 8580 500E 66F9 0BFC State-of-the-art: What we could do with enough money. ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] Cisco 7206VXR Configuration issue
Robert, Thank you. I believe that is what I missed which was the aaa authorization network name none --Keith On Fri, Apr 27, 2007 at 03:59:48PM -0400, Robert Blayzor wrote: Keith Madara wrote: I have been using a 7206VXR for many years now to provide DSL Services. We are running this unit utilizing PPPoE. Recently, we attempted to insert a PA-MC-T3 card into the unit and program a Multilink PPP connection for a Customer with 3 T1's bonded together. While the individual serial interfaces went up/down, I could not get the PPP to establish as I believe it was attempting to become PPPoE. I placed ppp username/passwords on each Serial Interface for authentication/authorization with no luck. Does anyone know of a work around for this type of situation? Try something like: aaa authorization network PTP none Then under your multilink interface something like: ppp authorization PTP You may need the ppp authorization PTP under each PPP serial link, it's been a while. -- Robert Blayzor, BOFH INOC, LLC rblayzor\@(inoc.net|gmail.com) PGP: 0x66F90BFC @ http://pgp.mit.edu Key fingerprint = 6296 F715 038B 44C1 2720 292A 8580 500E 66F9 0BFC State-of-the-art: What we could do with enough money. -- Keith J. Madara 215-259-2100 Voicenet Network Operations [EMAIL PROTECTED] ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
