Here are the sh controller and sh proc results.
I'll send the config directly - too much to sanitize ...
Thanks!
Hardware is MV64460 Internal MAC (Revision MV64460-Ethernet)
network link is up
Config is 1Gbps, Full Duplex
Selected media-type is RJ45
GBIC is not present
Ethernet Unit Global Registers:
PHY Address = 0x00000820 SMI (PHY Control) = 0x0C001000
Default Address (Err) = 0xFE200000 Default ID (Err) = 0x000001D1
Interrupt Cause = 0x00000210 Interrupt Mask = 0x0000108E
Error Address = 0xD7FC6000 Internal Addr Error = 0x00000000
Port Pad Calibration = 0x0013000B Base Address 0 = 0xD7FC0002
Size (BA0) = 0x00030000 Base Address 1 = 0x38002E00
Size (BA1) = 0x03FF0000 Base Address 2 = 0x00000000
Size (BA2) = 0x00000000 Base Address 3 = 0x00000000
Size (BA3) = 0x00000000 Base Address 4 = 0x00000000
Size (BA4) = 0x00000000 Base Address 5 = 0x00000000
Size (BA5) = 0x00000000 Header Retarget Base = 0x00000000
Header Retarget Ctrl = 0x00000000 High Address Remap 0 = 0x00000000
High Address Remap 1 = 0x00000000 Base Address Enable = 0x0000003C
Port Access Protect 0 = 0x0000000F Port Access Protect 1 = 0x0000000F
Port Access Protect 2 = 0x0000000F
MAC Specific Registers:
Port Cfg PxC = 0x00000000 Port Cfg Extd PxCX = 0x00000000
MII Serial Params = 0x00218823 GMII Serial Params = 0x00000006
VLAN EtherType EVLANE = 0x00000000 MAC Addr Low MACAL = 0x0000091B
MAC Addr High MACAH = 0x001A6D30 SDMA Config SDC = 0x01002005
PORT SERIAL CTRL PSC = 0x00A2A60D PORT STATUS PS = 0x00001C16
TX Queue Cmd TQC = 0x00000000 TxQ Fixed Prio TQFPC = 0x00000001
MTU (Token-Bucket) MTU = 0x00000000 INTR CAUSE IC = 0x80000007
INTR CAUSE EXT ICE = 0x80000001 Intr Mask PIM = 0x00080804
Extend Intr Mask PEIM = 0x00000101 RXQ Desc Ptr 0 CRDP0 = 0xD7FC0F80
RX Queue Cmd RQC = 0x0003FE01 TXQ Desc Ptr 0 TCQDP0 = 0xD7FC1100
TX Curr Desc TCSDP = 0xD7FC1100
MAC Serial Port is ENABLED
MAC Autoneg Capability: [Speed] [Duplex] [Flow Control]
MAC Status: Link is UP, Speed is 1000Mbps, Duplex is Full, Interface: GMII
RX Queue [0] is ENABLED
PHY Registers:
PHY is Marvell 88E1146C (Rev D0), address 0x0
Control = 0x1000 Status = 0x796D
PHY ID 1 = 0x0141 PHY ID 2 =
0x0CD4
Auto Neg Advertisement = 0x0000 Link Partner Ability = 0xCDE1
Auto Neg Expansion = 0x000D Next Page Tx = 0x2001
Link Partner Next Page = 0x4773 1000BaseT Control = 0x0200
1000BaseT Status = 0x3C00 Extended Status = 0x3000
PHY Specific Control = 0x0008 PHY Specific Status = 0xAC00
Interrupt Enable = 0x6C00 Interrupt Status = 0x0000
Ext PHY Spec Control = 0x0CE2 Receive Error Counter = 0x0000
LED Control = 0x4101
Ext PHY Spec Control 2 = 0x000A Ext PHY Spec Status = 0x800B
PHY says Link is UP, Speed 1000Mbps, Full-Duplex [AUTONEG Done]
AUTONEG - Our ability is 1000M/FD
AUTONEG - Partner ability is 1000M/FD 1000M/HD 100M/FD 100M/HD 10M/FD 10M/HD
IDB Information:
lc_ip_turbo_fs = 0xAB7F4, ip_routecache = 0x11 (dfs = 0/mdfs = 0)
rx cache size = 1000, rx cache end = 849
max_mtu = 1528
Software MAC address filter(hash:length/addr/mask/hits):
need_af_check = 0
0x00: 0 ffff.ffff.ffff 0000.0000.0000 0
0x5B: 0 0100.5e00.0005 0000.0000.0000 0
0xC0: 0 0100.0ccc.cccc 0000.0000.0000 0
Internal Driver Information:
RX Ring base: 0xD7FC0000
TX Ring base: 0xD7FC1000
Software RX Head: 0xD7FC0F40
Hardware RX Head: 0xD7FC0800
Software TX Head: 0xD7FC1080
Hardware TX Head: 0xD7FC2F00
ring sizes: RX = 128, TX = 256
rx_particle_size: 512
rx_pak = 0x0444F908
rx_head = 122
rx_discard = FALSE
tx_head = 4, tx_count = 0
chip_state = 2, ds->tx_limited = 0
throttled = 0, enabled = 0, disabled = 11
reset=5(init=1, restart=4), auto_restart=6
tx_underflow = 0, tx_overflow = 0, tx_end_count = 51049471
rx_nobuffer = 0, rx_overrun = 0
rx_no_descriptors = 2115, rx_interrupt_count = 41996968
rx_crc_error = 0, rx_too_big = 0, rx_resource_error = 4629
rx_sop_eop_error = 0
tqc = 0xF1002448, cause = 0xF1002460, cause_ext = 0xF1002464
Address Filter:
Promiscuous mode OFF
(All other entries are empty)
Statistics:
Receive and Transmit Statistics:
RX Good Octets 45879122062 TX Good Octets 22423886055
RX Good Packets 58699012 TX Good Packets 52765087
RX Bad Octets 0
RX Bad Packets 0
RX Broadcast Packets 289 TX Broadcast Packets 25
RX Multicast Packets 3255 TX Multicast Packets 336
Error Statistics:
TX MAC Error 0
TX Excess Collisions 0
RX Bad MAC Ctrl Frame 0
RX Good Flow Control 0
RX Bad Flow Control 0
RX Undersize Paks 0
RX Oversize Paks 0
RX Fragments 0
RX Jabber Paks 0
RX MAC Error Events 0
RX Bad CRC Events 0
RX Collisions 0
RX Late Collisions 0
RX MAC Discard Frame 283215
RX MAC Overrun Frame 0
Total Packets (RX and TX), including errors:
0 -> 64 30696290
65 -> 127 22210681
128 -> 255 9294449
256 -> 511 4627758
512 -> 1023 6428675
1024 ->
max 38947325
lns3-Windsor>sh proc cpu sort | excl 0.00
CPU utilization for five seconds: 57%/51%; one minute: 59%; five minutes: 58%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
191 943061842068783944 45 1.80% 1.77% 1.79% 0 PPP Events
150 133733268 50856299 2629 1.06% 1.26% 1.21% 0 AAA
SEND STOP EV
58 3289317521961441484 167 0.65% 0.66% 0.65% 0 ATM OAM Input
84 167482244 113323165 1477 0.57% 0.62% 0.64% 0 CEF process
181 9657704-1355730504 0 0.32% 0.37% 0.35% 0 L2X
Data Daemon
80 40515732 130839022 309 0.24% 0.24% 0.24% 0 L2TP
mgmt daemon
203 35772716 92421692 387 0.24% 0.11% 0.12% 0 OSPF-1 Router
199 388871201904317329 20 0.16% 0.16% 0.16% 0 RADIUS
79 20652720 155060775 133 0.16% 0.12% 0.13% 0 L2X SSS manager
2 355544 10795823 32 0.08% 0.03% 0.02% 0 Load Meter
190 18684041721110574 1 0.08% 0.09% 0.08% 0 PPP manager
66 1206876561422016980 84 0.08% 0.22% 0.19% 0 IP Input
120 7097564 43773086 162 0.08% 0.03% 0.02% 0 PPP Bind
43 4238636 55478504 76 0.08% 0.08% 0.08% 0 Per-Second Jobs
16 198394500 979392997 202 0.08% 0.29% 0.14% 0 EnvMon
82 9579436 68673081 139 0.08% 0.02% 0.01% 0 IP Background
177 328704 541870926 0 0.08% 0.03% 0.02% 0 CCPROXY_CT
173 244061721459348569 16 0.08% 0.04% 0.06% 0 Net Input
73 21365328 131389120 162 0.08% 0.08% 0.08% 0 SSS Manager
62 12653484 48028054 263 0.08% 0.04% 0.06% 0 AAA
Server
186 19462048 591135940 32 0.08% 0.06% 0.09% 0 PPPoE
Background
At 02:43 PM 9/12/2008, Rodney Dunn wrote:
On Fri, Sep 12, 2008 at 02:40:04PM -0400, Clayton Zekelman wrote:
>
> No luck... didn't fix it. Is it fixed in a subsequent release? Are
> there any other parameters I can tune?
Not really because you can't tune the rx ring depth.
Check 'sh controller'.
What does 'sh proc cpu sort | excl 0.00' say?
Can you post the configuration..I'm curious what your features
look like because the more you have the less pps you get through
this box..it's all done in software and can't do all features at line
rate during a microburst.
sh int stat
Rodney
>
> GigabitEthernet0/1 is up, line protocol is up
> Hardware is MV64460 Internal MAC, address is 001a.6d30.091b (bia
> 001a.6d30.091b)
> Description: to gig-fastiron Ethernet11
> MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
> reliability 255/255, txload 23/255, rxload 48/255
> Encapsulation 802.1Q Virtual LAN, Vlan ID 1., loopback not set
> Keepalive set (10 sec)
> Full-duplex, 1000Mb/s, media type is RJ45
> output flow-control is XON, input flow-control is XON
> ARP type: ARPA, ARP Timeout 04:00:00
> Last input 00:00:00, output 00:00:00, output hang never
> Last clearing of "show interface" counters 00:10:09
> Input queue: 0/4096/533/0 (size/max/drops/flushes); Total output drops: 0
> Queueing strategy: fifo
> Output queue: 0/40 (size/max)
> 30 second input rate 189692000 bits/sec, 30246 packets/sec
> 30 second output rate 91448000 bits/sec, 27197 packets/sec
> 18432915 packets input, 1555851456 bytes, 0 no buffer
> Received 65 broadcasts, 0 runts, 0 giants, 0 throttles
> 1117 input errors, 0 CRC, 0 frame, 0 overrun, 1117 ignored
> 0 watchdog, 1034 multicast, 0 pause input
> 0 input packets with dribble condition detected
>
>
>
> At 02:16 PM 9/12/2008, Rodney Dunn wrote:
> >Can you bump up your input queue depth:
> >
> >hold-queue 4096 in
> >
> >and see if they stop.
> >
> >I don't suspect that is going to help because the ignores
> >are not increasing that would point to:
> >
> >CSCse05447
> >Externally found moderate defect: Resolved (R)
> >7200 ethernet interfaces should not throttle on input queue full drops
> >
> >Most likely you are seeing micro burst that are coming in faster
> >than the CPU can drain the rx ring.
> >
> >Rodney
> >
> >
> >
> >On Fri, Sep 12, 2008 at 12:50:29PM -0400, Clayton Zekelman wrote:
> >>
> >> I'm running a Cisco 7206/VXR with an NPE G2, Version 12.4(4)XD4
> >> acting as an LNS.
> >>
> >> I'm getting input errors consistently incrementing on the Gig
> >> interface (ignored errors)
> >>
> >> Any way to fix this? I saw some discussion a while back about this,
> >> and it seemed to have to do with buffers - but I can't find any
> >> definitive recommendations on what the settings should be.
> >>
> >>
> >>
> >> GigabitEthernet0/1 is up, line protocol is up
> >> Hardware is MV64460 Internal MAC, address is 001a.6d30.091b (bia
> >> 001a.6d30.091b)
> >> Description: to gig-fastiron Ethernet11
> >> MTU 1500 bytes, BW 1000000 Kbit, DLY 10 usec,
> >> reliability 255/255, txload 22/255, rxload 46/255
> >> Encapsulation 802.1Q Virtual LAN, Vlan ID 1., loopback not set
> >> Keepalive set (10 sec)
> >> Full-duplex, 1000Mb/s, media type is RJ45
> >> output flow-control is XON, input flow-control is XON
> >> ARP type: ARPA, ARP Timeout 04:00:00
> >> Last input 00:00:00, output 00:00:00, output hang never
> >> Last clearing of "show interface" counters 00:22:17
> >> Input queue: 0/75/1191/0 (size/max/drops/flushes); Total
output drops:
> >0
> >> Queueing strategy: fifo
> >> Output queue: 0/40 (size/max)
> >> 30 second input rate 181384000 bits/sec, 29001 packets/sec
> >> 30 second output rate 86319000 bits/sec, 26045 packets/sec
> >> 38605963 packets input, 4274358612 bytes, 1 no buffer
> >> Received 230 broadcasts, 0 runts, 0 giants, 0 throttles
> >> 2677 input errors, 0 CRC, 0 frame, 0 overrun, 2677 ignored
> >> 0 watchdog, 2196 multicast, 0 pause input
> >> 0 input packets with dribble condition detected
> >> 34556615 packets output, 1656923135 bytes, 0 underruns
> >> 0 output errors, 0 collisions, 0 interface resets
> >> 0 babbles, 0 late collision, 0 deferred
> >> 0 lost carrier, 0 no carrier, 0 pause output
> >> 0 output buffer failures, 0 output buffers swapped
> >> out
> >>
> >>
> >>
> >> ---
> >> Clayton Zekelman
> >> Managed Network Systems Inc. (MNSi)
> >> 344-300 Tecumseh Rd. E.
> >> Windsor, Ontario
> >> N8X 5E8
> >>
> >> tel. 519-985-8410
> >> fax. 519-985-8409
> >>
> >> _______________________________________________
> >> cisco-nsp mailing list [email protected]
> >> https://puck.nether.net/mailman/listinfo/cisco-nsp
> >> archive at http://puck.nether.net/pipermail/cisco-nsp/
>
> ---
> Clayton Zekelman
> Managed Network Systems Inc. (MNSi)
> 344-300 Tecumseh Rd. E.
> Windsor, Ontario
> N8X 5E8
>
> tel. 519-985-8410
> fax. 519-985-8409
---
Clayton Zekelman
Managed Network Systems Inc. (MNSi)
344-300 Tecumseh Rd. E.
Windsor, Ontario
N8X 5E8
tel. 519-985-8410
fax. 519-985-8409
_______________________________________________
cisco-nsp mailing list [email protected]
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/
