Hi Martin,
On 4/23/07, Martin Knoblauch <[EMAIL PROTECTED]> wrote:
Hi Jeff,
could you provide me with the output from:
ifconfig -a
[EMAIL PROTECTED] ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:15:C5:F7:CC:3E
inet addr:10.2.20.1 Bcast:10.2.255.255 Mask:255.255.0.0
inet6 addr: fe80::215:c5ff:fef7:cc3e/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Interrupt:11 Memory:f4000000-f4011100
eth1 Link encap:Ethernet HWaddr 00:15:C5:F7:CC:3C
inet addr:10.1.20.1 Bcast:10.1.255.255 Mask:255.255.0.0
inet6 addr: fe80::215:c5ff:fef7:cc3c/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:342639 errors:0 dropped:0 overruns:0 frame:0
TX packets:308482 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:106638990 (101.6 MiB) TX bytes:58555196 (55.8 MiB)
Interrupt:11 Memory:f8000000-f8011100
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:8233 errors:0 dropped:0 overruns:0 frame:0
TX packets:8233 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:519443 (507.2 KiB) TX bytes:519443 (507.2 KiB)
sit0 Link encap:IPv6-in-IPv4
NOARP MTU:1480 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
netstat -i
[EMAIL PROTECTED] ~]# netstat -i
Kernel Interface table
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR
TX-DRP TX-OVR Flg
eth0 1500 0 0 0 0 0 0 0
0 0 BMU
eth1 1500 0 342917 0 0 0 308663 0
0 0 BMRU
lo 16436 0 8233 0 0 0 8233 0
0 0 LRU
cat /proc/net/dev
[EMAIL PROTECTED] ~]# cat /proc/net/dev
Inter-| Receive | Transmit
face |bytes packets errs drop fifo frame compressed
multicast|bytes packets errs drop fifo colls carrier compressed
lo: 519443 8233 0 0 0 0 0 0
519443 8233 0 0 0 0 0 0
eth0: 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
eth1:106684548 343047 0 0 0 0 0 5
58638596 308777 0 0 0 0 0 0
sit0: 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
And what is "bnx"?
bnx2 is the "Broadcom NetXtreme II" kernel module...
[EMAIL PROTECTED] ~]# lsmod
Module Size Used by
ext3 137809 1
jbd 69105 1 ext3
md5 5696 1
ipv6 282913 18
nfs 245617 4
lockd 77809 2 nfs
nfs_acl 5185 1 nfs
sunrpc 175545 8 nfs,lockd,nfs_acl
dm_mirror 32465 0
dm_multipath 21841 0
dm_mod 68097 2 dm_mirror,dm_multipath
button 9057 0
battery 11209 0
ac 6729 0
uhci_hcd 34665 0
ehci_hcd 33605 0
hw_random 7137 0
bnx2 147253 0
mptfc 10825 0
sd_mod 19393 2
mptsas 11981 1
mptscsi 46161 2 mptfc,mptsas
mptbase 66721 3 mptfc,mptsas,mptscsi
scsi_mod 141457 4 mptfc,sd_mod,mptsas,mptscsi
Actually here is a node that just hit 15Pb...
[EMAIL PROTECTED] ~]# ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:15:C5:F7:BF:91
inet addr:10.2.20.58 Bcast:10.2.255.255 Mask:255.255.0.0
inet6 addr: fe80::215:c5ff:fef7:bf91/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Interrupt:11 Memory:f4000000-f4011100
eth1 Link encap:Ethernet HWaddr 00:15:C5:F7:BF:8F
inet addr:10.1.20.58 Bcast:10.1.255.255 Mask:255.255.0.0
inet6 addr: fe80::215:c5ff:fef7:bf8f/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:188716366 errors:0 dropped:0 overruns:0 frame:0
TX packets:188642352 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:185731878904 (172.9 GiB) TX bytes:186844509921 (174.0 GiB)
Interrupt:11 Memory:f8000000-f8011100
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:1449338 errors:0 dropped:0 overruns:0 frame:0
TX packets:1449338 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:7060168927 (6.5 GiB) TX bytes:7060168927 (6.5 GiB)
sit0 Link encap:IPv6-in-IPv4
NOARP MTU:1480 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
[EMAIL PROTECTED] ~]# netstat -i
Kernel Interface table
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR
TX-DRP TX-OVR Flg
eth0 1500 0 0 0 0 0 0 0
0 0 BMU
eth1 1500 0 189502450 0 0 0 189429065 0
0 0 BMRU
lo 16436 0 1455424 0 0 0 1455424 0
0 0 LRU
[EMAIL PROTECTED] ~]# cat /proc/net/dev
Inter-| Receive | Transmit
face |bytes packets errs drop fifo frame compressed
multicast|bytes packets errs drop fifo colls carrier compressed
lo:7124649735 1462180 0 0 0 0 0 0
7124649735 1462180 0 0 0 0 0 0
eth0: 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
eth1:187345338812 190354985 0 0 0 0 0
5 188470153159 190282320 0 0 0 0 0 0
sit0: 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
Thanks
Martin
--- Jeff Blasius <[EMAIL PROTECTED]> wrote:
> Hello Martin,
> Here is some more information regarding the setup. Thank You!
> -jeff
>
> 06:00.0 Ethernet controller: Broadcom Corporation NetXtreme II
> BCM5708S Gigabit Ethernet (rev 11)
> 0d:00.0 PCI bridge: Intel Corporation 6702PXH PCI Express-to-PCI
> Bridge A (rev 09)
>
> Linux c001 2.6.9-42.ELsmp #1 SMP Tue Aug 15 10:35:26 BST 2006 x86_64
> x86_64 x86_64 GNU/Linux
>
> Red Hat Enterprise Linux WS release 4 (Nahant Update 4)
>
> [EMAIL PROTECTED] ~]# dmesg |grep eth0
> divert: allocating divert_blk for eth0
> eth0: Broadcom NetXtreme II BCM5708 1000Base-SX (B1) PCI-X 64-bit
> 133MHz found at mem f4000000, IRQ 11, node addr 0015c5f7cc3e
> bnx2: eth0: using MSI
> eth0: no IPv6 routers present
> [EMAIL PROTECTED] ~]# dmesg |grep eth1
> divert: allocating divert_blk for eth1
> eth1: Broadcom NetXtreme II BCM5708 1000Base-SX (B1) PCI-X 64-bit
> 133MHz found at mem f8000000, IRQ 11, node addr 0015c5f7cc3c
> bnx2: eth1: using MSI
> bnx2: eth1 NIC Link is Up, 1000 Mbps full duplex
> eth1: no IPv6 routers present
>
>
> On 4/23/07, Martin Knoblauch <[EMAIL PROTECTED]> wrote:
> > Hi Jeff,
> >
> > what kind of nodes and networking? We have known problems with AIX
> and
> > Gigabit due to overruns in the byte_in/out code.
> >
> > Cheers
> > Martin
> > --- Jeff Blasius <[EMAIL PROTECTED]> wrote:
> >
> > > Hello!
> > > On one of our clusters, ganglia seems to be reporting erroneous
> > > network information.
> > > See:
> > > http://research.yale.edu/hpc/net.jpeg
> > > Notice the Pb range spikes? Unfortunately this happens randomly,
> at
> > > least once an hour, on single nodes, which makes any real network
> > > information from the cluster Network plot disappear.
> > >
> > > This is gmond/gmetad version 3.0.3-1, which is running just fine
> on
> > > most of the clusters in our grid. Any ideas? The only unique
> network
> > > setup here is that eth0 and eth1 are both up, but only eth1 has a
> > > connection to the switch.
> > >
> > > Thank You,
> > > jeff
> > >
> > > --
> > > Jeff Blasius / [EMAIL PROTECTED]
> > > Phone: (203)432-9940 51 Prospect Rm. 011
> > > High Performance Computing (HPC)
> > > UNIX Systems Administrator, WorkStation Support (WSS)
> > > Yale University Information Technology Services (ITS)
> > >
> > >
> >
>
-------------------------------------------------------------------------
> > > This SF.net email is sponsored by DB2 Express
> > > Download DB2 Express C - the FREE version of DB2 express and take
> > > control of your XML. No limits. Just data. Click to get it now.
> > > http://sourceforge.net/powerbar/db2/
> > > _______________________________________________
> > > Ganglia-general mailing list
> > > [email protected]
> > > https://lists.sourceforge.net/lists/listinfo/ganglia-general
> > >
> > >
> >
> >
> > ------------------------------------------------------
> > Martin Knoblauch
> > email: k n o b i AT knobisoft DOT de
> > www: http://www.knobisoft.de
> >
>
>
> --
> Jeff Blasius / [EMAIL PROTECTED]
> Phone: (203)432-9940 51 Prospect Rm. 011
> High Performance Computing (HPC)
> UNIX Systems Administrator, WorkStation Support (WSS)
> Yale University Information Technology Services (ITS)
>
>
------------------------------------------------------
Martin Knoblauch
email: k n o b i AT knobisoft DOT de
www: http://www.knobisoft.de
--
Jeff Blasius / [EMAIL PROTECTED]
Phone: (203)432-9940 51 Prospect Rm. 011
High Performance Computing (HPC)
UNIX Systems Administrator, WorkStation Support (WSS)
Yale University Information Technology Services (ITS)
