Hi all,
(2nd try - the first message didn't make it to the list, apparently)
I'm currently trying to get one of my SGI Indys to run as a diskless
music player. I'm using Debian Linux (Lenny) for that and the Indy is
supposed to be booting diskless off my OpenBSD file server (i.e. NFS
root file system).
After having figured out all the necessary parts (dhcpd set-up, tftpd
set-up, nfs set-up) I've got the Indy to boot - it gets its IP address,
finds its kernel via tftp and starts booting. However, as soon as it
starts doing something on its NFS root file system, I get tons of
"server not responding, still trying" messages on the Indy. After a long
time, the Indy will finally succeed in booting, but any further activity
on the root filesystem generates more errors.
On the file server, I cannot find any errors in the log files. However,
when the Indy is doing something, I can see the load going up without
any program in particular using CPU (what's that - interrupts?). At one
point it got that bad that the server hung completely and I was forced
to reboot. That server is running OpenBSD 4.5.
I've also noticed that things get better when I remount the nfsroot
on the Indy with an explicit "vers=3" (I think I read somewhere that the
default is NFSv2 when booting it that way) - after the remount, the
errors stop.
To investigate this further, I've set up a test server for the tftp and
nfsroot (dhcp is still done by the main server) running OpenBSD 4.6. I
did a basic install and all I configured was tftp and nfsd (no pf or any
other extras). Same result: Any activity on the Indy results in loads of
"server not responding" NFS errors and everything is very, very slow.
tcpdump on the connection reveals loads of this:
00:23:51.589956 00:04:75:98:2b:9d 08:00:69:09:88:d3 0800 1514:
192.168.1.2.2049 > 192.168.1.82.940: xid 0x0 reply ERR 1448 (DF) (ttl
64, id 33443, len 1500)
(.2 being the server and .82 the Indy) - but that doesn't tell me
much...
As I remembered having NFS trouble with 4.5 before (after I upgraded
the main server from 4.2), I installed OpenBSD 4.2 on the test server.
Same configuration (just tftp and nfsd) - and presto, the Indy boots
absolutely fine - no problems at all.
Apparently, something in NFS has changed between 4.2 and 4.5 (and
higher) - and I just cannot figure out what... Hence, I have no idea
what I would need to change nor what to investigate further. I've been
over the release notes and the only NFS related change that I noticed
was the addition of rpc.statd in 4.4 - could this have anything to do
with the problems I'm seeing?
Any hints would be much appreciated - especially RTFM pointers and/or
ideas for further investigaiton...
Thanks in advance,
Thomas
Server config:
/etc/exports:
/export/nfs -alldirs -maproot=root -network=192.168.1.64 -mask=255.255.255.192
/etc/rc.conf.local:
nfs_server=YES # see sysctl.conf for nfs client configuration
portmap=YES # Note: inetd(8) rpc services need portmap too
lockd=YES
dmesg of the test server (OpenBSD 4.6):
OpenBSD 4.6 (GENERIC) #58: Thu Jul 9 21:24:42 MDT 2009
dera...@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC
cpu0: Intel Pentium III ("GenuineIntel" 686-class) 1 GHz
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE
real mem = 536178688 (511MB)
avail mem = 509644800 (486MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 11/14/00, BIOS32 rev. 0 @ 0xfda74,
SMBIOS rev. 2.3 @ 0xf0ea0 (56 entries)
bios0: vendor Intel Corp. version "EA81510A.86A.0040.P09.0011141019"
date 11/14/2000
bios0: Intel Corporation D815EEA
apm0 at bios0: Power Management spec V1.2
apm0: AC on, battery charge unknown
acpi at bios0 function 0x0 not configured
pcibios0 at bios0: rev 2.1 @ 0xf0000/0x10000
pcibios0: PCI IRQ Routing Table rev 1.0 @ 0xf2f70/224 (12 entries)
pcibios0: PCI Interrupt Router at 000:31:0 ("Intel 82371FB ISA" rev
0x00)
pcibios0: PCI bus #2 is the last bus
bios0: ROM list: 0xc0000/0xb000 0xcb000/0x800
cpu0 at mainbus0: (uniprocessor)
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "Intel 82815 Host" rev 0x02
intelagp0 at pchb0
agp0 at intelagp0: aperture at 0xf8000000, size 0x2400000
ppb0 at pci0 dev 1 function 0 "Intel 82815 AGP" rev 0x02
pci1 at ppb0 bus 2
vga1 at pci1 dev 0 function 0 "NVIDIA Quadro" rev 0x10
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ppb1 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x02
pci2 at ppb1 bus 1
xl0 at pci2 dev 11 function 0 "3Com 3c905C 100Base-TX" rev 0x78: irq 9,
address 00:04:75:98:2b:9d
exphy0 at xl0 phy 24: 3Com internal media interface
ichpcib0 at pci0 dev 31 function 0 "Intel 82801BA LPC" rev 0x02: 24-bit
timer at 3579545Hz
pciide0 at pci0 dev 31 function 1 "Intel 82801BA IDE" rev 0x02: DMA,
channel 0 wired to compatibility, channel 1 wired to compatibility
wd0 at pciide0 channel 0 drive 0: <Maxtor 32049H3>
wd0: 16-sector PIO, LBA, 19541MB, 40021632 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
atapiscsi0 at pciide0 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <LG, CD-ROM CRD-8521B, 1.00> ATAPI 5/cdrom
removable
atapiscsi1 at pciide0 channel 1 drive 1
scsibus1 at atapiscsi1: 2 targets
cd1 at scsibus1 targ 0 lun 0: <PLEXTOR, CD-R PX-W1210A, 1.07> ATAPI
5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, DMA mode 2
cd1(pciide0:1:1): using PIO mode 4, DMA mode 2
uhci0 at pci0 dev 31 function 2 "Intel 82801BA USB" rev 0x02: irq 11
ichiic0 at pci0 dev 31 function 3 "Intel 82801BA SMBus" rev 0x02: irq 10
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 256MB SDRAM non-parity PC133CL3
spdmem1 at iic0 addr 0x51: 128MB SDRAM non-parity PC133CL2
spdmem2 at iic0 addr 0x52: 128MB SDRAM non-parity PC133CL3
uhci1 at pci0 dev 31 function 4 "Intel 82801BA USB" rev 0x02: irq 9
isa0 at ichpcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
usb0 at uhci0: USB revision 1.0
uhub0 at usb0 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb1 at uhci1: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
biomask ff65 netmask ff65 ttymask ffff
mtrr: Pentium Pro MTRR support
softraid0 at root
root on wd0a swap on wd0b dump on wd0b
--
-----------------------------------------------------------------------------
Thomas Ribbrock http://www.ribbrock.org
"You have to live on the edge of reality - to make your dreams come true!"
