こんにちは、いつもお世話になっています、伊藤です。
HP社のML310というマシンに、FreeBSD 6.2-RELEASE(i386)をインストールしたのですが、
DISK I/O があまりにも遅くて困っています。
このマシンには、 HP Smart Array E200というRAIDコントローラが搭載されており、
その先に、SATAのHDD(WD1600JS 160GB,7200rpm)が２本ぶら下がっています。
この２本のHDDをRAID0+1で使用してます。
具体的なアクセス速度は、
# dd if=/dev/zero of=data.dat
115146240 bytes transferred in 8.883952 secs (12961150 bytes/sec)
# dd if=/dev/zero of=data.dat bs=1024
117111808 bytes transferred in 8.938305 secs (13102239 bytes/sec)
# dd if=/dev/zero of=data.dat bs=10240
107540480 bytes transferred in 8.403268 secs (12797459 bytes/sec)
となっており、ddでの書き込み速度が、10MByte/s程度しか出ていません。
このRAIDカードは、FreeBSDからはcissドライバで認識されており、
これまでに、cissドライバを使うHP Smart Array は、5i, 6i,642 などいくつか
触ってきたのですが、いずれも50MByte/s以上は出ていました。
書き込みを行っている最中にiostatを取ってみると、
# iostat 1
tty da0 sa0 pass0 cpu
tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id
0 78 128.00 18 2.25 0.00 0 0.00 0.00 0 0.00 0 0 1 0 99
0 232 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100
0 78 126.85 97 11.99 0.00 0 0.00 0.00 0 0.00 0 0 10 0 90
0 78 128.00 159 19.94 0.00 0 0.00 0.00 0 0.00 1 0 14 0 85
0 78 127.36 175 21.80 0.00 0 0.00 0.00 0 0.00 1 0 18 1 80
0 78 128.00 2 0.25 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100
0 79 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0
100
0 78 128.00 79 9.86 0.00 0 0.00 0.00 0 0.00 1 0 7 1 92
0 78 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100
0 77 127.37 355 44.18 0.00 0 0.00 0.00 0 0.00 2 0 35 1 62
0 78 128.00 37 4.62 0.00 0 0.00 0.00 0 0.00 0 0 4 0 96
0 78 16.00 12 0.19 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100
0 78 126.36 77 9.48 0.00 0 0.00 0.00 0 0.00 0 0 7 0 92
0 78 128.00 43 5.37 0.00 0 0.00 0.00 0 0.00 0 0 5 0 95
1 192 127.38 181 22.56 0.00 0 0.00 0.00 0 0.00 1 0 15 0 84
0 78 18.67 12 0.22 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100
こんな感じで、瞬間的には40MByte/sとか出ているのですが、それが継続しない
というか、書いて、止まって、書いて、止まってみたいな感じです。
試しに、KNOPPIX Linix で起動して同じことをしてみると、60MByte/s 程度は出てい
たので、ハード的には、これぐらい出てもおかしくないと思っています。
２、３日前のCURRENTでも試してみましたが、結果は同じでした。
あまり、出会ったことの無い現象で、なにを調べれは良いのかよく分かりません。
こういった所をチェックした方がいいよとか、ここの辺りがダメなんじゃないとか、
なんでも結構ですので、気づいたことがあれば、教えて頂きたいと思います。
最後に、このマシンのdmesg, camcontrol, pciconf,dfを付けます。
#demsg
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 6.2-RELEASE #0: Fri Jan 12 11:05:30 UTC 2007
[メールアドレス保護]:/usr/obj/usr/src/sys/SMP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) D CPU 3.40GHz (3400.14-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf65 Stepping = 5
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0xe49d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>,<b15>>
AMD Features=0x20000000<LM>
AMD Features2=0x1<LAHF>
Cores per package: 2
real memory = 1073577984 (1023 MB)
avail memory = 1041408000 (993 MB)
ACPI APIC Table: <HP 00000083>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <HP W03> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci9: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci9
pci10: <ACPI PCI bus> on pcib2
mpt0: <LSILogic 1030 Ultra4 Adapter> port 0x6000-0x60ff mem
0xfdfe0000-0xfdffffff,0xfdfc0000-0xfdfdffff irq 27 at device
4.0 on pci10
mpt0: [GIANT-LOCKED]
mpt0: MPI Version=1.2.14.0
pcib3: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib3
pcib4: <PCI-PCI bridge> at device 0.0 on pci2
pci3: <PCI bus> on pcib4
pcib5: <PCI-PCI bridge> at device 4.0 on pci3
pci4: <PCI bus> on pcib5
ciss0: <HP Smart Array E200> port 0x4000-0x40ff mem
0xfdc80000-0xfdcfffff,0xfdc70000-0xfdc77fff irq 16 at device 8.0 on pci3
ciss0: [GIANT-LOCKED]
pcib6: <ACPI PCI-PCI bridge> at device 28.4 on pci0
pci5: <ACPI PCI bus> on pcib6
bge0: <Broadcom BCM5750 B1, ASIC rev. 0x4101> mem 0xfddf0000-0xfddfffff irq 16
at device 0.0 on pci5
miibus0: <MII bus> on bge0
brgphy0: <BCM5750 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX,
1000baseTX-FDX, auto
bge0: Ethernet address: xx:xx:xx:xx:xx:xx
pcib7: <ACPI PCI-PCI bridge> at device 28.5 on pci0
pci6: <ACPI PCI bus> on pcib7
em0: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x5000-0x501f
mem
0xfdee0000-0xfdefffff,0xfdec0000-0xfdedffff irq 17 at device 0.0 on pci6
em0: Ethernet address: xx:xx:xx:xx:xx:xx
uhci0: <UHCI (generic) USB controller> port 0x1000-0x101f irq 21 at device 29.0
on pci0
uhci0: [GIANT-LOCKED]
usb0: <UHCI (generic) USB controller> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <UHCI (generic) USB controller> port 0x1020-0x103f irq 21 at device 29.1
on pci0
uhci1: [GIANT-LOCKED]
usb1: <UHCI (generic) USB controller> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <UHCI (generic) USB controller> port 0x1040-0x105f irq 21 at device 29.2
on pci0
uhci2: [GIANT-LOCKED]
usb2: <UHCI (generic) USB controller> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3: <UHCI (generic) USB controller> port 0x1060-0x107f irq 21 at device 29.3
on pci0
uhci3: [GIANT-LOCKED]
usb3: <UHCI (generic) USB controller> on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xfd9f0000-0xfd9f03ff
irq 21 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
usb4: waiting for BIOS to give up control
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <Intel 82801GB/R (ICH7) USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
pcib8: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib8
pci1: <display, VGA> at device 3.0 (no driver attached)
pci1: <base peripheral> at device 4.0 (no driver attached)
pci1: <base peripheral> at device 4.2 (no driver attached)
uhci4: <UHCI (generic) USB controller> port 0x3800-0x381f irq 23 at device 4.4
on pci1
uhci4: [GIANT-LOCKED]
usb5: <UHCI (generic) USB controller> on uhci4
usb5: USB revision 1.0
uhub5: (0x103c) UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub5: 2 ports with 2 removable, self powered
pci1: <serial bus> at device 4.6 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH7 UDMA100 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
atapci1: <Intel ICH7 SATA300 controller> port
0x1080-0x1087,0x1088-0x108b,0x1090-0x1097,0x1098-0x109b,0x10a0-0x10af mem
0xfd9e0000-0xfd9e03ff irq 20 at device 31.2 on pci0
ata2: <ATA channel 0> on atapci1
ata3: <ATA channel 1> on atapci1
acpi_tz0: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
ppc0: <Standard parallel printer port> port 0x378-0x37f,0x778-0x77d irq 7 drq 4
on acpi0
ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xe6000-0xe7fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ukbd0: HP Virtual Keyboard, rev 1.10/0.02, addr 2, iclass 3/1
kbd2 at ukbd0
ums0: HP Virtual Keyboard, rev 1.10/0.02, addr 2, iclass 3/1
ums0: 3 buttons.
uhub6: HP Virtual Hub, class 9/0, rev 1.10/0.01, addr 3
uhub6: 7 ports with 7 removable, self powered
Timecounters tick every 1.000 msec
acd0: CDRW <HL-DT-ST RW/DVD GCC-H20N/2.01> at ata0-master UDMA33
Waiting 5 seconds for SCSI devices to settle
sa0 at mpt0 bus 0 target 3 lun 0
sa0: <HP C7438A ZP6B> Removable Sequential Access SCSI-3 device
sa0: 160.000MB/s transfers (80.000MHz, offset 64, 16bit)
da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device
da0: 135.168MB/s transfers
da0: 152593MB (312511680 512 byte sectors: 255H 32S/T 38298C)
SMP: AP CPU #1 Launched!
Trying to mount root from ufs:/dev/da0s1a
# camcontrol devlist -v
scbus0 on mpt0 bus 0:
<HP C7438A ZP6B> at scbus0 target 3 lun 0 (pass0,sa0)
< > at scbus0 target -1 lun -1 ()
scbus1 on ciss0 bus 0:
<COMPAQ RAID 1 VOLUME OK> at scbus1 target 0 lun 0 (pass1,da0)
scbus2 on ciss0 bus 32:
scbus-1 on xpt0 bus 0:
< > at scbus-1 target -1 lun -1 (xpt0)
# pciconf -l
[メールアドレス保護]:0:0:
class=0x060000 card=0x31f9103c chip=0x27788086 rev=0xc0 hdr=0x00
[メールアドレス保護]:1:0:
class=0x060400 card=0x00000088 chip=0x27798086 rev=0xc0 hdr=0x01
[メールアドレス保護]:28:0:
class=0x060400 card=0x00000040 chip=0x27d08086 rev=0x01 hdr=0x01
[メールアドレス保護]:28:4:
class=0x060400 card=0x00000040 chip=0x27e08086 rev=0x01 hdr=0x01
[メールアドレス保護]:28:5:
class=0x060400 card=0x00000040 chip=0x27e28086 rev=0x01 hdr=0x01
[メールアドレス保護]:29:0:
class=0x0c0300 card=0x31fe103c chip=0x27c88086 rev=0x01 hdr=0x00
[メールアドレス保護]:29:1:
class=0x0c0300 card=0x31fe103c chip=0x27c98086 rev=0x01 hdr=0x00
[メールアドレス保護]:29:2:
class=0x0c0300 card=0x31fe103c chip=0x27ca8086 rev=0x01 hdr=0x00
[メールアドレス保護]:29:3:
class=0x0c0300 card=0x31fe103c chip=0x27cb8086 rev=0x01 hdr=0x00
[メールアドレス保護]:29:7:
class=0x0c0320 card=0x31fe103c chip=0x27cc8086 rev=0x01 hdr=0x00
[メールアドレス保護]:30:0:
class=0x060401 card=0x00000050 chip=0x244e8086 rev=0xe1 hdr=0x01
[メールアドレス保護]:31:0:
class=0x060100 card=0x00000000 chip=0x27b88086 rev=0x01 hdr=0x00
[メールアドレス保護]:31:1:
class=0x01018a card=0x31fe103c chip=0x27df8086 rev=0x01 hdr=0x00
[メールアドレス保護]:31:2:
class=0x01018f card=0x31fe103c chip=0x27c08086 rev=0x01 hdr=0x00
[メールアドレス保護]:0:0:
class=0x060400 card=0x00000044 chip=0x032c8086 rev=0x09 hdr=0x01
[メールアドレス保護]:4:0:
class=0x010000 card=0x3108103c chip=0x00301000 rev=0x07 hdr=0x00
[メールアドレス保護]:0:0:
class=0x060400 card=0x00000060 chip=0x01031166 rev=0xb4 hdr=0x01
[メールアドレス保護]:4:0:
class=0x060400 card=0x00000090 chip=0x01041166 rev=0xb2 hdr=0x01
[メールアドレス保護]:8:0:
class=0x010400 card=0x3212103c chip=0x3238103c rev=0x00 hdr=0x00
[メールアドレス保護]:0:0:
class=0x020000 card=0x7032103c chip=0x165914e4 rev=0x11 hdr=0x00
[メールアドレス保護]:0:0:
class=0x020000 card=0x704a103c chip=0x10b98086 rev=0x06 hdr=0x00
[メールアドレス保護]:3:0:
class=0x030000 card=0x31fb103c chip=0x515e1002 rev=0x02 hdr=0x00
[メールアドレス保護]:4:0:
class=0x088000 card=0x3305103c chip=0xb2030e11 rev=0x03 hdr=0x00
[メールアドレス保護]:4:2:
class=0x088000 card=0x3305103c chip=0xb2040e11 rev=0x03 hdr=0x00
[メールアドレス保護]:4:4:
class=0x0c0300 card=0x3305103c chip=0x3300103c rev=0x00 hdr=0x00
[メールアドレス保護]:4:6:
class=0x0c0701 card=0x3305103c chip=0x3302103c rev=0x00 hdr=0x00
# df
Filesystem 1K-blocks Used Avail Capacity Mounted on
/dev/da0s1a 10154158 59876 9281950 1% /
devfs 1 1 0 100% /dev
/dev/da0s1f 96495030 489188 88286240 1% /DATA
/dev/da0s1d 20308398 940180 17743548 5% /usr
/dev/da0s1e 20308398 1926 18681802 0% /var
以上
