こんにちは、いつもお世話になっています、伊藤です。
HP社のML310というマシンに、FreeBSD 6.2-RELEASE(i386)をインストールしたのですが、 DISK I/O があまりにも遅くて困っています。 このマシンには、 HP Smart Array E200というRAIDコントローラが搭載されており、 その先に、SATAのHDD(WD1600JS 160GB,7200rpm)が2本ぶら下がっています。 この2本のHDDをRAID0+1で使用してます。 具体的なアクセス速度は、 # dd if=/dev/zero of=data.dat 115146240 bytes transferred in 8.883952 secs (12961150 bytes/sec) # dd if=/dev/zero of=data.dat bs=1024 117111808 bytes transferred in 8.938305 secs (13102239 bytes/sec) # dd if=/dev/zero of=data.dat bs=10240 107540480 bytes transferred in 8.403268 secs (12797459 bytes/sec) となっており、ddでの書き込み速度が、10MByte/s程度しか出ていません。 このRAIDカードは、FreeBSDからはcissドライバで認識されており、 これまでに、cissドライバを使うHP Smart Array は、5i, 6i,642 などいくつか 触ってきたのですが、いずれも50MByte/s以上は出ていました。 書き込みを行っている最中にiostatを取ってみると、 # iostat 1 tty da0 sa0 pass0 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 78 128.00 18 2.25 0.00 0 0.00 0.00 0 0.00 0 0 1 0 99 0 232 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 78 126.85 97 11.99 0.00 0 0.00 0.00 0 0.00 0 0 10 0 90 0 78 128.00 159 19.94 0.00 0 0.00 0.00 0 0.00 1 0 14 0 85 0 78 127.36 175 21.80 0.00 0 0.00 0.00 0 0.00 1 0 18 1 80 0 78 128.00 2 0.25 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 79 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 78 128.00 79 9.86 0.00 0 0.00 0.00 0 0.00 1 0 7 1 92 0 78 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 77 127.37 355 44.18 0.00 0 0.00 0.00 0 0.00 2 0 35 1 62 0 78 128.00 37 4.62 0.00 0 0.00 0.00 0 0.00 0 0 4 0 96 0 78 16.00 12 0.19 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 0 78 126.36 77 9.48 0.00 0 0.00 0.00 0 0.00 0 0 7 0 92 0 78 128.00 43 5.37 0.00 0 0.00 0.00 0 0.00 0 0 5 0 95 1 192 127.38 181 22.56 0.00 0 0.00 0.00 0 0.00 1 0 15 0 84 0 78 18.67 12 0.22 0.00 0 0.00 0.00 0 0.00 0 0 0 0 100 こんな感じで、瞬間的には40MByte/sとか出ているのですが、それが継続しない というか、書いて、止まって、書いて、止まってみたいな感じです。 試しに、KNOPPIX Linix で起動して同じことをしてみると、60MByte/s 程度は出てい たので、ハード的には、これぐらい出てもおかしくないと思っています。 2、3日前のCURRENTでも試してみましたが、結果は同じでした。 あまり、出会ったことの無い現象で、なにを調べれは良いのかよく分かりません。 こういった所をチェックした方がいいよとか、ここの辺りがダメなんじゃないとか、 なんでも結構ですので、気づいたことがあれば、教えて頂きたいと思います。 最後に、このマシンのdmesg, camcontrol, pciconf,dfを付けます。 #demsg Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-RELEASE #0: Fri Jan 12 11:05:30 UTC 2007 [メールアドレス保護]:/usr/obj/usr/src/sys/SMP Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Pentium(R) D CPU 3.40GHz (3400.14-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf65 Stepping = 5 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0xe49d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>,<b15>> AMD Features=0x20000000<LM> AMD Features2=0x1<LAHF> Cores per package: 2 real memory = 1073577984 (1023 MB) avail memory = 1041408000 (993 MB) ACPI APIC Table: <HP 00000083> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0 <Version 2.0> irqs 0-23 on motherboard ioapic1 <Version 2.0> irqs 24-47 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) acpi0: <HP W03> on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0 cpu0: <ACPI CPU> on acpi0 cpu1: <ACPI CPU> on acpi0 pcib0: <ACPI Host-PCI bridge> on acpi0 pci0: <ACPI PCI bus> on pcib0 pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0 pci9: <ACPI PCI bus> on pcib1 pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci9 pci10: <ACPI PCI bus> on pcib2 mpt0: <LSILogic 1030 Ultra4 Adapter> port 0x6000-0x60ff mem 0xfdfe0000-0xfdffffff,0xfdfc0000-0xfdfdffff irq 27 at device 4.0 on pci10 mpt0: [GIANT-LOCKED] mpt0: MPI Version=1.2.14.0 pcib3: <ACPI PCI-PCI bridge> at device 28.0 on pci0 pci2: <ACPI PCI bus> on pcib3 pcib4: <PCI-PCI bridge> at device 0.0 on pci2 pci3: <PCI bus> on pcib4 pcib5: <PCI-PCI bridge> at device 4.0 on pci3 pci4: <PCI bus> on pcib5 ciss0: <HP Smart Array E200> port 0x4000-0x40ff mem 0xfdc80000-0xfdcfffff,0xfdc70000-0xfdc77fff irq 16 at device 8.0 on pci3 ciss0: [GIANT-LOCKED] pcib6: <ACPI PCI-PCI bridge> at device 28.4 on pci0 pci5: <ACPI PCI bus> on pcib6 bge0: <Broadcom BCM5750 B1, ASIC rev. 0x4101> mem 0xfddf0000-0xfddfffff irq 16 at device 0.0 on pci5 miibus0: <MII bus> on bge0 brgphy0: <BCM5750 10/100/1000baseTX PHY> on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto bge0: Ethernet address: xx:xx:xx:xx:xx:xx pcib7: <ACPI PCI-PCI bridge> at device 28.5 on pci0 pci6: <ACPI PCI bus> on pcib7 em0: <Intel(R) PRO/1000 Network Connection Version - 6.2.9> port 0x5000-0x501f mem 0xfdee0000-0xfdefffff,0xfdec0000-0xfdedffff irq 17 at device 0.0 on pci6 em0: Ethernet address: xx:xx:xx:xx:xx:xx uhci0: <UHCI (generic) USB controller> port 0x1000-0x101f irq 21 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] usb0: <UHCI (generic) USB controller> on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1: <UHCI (generic) USB controller> port 0x1020-0x103f irq 21 at device 29.1 on pci0 uhci1: [GIANT-LOCKED] usb1: <UHCI (generic) USB controller> on uhci1 usb1: USB revision 1.0 uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhci2: <UHCI (generic) USB controller> port 0x1040-0x105f irq 21 at device 29.2 on pci0 uhci2: [GIANT-LOCKED] usb2: <UHCI (generic) USB controller> on uhci2 usb2: USB revision 1.0 uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered uhci3: <UHCI (generic) USB controller> port 0x1060-0x107f irq 21 at device 29.3 on pci0 uhci3: [GIANT-LOCKED] usb3: <UHCI (generic) USB controller> on uhci3 usb3: USB revision 1.0 uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub3: 2 ports with 2 removable, self powered ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xfd9f0000-0xfd9f03ff irq 21 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] usb4: waiting for BIOS to give up control usb4: EHCI version 1.0 usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 usb4: <Intel 82801GB/R (ICH7) USB 2.0 controller> on ehci0 usb4: USB revision 2.0 uhub4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1 uhub4: 8 ports with 8 removable, self powered pcib8: <ACPI PCI-PCI bridge> at device 30.0 on pci0 pci1: <ACPI PCI bus> on pcib8 pci1: <display, VGA> at device 3.0 (no driver attached) pci1: <base peripheral> at device 4.0 (no driver attached) pci1: <base peripheral> at device 4.2 (no driver attached) uhci4: <UHCI (generic) USB controller> port 0x3800-0x381f irq 23 at device 4.4 on pci1 uhci4: [GIANT-LOCKED] usb5: <UHCI (generic) USB controller> on uhci4 usb5: USB revision 1.0 uhub5: (0x103c) UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub5: 2 ports with 2 removable, self powered pci1: <serial bus> at device 4.6 (no driver attached) isab0: <PCI-ISA bridge> at device 31.0 on pci0 isa0: <ISA bus> on isab0 atapci0: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f at device 31.1 on pci0 ata0: <ATA channel 0> on atapci0 ata1: <ATA channel 1> on atapci0 atapci1: <Intel ICH7 SATA300 controller> port 0x1080-0x1087,0x1088-0x108b,0x1090-0x1097,0x1098-0x109b,0x10a0-0x10af mem 0xfd9e0000-0xfd9e03ff irq 20 at device 31.2 on pci0 ata2: <ATA channel 0> on atapci1 ata3: <ATA channel 1> on atapci1 acpi_tz0: <Thermal Zone> on acpi0 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A ppc0: <Standard parallel printer port> port 0x378-0x37f,0x778-0x77d irq 7 drq 4 on acpi0 ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode ppbus0: <Parallel port bus> on ppc0 plip0: <PLIP network interface> on ppbus0 lpt0: <Printer> on ppbus0 lpt0: Interrupt-driven port ppi0: <Parallel I/O> on ppbus0 pmtimer0 on isa0 orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xe6000-0xe7fff on isa0 sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1 at port 0x2f8-0x2ff irq 3 on isa0 sio1: type 16550A vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ukbd0: HP Virtual Keyboard, rev 1.10/0.02, addr 2, iclass 3/1 kbd2 at ukbd0 ums0: HP Virtual Keyboard, rev 1.10/0.02, addr 2, iclass 3/1 ums0: 3 buttons. uhub6: HP Virtual Hub, class 9/0, rev 1.10/0.01, addr 3 uhub6: 7 ports with 7 removable, self powered Timecounters tick every 1.000 msec acd0: CDRW <HL-DT-ST RW/DVD GCC-H20N/2.01> at ata0-master UDMA33 Waiting 5 seconds for SCSI devices to settle sa0 at mpt0 bus 0 target 3 lun 0 sa0: <HP C7438A ZP6B> Removable Sequential Access SCSI-3 device sa0: 160.000MB/s transfers (80.000MHz, offset 64, 16bit) da0 at ciss0 bus 0 target 0 lun 0 da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device da0: 135.168MB/s transfers da0: 152593MB (312511680 512 byte sectors: 255H 32S/T 38298C) SMP: AP CPU #1 Launched! Trying to mount root from ufs:/dev/da0s1a # camcontrol devlist -v scbus0 on mpt0 bus 0: <HP C7438A ZP6B> at scbus0 target 3 lun 0 (pass0,sa0) < > at scbus0 target -1 lun -1 () scbus1 on ciss0 bus 0: <COMPAQ RAID 1 VOLUME OK> at scbus1 target 0 lun 0 (pass1,da0) scbus2 on ciss0 bus 32: scbus-1 on xpt0 bus 0: < > at scbus-1 target -1 lun -1 (xpt0) # pciconf -l [メールアドレス保護]:0:0: class=0x060000 card=0x31f9103c chip=0x27788086 rev=0xc0 hdr=0x00 [メールアドレス保護]:1:0: class=0x060400 card=0x00000088 chip=0x27798086 rev=0xc0 hdr=0x01 [メールアドレス保護]:28:0: class=0x060400 card=0x00000040 chip=0x27d08086 rev=0x01 hdr=0x01 [メールアドレス保護]:28:4: class=0x060400 card=0x00000040 chip=0x27e08086 rev=0x01 hdr=0x01 [メールアドレス保護]:28:5: class=0x060400 card=0x00000040 chip=0x27e28086 rev=0x01 hdr=0x01 [メールアドレス保護]:29:0: class=0x0c0300 card=0x31fe103c chip=0x27c88086 rev=0x01 hdr=0x00 [メールアドレス保護]:29:1: class=0x0c0300 card=0x31fe103c chip=0x27c98086 rev=0x01 hdr=0x00 [メールアドレス保護]:29:2: class=0x0c0300 card=0x31fe103c chip=0x27ca8086 rev=0x01 hdr=0x00 [メールアドレス保護]:29:3: class=0x0c0300 card=0x31fe103c chip=0x27cb8086 rev=0x01 hdr=0x00 [メールアドレス保護]:29:7: class=0x0c0320 card=0x31fe103c chip=0x27cc8086 rev=0x01 hdr=0x00 [メールアドレス保護]:30:0: class=0x060401 card=0x00000050 chip=0x244e8086 rev=0xe1 hdr=0x01 [メールアドレス保護]:31:0: class=0x060100 card=0x00000000 chip=0x27b88086 rev=0x01 hdr=0x00 [メールアドレス保護]:31:1: class=0x01018a card=0x31fe103c chip=0x27df8086 rev=0x01 hdr=0x00 [メールアドレス保護]:31:2: class=0x01018f card=0x31fe103c chip=0x27c08086 rev=0x01 hdr=0x00 [メールアドレス保護]:0:0: class=0x060400 card=0x00000044 chip=0x032c8086 rev=0x09 hdr=0x01 [メールアドレス保護]:4:0: class=0x010000 card=0x3108103c chip=0x00301000 rev=0x07 hdr=0x00 [メールアドレス保護]:0:0: class=0x060400 card=0x00000060 chip=0x01031166 rev=0xb4 hdr=0x01 [メールアドレス保護]:4:0: class=0x060400 card=0x00000090 chip=0x01041166 rev=0xb2 hdr=0x01 [メールアドレス保護]:8:0: class=0x010400 card=0x3212103c chip=0x3238103c rev=0x00 hdr=0x00 [メールアドレス保護]:0:0: class=0x020000 card=0x7032103c chip=0x165914e4 rev=0x11 hdr=0x00 [メールアドレス保護]:0:0: class=0x020000 card=0x704a103c chip=0x10b98086 rev=0x06 hdr=0x00 [メールアドレス保護]:3:0: class=0x030000 card=0x31fb103c chip=0x515e1002 rev=0x02 hdr=0x00 [メールアドレス保護]:4:0: class=0x088000 card=0x3305103c chip=0xb2030e11 rev=0x03 hdr=0x00 [メールアドレス保護]:4:2: class=0x088000 card=0x3305103c chip=0xb2040e11 rev=0x03 hdr=0x00 [メールアドレス保護]:4:4: class=0x0c0300 card=0x3305103c chip=0x3300103c rev=0x00 hdr=0x00 [メールアドレス保護]:4:6: class=0x0c0701 card=0x3305103c chip=0x3302103c rev=0x00 hdr=0x00 # df Filesystem 1K-blocks Used Avail Capacity Mounted on /dev/da0s1a 10154158 59876 9281950 1% / devfs 1 1 0 100% /dev /dev/da0s1f 96495030 489188 88286240 1% /DATA /dev/da0s1d 20308398 940180 17743548 5% /usr /dev/da0s1e 20308398 1926 18681802 0% /var 以上