Having myself a bit of a problem that the man pages haven't helped me
figure out. Running 4.3-RELEASE(amd64) with an Areca 1220 host
controller, I'm trying to bring a 5T RAID-5 array online (nothing but
samba storage, everything OS lives on sd0). In the dmesg, the
card+array show up thus when initialized using 64bit LBA:
arc0 at pci6 dev 14 function 0 "Areca ARC-1220" rev 0x00: irq 11
arc0: 8 ports, 256MB SDRAM, firmware V1.43 2007-4-17
scsibus1 at arc0: 16 targets
sd0 at scsibus1 targ 0 lun 0: <Areca, ARC-1220-VOL#00, R001> SCSI3
0/direct fixed
sd0: 305245MB, 54265 cyl, 24 head, 480 sec, 512 bytes/sec, 625141760 sec
total
sd1 at scsibus1 targ 0 lun 1: <Areca, ARC-1220-VOL#01, R001> SCSI3
0/direct fixed
sd1: 4769346MB, 74959 cyl, 511 head, 255 sec, 512 bytes/sec, 9767621120
sec total
Trying to fdisk, this is what I get:
# fdisk -e sd1
Enter 'help' for information
fdisk: 1> p
Disk: sd1 geometry: 608006/255/63 [1177686528 Sectors]
Offset: 0 Signature: 0x0
Starting Ending LBA Info:
#: id C H S - C H S [ start: size ]
-------------------------------------------------------------------------------
0: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
1: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
2: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
3: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
fdisk: 1> e 3
Starting Ending LBA Info:
#: id C H S - C H S [ start: size ]
-------------------------------------------------------------------------------
3: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
Partition id ('0' to disable) [0 - FF]: [0] (? for help) A6
Do you wish to edit in CHS mode? [n] y
BIOS Starting cylinder [0 - 608005]: [0]
BIOS Starting head [0 - 254]: [0]
BIOS Starting sector [1 - 63]: [1]
BIOS Ending cylinder [0 - 608005]: [267349] 608005
BIOS Ending head [0 - 254]: [89] 254
BIOS Ending sector [1 - 63]: [4] 63
fdisk:*1> p
Disk: sd1 geometry: 608006/255/63 [1177686528 Sectors]
Offset: 0 Signature: 0x0
Starting Ending LBA Info:
#: id C H S - C H S [ start: size ]
-------------------------------------------------------------------------------
0: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
1: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
2: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
3: A6 0 0 1 - 73307 76 55 [ 0: 1177681798 ] OpenBSD
fdisk:*1>
Clearly that's not right. Trying "fdisk -i sd1" results in an MBR that
starts at 0-1-1, but still ends at 73307-76-55. If I use 4k blocks
instead of 64bit LBA...
sd1 at scsibus1 targ 0 lun 1: <Areca, ARC-1220-VOL#01, R001> SCSI3
0/direct fixed
sd1: 4769346MB, 80750 cyl, 252 head, 60 sec, 4096 bytes/sec, 1220952640
sec total
# fdisk sd1
Disk: sd1 geometry: 80750/252/60 [1220952640 4096-byte Sectors]
Offset: 0 Signature: 0xAA55
Starting Ending LBA Info:
#: id C H S - C H S [ start: size ]
-------------------------------------------------------------------------------
0: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
1: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
2: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused
*3: A6 0 0 1 - 80749 251 60 [ 0: 1220940000 ] OpenBSD
So far, so good. But now disklabel+newfs cause problems...
# disklabel -E sd1
Initial label editor (enter '?' for help at any prompt)
> a d
offset: [0]
size: [1220952640] 900g
Rounding to cylinder: 235932480
FS type: [4.2BSD]
...
# size offset fstype [fsize bsize cpg]
c: 1220952640 0 unused 0 0
d: 235932480 0 4.2BSD 2048 16384 1
e: 235932480 235932480 4.2BSD 2048 16384 1
f: 235932480 471864960 4.2BSD 2048 16384 1
g: 235932480 707797440 4.2BSD 2048 16384 1
h: 235932480 943729920 4.2BSD 2048 16384 1
i: 41290240 1179662400 4.2BSD 2048 16384 1
> q
Write new label?: [y] y
# newfs sd1d
newfs: wtfs: write error on block 1887459839: Invalid argument
Since each individual slice is only 900g, I would have thought I'm
safely below the sector addressing limits of an FFS filesystem, and it
would have worked. Granted, I could split the array itself into three
sub-2T logical volumes, but I've noticed a very large performance hit
just on the initialization stage in doing so (5 hours for 64bit/4k,
nearly a day when split). Am I doing something wrong, or bashing up
against a subtle limitation of fdisk/disklabel/newfs somewhere? Full dmesg:
# dmesg
OpenBSD 4.3 (GENERIC) #1368: Wed Mar 12 11:05:31 MDT 2008
[EMAIL PROTECTED]:/usr/src/sys/arch/amd64/compile/GENERIC
real mem = 2145906688 (2046MB)
avail mem = 2072309760 (1976MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.2 @ 0xf0000 (39 entries)
bios0: vendor Phoenix Technologies, LTD version "6.00 PG" date 05/30/2006
bios0: http://www.abit.com.tw/ KN8 Series(NF-CK804)
acpi0 at bios0: rev 0
acpi0: tables DSDT FACP SSDT MCFG APIC
acpi0: wakeup devices HUB0(S5) XVR0(S5) XVR1(S5) XVR2(S5) XVR3(S5)
USB0(S3) USB2(S3) MMAC(S5) MMCI(S5) UAR1(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 1 (HUB0)
acpicpu0 at acpi0: PSS
acpitz0 at acpi0: critical temperature 100 degC
acpibtn0 at acpi0: PWRB
cpu0 at mainbus0: (uniprocessor)
cpu0: AMD Opteron(tm) Processor 154 , 2813.27 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,MMXX,FFXSR,L
ONG,3DNOW2,3DNOW
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB
64b/line 16-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: DTLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: AMD erratum 89 present, BIOS upgrade may be required
cpu0: Cool'n'Quiet K8 2813 MHz: speeds: 2800 2600 2400 2200 2000 1800
1000 MHz
pci0 at mainbus0 bus 0: configuration mode 1
"NVIDIA nForce4 DDR" rev 0xa3 at pci0 dev 0 function 0 not configured
pcib0 at pci0 dev 1 function 0 "NVIDIA nForce4 ISA" rev 0xa3
nviic0 at pci0 dev 1 function 1 "NVIDIA nForce4 SMBus" rev 0xa2
iic0 at nviic0
iic0: addr 0x2e 00=00 01=00 02=00 03=00 04=a1 05=07 06=00 07=00 words
00=00ff 01=00ff 02=00ff 03=00ff 04=a1ff 05=07ff 06=00f
f 07=00ff 08=ffff 09=ffff 0a=ffff 0b=ffff 0c=ffff 0d=ffff 0e=ffff 0f=ffff
spdmem0 at iic0 addr 0x50: 512MB DDR SDRAM non-parity PC3200CL3.0
spdmem1 at iic0 addr 0x51: 512MB DDR SDRAM non-parity PC3200CL3.0
spdmem2 at iic0 addr 0x52: 512MB DDR SDRAM non-parity PC3200CL3.0
spdmem3 at iic0 addr 0x53: 512MB DDR SDRAM non-parity PC3200CL3.0
iic1 at nviic0
ohci0 at pci0 dev 2 function 0 "NVIDIA nForce4 USB" rev 0xa2: irq 11,
version 1.0, legacy support
ehci0 at pci0 dev 2 function 1 "NVIDIA nForce4 USB" rev 0xa3: irq 3
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "NVIDIA EHCI root hub" rev 2.00/1.00 addr 1
pciide0 at pci0 dev 6 function 0 "NVIDIA nForce4 IDE" rev 0xf2: DMA,
channel 0 configured to compatibility, channel 1 config
ured to compatibility
atapiscsi0 at pciide0 channel 0 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <SONY, DVD-ROM DDU1615, GYS4> SCSI0
5/cdrom removable
cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 4
pciide0: channel 1 ignored (disabled)
ppb0 at pci0 dev 9 function 0 "NVIDIA nForce4 PCI-PCI" rev 0xa2
pci1 at ppb0 bus 1
vga1 at pci1 dev 6 function 0 "S3 ViRGE DX/GX" rev 0x01
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
nfe0 at pci0 dev 10 function 0 "NVIDIA CK804 LAN" rev 0xa3: irq 5,
address 00:50:8d:83:09:e7
ciphy0 at nfe0 phy 1: Cicada CS8201 10/100/1000TX PHY, rev. 3
ppb1 at pci0 dev 11 function 0 "NVIDIA nForce4 PCIE" rev 0xa3
pci2 at ppb1 bus 2
ppb2 at pci0 dev 12 function 0 "NVIDIA nForce4 PCIE" rev 0xa3
pci3 at ppb2 bus 3
ppb3 at pci0 dev 13 function 0 "NVIDIA nForce4 PCIE" rev 0xa3
pci4 at ppb3 bus 4
ppb4 at pci0 dev 14 function 0 "NVIDIA nForce4 PCIE" rev 0xa3
pci5 at ppb4 bus 5
ppb5 at pci5 dev 0 function 0 "Intel IOP333 PCIE-PCIX" rev 0x00
pci6 at ppb5 bus 6
arc0 at pci6 dev 14 function 0 "Areca ARC-1220" rev 0x00: irq 11
arc0: 8 ports, 256MB SDRAM, firmware V1.43 2007-4-17
scsibus1 at arc0: 16 targets
sd0 at scsibus1 targ 0 lun 0: <Areca, ARC-1220-VOL#00, R001> SCSI3
0/direct fixed
sd0: 305245MB, 54265 cyl, 24 head, 480 sec, 512 bytes/sec, 625141760 sec
total
sd1 at scsibus1 targ 0 lun 1: <Areca, ARC-1220-VOL#01, R001> SCSI3
0/direct fixed
sd1: 4769346MB, 80750 cyl, 252 head, 60 sec, 4096 bytes/sec, 1220952640
sec total
ppb6 at pci5 dev 0 function 2 "Intel IOP333 PCIE-PCIX" rev 0x00
pci7 at ppb6 bus 7
pchb0 at pci0 dev 24 function 0 "AMD AMD64 HyperTransport" rev 0x00
pchb1 at pci0 dev 24 function 1 "AMD AMD64 Address Map" rev 0x00
pchb2 at pci0 dev 24 function 2 "AMD AMD64 DRAM Cfg" rev 0x00
pchb3 at pci0 dev 24 function 3 "AMD AMD64 Misc Cfg" rev 0x00
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: W83627HF rev 0x41
lm1 at wbsio0 port 0x290/8: W83627HF
usb1 at ohci0: USB revision 1.0
uhub1 at usb1 "NVIDIA OHCI root hub" rev 1.00/1.00 addr 1
softraid0 at root
root on sd0a swap on sd0b dump on sd0b
