Re: Can't create > 1.5TB softraid partition.
Hi Christian, I'll will try as soon as I can. That's going to be early next year now as I accidentally messed with the wrong disk in the server and will now need to make a wee trip to the data center to reinstall obsd oops... Cheers Keith On 22/12/2011 23:05, Christian Weisgerber wrote: Keith wrote: I am having some trouble getting 4 x 2TB sata disks into one big single softraid (raid 5) disk. I can create the softraid0 disk and it's 5.5TB want would like to get a single 5.5TB partition but can only make one single 1.5TB partition! Can someone tell me where I'm going wrong. #fdisk -iy sd1 The MBR format is limited to a 32-bit number of sectors. Given 512-byte sectos, it cannot handle values larger than 2TB. However, this doesn't matter if you don't want to share the disk with other operating systems. In disklabel(8), simply set the OpenBSD disk boundaries 'b' to the real size '*'; see the man page. Here's the partition info I put on a 3TB disk: # fdisk sd1 Disk: sd1 geometry: 364801/255/63 [1565565872 Sectors] Offset: 0 Signature: 0xAA55 Starting Ending LBA Info: #: id C H S - C H S [ start:size ] --- 0: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 1: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 2: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused *3: A6 0 1 2 - 267349 89 3 [ 64: 4294967231 ] OpenBSD # disklabel sd1 # /dev/rsd1c: type: SCSI disk: SCSI disk label: Hitachi HUA72303 duid: aa3700ccfc518ee8 flags: bytes/sector: 512 sectors/track: 63 tracks/cylinder: 255 sectors/cylinder: 16065 cylinders: 364801 total sectors: 5860533168 boundstart: 64 boundend: 4294967295 drivedata: 0 16 partitions: #size offset fstype [fsize bsize cpg] c: 58605331680 unused d: 5860533056 64 4.2BSD 8192 655361 # /export
Re: Can't create > 1.5TB softraid partition.
On Fri, Dec 23, 2011 at 01:21:20PM +, keith wrote: > On 22/12/2011 21:36, Keith wrote: > >I am having some trouble getting 4 x 2TB sata disks into one big > >single softraid (raid 5) disk. I can create the softraid0 disk and > >it's 5.5TB want would like to get a single 5.5TB partition but can > >only make one single 1.5TB partition! Can someone tell me where > >I'm going wrong. > > > >Thanks > >Keith > > > >=== > > > >Start from fresh and delete softraid0 disk... > >#bioctl -d sd0 > > > >## Wipe the first part of the disks. > >#dd if=/dev/zero of=/dev/rwd0c bs=10m count=1 > >#dd if=/dev/zero of=/dev/rwd1c bs=10m count=1 > >#dd if=/dev/zero of=/dev/rwd2c bs=10m count=1 > >#dd if=/dev/zero of=/dev/rwd3c bs=10m count=1 > > > >#fdisk -iy wd0 > >#fdisk -iy wd1 > >#fdisk -iy wd2 > >#fdisk -iy wd3 > > > >## Make a partition of type RAID > >#printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd0 > >#printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd1 > >#printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd2 > >#printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd3 > > > >#bioctl -c 5 -l /dev/wd0a,/dev/wd1a,/dev/wd2a,/dev/wd3a softraid0 > > > >sd1 at scsibus3 targ 1 lun 0: SCSI2 > >0/direct fixed > >sd1: 5723178MB, 512 bytes/sector, 11721070080 sectors > > > >#dd if=/dev/zero of=/dev/rsd1c bs=1m count=1 > > > >#fdisk -iy sd1 > > > >This give me > > > ># fdisk -e sd1 > >Enter 'help' for information > >fdisk: 1> p > >Disk: sd1 geometry: 729602/255/63 [3131135488 Sectors] > >Offset: 0 Signature: 0xAA55 > >Starting Ending LBA Info: > > #: id C H S - C H S [ start:size ] > >--- > > > > 0: 00 0 0 0 - 0 0 0 [ 0: 0 > >] unused > > 1: 00 0 0 0 - 0 0 0 [ 0: 0 > >] unused > > 2: 00 0 0 0 - 0 0 0 [ 0: 0 > >] unused > >*3: A6 0 1 2 - 194903 76 55 [ 64: 3131121474 > >] OpenBSD > > > >Then I try and partition the disk. > > > ># disklabel -E sd1 > >Label editor (enter '?' for help at any prompt) > >> a a > >offset: [64] > >size: [3131121474] > >FS type: [4.2BSD] > >> p T > >OpenBSD area: 64-3131121538; size: 1.5T; free: 0.0T > >#size offset fstype [fsize bsize cpg] > > a: 1.5T 64 4.2BSD 8192 655361 > > c: 5.5T0 unused > >> > > > > > > It seems like an fdisk issue to me. If I just use one 2TB sata disk > and create the biggest partition I can using fdisk then I get a > 1.8TB partition. If I do the same on a softraid (raid 5) partition > using 4 of the 2TB disks the biggest partition I can make is just > 1.5TB but the actual softraid disk is apparently 5723178MB (5.4TB) > > I was trying to get some details from fdisk to put here but i've > just run "fdisk -i sd0" on the wrong disk and trashed the boot > disk I can't run the reboot command either as it just gives > "Segmentation fault". > > Keith As Christian Weisgerber (aka naddy) already told you, the original problem can be fixed using the 'b' command within disklabel. But now I'm afraid you trashed some vital info. Booting form another cd or hard disk can help you solve the probem of repairing the mbr partition map and boot info. man installboot contains some help. -Ott
Re: Can't create > 1.5TB softraid partition.
On Fri, Dec 23, 2011 at 09:05:08AM +0100, Martin Schr?der wrote: > 2011/12/23 Christian Weisgerber : > > The MBR format is limited to a 32-bit number of sectors. Given > > And then there was GPT. > > What's the state of GPT support in OpenBSD? > > Best >Martin > Non-existant. Ken
Re: Can't create > 1.5TB softraid partition.
On 22/12/2011 21:36, Keith wrote: I am having some trouble getting 4 x 2TB sata disks into one big single softraid (raid 5) disk. I can create the softraid0 disk and it's 5.5TB want would like to get a single 5.5TB partition but can only make one single 1.5TB partition! Can someone tell me where I'm going wrong. Thanks Keith === Start from fresh and delete softraid0 disk... #bioctl -d sd0 ## Wipe the first part of the disks. #dd if=/dev/zero of=/dev/rwd0c bs=10m count=1 #dd if=/dev/zero of=/dev/rwd1c bs=10m count=1 #dd if=/dev/zero of=/dev/rwd2c bs=10m count=1 #dd if=/dev/zero of=/dev/rwd3c bs=10m count=1 #fdisk -iy wd0 #fdisk -iy wd1 #fdisk -iy wd2 #fdisk -iy wd3 ## Make a partition of type RAID #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd0 #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd1 #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd2 #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd3 #bioctl -c 5 -l /dev/wd0a,/dev/wd1a,/dev/wd2a,/dev/wd3a softraid0 sd1 at scsibus3 targ 1 lun 0: SCSI2 0/direct fixed sd1: 5723178MB, 512 bytes/sector, 11721070080 sectors #dd if=/dev/zero of=/dev/rsd1c bs=1m count=1 #fdisk -iy sd1 This give me # fdisk -e sd1 Enter 'help' for information fdisk: 1> p Disk: sd1 geometry: 729602/255/63 [3131135488 Sectors] Offset: 0 Signature: 0xAA55 Starting Ending LBA Info: #: id C H S - C H S [ start:size ] --- 0: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 1: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 2: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused *3: A6 0 1 2 - 194903 76 55 [ 64: 3131121474 ] OpenBSD Then I try and partition the disk. # disklabel -E sd1 Label editor (enter '?' for help at any prompt) > a a offset: [64] size: [3131121474] FS type: [4.2BSD] > p T OpenBSD area: 64-3131121538; size: 1.5T; free: 0.0T #size offset fstype [fsize bsize cpg] a: 1.5T 64 4.2BSD 8192 655361 c: 5.5T0 unused > It seems like an fdisk issue to me. If I just use one 2TB sata disk and create the biggest partition I can using fdisk then I get a 1.8TB partition. If I do the same on a softraid (raid 5) partition using 4 of the 2TB disks the biggest partition I can make is just 1.5TB but the actual softraid disk is apparently 5723178MB (5.4TB) I was trying to get some details from fdisk to put here but i've just run "fdisk -i sd0" on the wrong disk and trashed the boot disk I can't run the reboot command either as it just gives "Segmentation fault". Keith
Re: Can't create > 1.5TB softraid partition.
2011/12/23 Christian Weisgerber : > The MBR format is limited to a 32-bit number of sectors. Given And then there was GPT. What's the state of GPT support in OpenBSD? Best Martin
Re: Can't create > 1.5TB softraid partition.
Keith wrote: > I am having some trouble getting 4 x 2TB sata disks into one big single > softraid (raid 5) disk. I can create the softraid0 disk and it's 5.5TB > want would like to get a single 5.5TB partition but can only make one > single 1.5TB partition! Can someone tell me where I'm going wrong. > #fdisk -iy sd1 The MBR format is limited to a 32-bit number of sectors. Given 512-byte sectos, it cannot handle values larger than 2TB. However, this doesn't matter if you don't want to share the disk with other operating systems. In disklabel(8), simply set the OpenBSD disk boundaries 'b' to the real size '*'; see the man page. Here's the partition info I put on a 3TB disk: # fdisk sd1 Disk: sd1 geometry: 364801/255/63 [1565565872 Sectors] Offset: 0 Signature: 0xAA55 Starting Ending LBA Info: #: id C H S - C H S [ start:size ] --- 0: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 1: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 2: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused *3: A6 0 1 2 - 267349 89 3 [ 64: 4294967231 ] OpenBSD # disklabel sd1 # /dev/rsd1c: type: SCSI disk: SCSI disk label: Hitachi HUA72303 duid: aa3700ccfc518ee8 flags: bytes/sector: 512 sectors/track: 63 tracks/cylinder: 255 sectors/cylinder: 16065 cylinders: 364801 total sectors: 5860533168 boundstart: 64 boundend: 4294967295 drivedata: 0 16 partitions: #size offset fstype [fsize bsize cpg] c: 58605331680 unused d: 5860533056 64 4.2BSD 8192 655361 # /export -- Christian "naddy" Weisgerber na...@mips.inka.de
Re: Can't create > 1.5TB softraid partition.
Here's my DMESG OpenBSD 5.0 (GENERIC.MP) #63: Wed Aug 17 10:14:30 MDT 2011 dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP real mem = 2136576000 (2037MB) avail mem = 2065637376 (1969MB) mainbus0 at root bios0 at mainbus0: SMBIOS rev. 2.6 @ 0x7f79c000 (66 entries) bios0: vendor Dell Inc. version "1.6.4" date 03/03/2011 bios0: Dell Inc. PowerEdge R310 acpi0 at bios0: rev 2 acpi0: sleep states S0 S4 S5 acpi0: tables DSDT FACP APIC SPCR HPET DM__ MCFG WDAT SLIC ERST HEST BERT EINJ TCPA SSDT acpi0: wakeup devices PCI0(S5) USBA(S0) USBB(S0) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee0: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: Intel(R) Core(TM) i3 CPU 540 @ 3.07GHz, 3059.45 MHz cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,NXE,LONG cpu0: 256KB 64b/line 8-way L2 cache cpu0: apic clock running at 132MHz cpu1 at mainbus0: apid 4 (application processor) cpu1: Intel(R) Core(TM) i3 CPU 540 @ 3.07GHz, 3058.98 MHz cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,NXE,LONG cpu1: 256KB 64b/line 8-way L2 cache cpu2 at mainbus0: apid 1 (application processor) cpu2: Intel(R) Core(TM) i3 CPU 540 @ 3.07GHz, 3058.99 MHz cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,NXE,LONG cpu2: 256KB 64b/line 8-way L2 cache cpu3 at mainbus0: apid 5 (application processor) cpu3: Intel(R) Core(TM) i3 CPU 540 @ 3.07GHz, 3058.99 MHz cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT,NXE,LONG cpu3: 256KB 64b/line 8-way L2 cache ioapic0 at mainbus0: apid 0 pa 0xfec0, version 20, 24 pins acpihpet0 at acpi0: 14318179 Hz acpimcfg0 at acpi0 addr 0xe000, bus 0-255 acpiprt0 at acpi0: bus 0 (PCI0) acpiprt1 at acpi0: bus -1 (LYD0) acpiprt2 at acpi0: bus -1 (LYD2) acpiprt3 at acpi0: bus 4 (HVD0) acpiprt4 at acpi0: bus 5 (HVD2) acpiprt5 at acpi0: bus 3 (PEX0) acpiprt6 at acpi0: bus -1 (PEX2) acpiprt7 at acpi0: bus -1 (PEX3) acpiprt8 at acpi0: bus 2 (PEX4) acpiprt9 at acpi0: bus 1 (COMP) acpicpu0 at acpi0: C3, C1, PSS acpicpu1 at acpi0: C3, C1, PSS acpicpu2 at acpi0: C3, C1, PSS acpicpu3 at acpi0: C3, C1, PSS ipmi at mainbus0 not configured cpu0: Enhanced SpeedStep 3058 MHz: speeds: 3059, 2926, 2793, 2660, 2527, 2394, 2261, 2128, 1995, 1862, 1729, 1596, 1463, 1330, 1197 MHz pci0 at mainbus0 bus 0 pchb0 at pci0 dev 0 function 0 vendor "Intel", unknown product 0x0048 rev 0x18 ppb0 at pci0 dev 1 function 0 vendor "Intel", unknown product 0x0049 rev 0x18: msi pci1 at ppb0 bus 4 ohci0 at pci1 dev 0 function 0 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 16, version 1.0 ehci0 at pci1 dev 0 function 1 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 16 usb0 at ehci0: USB revision 2.0 uhub0 at usb0 "NetMos EHCI root hub" rev 2.00/1.00 addr 1 ohci1 at pci1 dev 0 function 2 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 17, version 1.0 ehci1 at pci1 dev 0 function 3 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 17 usb1 at ehci1: USB revision 2.0 uhub1 at usb1 "NetMos EHCI root hub" rev 2.00/1.00 addr 1 ohci2 at pci1 dev 0 function 4 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 18, version 1.0 ehci2 at pci1 dev 0 function 5 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 18 usb2 at ehci2: USB revision 2.0 uhub2 at usb2 "NetMos EHCI root hub" rev 2.00/1.00 addr 1 ohci3 at pci1 dev 0 function 6 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 19, version 1.0 ehci3 at pci1 dev 0 function 7 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 19 usb3 at ehci3: USB revision 2.0 uhub3 at usb3 "NetMos EHCI root hub" rev 2.00/1.00 addr 1 usb4 at ohci0: USB revision 1.0 uhub4 at usb4 "NetMos OHCI root hub" rev 1.00/1.00 addr 1 usb5 at ohci1: USB revision 1.0 uhub5 at usb5 "NetMos OHCI root hub" rev 1.00/1.00 addr 1 usb6 at ohci2: USB revision 1.0 uhub6 at usb6 "NetMos OHCI root hub" rev 1.00/1.00 addr 1 usb7 at ohci3: USB revision 1.0 uhub7 at usb7 "NetMos OHCI root hub" rev 1.00/1.00 addr 1 ppb1 at pci0 dev 6 function 0 vendor "Intel", unknown product 0x004b rev 0x18: msi pci2 at ppb1 bus 5 ohci4 at pci2 dev 0 function 0 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 16, version 1.0 ehci4 at pci2 dev 0 function 1 vendor "NetMos", unknown product 0x9990 rev 0x00: apic 0 int 16 usb8 at ehci4: USB revision 2.0 uhub8 at usb8 "NetMos EHCI root hub" rev 2.00/1.00
Can't create > 1.5TB softraid partition.
I am having some trouble getting 4 x 2TB sata disks into one big single softraid (raid 5) disk. I can create the softraid0 disk and it's 5.5TB want would like to get a single 5.5TB partition but can only make one single 1.5TB partition! Can someone tell me where I'm going wrong. Thanks Keith === Start from fresh and delete softraid0 disk... #bioctl -d sd0 ## Wipe the first part of the disks. #dd if=/dev/zero of=/dev/rwd0c bs=10m count=1 #dd if=/dev/zero of=/dev/rwd1c bs=10m count=1 #dd if=/dev/zero of=/dev/rwd2c bs=10m count=1 #dd if=/dev/zero of=/dev/rwd3c bs=10m count=1 #fdisk -iy wd0 #fdisk -iy wd1 #fdisk -iy wd2 #fdisk -iy wd3 ## Make a partition of type RAID #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd0 #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd1 #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd2 #printf "a\n\n\n\nRAID\nw\nq\n\n" | disklabel -E wd3 #bioctl -c 5 -l /dev/wd0a,/dev/wd1a,/dev/wd2a,/dev/wd3a softraid0 sd1 at scsibus3 targ 1 lun 0: SCSI2 0/direct fixed sd1: 5723178MB, 512 bytes/sector, 11721070080 sectors #dd if=/dev/zero of=/dev/rsd1c bs=1m count=1 #fdisk -iy sd1 This give me # fdisk -e sd1 Enter 'help' for information fdisk: 1> p Disk: sd1 geometry: 729602/255/63 [3131135488 Sectors] Offset: 0 Signature: 0xAA55 Starting Ending LBA Info: #: id C H S - C H S [ start:size ] --- 0: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 1: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused 2: 00 0 0 0 - 0 0 0 [ 0: 0 ] unused *3: A6 0 1 2 - 194903 76 55 [ 64: 3131121474 ] OpenBSD Then I try and partition the disk. # disklabel -E sd1 Label editor (enter '?' for help at any prompt) > a a offset: [64] size: [3131121474] FS type: [4.2BSD] > p T OpenBSD area: 64-3131121538; size: 1.5T; free: 0.0T #size offset fstype [fsize bsize cpg] a: 1.5T 64 4.2BSD 8192 655361 c: 5.5T0 unused
