> Let me know if you can confirm that interpretation of "sr0a"
Yes, "sr" == "softraid," but when I pulled the working config from my systems, I discovered that there's an unintuitive syntax that I had forgotten about, which is probeblty your missing piece. It looks like I actually set boot-device = "disk0" and boot-file = "sr0" (notice the omitted file and slice into), and the loader auto-selected "sr0:a/bsd" (no that's not a typo... "sr" + [softraid number] + ":" + [root slice on softraid dev] + "/bsd"). Give that a shot. That's jogging my memory about having to dig through source for the sparc64 loader to discover that very unintutive syntax. Here's my working config. > > ===PHYSICAL DISK PARTITION INFO=== > glasloc-obsd# disklabel -h /dev/rsd0c > # /dev/rsd0c: > [...] > 16 partitions: > # size offset fstype [fsize bsize cpg] > a: 931.5G 0 RAID > c: 931.5G 0 unused > glasloc-obsd# bioctl softraid0 > Volume Status Size Device > softraid0 0 Online 1000190238720 sd2 RAID1 > 0 Online 1000190238720 0:0.0 noencl <sd0a> > 1 Online 1000190238720 0:1.0 noencl <sd1a> > > ===SOFTRAID DISK PARTITION INFO=== > glasloc-obsd# disklabel -h /dev/rsd2c > # /dev/rsd2c: > [...] > 16 partitions: > # size offset fstype [fsize bsize cpg] > a: 1.0G 0 4.2BSD 2048 16384 12958 # / > b: 28.3G 2104515 swap # none > c: 931.5G 0 unused > d: 4.0G 61352235 4.2BSD 2048 16384 12958 # /tmp > e: 60.0G 69754230 4.2BSD 2048 16384 12958 # /var > f: 2.0G 195591375 4.2BSD 2048 16384 12958 # /usr > g: 1.0G 199800405 4.2BSD 2048 16384 12958 # /usr/X11R6 > h: 20.0G 201904920 4.2BSD 2048 16384 12958 # /usr/local > i: 2.0G 243850635 4.2BSD 2048 16384 12958 # /usr/src > j: 40.0G 248059665 4.2BSD 2048 16384 12958 # /usr/obj > k: 10.0G 331951095 4.2BSD 2048 16384 12958 # /usr/ports > l: 8.0G 352931985 4.2BSD 2048 16384 12958 # > /usr/xenocara > m: 755.2G 369719910 4.2BSD 8192 65536 52238 # /home > > ===OPENBOOT VARIABLES=== > glasloc-obsd# eeprom boot-device > boot-device=vdisk0 > glasloc-obsd# eeprom boot-file > boot-file=sr0 > > ===BOOT MESSAGES=== > T5140, No Keyboard > Copyright (c) 1998, 2012, Oracle and/or its affiliates. All rights reserved. > OpenBoot 4.33.6, <<OMITTED>> MB memory available, Serial #<<OMITTED>>. > Ethernet address <<OMITTED>>, Host ID: <<OMITTED>>. > > > > Boot device: disk0 File and args: sr0 > OpenBSD IEEE 1275 Bootblock 1.4 > >> OpenBSD BOOT 1.12 > ERROR: /iscsi-hba: No iscsi-network-bootpath property > sr0* > Booting sr0:a/bsd > <<OMITTED>> > <<OMITTED>> > [ using 1036112 bytes of bsd ELF symbol table ] > console is /virtual-devices@100/console@1 > Copyright (c) 1982, 1986, 1989, 1991, 1993 > The Regents of the University of California. All rights reserved. > Copyright (c) 1995-2019 OpenBSD. All rights reserved. https://www.OpenBSD.org > > OpenBSD 6.5 (GENERIC.MP) #0: Tue Jun 18 18:13:03 EDT 2019 On Sun, Jun 30, 2019 at 10:55 AM Chris Ross <cross+open...@distal.com> wrote: > > On Sun, Jun 30, 2019 at 01:34:53AM -0400, Gao-Mi Baohao wrote: > > "bioctl -c 1 -l sd2a,sd3a softraid0" > > > > ... And those were both set to slices of type "RAID" when you ran disklabel > > (which is needed for the loader to discover them) as opposed to type > > "4.2BSD" or such? > > I'm sure they were once, but I initialized the disks multiple times. > Booting it back up to verify now. Yup, both drives show: > > # disklabel sd2 > # /dev/rsd2c: > type: SCSI > [...] > total sectors: 286739329 > > 16 partitions: > # size offset fstype [fsize bsize cpg] > a: 286739328 0 RAID > c: 286739329 0 unused > # > > > If so, then I'm officially stumped. Running a virtually identical setup > > successfully on my T5140 and Blade 1000. Clearly I've missed something, > > but what that might be does not occur to me. > > :-/ > > So after experimenting yesterday, I think my dated recollection of "srN" > meaning "SCSI removable" caused me to presume it incorrect. I was trying > "sd2a/BSD" and "sd4a/bsd", but those give me unusual errors. If "srN" > instead means "soft RAID N", then "sr0a" is correct, and I hadn't originally > tried that. But, as noted, that gives me: > > {0} ok boot disk2 sr0a/bsd > Boot device: /pci@0/pci@0/pci@2/scsi@0/disk@2 File and args: sr0a/bsd > OpenBSD IEEE 1275 Bootblock 1.4 > >> OpenBSD BOOT 1.12 > ERROR: /iscsi-hba: No iscsi-network-bootpath property > Unknown device: sr0 > Cannot boot from softraid: Unknown error: code 19 > Program terminated > {0} ok > > So, maybe I should look at that error? Let me know if you can confirm > that interpretation of "sr0a", and if that's for sure what I should > be using with this raid across sd2a and sd3a. Thanks! > > - Chris