hi,
On 2019/02/26 14:00, Nils Frohberg wrote:
> On Mon, Feb 25, 2019 at 03:50:48PM -0300, Martin Pieuchot wrote:
>> On 25/02/19(Mon) 14:52, Nils Frohberg wrote:
[snip]
>>> I didn't get around to much testing/debugging lately, therefore I
>>> wanted to share the current state (diff below).
>>>
>>> The current state works a lot better than previously (for me). I
>>> used to have a huge amount of ierrs (aprrox. 1 ierr per ipkt) and
>>> often no packets would be transferred at all (or stop being transferred
>>> after some time).
>>
>> Do you know why? What were the problems?
>
> I'm not 100% sure, since I did a lot of back and forth. It finally
> got better once I disabled EEE and lowered the watermark levels.
I run my axen + your [1-7]/7 patches on amd64 with ehci,
that is, on high-speed.
When I ping to another host, it drops 20-30% of receiving packets.
It looks like the txeof does its job but the rxeof is not called
when packets arrive.
(debug messages and tcpdump on another host says so).
I checked each difference of diffs and found out that the initial
bufsz value in attach causes the drops.
I reverted like as following diff, it works correctly without drops
even the BUFSZ of HS is lower than bufsz of qctrl of HS.
Thoughts?
--- sys/dev/usb/if_axenreg.h Sun Jun 16 00:48:48 2019
+++ sys/dev/usb/if_axenreg.h Sun Jun 16 00:49:24 2019
@@ -13,7 +13,7 @@
#define AXEN_MCAST_FILTER_SIZE 8
/* unit: KB */
#define AXEN_BUFSZ_LS 0x18
-#define AXEN_BUFSZ_HS 0x16
+#define AXEN_BUFSZ_HS 0x10
#define AXEN_BUFSZ_SS 0x12
#define AXEN_BUFSZ_MAX AXEN_BUFSZ_LS
--- sys/dev/usb/if_axen.c Wed Jun 12 12:52:01 2019
+++ sys/dev/usb/if_axen.c Sun Jun 16 00:50:08 2019
@@ -690,8 +695,10 @@ axen_attach(struct device *parent, struct device *self
* this will be updated once the link state changes
*/
switch (sc->axen_udev->speed) {
- case USB_SPEED_FULL:
case USB_SPEED_HIGH:
+ sc->axen_bufsz = AXEN_BUFSZ_HS * 1024;
+ break;
+ case USB_SPEED_FULL:
case USB_SPEED_SUPER:
/* linux adds 2 to the buffer size (why?) */
sc->axen_bufsz = (AXEN_BUFSZ_MAX + 2) * 1024;
>>> This box hosts backups (rsync and TimeMachine), so it gets its fair
>>> share of traffic. I could reduce the ierrs to ~2100 with 5d uptime,
>>> and the packets keep flowing:
>>>
>>> $ netstat -niI axen0
>>> Name Mtu Network Address Ipkts Ierrs Opkts Oerrs
>>> Colls
>>> axen0 1500 <Link> 94:c6:91:1f:85:a5 141199356 2099 112289969 0
>>> 0
>>> $ uptime
>>> 7:15PM up 5 days, 9:57, 3 users, load averages: 0.11, 0.13, 0.14
>>> $
>>>
>>> But there a still a few problems:
>>>
>>> 1) There are still ierrs. These happen when the rx path can't
>>> allocate mbufs (cf. diff below for DPRINTF):
>>> axen0: could not allocate rx mbuf (2 total, 2 remaining)
>>> axen0: could not allocate rx mbuf (3 total, 3 remaining)
>>> axen0: could not allocate rx mbuf (2 total, 2 remaining)
>>> axen0: could not allocate rx mbuf (1 total, 1 remaining)
>>
>> Look at the pools when this happen, what do you see? What is the size
>> of `pkt_len' when this happen?
>
> I added pkt_len to the DPRINTF so that I can check the relevant
> pools once I see this error.
>
>>> 2) If the adapter is plugged into a USB 3 port at boot, it will
>>> return 0x42 when aked for AXEN_PHYSICAL_LINK_STATUS, ie.
>>> (AXEN_EPHY_1000|AXEN_USB_HS). The adapter most often then simply
>>> doesn't receive packets. If I plug in the adapter after boot is
>>> complete, 0x44 is returned (AXEN_EPHY_1000|AXEN_USB_SS), as expected.
>>> I'm not sure if I'm still missing something in init (probably) or
>>> if this results from something higher in the stack (xhci?).
>>> (Didn't test USB 2 or lower.)
>>
>> Do you see any difference in 'usbdevs -vv' output during the two cases?
>
> Yes, high speed vs super speed and power draw:
>
> # Plugged in after boot:
>
> $ usbdevs -vv
> Controller /dev/usb0:
> addr 01: 8086:0000 Intel, xHCI root hub
> super speed, self powered, config 1, rev 1.00
> driver: uhub0
> port 01: 0001.02a0 power Rx.detect
> port 02: 0011.02a0 power Rx.detect
> port 03: 0000.0503 connect enabled recovery
> port 04: 0000.0503 connect enabled recovery
> port 05: 0000.02a0 power Rx.detect
> port 06: 0000.02a0 power Rx.detect
> port 07: 0000.02a0 power Rx.detect
> port 08: 0000.0103 connect enabled recovery
> port 09: 0000.02a0 power Rx.detect
> port 10: 0000.0203 connect enabled power U0
> port 11: 0000.0203 connect enabled power U0
> port 12: 0000.0203 connect enabled power U0
> port 13: 0000.02a0 power Rx.detect
> port 14: 0000.02a0 power Rx.detect
> port 15: 0000.02a0 power Rx.detect
> addr 04: 0bc2:ab44 Seagate, Backup+ Hub
> high speed, self powered, config 1, rev 48.85, iSerial 01CB7236B0N6
> driver: uhub2
> port 01: 0000.0100 power
> port 02: 0000.0100 power
> port 03: 0000.0100 power
> addr 05: 05e3:0610 GenesysLogic, USB2.0 Hub
> high speed, self powered, config 1, rev 92.16
> driver: uhub3
> port 01: 0000.0100 power
> port 02: 0000.0100 power
> port 03: 0000.0100 power
> port 04: 0000.0100 power
> addr 06: 8087:0aa7 Intel, product 0x0aa7
> full speed, self powered, config 1, rev 0.01
> driver: ugen0
> addr 07: 0bc2:ab45 Seagate, Backup+ Hub
> super speed, self powered, config 1, rev 48.85, iSerial 01CB7236B0N6
> driver: uhub4
> port 01: 0000.0203 connect enabled power U0
> port 02: 0000.02a0 power Rx.detect
> port 03: 0000.0203 connect enabled power U0
> addr 08: 0bc2:ab38 Seagate, Backup+ Hub BK
> super speed, self powered, config 1, rev 1.00, iSerial NA8TMK6F
> driver: umass0
> addr 09: 05e3:0612 GenesysLogic, USB3.0 Hub
> super speed, self powered, config 1, rev 92.16
> driver: uhub5
> port 01: 0000.02a0 power Rx.detect
> port 02: 0000.02a0 power Rx.detect
> port 03: 0000.02a0 power Rx.detect
> port 04: 0000.0203 connect enabled power U0
> addr 10: 1058:25a2 Western Digital, Elements 25A2
> super speed, power 224 mA, config 1, rev 10.14, iSerial
> 575854314131373838593538
> driver: umass1
> addr 11: 0b95:1790 ASIX Elec. Corp., AX88179
> super speed, power 124 mA, config 1, rev 1.00, iSerial 0000000000013F
> driver: axen0
> addr 12: 2109:0701 Intenso, External USB 3.0
> super speed, self powered, config 1, rev 3.07, iSerial 20130301005083
> driver: umass2
> $
>
> # Plugged in before boot:
>
> $ usbdevs -vv
> Controller /dev/usb0:
> addr 01: 8086:0000 Intel, xHCI root hub
> super speed, self powered, config 1, rev 1.00
> driver: uhub0
> port 01: 0001.02a0 power Rx.detect
> port 02: 0000.0503 connect enabled recovery
> port 03: 0000.0503 connect enabled recovery
> port 04: 0000.0503 connect enabled recovery
> port 05: 0000.02a0 power Rx.detect
> port 06: 0000.02a0 power Rx.detect
> port 07: 0000.02a0 power Rx.detect
> port 08: 0000.0103 connect enabled recovery
> port 09: 0000.02a0 power Rx.detect
> port 10: 0000.02a0 power Rx.detect
> port 11: 0000.0203 connect enabled power U0
> port 12: 0000.0203 connect enabled power U0
> port 13: 0000.02a0 power Rx.detect
> port 14: 0000.02a0 power Rx.detect
> port 15: 0000.02a0 power Rx.detect
> addr 04: 0b95:1790 ASIX Elec. Corp., AX88179
> high speed, power 248 mA, config 1, rev 1.00, iSerial 0000000000013F
> driver: axen0
> addr 05: 0bc2:ab44 Seagate, Backup+ Hub
> high speed, self powered, config 1, rev 48.85, iSerial 01CB7236B0N6
> driver: uhub2
> port 01: 0000.0100 power
> port 02: 0000.0100 power
> port 03: 0000.0100 power
> addr 06: 05e3:0610 GenesysLogic, USB2.0 Hub
> high speed, self powered, config 1, rev 92.16
> driver: uhub3
> port 01: 0000.0100 power
> port 02: 0000.0100 power
> port 03: 0000.0100 power
> port 04: 0000.0100 power
> addr 07: 8087:0aa7 Intel, product 0x0aa7
> full speed, self powered, config 1, rev 0.01
> driver: ugen0
> addr 08: 0bc2:ab45 Seagate, Backup+ Hub
> super speed, self powered, config 1, rev 48.85, iSerial 01CB7236B0N6
> driver: uhub4
> port 01: 0000.0203 connect enabled power U0
> port 02: 0000.02a0 power Rx.detect
> port 03: 0000.02b0 power Rx.detect
> addr 09: 0bc2:ab38 Seagate, Backup+ Hub BK
> super speed, self powered, config 1, rev 1.00, iSerial NA8TMK6F
> driver: umass0
> addr 10: 05e3:0612 GenesysLogic, USB3.0 Hub
> super speed, self powered, config 1, rev 92.16
> driver: uhub5
> port 01: 0000.02a0 power Rx.detect
> port 02: 0000.02a0 power Rx.detect
> port 03: 0000.02a0 power Rx.detect
> port 04: 0000.0203 connect enabled power U0
> addr 11: 1058:25a2 Western Digital, Elements 25A2
> super speed, power 224 mA, config 1, rev 10.14, iSerial
> 575854314131373838593538
> driver: umass1
> $
>
> Here's a dmesg:
>
> OpenBSD 6.4-current (AXEN_DEBUG) #58: Tue Feb 26 13:42:44 CET 2019
> bu...@build.tako.de:/usr/src/sys/arch/amd64/compile/AXEN_DEBUG
> real mem = 8415174656 (8025MB)
> avail mem = 8150171648 (7772MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 3.0 @ 0x79a9a000 (51 entries)
> bios0: vendor Intel Corp. version "AYAPLCEL.86A.0056.2018.0926.1100" date
> 09/26/2018
> bios0: Intel Corporation NUC6CAYH
> acpi0 at bios0: rev 2
> acpi0: sleep states S0 S3 S4 S5
> acpi0: tables DSDT FACP FPDT FIDT MCFG DBG2 DBGP HPET LPIT APIC NPKT PRAM
> WSMT SSDT SSDT SSDT SSDT SSDT SSDT SSDT UEFI BGRT TPM2 DMAR WDAT NHLT
> acpi0: wakeup devices SIO1(S3) HDAS(S3) XHC_(S4) XDCI(S4) BRCM(S0) PXSX(S4)
> RP01(S4) PXSX(S4) RP02(S4) PXSX(S4) RP03(S4) PXSX(S4) RP04(S4) PXSX(S4)
> RP05(S4) PXSX(S4) [...]
> acpitimer0 at acpi0: 3579545 Hz, 32 bits
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xe0000000, bus 0-255
> acpihpet0 at acpi0: 19200000 Hz
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Celeron(R) CPU J3455 @ 1.50GHz, 1496.67 MHz, 06-5c-09
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,SMEP,ERMS,MPX,RDSEED,SMAP,CLFLUSHOPT,PT,SHA,IBRS,IBPB,STIBP,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
> cpu0: 1MB 64b/line 16-way L2 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> cpu0: apic clock running at 19MHz
> cpu0: mwait min=64, max=64, C-substates=0.2.0.2.4.2.1.1, IBE
> cpu1 at mainbus0: apid 2 (application processor)
> cpu1: Intel(R) Celeron(R) CPU J3455 @ 1.50GHz, 1496.55 MHz, 06-5c-09
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,SMEP,ERMS,MPX,RDSEED,SMAP,CLFLUSHOPT,PT,SHA,IBRS,IBPB,STIBP,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
> cpu1: 1MB 64b/line 16-way L2 cache
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 4 (application processor)
> cpu2: Intel(R) Celeron(R) CPU J3455 @ 1.50GHz, 1496.55 MHz, 06-5c-09
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,SMEP,ERMS,MPX,RDSEED,SMAP,CLFLUSHOPT,PT,SHA,IBRS,IBPB,STIBP,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
> cpu2: 1MB 64b/line 16-way L2 cache
> cpu2: smt 0, core 2, package 0
> cpu3 at mainbus0: apid 6 (application processor)
> cpu3: Intel(R) Celeron(R) CPU J3455 @ 1.50GHz, 1496.55 MHz, 06-5c-09
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,SMEP,ERMS,MPX,RDSEED,SMAP,CLFLUSHOPT,PT,SHA,IBRS,IBPB,STIBP,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
> cpu3: 1MB 64b/line 16-way L2 cache
> cpu3: smt 0, core 3, package 0
> ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 20, 120 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus -1 (RP01)
> acpiprt2 at acpi0: bus -1 (RP02)
> acpiprt3 at acpi0: bus 1 (RP03)
> acpiprt4 at acpi0: bus 2 (RP04)
> acpiprt5 at acpi0: bus 3 (RP05)
> acpiprt6 at acpi0: bus -1 (RP06)
> acpiec0 at acpi0
> acpicpu0 at acpi0: C1(@1 halt!), PSS
> acpicpu1 at acpi0: C1(@1 halt!), PSS
> acpicpu2 at acpi0: C1(@1 halt!), PSS
> acpicpu3 at acpi0: C1(@1 halt!), PSS
> acpipwrres0 at acpi0: FN00, resource for FAN0
> acpitz0 at acpi0: critical temperature is 100 degC
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> acpibtn0 at acpi0: PWRB
> acpibtn1 at acpi0: SLPB
> "INT3452" at acpi0 not configured
> "INT3452" at acpi0 not configured
> "INT3452" at acpi0 not configured
> "INT3452" at acpi0 not configured
> "INT33A1" at acpi0 not configured
> "MSFT0101" at acpi0 not configured
> "PNP0C0B" at acpi0 not configured
> "PNP0C14" at acpi0 not configured
> acpivideo0 at acpi0: GFX0
> acpivout0 at acpivideo0: DD1F
> cpu0: Enhanced SpeedStep 1496 MHz: speeds: 1501, 1500, 1400, 1300, 1200,
> 1100, 1000, 900, 800 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel Apollo Lake Host" rev 0x0b
> inteldrm0 at pci0 dev 2 function 0 "Intel HD Graphics 500" rev 0x0b
> drm0 at inteldrm0
> inteldrm0: msi
> error: [drm:pid0:i915_firmware_load_error_print] *ERROR* failed to load
> firmware i915/bxt_dmc_ver1.bin (-22)
> error: [drm:pid0:i915_gem_init_hw] *ERROR* Failed to initialize GuC, error -8
> (ignored)
> inteldrm0: 1680x1050, 32bpp
> wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
> wsdisplay0: screen 1-5 added (std, vt100 emulation)
> azalia0 at pci0 dev 14 function 0 "Intel Apollo Lake HD Audio" rev 0x0b: msi
> azalia0: codecs: Realtek/0x0283, Intel/0x280a, using Realtek/0x0283
> audio0 at azalia0
> "Intel Apollo Lake TXE" rev 0x0b at pci0 dev 15 function 0 not configured
> ahci0 at pci0 dev 18 function 0 "Intel Apollo Lake AHCI" rev 0x0b: msi, AHCI
> 1.3.1
> ahci0: port 0: 6.0Gb/s
> ahci0: PHY offline on port 1
> scsibus1 at ahci0: 32 targets
> sd0 at scsibus1 targ 0 lun 0: <ATA, KINGSTON SA400S3, SBFK> SCSI3 0/direct
> fixed naa.50026b7682433dc5
> sd0: 114473MB, 512 bytes/sector, 234441648 sectors, thin
> ppb0 at pci0 dev 19 function 0 "Intel Apollo Lake PCIE" rev 0xfb: msi
> pci1 at ppb0 bus 1
> rtsx0 at pci1 dev 0 function 0 "Realtek RTS5229 Card Reader" rev 0x01: msi
> sdmmc0 at rtsx0: 4-bit, dma
> ppb1 at pci0 dev 19 function 1 "Intel Apollo Lake PCIE" rev 0xfb: msi
> pci2 at ppb1 bus 2
> iwm0 at pci2 dev 0 function 0 "Intel Dual Band Wireless-AC 3168" rev 0x10, msi
> ppb2 at pci0 dev 19 function 2 "Intel Apollo Lake PCIE" rev 0xfb: msi
> pci3 at ppb2 bus 3
> re0 at pci3 dev 0 function 0 "Realtek 8168" rev 0x15: RTL8168H/8111H
> (0x5400), msi, address 94:c6:91:1f:85:a5
> rgephy0 at re0 phy 7: RTL8251 PHY, rev. 0
> xhci0 at pci0 dev 21 function 0 "Intel Apollo Lake xHCI" rev 0x0b: msi, xHCI
> 1.0
> usb0 at xhci0: USB revision 3.0
> uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00
> addr 1
> "Intel Apollo Lake I2C" rev 0x0b at pci0 dev 22 function 0 not configured
> "Intel Apollo Lake HSUART" rev 0x0b at pci0 dev 24 function 0 not configured
> "Intel Apollo Lake SPI" rev 0x0b at pci0 dev 25 function 0 not configured
> "Intel Apollo Lake SPI" rev 0x0b at pci0 dev 25 function 1 not configured
> "Intel Apollo Lake SPI" rev 0x0b at pci0 dev 25 function 2 not configured
> pcib0 at pci0 dev 31 function 0 "Intel Apollo Lake LPC" rev 0x0b
> ichiic0 at pci0 dev 31 function 1 "Intel Apollo Lake SMBus" rev 0x0b: polling
> iic0 at ichiic0
> spdmem0 at iic0 addr 0x50: 4GB DDR3 SDRAM PC3-14200 SO-DIMM
> spdmem1 at iic0 addr 0x52: 4GB DDR3 SDRAM PC3-14200 SO-DIMM
> isa0 at pcib0
> isadma0 at isa0
> fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com0: probed fifo depth: 0 bytes
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pckbd0 at pckbc0 (kbd slot)
> wskbd0 at pckbd0: console keyboard, using wsdisplay0
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> vmm0 at mainbus0: VMX/EPT
> efifb at mainbus0 not configured
> fdc0: drive 0: unknown device type 0xf0
> uhub1 at uhub0 port 1 configuration 1 interface 0 "Mitsumi Electric Hub in
> Apple Extended USB Keyboard" rev 1.10/4.20 addr 2
> uhidev0 at uhub1 port 3 configuration 1 interface 0 "Mitsumi Electric Apple
> Extended USB Keyboard" rev 1.10/4.20 addr 3
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes, country code 13
> wskbd1 at ukbd0 mux 1
> wskbd1: connecting to wsdisplay0
> uhidev1 at uhub1 port 3 configuration 1 interface 1 "Mitsumi Electric Apple
> Extended USB Keyboard" rev 1.10/4.20 addr 3
> uhidev1: iclass 3/0, 3 report ids
> uhid0 at uhidev1 reportid 2: input=1, output=0, feature=0
> uhid1 at uhidev1 reportid 3: input=3, output=0, feature=0
> fdc0: drive 1: unknown device type 0xd0
> axen0 at uhub0 port 2 configuration 1 interface 0 "ASIX Elec. Corp. AX88179"
> rev 2.10/1.00 addr 4
> axen0: AX88179, address 94:c6:91:1f:85:a5
> rgephy1 at axen0 phy 3: RTL8169S/8110S/8211 PHY, rev. 5
> uhub2 at uhub0 port 3 configuration 1 interface 0 "Seagate Backup+ Hub" rev
> 2.10/48.85 addr 5
> uhub3 at uhub0 port 4 configuration 1 interface 0 "GenesysLogic USB2.0 Hub"
> rev 2.10/92.16 addr 6
> ugen0 at uhub0 port 8 "Intel product 0x0aa7" rev 2.00/0.01 addr 7
> uhub4 at uhub0 port 11 configuration 1 interface 0 "Seagate Backup+ Hub" rev
> 3.00/48.85 addr 8
> umass0 at uhub4 port 1 configuration 1 interface 0 "Seagate Backup+ Hub BK"
> rev 3.10/1.00 addr 9
> umass0: using SCSI over Bulk-Only
> scsibus2 at umass0: 2 targets, initiator 0
> sd1 at scsibus2 targ 1 lun 0: <Seagate, Backup+ Hub BK, D781> SCSI4 0/direct
> fixed
> sd1: 7630885MB, 512 bytes/sector, 15628053167 sectors
> uhub5 at uhub0 port 12 configuration 1 interface 0 "GenesysLogic USB3.0 Hub"
> rev 3.00/92.16 addr 10
> umass1 at uhub5 port 4 configuration 1 interface 0 "Western Digital Elements
> 25A2" rev 3.00/10.14 addr 11
> umass1: using SCSI over Bulk-Only
> scsibus3 at umass1: 2 targets, initiator 0
> sd2 at scsibus3 targ 1 lun 0: <WD, Elements 25A2, 1014> SCSI4 0/direct fixed
> serial.105825a2373838593538
> sd2: 1907697MB, 512 bytes/sector, 3906963456 sectors
> vscsi0 at root
> scsibus4 at vscsi0: 256 targets
> softraid0 at root
> scsibus5 at softraid0: 256 targets
> sd3 at scsibus5 targ 1 lun 0: <OPENBSD, SR CRYPTO, 006> SCSI2 0/direct fixed
> sd3: 107519MB, 512 bytes/sector, 220200432 sectors
> root on sd3a (b8ec0b353d2db63d.a) swap on sd3b dump on sd3b
> iwm0: hw rev 0x220, fw ver 22.361476.0, address 0c:54:15:d0:a3:95
> wskbd1: disconnecting from wsdisplay0
> wskbd1 detached
> ukbd0 detached
> uhidev0 detached
> uhid0 detached
> uhid1 detached
> uhidev1 detached
> uhidev0 at uhub1 port 3 configuration 1 interface 0 "Mitsumi Electric Apple
> Extended USB Keyboard" rev 1.10/4.20 addr 3
> uhidev0: iclass 3/1
> ukbd0 at uhidev0: 8 variable keys, 6 key codes, country code 13
> wskbd1 at ukbd0: console keyboard, using wsdisplay0
> uhidev1 at uhub1 port 3 configuration 1 interface 1 "Mitsumi Electric Apple
> Extended USB Keyboard" rev 1.10/4.20 addr 3
> uhidev1: iclass 3/0, 3 report ids
> uhid0 at uhidev1 reportid 2: input=1, output=0, feature=0
> uhid1 at uhidev1 reportid 3: input=3, output=0, feature=0
> sd4 at scsibus5 targ 2 lun 0: <OPENBSD, SR CRYPTO, 006> SCSI2 0/direct fixed
> sd4: 1907694MB, 512 bytes/sector, 3906959213 sectors
> sd5 at scsibus5 targ 3 lun 0: <OPENBSD, SR CRYPTO, 006> SCSI2 0/direct fixed
> sd5: 7630885MB, 512 bytes/sector, 15628052512 sectors
>
