Re: CAM timeouts at startup

2017-04-10 Thread Mahlon E. Smith 
On Mon, Apr 10, 2017, Chris H wrote:
> 
> In the past, when I've run into this issue. I add the following to
> loader.conf(5)
> 
> kern.cam.boot_delay=""
> You'll want to tune it to find a "sweet spot".
> fe; on one of my boxes, it reads:
> kern.cam.boot_delay="7000"
> which is 7 seconds.

Heya Chris, thanks for the reply.

Trying it with the defaults from /boot/defaults/loader.conf doesn't seem
to help so far, but I'll keep seeing if there's a sweet spot to
discover.

--
Mahlon E. Smith  
http://www.martini.nu/


signature.asc
Description: PGP signature

Re: CAM timeouts at startup

2017-04-10 Thread Chris H 
On Mon, 10 Apr 2017 10:49:59 -0700 "Mahlon E. Smith"  wrote

> Hi.  Got some new machines running 11.0-RELEASE-p8 with a small pile of SSD
> in them. 
>
> Getting some strange CAM timeouts at boot, that dramatically delay
> startup times.  These errors don't happen at all after boot, everything
> seems just fine.
> 
> Any clues / tuning suggestions are appreciated.
> 
> 
> Relevant stuff from dmesg:
> 
> mpr0:  port 0x3000-0x30ff mem
> 0x9200-0x9200,0x91f0-0x91ff at device 0.0 numa-domain 0 on
> pci3 mpr0: IOCFacts  :
> MsgVersion: 0x205
> HeaderVersion: 0x2a00
> IOCNumber: 0
> IOCExceptions: 0x0
> MaxChainDepth: 128
> NumberOfPorts: 1
> RequestCredit: 9680
> ProductID: 0x2221
> IOCRequestFrameSize: 32
> MaxInitiators: 0
> MaxTargets: 544
> MaxSasExpanders: 125
> MaxEnclosures: 126
> HighPriorityCredit: 124
> MaxReplyDescriptorPostQueueDepth: 65504
> ReplyFrameSize: 32
> MaxVolumes: 0
> MaxDevHandle: 677
> MaxPersistentEntries: 240
> mpr0: Firmware: 13.00.00.00, Driver: 13.01.00.00-fbsd
> mpr0: IOCCapabilities:
> 7a85c stDisc> 
>
> da0 at mpr0 bus 0 scbus0 target 19 lun 0
> da0:  Fixed Direct Access SPC-4 SCSI device
> da0: Serial Number S2HTNX0H701448  
> da0: 1200.000MB/s transfers
> da0: Command Queueing enabled
> da0: 915715MB (1875385008 512 byte sectors)
> da0: quirks=0x8<4K>
> 
> 
> mpr0: Sending reset from mprsas_send_abort for target ID 19
> mpr0: Unfreezing devq for target ID 19
> (da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da0:mpr0:0:19:0): CAM status: Command timeout
> (da0:mpr0:0:19:0): Retrying command
> (da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da0:mpr0:0:19:0): CAM status: SCSI Status Error
> (da0:mpr0:0:19:0): SCSI status: Check Condition
> (da0:mpr0:0:19:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred) (da0:mpr0:0:19:0): Retrying command (per
> sense data) (noperiph:mpr0:0:4294967295:0): SMID 2 Aborting
> command 0xfe00026066c0 mpr0: Sending reset from mprsas_send_abort for
> target ID 20 mpr0: Unfreezing devq for target ID 20
> (da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da1:mpr0:0:20:0): CAM status: Command timeout
> (da1:mpr0:0:20:0): Retrying command
> (da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da1:mpr0:0:20:0): CAM status: SCSI Status Error
> (da1:mpr0:0:20:0): SCSI status: Check Condition
> (da1:mpr0:0:20:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred) (da1:mpr0:0:20:0): Retrying command (per
> sense data) (noperiph:mpr0:0:4294967295:0): SMID 3 Aborting
> command 0xfe0002609750 mpr0: Sending reset from mprsas_send_abort for
> target ID 21 (da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01
> 00  mpr0: (da2:mpr0:0:21:0): CAM status: Command timeout
> Unfreezing devq for target ID 21
> (da2:mpr0:0:21:0): Retrying command
> (da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da2:mpr0:0:21:0): CAM status: SCSI Status Error
> (da2:mpr0:0:21:0): SCSI status: Check Condition
> (da2:mpr0:0:21:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred) (da2:mpr0:0:21:0): Retrying command (per
> sense data) (noperiph:mpr0:0:4294967295:0): SMID 4 Aborting
> command 0xfe000260c7e0 mpr0: Sending reset from mprsas_send_abort for
> target ID 22 mpr0: Unfreezing devq for target ID 22
> (da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da3:mpr0:0:22:0): CAM status: Command timeout
> (da3:mpr0:0:22:0): Retrying command
> (da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da3:mpr0:0:22:0): CAM status: SCSI Status Error
> (da3:mpr0:0:22:0): SCSI status: Check Condition
> (da3:mpr0:0:22:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset,
> or bus device reset occurred) (da3:mpr0:0:22:0): Retrying command (per
> sense data) (noperiph:mpr0:0:4294967295:0): SMID 5 Aborting
> command 0xfe0002614f10 mpr0: Sending reset from mprsas_send_abort for
> target ID 25 mpr0: Unfreezing devq for target ID 25
> (da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da6:mpr0:0:25:0): CAM status: Command timeout
> (da6:mpr0:0:25:0): Retrying command
> (da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
> (da6:mpr0:0:25:0): CAM status: SCSI Status Error
> (da6:mpr0:0:25:0): SCSI status: Check

CAM timeouts at startup

2017-04-10 Thread Mahlon E. Smith 

Hi.  Got some new machines running 11.0-RELEASE-p8 with a small pile of SSD in 
them.

Getting some strange CAM timeouts at boot, that dramatically delay
startup times.  These errors don't happen at all after boot, everything
seems just fine.

Any clues / tuning suggestions are appreciated.


Relevant stuff from dmesg:

mpr0:  port 0x3000-0x30ff mem 
0x9200-0x9200,0x91f0-0x91ff at device 0.0 numa-domain 0 on pci3
mpr0: IOCFacts  :
MsgVersion: 0x205
HeaderVersion: 0x2a00
IOCNumber: 0
IOCExceptions: 0x0
MaxChainDepth: 128
NumberOfPorts: 1
RequestCredit: 9680
ProductID: 0x2221
IOCRequestFrameSize: 32
MaxInitiators: 0
MaxTargets: 544
MaxSasExpanders: 125
MaxEnclosures: 126
HighPriorityCredit: 124
MaxReplyDescriptorPostQueueDepth: 65504
ReplyFrameSize: 32
MaxVolumes: 0
MaxDevHandle: 677
MaxPersistentEntries: 240
mpr0: Firmware: 13.00.00.00, Driver: 13.01.00.00-fbsd
mpr0: IOCCapabilities: 
7a85c

da0 at mpr0 bus 0 scbus0 target 19 lun 0
da0:  Fixed Direct Access SPC-4 SCSI device
da0: Serial Number S2HTNX0H701448  
da0: 1200.000MB/s transfers
da0: Command Queueing enabled
da0: 915715MB (1875385008 512 byte sectors)
da0: quirks=0x8<4K>


mpr0: Sending reset from mprsas_send_abort for target ID 19
mpr0: Unfreezing devq for target ID 19
(da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da0:mpr0:0:19:0): CAM status: Command timeout
(da0:mpr0:0:19:0): Retrying command
(da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da0:mpr0:0:19:0): CAM status: SCSI Status Error
(da0:mpr0:0:19:0): SCSI status: Check Condition
(da0:mpr0:0:19:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, 
reset, or bus device reset occurred)
(da0:mpr0:0:19:0): Retrying command (per sense data)
(noperiph:mpr0:0:4294967295:0): SMID 2 Aborting command 
0xfe00026066c0
mpr0: Sending reset from mprsas_send_abort for target ID 20
mpr0: Unfreezing devq for target ID 20
(da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da1:mpr0:0:20:0): CAM status: Command timeout
(da1:mpr0:0:20:0): Retrying command
(da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da1:mpr0:0:20:0): CAM status: SCSI Status Error
(da1:mpr0:0:20:0): SCSI status: Check Condition
(da1:mpr0:0:20:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, 
reset, or bus device reset occurred)
(da1:mpr0:0:20:0): Retrying command (per sense data)
(noperiph:mpr0:0:4294967295:0): SMID 3 Aborting command 
0xfe0002609750
mpr0: Sending reset from mprsas_send_abort for target ID 21
(da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
mpr0: (da2:mpr0:0:21:0): CAM status: Command timeout
Unfreezing devq for target ID 21
(da2:mpr0:0:21:0): Retrying command
(da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da2:mpr0:0:21:0): CAM status: SCSI Status Error
(da2:mpr0:0:21:0): SCSI status: Check Condition
(da2:mpr0:0:21:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, 
reset, or bus device reset occurred)
(da2:mpr0:0:21:0): Retrying command (per sense data)
(noperiph:mpr0:0:4294967295:0): SMID 4 Aborting command 
0xfe000260c7e0
mpr0: Sending reset from mprsas_send_abort for target ID 22
mpr0: Unfreezing devq for target ID 22
(da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da3:mpr0:0:22:0): CAM status: Command timeout
(da3:mpr0:0:22:0): Retrying command
(da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da3:mpr0:0:22:0): CAM status: SCSI Status Error
(da3:mpr0:0:22:0): SCSI status: Check Condition
(da3:mpr0:0:22:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, 
reset, or bus device reset occurred)
(da3:mpr0:0:22:0): Retrying command (per sense data)
(noperiph:mpr0:0:4294967295:0): SMID 5 Aborting command 
0xfe0002614f10
mpr0: Sending reset from mprsas_send_abort for target ID 25
mpr0: Unfreezing devq for target ID 25
(da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 
(da6:mpr0:0:25:0): CAM