Hi Hans,
The drivers won't show up in command output of 'diskinfo' or 'format'.
Please refer to the attachment:
- ls /dev/dsk and /dev/rdsk reported broken sym links
- once I ran devfsadm -C, those broken links disappeared, then iostat -En
reported those drives as blkdev*
Thanks for your quick reply.
-- Youzhong
On Fri, Jun 17, 2016 at 12:49 PM, Hans Rosenfeld <[email protected]
> wrote:
> Hi,
>
> On Fri, Jun 17, 2016 at 12:01:18PM -0400, Youzhong Yang wrote:
> > Since NVMe driver has been in illumos for quite a while, so we decided to
> > get an evaluation unit and see how it goes. Here is what we got:
> >
> > Baseboad: Supermicro X10DRU-i+ (System SYS-2028U-TN24R4T+)
> > Memory: 768G
> > CPU: 2 x Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz, each with 16 physical
> > cores, 32 hyper-threaded cores
> > SATA SSDs: 2 x Intel DC S3100 1TB (SSDSC2KI010X601)
> > NVMe SSDs: 2 x Intel DC P3700 800GB (SSDPE2MD800G4)
> > NVMe SSDs: 22 x Intel DC P3600 400GB (SSDPE2ME400G4)
> > Ethernet: Ethernet Controller X710 for 10GbE SFP+
>
> > Attached are some files with information of the system such as prtconf,
> > nvme.conf etc. (we pulled out some drives, left only two INTEL DC 3100
> > SSDs, one Intel DC P3700, three Intel DC P3600 SSDs in place).
>
> > c2t1d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
> > Model: INTEL SSDPE2ME400G4 Revision: 8DV10171
> Serial No: CVMD50510009400FGN
> > Size: 400.09GB <400088457216 bytes>
> > Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
> > Illegal Request: 0 Predictive Failure Analysis: 0
> > c0t1d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
> > Model: INTEL SSDPE2MD800G4 Revision: 8DV10171
> Serial No: CVFT4222002Q800HGN
> > Size: 800.17GB <800166076416 bytes>
> > Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
> > Illegal Request: 0 Predictive Failure Analysis: 0
> > c1t1d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
> > Model: INTEL SSDPE2ME400G4 Revision: 8DV10171
> Serial No: CVMD5051000Z400FGN
> > Size: 400.09GB <400088457216 bytes>
> > Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
> > Illegal Request: 0 Predictive Failure Analysis: 0
> > c3t1d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
> > Model: INTEL SSDPE2ME400G4 Revision: 8DV10171
> Serial No: CVMD4450003A400FGN
> > Size: 400.09GB <400088457216 bytes>
> > Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
> > Illegal Request: 0 Predictive Failure Analysis: 0
>
> Looks like iostat -En shows the remaining 4 NVMe devices correctly. They
> also show up correctly in messages and prtconf.
>
> What did you do to check whether they "show up"? format(1M) or some
> other tool?
>
> Hans
>
> --
> %SYSTEM-F-ANARCHISM, The operating system has been overthrown
>
[root@batfs9995 /var/tmp]# ls -lL /dev/dsk /dev/rdsk >/dev/null
/dev/dsk/c0t1d0: No such file or directory
/dev/dsk/c0t1d0p0: No such file or directory
/dev/dsk/c0t1d0p1: No such file or directory
/dev/dsk/c0t1d0p2: No such file or directory
/dev/dsk/c0t1d0p3: No such file or directory
/dev/dsk/c0t1d0p4: No such file or directory
/dev/dsk/c0t1d0s0: No such file or directory
/dev/dsk/c0t1d0s1: No such file or directory
/dev/dsk/c0t1d0s10: No such file or directory
/dev/dsk/c0t1d0s11: No such file or directory
/dev/dsk/c0t1d0s12: No such file or directory
/dev/dsk/c0t1d0s13: No such file or directory
/dev/dsk/c0t1d0s14: No such file or directory
/dev/dsk/c0t1d0s15: No such file or directory
/dev/dsk/c0t1d0s2: No such file or directory
/dev/dsk/c0t1d0s3: No such file or directory
/dev/dsk/c0t1d0s4: No such file or directory
/dev/dsk/c0t1d0s5: No such file or directory
/dev/dsk/c0t1d0s6: No such file or directory
/dev/dsk/c0t1d0s8: No such file or directory
/dev/dsk/c0t1d0s9: No such file or directory
/dev/dsk/c1t1d0: No such file or directory
/dev/dsk/c1t1d0p0: No such file or directory
/dev/dsk/c1t1d0p1: No such file or directory
/dev/dsk/c1t1d0p2: No such file or directory
/dev/dsk/c1t1d0p3: No such file or directory
/dev/dsk/c1t1d0p4: No such file or directory
/dev/dsk/c1t1d0s0: No such file or directory
/dev/dsk/c1t1d0s1: No such file or directory
/dev/dsk/c1t1d0s10: No such file or directory
/dev/dsk/c1t1d0s11: No such file or directory
/dev/dsk/c1t1d0s12: No such file or directory
/dev/dsk/c1t1d0s13: No such file or directory
/dev/dsk/c1t1d0s14: No such file or directory
/dev/dsk/c1t1d0s15: No such file or directory
/dev/dsk/c1t1d0s2: No such file or directory
/dev/dsk/c1t1d0s3: No such file or directory
/dev/dsk/c1t1d0s4: No such file or directory
/dev/dsk/c1t1d0s5: No such file or directory
/dev/dsk/c1t1d0s6: No such file or directory
/dev/dsk/c1t1d0s8: No such file or directory
/dev/dsk/c1t1d0s9: No such file or directory
/dev/dsk/c2t1d0: No such file or directory
/dev/dsk/c2t1d0p0: No such file or directory
/dev/dsk/c2t1d0p1: No such file or directory
/dev/dsk/c2t1d0p2: No such file or directory
/dev/dsk/c2t1d0p3: No such file or directory
/dev/dsk/c2t1d0p4: No such file or directory
/dev/dsk/c2t1d0s0: No such file or directory
/dev/dsk/c2t1d0s1: No such file or directory
/dev/dsk/c2t1d0s10: No such file or directory
/dev/dsk/c2t1d0s11: No such file or directory
/dev/dsk/c2t1d0s12: No such file or directory
/dev/dsk/c2t1d0s13: No such file or directory
/dev/dsk/c2t1d0s14: No such file or directory
/dev/dsk/c2t1d0s15: No such file or directory
/dev/dsk/c2t1d0s2: No such file or directory
/dev/dsk/c2t1d0s3: No such file or directory
/dev/dsk/c2t1d0s4: No such file or directory
/dev/dsk/c2t1d0s5: No such file or directory
/dev/dsk/c2t1d0s6: No such file or directory
/dev/dsk/c2t1d0s8: No such file or directory
/dev/dsk/c2t1d0s9: No such file or directory
/dev/dsk/c3t1d0: No such file or directory
/dev/dsk/c3t1d0p0: No such file or directory
/dev/dsk/c3t1d0p1: No such file or directory
/dev/dsk/c3t1d0p2: No such file or directory
/dev/dsk/c3t1d0p3: No such file or directory
/dev/dsk/c3t1d0p4: No such file or directory
/dev/dsk/c3t1d0s0: No such file or directory
/dev/dsk/c3t1d0s1: No such file or directory
/dev/dsk/c3t1d0s10: No such file or directory
/dev/dsk/c3t1d0s11: No such file or directory
/dev/dsk/c3t1d0s12: No such file or directory
/dev/dsk/c3t1d0s13: No such file or directory
/dev/dsk/c3t1d0s14: No such file or directory
/dev/dsk/c3t1d0s15: No such file or directory
/dev/dsk/c3t1d0s2: No such file or directory
/dev/dsk/c3t1d0s3: No such file or directory
/dev/dsk/c3t1d0s4: No such file or directory
/dev/dsk/c3t1d0s5: No such file or directory
/dev/dsk/c3t1d0s6: No such file or directory
/dev/dsk/c3t1d0s8: No such file or directory
/dev/dsk/c3t1d0s9: No such file or directory
/dev/rdsk/c0t1d0: No such file or directory
/dev/rdsk/c0t1d0p0: No such file or directory
/dev/rdsk/c0t1d0p1: No such file or directory
/dev/rdsk/c0t1d0p2: No such file or directory
/dev/rdsk/c0t1d0p3: No such file or directory
/dev/rdsk/c0t1d0p4: No such file or directory
/dev/rdsk/c0t1d0s0: No such file or directory
/dev/rdsk/c0t1d0s1: No such file or directory
/dev/rdsk/c0t1d0s10: No such file or directory
/dev/rdsk/c0t1d0s11: No such file or directory
/dev/rdsk/c0t1d0s12: No such file or directory
/dev/rdsk/c0t1d0s13: No such file or directory
/dev/rdsk/c0t1d0s14: No such file or directory
/dev/rdsk/c0t1d0s15: No such file or directory
/dev/rdsk/c0t1d0s2: No such file or directory
/dev/rdsk/c0t1d0s3: No such file or directory
/dev/rdsk/c0t1d0s4: No such file or directory
/dev/rdsk/c0t1d0s5: No such file or directory
/dev/rdsk/c0t1d0s6: No such file or directory
/dev/rdsk/c0t1d0s8: No such file or directory
/dev/rdsk/c0t1d0s9: No such file or directory
/dev/rdsk/c1t1d0: No such file or directory
/dev/rdsk/c1t1d0p0: No such file or directory
/dev/rdsk/c1t1d0p1: No such file or directory
/dev/rdsk/c1t1d0p2: No such file or directory
/dev/rdsk/c1t1d0p3: No such file or directory
/dev/rdsk/c1t1d0p4: No such file or directory
/dev/rdsk/c1t1d0s0: No such file or directory
/dev/rdsk/c1t1d0s1: No such file or directory
/dev/rdsk/c1t1d0s10: No such file or directory
/dev/rdsk/c1t1d0s11: No such file or directory
/dev/rdsk/c1t1d0s12: No such file or directory
/dev/rdsk/c1t1d0s13: No such file or directory
/dev/rdsk/c1t1d0s14: No such file or directory
/dev/rdsk/c1t1d0s15: No such file or directory
/dev/rdsk/c1t1d0s2: No such file or directory
/dev/rdsk/c1t1d0s3: No such file or directory
/dev/rdsk/c1t1d0s4: No such file or directory
/dev/rdsk/c1t1d0s5: No such file or directory
/dev/rdsk/c1t1d0s6: No such file or directory
/dev/rdsk/c1t1d0s8: No such file or directory
/dev/rdsk/c1t1d0s9: No such file or directory
/dev/rdsk/c2t1d0: No such file or directory
/dev/rdsk/c2t1d0p0: No such file or directory
/dev/rdsk/c2t1d0p1: No such file or directory
/dev/rdsk/c2t1d0p2: No such file or directory
/dev/rdsk/c2t1d0p3: No such file or directory
/dev/rdsk/c2t1d0p4: No such file or directory
/dev/rdsk/c2t1d0s0: No such file or directory
/dev/rdsk/c2t1d0s1: No such file or directory
/dev/rdsk/c2t1d0s10: No such file or directory
/dev/rdsk/c2t1d0s11: No such file or directory
/dev/rdsk/c2t1d0s12: No such file or directory
/dev/rdsk/c2t1d0s13: No such file or directory
/dev/rdsk/c2t1d0s14: No such file or directory
/dev/rdsk/c2t1d0s15: No such file or directory
/dev/rdsk/c2t1d0s2: No such file or directory
/dev/rdsk/c2t1d0s3: No such file or directory
/dev/rdsk/c2t1d0s4: No such file or directory
/dev/rdsk/c2t1d0s5: No such file or directory
/dev/rdsk/c2t1d0s6: No such file or directory
/dev/rdsk/c2t1d0s8: No such file or directory
/dev/rdsk/c2t1d0s9: No such file or directory
/dev/rdsk/c3t1d0: No such file or directory
/dev/rdsk/c3t1d0p0: No such file or directory
/dev/rdsk/c3t1d0p1: No such file or directory
/dev/rdsk/c3t1d0p2: No such file or directory
/dev/rdsk/c3t1d0p3: No such file or directory
/dev/rdsk/c3t1d0p4: No such file or directory
/dev/rdsk/c3t1d0s0: No such file or directory
/dev/rdsk/c3t1d0s1: No such file or directory
/dev/rdsk/c3t1d0s10: No such file or directory
/dev/rdsk/c3t1d0s11: No such file or directory
/dev/rdsk/c3t1d0s12: No such file or directory
/dev/rdsk/c3t1d0s13: No such file or directory
/dev/rdsk/c3t1d0s14: No such file or directory
/dev/rdsk/c3t1d0s15: No such file or directory
/dev/rdsk/c3t1d0s2: No such file or directory
/dev/rdsk/c3t1d0s3: No such file or directory
/dev/rdsk/c3t1d0s4: No such file or directory
/dev/rdsk/c3t1d0s5: No such file or directory
/dev/rdsk/c3t1d0s6: No such file or directory
/dev/rdsk/c3t1d0s8: No such file or directory
/dev/rdsk/c3t1d0s9: No such file or directory
[root@batfs9995 /var/tmp]# devfsadm -C
Could not open /etc/saf/zsmon/_pmtab
[root@batfs9995 /var/tmp]# ls /dev/dsk /dev/rdsk
/dev/dsk:
c4t0d0 c4t0d0s1 c4t0d0s2 c4t1d0 c4t1d0s1 c4t1d0s2 c5t0d0p0
c5t0d0s10 c5t0d0s3 c6t0d0p0 c6t0d0s10 c6t0d0s3
c4t0d0p0 c4t0d0s10 c4t0d0s3 c4t1d0p0 c4t1d0s10 c4t1d0s3 c5t0d0p1
c5t0d0s11 c5t0d0s4 c6t0d0p1 c6t0d0s11 c6t0d0s4
c4t0d0p1 c4t0d0s11 c4t0d0s4 c4t1d0p1 c4t1d0s11 c4t1d0s4 c5t0d0p2
c5t0d0s12 c5t0d0s5 c6t0d0p2 c6t0d0s12 c6t0d0s5
c4t0d0p2 c4t0d0s12 c4t0d0s5 c4t1d0p2 c4t1d0s12 c4t1d0s5 c5t0d0p3
c5t0d0s13 c5t0d0s6 c6t0d0p3 c6t0d0s13 c6t0d0s6
c4t0d0p3 c4t0d0s13 c4t0d0s6 c4t1d0p3 c4t1d0s13 c4t1d0s6 c5t0d0p4
c5t0d0s14 c5t0d0s7 c6t0d0p4 c6t0d0s14 c6t0d0s7
c4t0d0p4 c4t0d0s14 c4t0d0s8 c4t1d0p4 c4t1d0s14 c4t1d0s8 c5t0d0s0
c5t0d0s15 c5t0d0s8 c6t0d0s0 c6t0d0s15 c6t0d0s8
c4t0d0s0 c4t0d0s15 c4t0d0s9 c4t1d0s0 c4t1d0s15 c4t1d0s9 c5t0d0s1
c5t0d0s2 c5t0d0s9 c6t0d0s1 c6t0d0s2 c6t0d0s9
/dev/rdsk:
c4t0d0 c4t0d0s1 c4t0d0s2 c4t1d0 c4t1d0s1 c4t1d0s2 c5t0d0p0
c5t0d0s10 c5t0d0s3 c6t0d0p0 c6t0d0s10 c6t0d0s3
c4t0d0p0 c4t0d0s10 c4t0d0s3 c4t1d0p0 c4t1d0s10 c4t1d0s3 c5t0d0p1
c5t0d0s11 c5t0d0s4 c6t0d0p1 c6t0d0s11 c6t0d0s4
c4t0d0p1 c4t0d0s11 c4t0d0s4 c4t1d0p1 c4t1d0s11 c4t1d0s4 c5t0d0p2
c5t0d0s12 c5t0d0s5 c6t0d0p2 c6t0d0s12 c6t0d0s5
c4t0d0p2 c4t0d0s12 c4t0d0s5 c4t1d0p2 c4t1d0s12 c4t1d0s5 c5t0d0p3
c5t0d0s13 c5t0d0s6 c6t0d0p3 c6t0d0s13 c6t0d0s6
c4t0d0p3 c4t0d0s13 c4t0d0s6 c4t1d0p3 c4t1d0s13 c4t1d0s6 c5t0d0p4
c5t0d0s14 c5t0d0s7 c6t0d0p4 c6t0d0s14 c6t0d0s7
c4t0d0p4 c4t0d0s14 c4t0d0s8 c4t1d0p4 c4t1d0s14 c4t1d0s8 c5t0d0s0
c5t0d0s15 c5t0d0s8 c6t0d0s0 c6t0d0s15 c6t0d0s8
c4t0d0s0 c4t0d0s15 c4t0d0s9 c4t1d0s0 c4t1d0s15 c4t1d0s9 c5t0d0s1
c5t0d0s2 c5t0d0s9 c6t0d0s1 c6t0d0s2 c6t0d0s9
[root@batfs9995 /var/tmp]# iostat -En
blkdev0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Model: INTEL SSDPE2ME400G4 Revision: 8DV10171 Serial No:
CVMD50510009400FGN
Size: 400.09GB <400088457216 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
blkdev1 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Model: INTEL SSDPE2MD800G4 Revision: 8DV10171 Serial No:
CVFT4222002Q800HGN
Size: 800.17GB <800166076416 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
blkdev2 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Model: INTEL SSDPE2ME400G4 Revision: 8DV10171 Serial No:
CVMD5051000Z400FGN
Size: 400.09GB <400088457216 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
blkdev3 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Model: INTEL SSDPE2ME400G4 Revision: 8DV10171 Serial No:
CVMD4450003A400FGN
Size: 400.09GB <400088457216 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c5t0d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: Innodisk Product: USB Drive 3SE Revision: 1120 Serial No:
Size: 0.00GB <0 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 67 Predictive Failure Analysis: 0
c6t0d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: ATEN Product: Virtual CDROM Revision: YS0J Serial No:
Size: 0.00GB <0 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 0 Predictive Failure Analysis: 0
c4t0d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: ATA Product: INTEL SSDSC2KI01 Revision: G200 Serial No:
CVLT615602X01P0
Size: 1000.20GB <1000204886016 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 126 Predictive Failure Analysis: 0
c4t1d0 Soft Errors: 0 Hard Errors: 0 Transport Errors: 0
Vendor: ATA Product: INTEL SSDSC2KI01 Revision: G200 Serial No:
CVLT6156031L1P0
Size: 1000.20GB <1000204886016 bytes>
Media Error: 0 Device Not Ready: 0 No Device: 0 Recoverable: 0
Illegal Request: 126 Predictive Failure Analysis: 0
[root@batfs9995 /var/tmp]# diskinfo
TYPE DISK VID PID SIZE RMV SSD
UNKNOWN c4t0d0 INTEL SSDSC2KI010X6 931.51 GiB no yes
UNKNOWN c4t1d0 INTEL SSDSC2KI010X6 931.51 GiB no yes
USB c5t0d0 Innodisk USB Drive 3SE 3.87 GiB yes no
[root@batfs9995 /var/tmp]# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c4t0d0 <INTEL-SSDSC2KI010X6- LSDG200-931.51GB>
/pci@0,0/pci15d9,844@11,4/disk@0,0
1. c4t1d0 <INTEL-SSDSC2KI010X6- LSDG200-931.51GB>
/pci@0,0/pci15d9,844@11,4/disk@1,0
Specify disk (enter its number):
-------------------------------------------
smartos-discuss
Archives: https://www.listbox.com/member/archive/184463/=now
RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00
Modify Your Subscription:
https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb
Powered by Listbox: http://www.listbox.com