Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Brian Hechinger]

> On Mar 23, 2017, at 12:01, Dan McDonald  wrote:
> 
> 
>> On Mar 23, 2017, at 11:53 AM, Brian Hechinger  wrote:
>> 
>> Has the issue with the Samsung drives been fixed? I haven’t tried it lately, 
>> but the 950 Pros were hanging. Those are 1.2a devices though, so I don’t 
>> know if that matters.
>> 
>> Just worried that enabling 1.2 might result in crashy systems.
>> 
> 
> No idea, and "crashy systems" is why it's not turned on by default today.

Fix it, fix it, fix it, fix it, fix it, fix it!

> Thank you for the reality check!

Yay, I’m useful! :-D

-brian
___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Dan McDonald]

> On Mar 23, 2017, at 11:20 AM, Arne  
> wrote:
> 
> 
> Thanks for creating the updated ISO. I can now mount that disc to the IPMI's 
> virtual drive, which is a lot more convenient!
> "prtconf -v" and "prtconf -vp" also work fine now.

Good!

> Unfortunately I am unable to capture their output. I tried several ways:
> 
> a) Network. Problem: The OmniOS installer won't recognize my Intel X550 10G 
> network card.

We *have* support for X550.  ESPECIALLY in bloody. I wonder what happened?

> b) Serial-over-LAN. Problem: I can see everything including the OmniOS 
> installer bootloader, but afterwards serial output stops. There seems to be 
> no option to enable serial console output for the main installer!?

There is, but it involves interacting with Loader.  Menu option #5 on the 
loader screen can dink with that.  Basically, you have to boot OmniOS 
mentioning console-output on the command line.

> c) USB stick. Problem: How to identify the USB stick in the installer shell? 
> There is no "rmformat" to identify the device. "ls -l /dev/rdsk/c*0" only 
> showed the CD-ROM.
> The USB stick will probably not work at all because there is no XHCI support 
> in the installer, I guess.

There is XHCI support in the bloody installer.  It was part of the bloody 
update last week.  There's still one fixed-but-not-yet-pushed bug, but that 
shouldn't affect USB sticks... at least I think it shouldn't.

> Anyway, I just ran "devfsadm -C" and I saw this output:
> "nvme0: NVMe spec version 1.2"

Aha.

> This suggests that the SSD is indeed a NVM 1.2 SSD. :-(
> But I still did not find a proper datasheet or any (Linux, ...) tool to 
> identify the NVMe level.
> 
> What are your plans to support NVMe 1.2?

We can override the NVMe settings to support 1.2 devices, but we can't support 
all of the 1.2 improvements (e.g. namespaces).  Colleague Dale Ghent, who's 
spent time both in ixgbe (he put X550 support into illumos and therefore 
OmniOS) and NVMe can speak more, but I don't think he'll disagree with anything 
I've said here.

The big question to my mind is whether or not we should just support NVMe 1.2 
devices out of the box (and out of the Installer ISO).

Dan

___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Arne]

Thanks for creating the updated ISO. I can now mount that disc to the 
IPMI's virtual drive, which is a lot more convenient!

"prtconf -v" and "prtconf -vp" also work fine now.

Unfortunately I am unable to capture their output. I tried several ways:

a) Network. Problem: The OmniOS installer won't recognize my Intel X550 
10G network card.


b) Serial-over-LAN. Problem: I can see everything including the OmniOS 
installer bootloader, but afterwards serial output stops. There seems to 
be no option to enable serial console output for the main installer!?


c) USB stick. Problem: How to identify the USB stick in the installer 
shell? There is no "rmformat" to identify the device. "ls -l 
/dev/rdsk/c*0" only showed the CD-ROM.
The USB stick will probably not work at all because there is no XHCI 
support in the installer, I guess.


Any ideas?


Anyway, I just ran "devfsadm -C" and I saw this output:
"nvme0: NVMe spec version 1.2"

This suggests that the SSD is indeed a NVM 1.2 SSD. :-(
But I still did not find a proper datasheet or any (Linux, ...) tool to 
identify the NVMe level.


What are your plans to support NVMe 1.2?


---- Original Message  ----
Subject: Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk
From: Dan McDonald <dan...@omniti.com>
To: Arne <mailing-list-omn...@kopierkatze.net>, Dan McDonald 
<dan...@omniti.com>

Date: Wed Mar 22 2017 19:01:17 GMT+0100



Please try this ISO:

http://kebe.com/~danmcd/webrevs/r151021-kayak.iso

which now has a working prtconf (because /lib/amd64/libnvpair.so... is now there).  Then please 
share "prtconf -v" and "prtconf -vp" output.  (You should be able to bring up a 
network interface using the installer shell.)

Thanks,
Dan


___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Dan McDonald]

> On Mar 22, 2017, at 12:15 PM, Arne  
> wrote:
> 
> What is the impact of this bug with libnvpair?
> 
> a) Is this only responsible for non-working "prtconf"? (I guess "prtconf" is 
> some kind of system overview tool!?)

Correct.

> b) Is it also responsible for the non-working NVMe SSD?

No.  Not correct.

Please try this ISO:

http://kebe.com/~danmcd/webrevs/r151021-kayak.iso

which now has a working prtconf (because /lib/amd64/libnvpair.so... is now 
there).  Then please share "prtconf -v" and "prtconf -vp" output.  (You should 
be able to bring up a network interface using the installer shell.)

Thanks,
Dan

___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Arne]

What is the impact of this bug with libnvpair?

a) Is this only responsible for non-working "prtconf"? (I guess 
"prtconf" is some kind of system overview tool!?)


b) Is it also responsible for the non-working NVMe SSD?


 Original Message  ----
Subject: Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk
From: Dan McDonald <dan...@omniti.com>
To: Arne <mailing-list-omn...@kopierkatze.net>, Dan McDonald 
<dan...@omniti.com>

Date: Wed Mar 22 2017 16:00:14 GMT+0100



It means we need to add at least libnvpair to the Kayak-for-ISO wad.  Thank you 
for finding this bug.

Dan


___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Dan McDonald]

> On Mar 22, 2017, at 3:28 AM, Arne  wrote:
> 
> This is the output of "prtconf -vp":
> 
> System Configuration:  Supermicro  i86pc
> Memory size: 65358 Megabytes
> System Peripherals (PROM Nodes):
> 
> ld.so.1: prtconf: fatal: libnvpair.so.1: open failed: No such file or 
> directory
> ld.so.1: prtconf: fatal: relocation error: file /usr/sbin/amd64/prtconf: 
> symbol nvlist_unpack: referenced symbol not found
> Killed
> 
> 
> So something seems wrong here as well...

It means we need to add at least libnvpair to the Kayak-for-ISO wad.  Thank you 
for finding this bug.

Dan

___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Arne]

There is no file "/var/adm/messages" and there is no file "messages" 
anywhere else either ("find /var -name 'mess*'" returns nothing).


Under "/var/adm" there are only 4 directory ("exacct", "log", "pool", 
"streams", all of them are empty) and 2 files: "utmpx" and "wtmpx".

Neither of them matches "nvme".


This is the output of "prtconf -vp":

System Configuration:  Supermicro  i86pc
Memory size: 65358 Megabytes
System Peripherals (PROM Nodes):

ld.so.1: prtconf: fatal: libnvpair.so.1: open failed: No such file or 
directory
ld.so.1: prtconf: fatal: relocation error: file /usr/sbin/amd64/prtconf: 
symbol nvlist_unpack: referenced symbol not found

Killed
--------------------

So something seems wrong here as well...


 Original Message  
Subject: Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk
From: Dan McDonald <dan...@omniti.com>
To: Arne <mailing-list-omn...@kopierkatze.net>
Date: Wed Mar 22 2017 01:21:13 GMT+0100



If it's NVMe 1.1, it should work with bloody.

I wonder if "grep nvme /var/adm/messages" would show you anything booting off 
of the bloody one.

Also, that "prtconf -vp" output I asked for earlier may be useful as well.

Dan


___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss

Re: [OmniOS-discuss] OmniOS r151020: Setup won't see my NVMe disk

[Dan McDonald]

> On Mar 21, 2017, at 5:07 PM, Arne  wrote:
> 
> Unfortunately, I won't see any disks in that menu, either.
> Does this mean that there is a problem with my BIOS not supporting NVMe block 
> devices, as Bob suggested?

I went back to your original note:

> System Disk: Intel SSD 600p 256GB, M.2 PCIe (=NVMe)


Which version of NVMe does this use?  I can't seem to find it anywhere. Also, 
can you "lspci -nn" from the bloody installer's shell?  I'm wondering if it's 
new enough where we don't have it in /etc/driver_aliases.

Thanks,
Dan

___
OmniOS-discuss mailing list
OmniOS-discuss@lists.omniti.com
http://lists.omniti.com/mailman/listinfo/omnios-discuss