Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 5 Oct 2013, at 2:32 am, Teske, Devin devin.te...@fisglobal.com wrote:
On Oct 4, 2013, at 8:59 AM, Sean Bruno wrote:
On Fri, 2013-10-04 at 18:27 +1000, Jan Mikkelsen wrote:
mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669
mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029
mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision
Does it make sense then, to take a survey and add a recommended minium
f/w for cards that we know about to the man page?
Sounds like a great idea.
I can provide the following *good* firmware infos:
===
In order:
1. (as root) mfiutil show adapter | grep Name
2. grep 'mfi[[:digit:]]\{1,\}:.*\(vers\|Board\)' /var/run/dmesg.boot
3. (as root) mfiutil show firmware | grep Pack # only required on older cards
===
The mfiutils instructions only work for the first card in the system.
I just went through a few running systems and found these combinations. Some of
these are looking a bit old and should be upgraded. All are running fine.
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 21552 (boot + 3s/0x0020/info) - Firmware version 2.130.383-2315
mfi0: 21554 (boot + 9s/0x0020/info) - Package version 12.13.0-0154
mfi0: 21555 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-4i
mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291
mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137
mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 62632 (boot + 4s/0x0020/info) - Firmware version 2.120.243-1482
mfi0: 62634 (boot + 9s/0x0020/info) - Package version 12.12.0-0090
mfi0: 62635 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-8i
mfi0: 6559 (boot + 3s/0x0020/info) - Firmware version 2.130.374-2023
mfi0: 6560 (boot + 5s/0x0020/info) - Package version 20.10.1-0126
mfi0: 6561 (boot + 5s/0x0020/info) - Board Revision 04A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 74819 (boot + 4s/0x0020/info) - Firmware version 2.120.183-1415
mfi0: 74822 (boot + 9s/0x0020/info) - Package version 12.12.0-0073
mfi0: 74823 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 72049 (boot + 4s/0x0020/info) - Firmware version 2.120.63-1242
mfi0: 72051 (boot + 6s/0x0020/info) - Package version 12.12.0-0048
mfi0: 72052 (boot + 6s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-8i
mfi0: 2463 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664
mfi0: 2464 (boot + 5s/0x0020/info) - Package version 20.10.1-0107
mfi0: 2465 (boot + 5s/0x0020/info) - Board Revision 04A
Regards,
Jan.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
- Original Message -
From: Jan Mikkelsen j...@transactionware.com
To: Teske, Devin devin.te...@fisglobal.com
Cc: Konstantin Belousov kostik...@gmail.com; Steven Hartland kill...@multiplay.co.uk; Ryan Stone ryst...@gmail.com;
freebsd-stable@freebsd.org
Sent: Monday, October 07, 2013 8:57 AM
Subject: Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 5 Oct 2013, at 2:32 am, Teske, Devin devin.te...@fisglobal.com wrote:
On Oct 4, 2013, at 8:59 AM, Sean Bruno wrote:
On Fri, 2013-10-04 at 18:27 +1000, Jan Mikkelsen wrote:
mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669
mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029
mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision
Does it make sense then, to take a survey and add a recommended minium
f/w for cards that we know about to the man page?
Sounds like a great idea.
I can provide the following *good* firmware infos:
===
In order:
1. (as root) mfiutil show adapter | grep Name
2. grep 'mfi[[:digit:]]\{1,\}:.*\(vers\|Board\)' /var/run/dmesg.boot
3. (as root) mfiutil show firmware | grep Pack # only required on older cards
===
The mfiutils instructions only work for the first card in the system.
I just went through a few running systems and found these combinations. Some of these are looking a bit old and should be
upgraded. All are running fine.
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 21552 (boot + 3s/0x0020/info) - Firmware version 2.130.383-2315
mfi0: 21554 (boot + 9s/0x0020/info) - Package version 12.13.0-0154
mfi0: 21555 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-4i
mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291
mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137
mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 62632 (boot + 4s/0x0020/info) - Firmware version 2.120.243-1482
mfi0: 62634 (boot + 9s/0x0020/info) - Package version 12.12.0-0090
mfi0: 62635 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-8i
mfi0: 6559 (boot + 3s/0x0020/info) - Firmware version 2.130.374-2023
mfi0: 6560 (boot + 5s/0x0020/info) - Package version 20.10.1-0126
mfi0: 6561 (boot + 5s/0x0020/info) - Board Revision 04A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 74819 (boot + 4s/0x0020/info) - Firmware version 2.120.183-1415
mfi0: 74822 (boot + 9s/0x0020/info) - Package version 12.12.0-0073
mfi0: 74823 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 72049 (boot + 4s/0x0020/info) - Firmware version 2.120.63-1242
mfi0: 72051 (boot + 6s/0x0020/info) - Package version 12.12.0-0048
mfi0: 72052 (boot + 6s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-8i
mfi0: 2463 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664
mfi0: 2464 (boot + 5s/0x0020/info) - Package version 20.10.1-0107
mfi0: 2465 (boot + 5s/0x0020/info) - Board Revision 04A
Just to confirm when you say fine, have you checked to ensure none
are reporting timeouts?
Regards
Steve
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it.
In the event of misdirection, illegible or incomplete transmission please
telephone +44 845 868 1337
or return the E.mail to postmas...@multiplay.co.uk.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 7 Oct 2013, at 7:30 pm, Steven Hartland kill...@multiplay.co.uk wrote:
- Original Message - From: Jan Mikkelsen j...@transactionware.com
To: Teske, Devin devin.te...@fisglobal.com
Cc: Konstantin Belousov kostik...@gmail.com; Steven Hartland
kill...@multiplay.co.uk; Ryan Stone ryst...@gmail.com;
freebsd-stable@freebsd.org
Sent: Monday, October 07, 2013 8:57 AM
Subject: Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 5 Oct 2013, at 2:32 am, Teske, Devin devin.te...@fisglobal.com wrote:
On Oct 4, 2013, at 8:59 AM, Sean Bruno wrote:
On Fri, 2013-10-04 at 18:27 +1000, Jan Mikkelsen wrote:
mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669
mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029
mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision
Does it make sense then, to take a survey and add a recommended minium
f/w for cards that we know about to the man page?
Sounds like a great idea.
I can provide the following *good* firmware infos:
===
In order:
1. (as root) mfiutil show adapter | grep Name
2. grep 'mfi[[:digit:]]\{1,\}:.*\(vers\|Board\)' /var/run/dmesg.boot
3. (as root) mfiutil show firmware | grep Pack # only required on older
cards
===
The mfiutils instructions only work for the first card in the system.
I just went through a few running systems and found these combinations. Some
of these are looking a bit old and should be upgraded. All are running fine.
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 21552 (boot + 3s/0x0020/info) - Firmware version 2.130.383-2315
mfi0: 21554 (boot + 9s/0x0020/info) - Package version 12.13.0-0154
mfi0: 21555 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-4i
mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291
mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137
mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 62632 (boot + 4s/0x0020/info) - Firmware version 2.120.243-1482
mfi0: 62634 (boot + 9s/0x0020/info) - Package version 12.12.0-0090
mfi0: 62635 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-8i
mfi0: 6559 (boot + 3s/0x0020/info) - Firmware version 2.130.374-2023
mfi0: 6560 (boot + 5s/0x0020/info) - Package version 20.10.1-0126
mfi0: 6561 (boot + 5s/0x0020/info) - Board Revision 04A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 74819 (boot + 4s/0x0020/info) - Firmware version 2.120.183-1415
mfi0: 74822 (boot + 9s/0x0020/info) - Package version 12.12.0-0073
mfi0: 74823 (boot + 9s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9261-8i
mfi0: 72049 (boot + 4s/0x0020/info) - Firmware version 2.120.63-1242
mfi0: 72051 (boot + 6s/0x0020/info) - Package version 12.12.0-0048
mfi0: 72052 (boot + 6s/0x0020/info) - Board Revision 15A
Product Name: LSI MegaRAID SAS 9240-8i
mfi0: 2463 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664
mfi0: 2464 (boot + 5s/0x0020/info) - Package version 20.10.1-0107
mfi0: 2465 (boot + 5s/0x0020/info) - Board Revision 04A
Just to confirm when you say fine, have you checked to ensure none
are reporting timeouts?
Yes.
Only the first two of these are from a 9.2 era system (also the ones with the
most recent firmware).
We did have timeout issues while testing this platform which were resolved by
taking the mfi driver from -HEAD at the time and setting hw.mfi.msi=1. The
oldest ones have been running for over two years.
I can go through our Perforce depot to tell you exactly what mfi driver they’re
running, if you care.
Regards,
Jan.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
- Original Message - From: Jan Mikkelsen j...@transactionware.com .. Just to confirm when you say fine, have you checked to ensure none are reporting timeouts? Yes. Only the first two of these are from a 9.2 era system (also the ones with the most recent firmware). We did have timeout issues while testing this platform which were resolved by taking the mfi driver from -HEAD at the time and setting hw.mfi.msi=1. The oldest ones have been running for over two years. Thats curious, hw.mfi.msi=1 is the default so you shouldn't need to change this. Also heads mfi is almost identical to 9.2 so not sure why you would need to update, could you clarify? Regards Steve This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmas...@multiplay.co.uk. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 7 Oct 2013, at 8:06 pm, Steven Hartland kill...@multiplay.co.uk wrote: - Original Message - From: Jan Mikkelsen j...@transactionware.com .. Just to confirm when you say fine, have you checked to ensure none are reporting timeouts? Yes. Only the first two of these are from a 9.2 era system (also the ones with the most recent firmware). We did have timeout issues while testing this platform which were resolved by taking the mfi driver from -HEAD at the time and setting hw.mfi.msi=1. The oldest ones have been running for over two years. Thats curious, hw.mfi.msi=1 is the default so you shouldn't need to change this. Also heads mfi is almost identical to 9.2 so not sure why you would need to update, could you clarify? The 9.2 system has the 9.2 driver and was not updated. It is a test system with a 9261-8i and a 9240-4i. The other machines are running 9.0 or 9.1 with a modified driver. The 9.0 systems have a patch that added the hw.mfi.msi sysctl with a default of zero. I just went back to our Perforce depot and checked the timing; that patch was applied to our local copy on 2011-12-08. My “running for over two years” was wrong, it is actually about a year and a half. At that point the 9261-8i was stable and we saw no further timeout errors even with the old firmware versions in my email. (looking through svn, this change was in rev 227562 to mfi_pci.c.) The loader.conf entry has been in our standard builds ever since, and even after the default value changed. Probably time to remove it. We started using the 9240-4i/8i in May 2012. We brought in changes from head mfi to support them. I’d need to go digging deeper to see exactly what the changes were. A quick look shows that this is when the hw.mfi.msi default changed in our copy of the code. In any case: These system are running and we don’t see timeout errors with the firmware versions I listed. There were also your later changes that improved the reliability of mfi. We brought those back into our 9.1 based systems, but the cards were working before those changes. Regards, Jan. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On Fri, Oct 04, 2013 at 03:53:10PM +1000, Jan Mikkelsen wrote: We have Drake Skinny (9240-4i and 9240-8i) cards running, most recently with 9.2-RC4. We'll be testing 9.2-RELEASE in the next week or two. We have seen problems with older versions of the firmware, and interactions with some Supermicro BIOS versions. All these problems have been resolved by upgrading to the latest versions of the controller firmware and system BIOSes. We're running with with hw.mfi.msi=1. I haven't tested without that since early 2011; I should probably try it out. So: What firmware do you have in the controller? Did you update it? Yes, I reflashed one board to the latest blob I was able to find at that time. For the second board, I did not bothered. The info I am able to find right now in my outcoming mbox, is (this is for four-ports, was flashed, I believe) mfi0: 916 (boot + 3s/0x0020/info) - Firmware version 2.130.374-2023 mfi0: 917 (boot + 6s/0x0020/info) - Package version 20.10.1-0126 mfi0: 918 (boot + 6s/0x0020/info) - Board Revision 03A (and this is for eight-ports) mfi0: 326 (boot + 4s/0x0020/info) - Firmware version 2.130.314-1585 mfi0: 327 (boot + 5s/0x0020/info) - Package version 20.10.1-0101 mfi0: 328 (boot + 5s/0x0020/info) - Board Revision 03B I am pretty much sure that the issue is either in the m/b compatibility or mfi(4) driver. OK. I haven't seen timeout errors like that for a long time, so you could be right. I don't know. This is from a running 9.2-RC4 system: mfi1: Drake Skinny port 0xc000-0xc0ff mem 0xfad9c000-0xfad9,0xfadc-0xfadf irq 30 at device 0.0 on pci2 mfi1: Using MSI mfi1: Megaraid SAS driver Ver 4.23 ... mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291 mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137 mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A Could you provide me the output of the kenv(8) ? I am interested in the smbios mibs, i.e. your hardware identification. pgpUnRmhdwROq.pgp Description: PGP signature
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
- Original Message - From: Jan Mikkelsen j...@transactionware.com To: Konstantin Belousov kostik...@gmail.com Cc: freebsd-stable@freebsd.org; Ryan Stone ryst...@gmail.com Sent: Friday, October 04, 2013 6:53 AM Subject: Re: Device timeout from mfi(9) while booting 9.2-RELEASE We have Drake Skinny (9240-4i and 9240-8i) cards running, most recently with 9.2-RC4. We'll be testing 9.2-RELEASE in the next week or two. We have seen problems with older versions of the firmware, and interactions with some Supermicro BIOS versions. All these problems have been resolved by upgrading to the latest versions of the controller firmware and system BIOSes. We're running with with hw.mfi.msi=1. I haven't tested without that since early 2011; I should probably try it out. So: What firmware do you have in the controller? Did you update it? Yes, I reflashed one board to the latest blob I was able to find at that time. For the second board, I did not bothered. The info I am able to find right now in my outcoming mbox, is (this is for four-ports, was flashed, I believe) mfi0: 916 (boot + 3s/0x0020/info) - Firmware version 2.130.374-2023 mfi0: 917 (boot + 6s/0x0020/info) - Package version 20.10.1-0126 mfi0: 918 (boot + 6s/0x0020/info) - Board Revision 03A (and this is for eight-ports) mfi0: 326 (boot + 4s/0x0020/info) - Firmware version 2.130.314-1585 mfi0: 327 (boot + 5s/0x0020/info) - Package version 20.10.1-0101 mfi0: 328 (boot + 5s/0x0020/info) - Board Revision 03B I am pretty much sure that the issue is either in the m/b compatibility or mfi(4) driver. OK. I haven't seen timeout errors like that for a long time, so you could be right. I don't know. This is from a running 9.2-RC4 system: mfi1: Drake Skinny port 0xc000-0xc0ff mem 0xfad9c000-0xfad9,0xfadc-0xfadf irq 30 at device 0.0 on pci2 mfi1: Using MSI mfi1: Megaraid SAS driver Ver 4.23 ... mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291 mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137 mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A In every case I've invesitgated for this is been either:- 1. Old Firmware 2. Bad Cabling, Disk or Ram I'm 99.% certain timeout issues are not a driver issue. #1 is the cause of almost all occurances I've looked at. FW we're running here is: mfi0: Megaraid SAS driver Ver 4.23 ... mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669 mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029 mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision So looks like your FW is quite old and needs updating. Regards Steve This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmas...@multiplay.co.uk. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 04/10/2013, at 6:10 PM, Steven Hartland kill...@multiplay.co.uk wrote: mfi1: Drake Skinny port 0xc000-0xc0ff mem 0xfad9c000-0xfad9,0xfadc-0xfadf irq 30 at device 0.0 on pci2 mfi1: Using MSI mfi1: Megaraid SAS driver Ver 4.23 ... mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291 mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137 mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A In every case I've invesitgated for this is been either:- 1. Old Firmware 2. Bad Cabling, Disk or Ram I'm 99.% certain timeout issues are not a driver issue. #1 is the cause of almost all occurances I've looked at. FW we're running here is: mfi0: Megaraid SAS driver Ver 4.23 ... mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669 mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029 mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision So looks like your FW is quite old and needs updating. Either we're not talking about the same card or there is somewhere to find firmware that I don't know about. I just checked the LSI website for 9240-4i firmware and there is a 20.12.1-0150 version (labeled 4.11) released on 23 September 2013. The previous version is the version running in this machine. Are we talking about the same card? Is there a better place to look for firmware updates on the LSI website? Thanks, Jan. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
- Original Message - From: Jan Mikkelsen j...@transactionware.com mfi1: Drake Skinny port 0xc000-0xc0ff mem 0xfad9c000-0xfad9,0xfadc-0xfadf irq 30 at device 0.0 on pci2 mfi1: Using MSI mfi1: Megaraid SAS driver Ver 4.23 ... mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291 mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137 mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A In every case I've invesitgated for this is been either:- 1. Old Firmware 2. Bad Cabling, Disk or Ram I'm 99.% certain timeout issues are not a driver issue. #1 is the cause of almost all occurances I've looked at. FW we're running here is: mfi0: Megaraid SAS driver Ver 4.23 ... mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669 mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029 mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision So looks like your FW is quite old and needs updating. Either we're not talking about the same card or there is somewhere to find firmware that I don't know about. I just checked the LSI website for 9240-4i firmware and there is a 20.12.1-0150 version (labeled 4.11) released on 23 September 2013. The previous version is the version running in this machine. Are we talking about the same card? Is there a better place to look for firmware updates on the LSI website? There are many different MFI controllers unforutnately making tracking versions very hard especially when OEM's have different versions again. Id suggest contacting LSI support and request the FW with the command timeout fix in. Regards Steve This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmas...@multiplay.co.uk. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 04/10/2013, at 6:59 PM, Steven Hartland kill...@multiplay.co.uk wrote: - Original Message - From: Jan Mikkelsen j...@transactionware.com mfi1: Drake Skinny port 0xc000-0xc0ff mem 0xfad9c000-0xfad9,0xfadc-0xfadf irq 30 at device 0.0 on pci2 mfi1: Using MSI mfi1: Megaraid SAS driver Ver 4.23 ... mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291 mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137 mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A In every case I've invesitgated for this is been either:- 1. Old Firmware 2. Bad Cabling, Disk or Ram I'm 99.% certain timeout issues are not a driver issue. #1 is the cause of almost all occurances I've looked at. FW we're running here is: mfi0: Megaraid SAS driver Ver 4.23 ... mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669 mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029 mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision So looks like your FW is quite old and needs updating. Either we're not talking about the same card or there is somewhere to find firmware that I don't know about. I just checked the LSI website for 9240-4i firmware and there is a 20.12.1-0150 version (labeled 4.11) released on 23 September 2013. The previous version is the version running in this machine. Are we talking about the same card? Is there a better place to look for firmware updates on the LSI website? There are many different MFI controllers unforutnately making tracking versions very hard especially when OEM's have different versions again. Id suggest contacting LSI support and request the FW with the command timeout fix in. I'm not the one with the problem, that's Konstantin Ryan. It works for me on many machines with 9240-4i and -8i controllers and 9261-8i controllers. I have also seen problems that have been resolved through firmware updates which is how we got to talking about firmware revisions. So the point ... looks like your FW is quite old and needs updating is really check your firmware. Thanks, Jan. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On Fri, 2013-10-04 at 18:27 +1000, Jan Mikkelsen wrote: mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669 mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029 mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision Does it make sense then, to take a survey and add a recommended minium f/w for cards that we know about to the man page? sean signature.asc Description: This is a digitally signed message part
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
- Original Message - From: Sean Bruno sean_br...@yahoo.com Finding out would be good for sure is this something that should in man page, wiki or both? FYI: There's already some version numbers in once of recent mfi commits of confirmed good FW versions. Regards Steve This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmas...@multiplay.co.uk. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On Oct 4, 2013, at 8:59 AM, Sean Bruno wrote:
On Fri, 2013-10-04 at 18:27 +1000, Jan Mikkelsen wrote:
mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669
mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029
mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision
Does it make sense then, to take a survey and add a recommended minium
f/w for cards that we know about to the man page?
Sounds like a great idea.
I can provide the following *good* firmware infos:
===
In order:
1. (as root) mfiutil show adapter | grep Name
2. grep 'mfi[[:digit:]]\{1,\}:.*\(vers\|Board\)' /var/run/dmesg.boot
3. (as root) mfiutil show firmware | grep Pack # only required on older cards
===
Machine 1 (older):
Product Name: Intel(R) RAID Controller SROMBSAS18E
mfi0: 3736 (boot + 0s/0x0020/info) - Firmware version 1.12.280-0826
mfi0: 3740 (boot + 14s/0x0020/info) - Board Revision
mfi0 Firmware Package Version: 7.0.1-0075
===
Machine 2 (newer):
Product Name: LSI MegaRAID SAS 9264-8i
mfi0: 3270 (boot + 3s/0x0020/info) - Firmware version 2.130.383-2315
mfi0: 3272 (boot + 46s/0x0020/info) - Package version 12.13.0-0154
mfi0: 3273 (boot + 46s/0x0020/info) - Board Revision 62A
===
Machine 3 (newest):
Product Name: LSI MegaRAID SAS 9267-8i
mfi0: 4535 (boot + 8s/0x0020/info) - Firmware version 3.140.95-1967
mfi0: 4538 (boot + 20s/0x0020/info) - Package version 23.1.1-0017
mfi0: 4539 (boot + 20s/0x0020/info) - Board Revision 04B
===
Your mileage may vary, as I'm told that these product versions (9267-8i) may
not exist outside of VICOR (but rather were custom models that can handle
either SAS or SATA using internal MiniSAS break-out cables).
--
Devin
_
The information contained in this message is proprietary and/or confidential.
If you are not the intended recipient, please: (i) delete the message and all
copies; (ii) do not disclose, distribute or use the message in any manner; and
(iii) notify the sender immediately. In addition, please be aware that any
message addressed to our domain is subject to archiving and review by persons
other than the intended recipient. Thank you.
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On 05/10/2013 02:32, Teske, Devin wrote:
On Oct 4, 2013, at 8:59 AM, Sean Bruno wrote:
On Fri, 2013-10-04 at 18:27 +1000, Jan Mikkelsen wrote:
mfi0: 14299 (boot + 4s/0x0020/info) - Firmware version 3.190.05-1669
mfi0: 14300 (boot + 5s/0x0020/info) - Package version 23.7.0-0029
mfi0: 14301 (boot + 5s/0x0020/info) - Board Revision
Does it make sense then, to take a survey and add a recommended minium
f/w for cards that we know about to the man page?
Sounds like a great idea.
I can provide the following *good* firmware infos:
===
In order:
1. (as root) mfiutil show adapter | grep Name
2. grep 'mfi[[:digit:]]\{1,\}:.*\(vers\|Board\)' /var/run/dmesg.boot
3. (as root) mfiutil show firmware | grep Pack # only required on older cards
===
Machine 1 (older):
Product Name: Intel(R) RAID Controller SROMBSAS18E
mfi0: 3736 (boot + 0s/0x0020/info) - Firmware version 1.12.280-0826
mfi0: 3740 (boot + 14s/0x0020/info) - Board Revision
mfi0 Firmware Package Version: 7.0.1-0075
===
Machine 2 (newer):
Product Name: LSI MegaRAID SAS 9264-8i
mfi0: 3270 (boot + 3s/0x0020/info) - Firmware version 2.130.383-2315
mfi0: 3272 (boot + 46s/0x0020/info) - Package version 12.13.0-0154
mfi0: 3273 (boot + 46s/0x0020/info) - Board Revision 62A
===
Machine 3 (newest):
Product Name: LSI MegaRAID SAS 9267-8i
mfi0: 4535 (boot + 8s/0x0020/info) - Firmware version 3.140.95-1967
mfi0: 4538 (boot + 20s/0x0020/info) - Package version 23.1.1-0017
mfi0: 4539 (boot + 20s/0x0020/info) - Board Revision 04B
===
Product Name: Intel (R) RAID Controller RS2BL080
mfi0: Megaraid SAS driver Ver 4.23
mfi0: 11650 (boot + 4s/0x0020/info) - Firmware version 2.130.03-1332
mfi0: 11651 (boot + 5s/0x0020/info) - Package version 12.13.0-0104
mfi0: 11652 (boot + 5s/0x0020/info) - Board Revision 66D
(this shows up in pciconf(8) as 'MegaRAID SAS 2108 [Liberator]')
--
John Marshall
___
freebsd-stable@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Device timeout from mfi(9) while booting 9.2-RELEASE
We're having trouble booting 9.2-RELEASE on a system with an mfi (Drake Skinny) controller. When it tries to mount root we get: mfi0: COMMAND 0xff8000cb7220 TIMEOUT AFTER 59 SECONDS mfi0: COMMAND 0xff8000cb72a8 TIMEOUT AFTER 60 SECONDS mfi0: COMMAND 0xff8000cb7220 TIMEOUT AFTER 90 SECONDS I also get the following when mfi attaches (with bootverbose): mfi0: Drake Skinny port 0x5000-0x50ff mem 0xfbd6-0xfbd63fff,0xfbd0-0xf bd3 irq 16 at device 0.0 on pci2^M mfi0: attempting to allocate 1 MSI vectors (1 supported)^M msi: routing MSI IRQ 282 to local APIC 0 vector 77^M mfi0: using IRQ 282 for MSI^M mfi0: Using MSI^M mfi0: Megaraid SAS driver Ver 4.23 ^M mfi0: Frame 0xff85d394b280 timed out command 0x101^M error 60 in callback from mfi_send_frame^M mfi0: Frame 0xff85d394b500 timed out command 0x1040100^M error 60 in callback from mfi_send_frame^M mfi0: Frame 0xff85d394b780 timed out command 0x1040300^M error 60 in callback from mfi_send_frame^M mfi0: Error 255 fetching controller entries^M I've put full bootverbose logs from boots with hw.mfi.msi=0 and hw.mfi.msi=1 here: http://people.freebsd.org/~rstone/mfi_timeout_irq.txt http://people.freebsd.org/~rstone/mfi_timeout_msi.txt Neither boot was successful. I don't have the ability to boot from alternative media so I have a limited ability to test changes (I can re-image from a full disk image, but that requires building a new disk image which takes some time). I did see the following forum post and tried with cbb and pccard removed from GENERIC. That didn't fix it. http://forums.freebsd.org/showpost.php?p=231135postcount=4 ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On Thu, Oct 03, 2013 at 11:50:15AM -0400, Ryan Stone wrote: We're having trouble booting 9.2-RELEASE on a system with an mfi (Drake Skinny) controller. When it tries to mount root we get: mfi0: COMMAND 0xff8000cb7220 TIMEOUT AFTER 59 SECONDS mfi0: COMMAND 0xff8000cb72a8 TIMEOUT AFTER 60 SECONDS mfi0: COMMAND 0xff8000cb7220 TIMEOUT AFTER 90 SECONDS I also get the following when mfi attaches (with bootverbose): mfi0: Drake Skinny port 0x5000-0x50ff mem 0xfbd6-0xfbd63fff,0xfbd0-0xf bd3 irq 16 at device 0.0 on pci2^M mfi0: attempting to allocate 1 MSI vectors (1 supported)^M msi: routing MSI IRQ 282 to local APIC 0 vector 77^M mfi0: using IRQ 282 for MSI^M mfi0: Using MSI^M mfi0: Megaraid SAS driver Ver 4.23 ^M mfi0: Frame 0xff85d394b280 timed out command 0x101^M error 60 in callback from mfi_send_frame^M mfi0: Frame 0xff85d394b500 timed out command 0x1040100^M error 60 in callback from mfi_send_frame^M mfi0: Frame 0xff85d394b780 timed out command 0x1040300^M error 60 in callback from mfi_send_frame^M mfi0: Error 255 fetching controller entries^M I've put full bootverbose logs from boots with hw.mfi.msi=0 and hw.mfi.msi=1 here: http://people.freebsd.org/~rstone/mfi_timeout_irq.txt http://people.freebsd.org/~rstone/mfi_timeout_msi.txt Neither boot was successful. I don't have the ability to boot from alternative media so I have a limited ability to test changes (I can re-image from a full disk image, but that requires building a new disk image which takes some time). I did see the following forum post and tried with cbb and pccard removed from GENERIC. That didn't fix it. http://forums.freebsd.org/showpost.php?p=231135postcount=4 I have two Drake Skinny cards, one four-ports, one with eight ports, both not working with either version of driver in HEAD from February up to now. I tried to talk about this both with Doug Ambrisko and Desai, Kashyap kashyap.de...@lsi.com, and provided the debugging data I could think of, but no avail. There is a rumor that it might be related to the slot the card is inserted in. I only have 8x or wider PCIe slot provided by CPU north-bridge. It might be that card does not like it and only work in the south-bridge PCIe lanes. I have no idea why could it be so, neither I saw the confirmation of the speculation. pgpuCq2UR3ALv.pgp Description: PGP signature
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
Hi, We have Drake Skinny (9240-4i and 9240-8i) cards running, most recently with 9.2-RC4. We'll be testing 9.2-RELEASE in the next week or two. We have seen problems with older versions of the firmware, and interactions with some Supermicro BIOS versions. All these problems have been resolved by upgrading to the latest versions of the controller firmware and system BIOSes. We're running with with hw.mfi.msi=1. I haven't tested without that since early 2011; I should probably try it out. So: What firmware do you have in the controller? Did you update it? Regards, Jan. On 04/10/2013, at 5:47 AM, Konstantin Belousov kostik...@gmail.com wrote: On Thu, Oct 03, 2013 at 11:50:15AM -0400, Ryan Stone wrote: We're having trouble booting 9.2-RELEASE on a system with an mfi (Drake Skinny) controller. When it tries to mount root we get: mfi0: COMMAND 0xff8000cb7220 TIMEOUT AFTER 59 SECONDS mfi0: COMMAND 0xff8000cb72a8 TIMEOUT AFTER 60 SECONDS mfi0: COMMAND 0xff8000cb7220 TIMEOUT AFTER 90 SECONDS I also get the following when mfi attaches (with bootverbose): mfi0: Drake Skinny port 0x5000-0x50ff mem 0xfbd6-0xfbd63fff,0xfbd0-0xf bd3 irq 16 at device 0.0 on pci2^M mfi0: attempting to allocate 1 MSI vectors (1 supported)^M msi: routing MSI IRQ 282 to local APIC 0 vector 77^M mfi0: using IRQ 282 for MSI^M mfi0: Using MSI^M mfi0: Megaraid SAS driver Ver 4.23 ^M mfi0: Frame 0xff85d394b280 timed out command 0x101^M error 60 in callback from mfi_send_frame^M mfi0: Frame 0xff85d394b500 timed out command 0x1040100^M error 60 in callback from mfi_send_frame^M mfi0: Frame 0xff85d394b780 timed out command 0x1040300^M error 60 in callback from mfi_send_frame^M mfi0: Error 255 fetching controller entries^M I've put full bootverbose logs from boots with hw.mfi.msi=0 and hw.mfi.msi=1 here: http://people.freebsd.org/~rstone/mfi_timeout_irq.txt http://people.freebsd.org/~rstone/mfi_timeout_msi.txt Neither boot was successful. I don't have the ability to boot from alternative media so I have a limited ability to test changes (I can re-image from a full disk image, but that requires building a new disk image which takes some time). I did see the following forum post and tried with cbb and pccard removed from GENERIC. That didn't fix it. http://forums.freebsd.org/showpost.php?p=231135postcount=4 I have two Drake Skinny cards, one four-ports, one with eight ports, both not working with either version of driver in HEAD from February up to now. I tried to talk about this both with Doug Ambrisko and Desai, Kashyap kashyap.de...@lsi.com, and provided the debugging data I could think of, but no avail. There is a rumor that it might be related to the slot the card is inserted in. I only have 8x or wider PCIe slot provided by CPU north-bridge. It might be that card does not like it and only work in the south-bridge PCIe lanes. I have no idea why could it be so, neither I saw the confirmation of the speculation. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
On Fri, Oct 04, 2013 at 11:23:45AM +1000, Jan Mikkelsen wrote: Hi, We have Drake Skinny (9240-4i and 9240-8i) cards running, most recently with 9.2-RC4. We'll be testing 9.2-RELEASE in the next week or two. We have seen problems with older versions of the firmware, and interactions with some Supermicro BIOS versions. All these problems have been resolved by upgrading to the latest versions of the controller firmware and system BIOSes. We're running with with hw.mfi.msi=1. I haven't tested without that since early 2011; I should probably try it out. So: What firmware do you have in the controller? Did you update it? Yes, I reflashed one board to the latest blob I was able to find at that time. For the second board, I did not bothered. The info I am able to find right now in my outcoming mbox, is (this is for four-ports, was flashed, I believe) mfi0: 916 (boot + 3s/0x0020/info) - Firmware version 2.130.374-2023 mfi0: 917 (boot + 6s/0x0020/info) - Package version 20.10.1-0126 mfi0: 918 (boot + 6s/0x0020/info) - Board Revision 03A (and this is for eight-ports) mfi0: 326 (boot + 4s/0x0020/info) - Firmware version 2.130.314-1585 mfi0: 327 (boot + 5s/0x0020/info) - Package version 20.10.1-0101 mfi0: 328 (boot + 5s/0x0020/info) - Board Revision 03B I am pretty much sure that the issue is either in the m/b compatibility or mfi(4) driver. pgpEdTm8QzQ0P.pgp Description: PGP signature
Re: Device timeout from mfi(9) while booting 9.2-RELEASE
We have Drake Skinny (9240-4i and 9240-8i) cards running, most recently with 9.2-RC4. We'll be testing 9.2-RELEASE in the next week or two. We have seen problems with older versions of the firmware, and interactions with some Supermicro BIOS versions. All these problems have been resolved by upgrading to the latest versions of the controller firmware and system BIOSes. We're running with with hw.mfi.msi=1. I haven't tested without that since early 2011; I should probably try it out. So: What firmware do you have in the controller? Did you update it? Yes, I reflashed one board to the latest blob I was able to find at that time. For the second board, I did not bothered. The info I am able to find right now in my outcoming mbox, is (this is for four-ports, was flashed, I believe) mfi0: 916 (boot + 3s/0x0020/info) - Firmware version 2.130.374-2023 mfi0: 917 (boot + 6s/0x0020/info) - Package version 20.10.1-0126 mfi0: 918 (boot + 6s/0x0020/info) - Board Revision 03A (and this is for eight-ports) mfi0: 326 (boot + 4s/0x0020/info) - Firmware version 2.130.314-1585 mfi0: 327 (boot + 5s/0x0020/info) - Package version 20.10.1-0101 mfi0: 328 (boot + 5s/0x0020/info) - Board Revision 03B I am pretty much sure that the issue is either in the m/b compatibility or mfi(4) driver. OK. I haven't seen timeout errors like that for a long time, so you could be right. I don't know. This is from a running 9.2-RC4 system: mfi1: Drake Skinny port 0xc000-0xc0ff mem 0xfad9c000-0xfad9,0xfadc-0xfadf irq 30 at device 0.0 on pci2 mfi1: Using MSI mfi1: Megaraid SAS driver Ver 4.23 ... mfi1: 15228 (boot + 3s/0x0020/info) - Firmware version 2.130.384-2291 mfi1: 15229 (boot + 5s/0x0020/info) - Package version 20.11.1-0137 mfi1: 15230 (boot + 5s/0x0020/info) - Board Revision 03A Regards, Jan. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to freebsd-stable-unsubscr...@freebsd.org
