Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
The lesson is- Never take drivers from strangers :) So far so good- the box has been stable since I went back to the driver I compiled. My test box also crashed running the new driver so that's a no go. The current project is figuring out how to boot a V210 off an LP1DC connected to a COMSTAR target. I was able to install but I end up unable to mount root: Cannot assemble drivers for root /p...@1d,70/l...@1/s...@0,c:a Cannot mount root on /p...@1d,70/l...@1/s...@0,c:a fstype ufs That's a problem for a different list though. In this case the patch provided earlier in the thread seems to work as a target when compiled with 134 source. Thanks again for the build links. They were very helpful. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
That's a bummer about the emulex driver, I still have not tried it with my setup. Glad to hear you got your setup all working though. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
So for the record- the driver off the Emulex site does not seem to work with 134- None of my Solaris hosts could see the target- and eventually it crashed my NAS head. When I went back to the driver I compiled- everything started working again. -Don -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
> The binaries can be found on our ftp site: Thanks for getting this out. I built a driver using the patch you supplied and that seemed to work- I've since broken the COMSTAR target and am not sure how. I will test with your driver as soon as I have an opportunity to reboot. Thanks again. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
Thanks, I am definitely downloading that and for the lazy people here is cut and paste wget --ftp-user=incoming --ftp-password=dropbox ftp://ftp.emulex.com/pub/snv_emlxs_2.50q_oce_1.10f2_01.tar.Z -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
All, The fix will be in the emlxs 2.50q driver and is currently being integrated into SNV 148. I got permission to release a copy of the binaries ahead of time. The binaries can be found on our ftp site: site: ftp.emulex.com login:incoming password: dropbox file: /pub/snv_emlxs_2.50q_oce_1.10f2_01.tar.Z You will need to copy the appropriate emlxs driver binaries from this bundle to your system and replace the file(s) with that of the same name and directory. WARNING: These binaries are built with the latest SNV, so they can only be used with the newer SNV builds. I believe SNV 134 or higher should work fine. COMSTAR changed their interface header files around that time and if you try running newer driver binaries with older SNV builds or old driver binaries with newer SNV builds the system will panic when you try to use the driver. Sorry for the delay in getting this out. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
> Yep that should be your file, just checked mine. Thanks- I'm going to give this a try on Sunday. > Also don't forget to set the permissions to match the original. Already did but thanks for reminding me. Hopefully this will solve my issue- I'll let everyone know how it works. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
Yep that should be your file, just checked mine. Also don't forget to set the permissions to match the original. $ ls -l dev/b134/usr/src/uts/sparc/emlxs/obj64/emlxs -rw-r--r-- 1 matt smbusers 1243808 Aug 12 05:47 dev/b134/usr/src/uts/sparc/emlxs/obj64/emlxs $ ls -l /kernel/drv/sparcv9/emlxs -rwxr-xr-x 1 root sys 1243808 Aug 12 06:32 /kernel/drv/sparcv9/emlxs -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
Unfortunately I did not get any errors- I get files but I don't know if they are the final module or still need to linked or otherwise tied to something else: /usr/src/onnv# file /kernel/drv/amd64/emlxs /kernel/drv/amd64/emlxs.dist: ELF 64-bit LSB relocatable AMD64 Version 1 [SSE CMOV] /usr/src/onnv# file usr/src/uts/intel/emlxs/obj64/emlxs usr/src/uts/intel/emlxs/obj64/emlxs:ELF 64-bit LSB relocatable AMD64 Version 1 [SSE CMOV] -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
Wish I could answer you on that one, did you get any compile errors? -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
The package certificate site came back online and I was able to download and build the kernel. The emlxs driver does not end up in proto/root_i386/kernel/drv/amd64 but I wind up with an emlxs binary in usr/src/uts/intel/emlxs/obj64/emlxs. Is there something else that needs to be done to build the emlxs driver? -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
I starting set up a build environment to recompile this driver but it seems like the package certificate site is down for maintenance. Considering the recent announcements I've no idea if and when it might be back up (they are claiming today but who knows). Has anyone built a patched emxls driver from svn_134 that I could at least test my configuration with? -Thanks- -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
I followed the instructions listed at the below address to grab the source for b134 and setup my build environment. (The confusing part is that you need two different SunStudios and neither can be obtained by using pkg) http://insanum.com/blog/2010/06/08/how-to-build-opensolaris Once setup I compiled just the kernel (I'll look for the specific commands when I get home and edit this). Replaced the emlxs file under /kernel/drv/sparv9/ with the newly compiled one and rebooted. I'll try to get a few more specifics when I get home and update this. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
> Well after much stumbling I have successfully compiled the driver with the > fix. Can you elaborate on what it took to get the driver built and installed? I'm nearly certain I do, in fact, have the same issue you were having. -Thanks- -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
UPDATE: Well after much stumbling I have successfully compiled the driver with the fix. I am now able to share LUNs from my opensolaris server to my ESXi server. Here is what I am running successfully (directly connected no FC switch) Sunfire V240 ( 2x1Ghz, 8GB Ram, LP9802 ) - OpenSolaris b134 Proliant DL360 ( 2x3.4Ghz, 4GB Ram, LP9802 ) - ESXi 4.1 -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
Has anyone been able to compile and try this fix? I have a couple of LP9802 cards that are having this issue (sparc platform), I've been trying to get a compile of this but have been failing miserably. I'm somewhat used to compiling stuff on Linux but this being the first thing I've ever tried to compile on opensolaris. Would it be better for me just to get a copy of snv_126 and install it? -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
I have tested a fix for this issue and the LP9002 is working again on my system. We will be submitting an updated driver to Sun in a future gate, but I am not sure yet which one it will make it into.Until then, I am posting the fix below for any of you who are compiling the source yourself. You can make the change and give it a try. We may be able to compile and distribute a test build of the driver for those that really need it, but officially you should not redistribute it beyond your test facilities. Just email me directly if that is desirable ([email protected]). Here is the fix: emlxs_sli3.c: static uint32_t emlxs_sli3_prep_fct_iocb(emlxs_port_t *port, emlxs_buf_t *cmd_sbp, int channel) { … if (fct_task->task_flags & TF_WRITE_DATA) { iocb->ULPCOMMAND = CMD_FCP_TRECEIVE64_CX; } else {/* TF_READ_DATA */ iocb->ULPCOMMAND = CMD_FCP_TSEND64_CX; -if (dbuf->db_data_size == -fct_task->task_expected_xfer_length) +if ((hba->sli_mode == EMLXS_HBA_SLI3_MODE) && +(dbuf->db_data_size == +fct_task->task_expected_xfer_length)) iocb->ULPCT = 0x1; /* enable auto-rsp AP feature */ } return (IOERR_SUCCESS); } /* emlxs_sli3_prep_fct_iocb() */ The change for SLI2 is made in the SLI3 routine because the SLI2 interface is very very similar to SLI3 and we didn't want to replicate all the code between SLI2 and SLI3. Therefore, the SLI3 functions handle both SLI2 and SLI3 behavior. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
I successfully recreated the problem and discovered the error in our driver. The 2.50 driver implemented a performance enhancement feature which sets a bit in the SCSI data IOCB that requests the adapter firmware automatically send the SCSI status once the response data has been transferred. Unfortunately, that feature is only available in our SLI3 interface and the LP9002 only supports our SLI2 interface. What was happening was the initiator was sending an inquiry or report LUN request and the target was responding to it, but the SCSI status was never being sent by the LP9002. The initiator timed out and thus never was able to discover the LUN info. Mike LaSpina was correct in his earlier posting about it being an SLI2 vs SLI3 issue. I am working on a fix that I will publish soon. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
We are trying to get a system setup to reproduce your problem with the LP9002 adapters. The LP9002 adapters have been EOL for some time now and we no longer do regular testing with them. We will post our results when we know more. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
In the examination of code changes within snv_128 there are multiple areas that could impact the SLI firmware layer. I suspect it is those changes that are the root of the issue. SLI-3 cards are functional but the LP9002 SLI-2 based instance in this case is impacted. I would suspect the SCSI Inquiry CDB and possibly CDB's are impacted with a mismatch in struct requirements. Regardless of the exact issue I did not find a existing bug in the system and there I added one for you. Regards, Mike http://blog.laspina.ca/ -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
I can confirm this. Yesterday i testet from snv 126 upwards. 127 is working Driver Version: 2.40s (2009.07.17.10.15). 128 is not working Driver Version: 2.50h (2009.10.23.17.15). But point to point mode between two cards is now working with snv128 and snv134. State is up but lun size = 0MB. This was not working till 128. -Ursprüngliche Nachricht- Von: [email protected] [mailto:[email protected]] Im Auftrag von Thomas Boeber Gesendet: Freitag, 25. Juni 2010 22:13 An: [email protected] Betreff: Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134 As far as I can tell the Emulex 2 Gbps FC cards are not working since snv_128. The last version to work has been snv_127. -- This message posted from opensolaris.org ___ ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
As far as I can tell the Emulex 2 Gbps FC cards are not working since snv_128. The last version to work has been snv_127. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
How far back can you define? So far it's 126 is ok and 134 is broken? Any of these releases work? 128 129 131 132 There is a lot of change since 126. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
Re: [storage-discuss] Lun Size 0MB with Emulex LP9002L FC Target and Opensolaris snv_134
I have very much the same issue. The Emulex LP9002 is supposed to be supported and was working in previous snv versions but is broken with snv_134. The same setup works with a LPe12002 and a QLogic 2460 HBA so I assume there is something in this code level which prevents the LP9002 from working as a FC Traget. -- This message posted from opensolaris.org ___ storage-discuss mailing list [email protected] http://mail.opensolaris.org/mailman/listinfo/storage-discuss
