Hi list, now, I've got IB/iSER working with sightly modified Linux 3.0 (Infiniband/iSCSI) mainline modules, too. We need them, because they have much better IPoIB performance than the ones from OFED-1.5.4.
I've used open-iscsi 2.0.872 (commit 4323e342d2c9fb8ed7233ce855001c189ec55b23) for this. During login to the Solaris 11 COMSTAR target I had the problem that the Mellanox IB HCA (mlx4) reported a vendor error: "iser: iser_drain_tx_cq:tx id ffff88402391f898 status 4 vend_err 57" This is a "local protection error", Or Gerlitz explained. And of cause it forced me to reboot, ... . Backporting the ib_iser module from 3.2 to 3.0 showed that the error was fixed between 3.0 and 3.2. We could locate the fix to the following commits: IB/iser: Support iSCSI PDU padding IB/iser: Use separate buffers for the login request/response After cherry-picking them to kernel 3.0.15 in the correct order it worked. :-) Thanks to Or Gerlitz for the help! Cheers, Sebastian On 15/12/11 15:34, Sebastian Riemer wrote: > Hi Mike, Or, others, > > finally I've got IB/iSER running on Debian Squeeze with Linux kernel 3.0 > smoothly. > > The problem was that we did not have the suitable OFED for our kernel > and we did not use the open-iscsi from OFED. Kernel 3.0 is supported > since OFED-1.5.4 from 2011-12-05. > > So, I've taken the 1.5.2-based stuff from Debian/Experimental and I've > updated it to 1.5.4 from OFA. Then, I've noticed that Debian doesn't > build "ib_iser" in the OFA kernel source and that they don't build the > open-iscsi kernel/user-space code - I made it do so. > > The next problem was that open-iscsi kernel code in OFED-1.5.4 is for <= > 2.6.32 based RedHat distributions. I had to port the source from 2.6.30 > to 3.0 due to kernel API changes. OFA even forgot libiscsi_tcp.[ch] in > OFED-1.5.4. So, I had to import it from 2.6.30 mainline. > I did so, because we wanted to compare TCP and iSER speed over > InfiniBand. Our Solaris COMSTAR targets provide both. > > FYI, I've attached two mindmaps which display the tight dependency > between OFED and open-iscsi kernel code. > > After fixing the kernel, there was still a problem in the open-iscsi > 2.0.869 user-space from OFED. Some sysfs magic has changed - so that the > iSCSI host number couldn't be found. > > After fixing that, it worked for me. > > Cheers, > > Sebastian > -- You received this message because you are subscribed to the Google Groups "open-iscsi" group. To post to this group, send email to open-iscsi@googlegroups.com. To unsubscribe from this group, send email to open-iscsi+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.
