Hello Kai, FYI, the "bnx2i: iSCSI not supported" message indicates that the port associated with eth3 is not licensed to do iSCSI offload. Echoing Mike's question, are you getting this message on all the ethXs that you intend to do iSCSI offload?
Eddie -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Mike Christie Sent: Thursday, July 15, 2010 2:05 PM To: [email protected] Cc: Kai Meyer Subject: Re: Centos 5.4 bnx2i iscsi woes On 07/15/2010 11:57 AM, Kai Meyer wrote: > We are experiencing nearly exactly the same issues as the original > poster. We are fully updated RHEL 5.5, including the iscsi-initiator- Just to make sure, you are using something like kernel version 2.6.18-194.8.1? > utils-6.2.0.871-0.18.el5 posted earlier in the list (http:// > people.redhat.com/mchristi/iscsi/rhel5.6/iscsi-initiator-utils/) > > We are on a Dell Blade M610 with a Quad 1GB NIC + iscsi offloader > mezzanine card. We're using the physical interfaces eth2 and eth3, and > would like to add Multipath into the mix once iSCSI is worked out. We > can use the 1GB connections on eth2 and eth3 to connect, login, and do > anything we want, so we thought it would be worthwhile to switch to > the iscsi offloader. During boot, we see these messages a lot: > ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready > bnx2i: iSCSI not supported, dev=eth3 Are you getting this no supported error on the other ethXs? > > Then much later, when iscsi starts, we get: > Broadcom NetXtreme II iSCSI Driver bnx2i v2.1.0 (Dec 06, 2009) > iscsi: registered transport (bnx2i) > scsi6 : Broadcom Offload iSCSI Initiator > scsi7 : Broadcom Offload iSCSI Initiator > scsi8 : Broadcom Offload iSCSI Initiator > scsi9 : Broadcom Offload iSCSI Initiator > scsi10 : Broadcom Offload iSCSI Initiator > scsi11 : Broadcom Offload iSCSI Initiator > iscsi: registered transport (tcp) > iscsi: registered transport (iser) > iscsi: registered transport (be2iscsi) > > We are basing our selection of iscsi offloading nics by their HW > address: > eth0 Link encap:Ethernet HWaddr 00:26:B9:FA:10:38 > inet addr:172.20.1.1 Bcast:172.20.15.255 Mask: > 255.255.240.0 > eth1 Link encap:Ethernet HWaddr 00:26:B9:FA:10:3A > eth2 Link encap:Ethernet HWaddr 00:23:AE:F9:38:74 > inet addr:172.20.17.1 Bcast:172.20.31.255 Mask: > 255.255.240.0 > eth3 Link encap:Ethernet HWaddr 00:23:AE:F9:38:76 > inet addr:172.20.18.1 Bcast:172.20.31.255 Mask: > 255.255.240.0 > eth4 Link encap:Ethernet HWaddr 00:23:AE:F9:38:78 > eth5 Link encap:Ethernet HWaddr 00:23:AE:F9:38:7A > > > # iscsiadm -m iface > default tcp,<empty>,<empty>,<empty>,<empty> > iser iser,<empty>,<empty>,<empty>,<empty> > bnx2i.00:23:ae:f9:38:79 bnx2i, > 00:23:ae:f9:38:79,<empty>,<empty>,<empty> > bnx2i.00:26:b9:fa:10:3b bnx2i,00:26:b9:fa: > 10:3b,<empty>,<empty>,<empty> > bnx2i.00:23:ae:f9:38:77 bnx2i, > 00:23:ae:f9:38:77,172.20.20.1,<empty>,<empty> > bnx2i.00:26:b9:fa:10:39 bnx2i,00:26:b9:fa: > 10:39,<empty>,<empty>,<empty> > bnx2i.00:23:ae:f9:38:75 bnx2i, > 00:23:ae:f9:38:75,172.20.19.1,<empty>,<empty> > bnx2i.00:23:ae:f9:38:7b bnx2i, > 00:23:ae:f9:38:7b,<empty>,<empty>,<empty> > > We are guessing (bnx2i.00:23:ae:f9:38:75 == eth2) and (bnx2i. > 00:23:ae:f9:38:77 == eth3), which is only important because of the > VLan configuration. > > iscsiadm -m iface -I bnx2i.00:23:ae:f9:38:75 > # BEGIN RECORD 2.0-871 > iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:75 > iface.net_ifacename =<empty> > iface.ipaddress = 172.20.19.1 > iface.hwaddress = 00:23:ae:f9:38:75 > iface.transport_name = bnx2i > iface.initiatorname =<empty> > # END RECORD > > iscsiadm -m iface -I bnx2i.00:23:ae:f9:38:77 > # BEGIN RECORD 2.0-871 > iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:77 > iface.net_ifacename =<empty> > iface.ipaddress = 172.20.20.1 > iface.hwaddress = 00:23:ae:f9:38:77 > iface.transport_name = bnx2i > iface.initiatorname =<empty> > # END RECORD > > > Send Targets works just fine, here's the result of one of the targets > I got back: > iscsiadm -m node -I bnx2i.00:23:ae:f9:38:75 -T iqn. > 2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513 -p > 172.20.16.14 > # BEGIN RECORD 2.0-871 > node.name = iqn.2001-05.com.equallogic:0-8a0906- > db234b706-9e70001687b4c378-008513 > node.tpgt = 1 > node.startup = automatic > iface.hwaddress = 00:23:ae:f9:38:75 > iface.ipaddress = 172.20.19.1 > iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:75 > iface.net_ifacename =<empty> > iface.transport_name = bnx2i > iface.initiatorname =<empty> > node.discovery_address = 172.20.16.14 > node.discovery_port = 3260 > node.discovery_type = send_targets > node.session.initial_cmdsn = 0 > node.session.initial_login_retry_max = 8 > node.session.xmit_thread_priority = -20 > node.session.cmds_max = 1024 > node.session.queue_depth = 128 > node.session.auth.authmethod = CHAP > node.session.auth.username = chap1 > node.session.auth.password = ******** > node.session.auth.username_in =<empty> > node.session.auth.password_in =<empty> > node.session.timeo.replacement_timeout = 120 > node.session.err_timeo.abort_timeout = 15 > node.session.err_timeo.lu_reset_timeout = 20 > node.session.err_timeo.host_reset_timeout = 60 > node.session.iscsi.FastAbort = Yes > node.session.iscsi.InitialR2T = No > node.session.iscsi.ImmediateData = Yes > node.session.iscsi.FirstBurstLength = 262144 > node.session.iscsi.MaxBurstLength = 16776192 > node.session.iscsi.DefaultTime2Retain = 0 > node.session.iscsi.DefaultTime2Wait = 2 > node.session.iscsi.MaxConnections = 1 > node.session.iscsi.MaxOutstandingR2T = 1 > node.session.iscsi.ERL = 0 > node.conn[0].address = 172.20.16.14 > node.conn[0].port = 3260 > node.conn[0].startup = manual > node.conn[0].tcp.window_size = 524288 > node.conn[0].tcp.type_of_service = 0 > node.conn[0].timeo.logout_timeout = 15 > node.conn[0].timeo.login_timeout = 15 > node.conn[0].timeo.auth_timeout = 45 > node.conn[0].timeo.noop_out_interval = 5 > node.conn[0].timeo.noop_out_timeout = 5 > node.conn[0].iscsi.MaxRecvDataSegmentLength = 131072 > node.conn[0].iscsi.HeaderDigest = None > node.conn[0].iscsi.IFMarker = No > node.conn[0].iscsi.OFMarker = No > # END RECORD > > iscsiadm -m node -I bnx2i.00:23:ae:f9:38:77 -T iqn. > 2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513 -p > 172.20.16.14 > # BEGIN RECORD 2.0-871 > node.name = iqn.2001-05.com.equallogic:0-8a0906- > db234b706-9e70001687b4c378-008513 > node.tpgt = 1 > node.startup = automatic > iface.hwaddress = 00:23:ae:f9:38:77 > iface.ipaddress = 172.20.20.1 > iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:77 > iface.net_ifacename =<empty> > iface.transport_name = bnx2i > iface.initiatorname =<empty> > node.discovery_address = 172.20.16.14 > node.discovery_port = 3260 > node.discovery_type = send_targets > node.session.initial_cmdsn = 0 > node.session.initial_login_retry_max = 8 > node.session.xmit_thread_priority = -20 > node.session.cmds_max = 1024 > node.session.queue_depth = 128 > node.session.auth.authmethod = CHAP > node.session.auth.username = chap1 > node.session.auth.password = ******** > node.session.auth.username_in =<empty> > node.session.auth.password_in =<empty> > node.session.timeo.replacement_timeout = 120 > node.session.err_timeo.abort_timeout = 15 > node.session.err_timeo.lu_reset_timeout = 20 > node.session.err_timeo.host_reset_timeout = 60 > node.session.iscsi.FastAbort = Yes > node.session.iscsi.InitialR2T = No > node.session.iscsi.ImmediateData = Yes > node.session.iscsi.FirstBurstLength = 262144 > node.session.iscsi.MaxBurstLength = 16776192 > node.session.iscsi.DefaultTime2Retain = 0 > node.session.iscsi.DefaultTime2Wait = 2 > node.session.iscsi.MaxConnections = 1 > node.session.iscsi.MaxOutstandingR2T = 1 > node.session.iscsi.ERL = 0 > node.conn[0].address = 172.20.16.14 > node.conn[0].port = 3260 > node.conn[0].startup = manual > node.conn[0].tcp.window_size = 524288 > node.conn[0].tcp.type_of_service = 0 > node.conn[0].timeo.logout_timeout = 15 > node.conn[0].timeo.login_timeout = 15 > node.conn[0].timeo.auth_timeout = 45 > node.conn[0].timeo.noop_out_interval = 5 > node.conn[0].timeo.noop_out_timeout = 5 > node.conn[0].iscsi.MaxRecvDataSegmentLength = 131072 > node.conn[0].iscsi.HeaderDigest = None > node.conn[0].iscsi.IFMarker = No > node.conn[0].iscsi.OFMarker = No > # END RECORD > > Logins fail though: > iscsiadm -m node -I bnx2i.00:23:ae:f9:38:75 -T iqn. > 2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513 -p > 172.20.16.14 -l > Logging in to [iface: bnx2i.00:23:ae:f9:38:75, target: iqn. > 2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513, > portal: 172.20.16.14,3260] > iscsiadm: Could not login to [iface: bnx2i.00:23:ae:f9:38:75, target: > iqn.2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513, > portal: 172.20.16.14,3260]: > iscsiadm: initiator reported error (8 - connection timed out) > > Syslog gives: > Jul 15 10:42:47 kvmt1 iscsid: Received iferror -1 > Jul 15 10:42:47 kvmt1 iscsid: cannot make a connection to > 172.20.16.14:3260 (-1,11) > Jul 15 10:42:53 kvmt1 iscsid: Received iferror -1 > Jul 15 10:42:53 kvmt1 iscsid: cannot make a connection to > 172.20.16.14:3260 (-1,11) > Jul 15 10:42:58 kvmt1 iscsid: Received iferror -1 > Jul 15 10:42:58 kvmt1 iscsid: cannot make a connection to > 172.20.16.14:3260 (-1,11) > Jul 15 10:43:03 kvmt1 iscsid: Received iferror -1 > Jul 15 10:43:03 kvmt1 iscsid: cannot make a connection to > 172.20.16.14:3260 (-1,11) > Jul 15 10:43:08 kvmt1 iscsid: Received iferror -1 > Jul 15 10:43:08 kvmt1 iscsid: cannot make a connection to > 172.20.16.14:3260 (-1,11) > > > We're ok going back to tcp transport for the time being, but then we > have to play games with ARP, and routing tables to get the data to go > down the right wires when using multipath. When using iscsi_tcp are you using iface binding and with that do you still have to do tricks with the routing tables and ARP? Are doing binding by iscsi iface hw address/MAC or by the vlan (iscsi iface iface.net_ifacename = ethX.Y setting)? -- You received this message because you are subscribed to the Google Groups "open-iscsi" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en. -- You received this message because you are subscribed to the Google Groups "open-iscsi" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/open-iscsi?hl=en.
