On 07/15/2010 11:57 AM, Kai Meyer wrote:
We are experiencing nearly exactly the same issues as the original
poster. We are fully updated RHEL 5.5, including the iscsi-initiator-
Just to make sure, you are using something like kernel version
2.6.18-194.8.1?
utils-6.2.0.871-0.18.el5 posted earlier in the list (http://
people.redhat.com/mchristi/iscsi/rhel5.6/iscsi-initiator-utils/)
We are on a Dell Blade M610 with a Quad 1GB NIC + iscsi offloader
mezzanine card. We're using the physical interfaces eth2 and eth3, and
would like to add Multipath into the mix once iSCSI is worked out. We
can use the 1GB connections on eth2 and eth3 to connect, login, and do
anything we want, so we thought it would be worthwhile to switch to
the iscsi offloader. During boot, we see these messages a lot:
ADDRCONF(NETDEV_CHANGE): eth3: link becomes ready
bnx2i: iSCSI not supported, dev=eth3
Are you getting this no supported error on the other ethXs?
Then much later, when iscsi starts, we get:
Broadcom NetXtreme II iSCSI Driver bnx2i v2.1.0 (Dec 06, 2009)
iscsi: registered transport (bnx2i)
scsi6 : Broadcom Offload iSCSI Initiator
scsi7 : Broadcom Offload iSCSI Initiator
scsi8 : Broadcom Offload iSCSI Initiator
scsi9 : Broadcom Offload iSCSI Initiator
scsi10 : Broadcom Offload iSCSI Initiator
scsi11 : Broadcom Offload iSCSI Initiator
iscsi: registered transport (tcp)
iscsi: registered transport (iser)
iscsi: registered transport (be2iscsi)
We are basing our selection of iscsi offloading nics by their HW
address:
eth0 Link encap:Ethernet HWaddr 00:26:B9:FA:10:38
inet addr:172.20.1.1 Bcast:172.20.15.255 Mask:
255.255.240.0
eth1 Link encap:Ethernet HWaddr 00:26:B9:FA:10:3A
eth2 Link encap:Ethernet HWaddr 00:23:AE:F9:38:74
inet addr:172.20.17.1 Bcast:172.20.31.255 Mask:
255.255.240.0
eth3 Link encap:Ethernet HWaddr 00:23:AE:F9:38:76
inet addr:172.20.18.1 Bcast:172.20.31.255 Mask:
255.255.240.0
eth4 Link encap:Ethernet HWaddr 00:23:AE:F9:38:78
eth5 Link encap:Ethernet HWaddr 00:23:AE:F9:38:7A
# iscsiadm -m iface
default tcp,<empty>,<empty>,<empty>,<empty>
iser iser,<empty>,<empty>,<empty>,<empty>
bnx2i.00:23:ae:f9:38:79 bnx2i,
00:23:ae:f9:38:79,<empty>,<empty>,<empty>
bnx2i.00:26:b9:fa:10:3b bnx2i,00:26:b9:fa:
10:3b,<empty>,<empty>,<empty>
bnx2i.00:23:ae:f9:38:77 bnx2i,
00:23:ae:f9:38:77,172.20.20.1,<empty>,<empty>
bnx2i.00:26:b9:fa:10:39 bnx2i,00:26:b9:fa:
10:39,<empty>,<empty>,<empty>
bnx2i.00:23:ae:f9:38:75 bnx2i,
00:23:ae:f9:38:75,172.20.19.1,<empty>,<empty>
bnx2i.00:23:ae:f9:38:7b bnx2i,
00:23:ae:f9:38:7b,<empty>,<empty>,<empty>
We are guessing (bnx2i.00:23:ae:f9:38:75 == eth2) and (bnx2i.
00:23:ae:f9:38:77 == eth3), which is only important because of the
VLan configuration.
iscsiadm -m iface -I bnx2i.00:23:ae:f9:38:75
# BEGIN RECORD 2.0-871
iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:75
iface.net_ifacename =<empty>
iface.ipaddress = 172.20.19.1
iface.hwaddress = 00:23:ae:f9:38:75
iface.transport_name = bnx2i
iface.initiatorname =<empty>
# END RECORD
iscsiadm -m iface -I bnx2i.00:23:ae:f9:38:77
# BEGIN RECORD 2.0-871
iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:77
iface.net_ifacename =<empty>
iface.ipaddress = 172.20.20.1
iface.hwaddress = 00:23:ae:f9:38:77
iface.transport_name = bnx2i
iface.initiatorname =<empty>
# END RECORD
Send Targets works just fine, here's the result of one of the targets
I got back:
iscsiadm -m node -I bnx2i.00:23:ae:f9:38:75 -T iqn.
2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513 -p
172.20.16.14
# BEGIN RECORD 2.0-871
node.name = iqn.2001-05.com.equallogic:0-8a0906-
db234b706-9e70001687b4c378-008513
node.tpgt = 1
node.startup = automatic
iface.hwaddress = 00:23:ae:f9:38:75
iface.ipaddress = 172.20.19.1
iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:75
iface.net_ifacename =<empty>
iface.transport_name = bnx2i
iface.initiatorname =<empty>
node.discovery_address = 172.20.16.14
node.discovery_port = 3260
node.discovery_type = send_targets
node.session.initial_cmdsn = 0
node.session.initial_login_retry_max = 8
node.session.xmit_thread_priority = -20
node.session.cmds_max = 1024
node.session.queue_depth = 128
node.session.auth.authmethod = CHAP
node.session.auth.username = chap1
node.session.auth.password = ********
node.session.auth.username_in =<empty>
node.session.auth.password_in =<empty>
node.session.timeo.replacement_timeout = 120
node.session.err_timeo.abort_timeout = 15
node.session.err_timeo.lu_reset_timeout = 20
node.session.err_timeo.host_reset_timeout = 60
node.session.iscsi.FastAbort = Yes
node.session.iscsi.InitialR2T = No
node.session.iscsi.ImmediateData = Yes
node.session.iscsi.FirstBurstLength = 262144
node.session.iscsi.MaxBurstLength = 16776192
node.session.iscsi.DefaultTime2Retain = 0
node.session.iscsi.DefaultTime2Wait = 2
node.session.iscsi.MaxConnections = 1
node.session.iscsi.MaxOutstandingR2T = 1
node.session.iscsi.ERL = 0
node.conn[0].address = 172.20.16.14
node.conn[0].port = 3260
node.conn[0].startup = manual
node.conn[0].tcp.window_size = 524288
node.conn[0].tcp.type_of_service = 0
node.conn[0].timeo.logout_timeout = 15
node.conn[0].timeo.login_timeout = 15
node.conn[0].timeo.auth_timeout = 45
node.conn[0].timeo.noop_out_interval = 5
node.conn[0].timeo.noop_out_timeout = 5
node.conn[0].iscsi.MaxRecvDataSegmentLength = 131072
node.conn[0].iscsi.HeaderDigest = None
node.conn[0].iscsi.IFMarker = No
node.conn[0].iscsi.OFMarker = No
# END RECORD
iscsiadm -m node -I bnx2i.00:23:ae:f9:38:77 -T iqn.
2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513 -p
172.20.16.14
# BEGIN RECORD 2.0-871
node.name = iqn.2001-05.com.equallogic:0-8a0906-
db234b706-9e70001687b4c378-008513
node.tpgt = 1
node.startup = automatic
iface.hwaddress = 00:23:ae:f9:38:77
iface.ipaddress = 172.20.20.1
iface.iscsi_ifacename = bnx2i.00:23:ae:f9:38:77
iface.net_ifacename =<empty>
iface.transport_name = bnx2i
iface.initiatorname =<empty>
node.discovery_address = 172.20.16.14
node.discovery_port = 3260
node.discovery_type = send_targets
node.session.initial_cmdsn = 0
node.session.initial_login_retry_max = 8
node.session.xmit_thread_priority = -20
node.session.cmds_max = 1024
node.session.queue_depth = 128
node.session.auth.authmethod = CHAP
node.session.auth.username = chap1
node.session.auth.password = ********
node.session.auth.username_in =<empty>
node.session.auth.password_in =<empty>
node.session.timeo.replacement_timeout = 120
node.session.err_timeo.abort_timeout = 15
node.session.err_timeo.lu_reset_timeout = 20
node.session.err_timeo.host_reset_timeout = 60
node.session.iscsi.FastAbort = Yes
node.session.iscsi.InitialR2T = No
node.session.iscsi.ImmediateData = Yes
node.session.iscsi.FirstBurstLength = 262144
node.session.iscsi.MaxBurstLength = 16776192
node.session.iscsi.DefaultTime2Retain = 0
node.session.iscsi.DefaultTime2Wait = 2
node.session.iscsi.MaxConnections = 1
node.session.iscsi.MaxOutstandingR2T = 1
node.session.iscsi.ERL = 0
node.conn[0].address = 172.20.16.14
node.conn[0].port = 3260
node.conn[0].startup = manual
node.conn[0].tcp.window_size = 524288
node.conn[0].tcp.type_of_service = 0
node.conn[0].timeo.logout_timeout = 15
node.conn[0].timeo.login_timeout = 15
node.conn[0].timeo.auth_timeout = 45
node.conn[0].timeo.noop_out_interval = 5
node.conn[0].timeo.noop_out_timeout = 5
node.conn[0].iscsi.MaxRecvDataSegmentLength = 131072
node.conn[0].iscsi.HeaderDigest = None
node.conn[0].iscsi.IFMarker = No
node.conn[0].iscsi.OFMarker = No
# END RECORD
Logins fail though:
iscsiadm -m node -I bnx2i.00:23:ae:f9:38:75 -T iqn.
2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513 -p
172.20.16.14 -l
Logging in to [iface: bnx2i.00:23:ae:f9:38:75, target: iqn.
2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513,
portal: 172.20.16.14,3260]
iscsiadm: Could not login to [iface: bnx2i.00:23:ae:f9:38:75, target:
iqn.2001-05.com.equallogic:0-8a0906-db234b706-9e70001687b4c378-008513,
portal: 172.20.16.14,3260]:
iscsiadm: initiator reported error (8 - connection timed out)
Syslog gives:
Jul 15 10:42:47 kvmt1 iscsid: Received iferror -1
Jul 15 10:42:47 kvmt1 iscsid: cannot make a connection to
172.20.16.14:3260 (-1,11)
Jul 15 10:42:53 kvmt1 iscsid: Received iferror -1
Jul 15 10:42:53 kvmt1 iscsid: cannot make a connection to
172.20.16.14:3260 (-1,11)
Jul 15 10:42:58 kvmt1 iscsid: Received iferror -1
Jul 15 10:42:58 kvmt1 iscsid: cannot make a connection to
172.20.16.14:3260 (-1,11)
Jul 15 10:43:03 kvmt1 iscsid: Received iferror -1
Jul 15 10:43:03 kvmt1 iscsid: cannot make a connection to
172.20.16.14:3260 (-1,11)
Jul 15 10:43:08 kvmt1 iscsid: Received iferror -1
Jul 15 10:43:08 kvmt1 iscsid: cannot make a connection to
172.20.16.14:3260 (-1,11)
We're ok going back to tcp transport for the time being, but then we
have to play games with ARP, and routing tables to get the data to go
down the right wires when using multipath.
When using iscsi_tcp are you using iface binding and with that do you
still have to do tricks with the routing tables and ARP? Are doing
binding by iscsi iface hw address/MAC or by the vlan (iscsi iface
iface.net_ifacename = ethX.Y setting)?
--
You received this message because you are subscribed to the Google Groups
"open-iscsi" group.
To post to this group, send email to open-is...@googlegroups.com.
To unsubscribe from this group, send email to
open-iscsi+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/open-iscsi?hl=en.
