Hello Mike!
Mike Christie wrote:
> On the initiator side running 2.6.24 and 2.0.865.15, I
> # start opensm and give the initaitor ib port an ip.
> # start open-iscsi etc/init.d/open-iscsi start
> # do discovery to a the port setup on the target in the attached script.
>
> iscsiadm -m discovery -t st -p 20.10.10.100
>
> # Disable header digests
> iscsiadm -m node -o update -n node.conn[0].iscsi.HeaderDigest -v None
>
> # login
> iscsiadm -m node -T iqn.2001-04.iser -p 20.10.10.100 -l
>
>
> If I have already discovered targets and had node.startup to automatic
> then when I do the open-iscsi start then I scan skip those commands.
>
> Also when you use iscsi_discovery the discovery and update steps are
> done for you so you do not have to worry.
>
> #/bin/bash
> opensm&
> ifconfig ib1 20.10.10.100
> ./tgtadm --lld iscsi --mode target --op new --tid 1 --targetname
> iqn.2001-04.iser
> ./tgtadm --lld iscsi --mode logicalunit --op new --tid 1 --lun 1
> --backing-store /home/mnc/iet_lun0
> ./tgtadm --lld iscsi --op bind --mode target --tid 1 -I ALL
> ./tgtadm --lld iscsi --op show --mode target
>
I did exactly the same thing :
Target:
modprobe rdma_ucm
/bin/mknod /dev/infiniband/rdma_cm c `cat /sys/class/misc/rdma_cm/dev |
sed 's/:/ /g'`
./tgtd
./tgtadm --lld iscsi --op new --mode target --tid 1 -T
de.inqbus.poseidon:disk1
./tgtadm --lld iscsi --op new --mode logicalunit --tid 1 --lun 1 -b
/dev/vg1/test
./tgtadm --lld iscsi --op bind --mode target --tid 1 -I ALL
./tgtadm --lld iscsi --op show --mode target
Output is:
Target 1: de.inqbus.poseidon:disk1
System information:
Driver: iscsi
State: ready
I_T nexus information:
LUN information:
LUN: 0
Type: controller
SCSI ID: deadbeaf1:0
SCSI SN: beaf10
Size: 0 MB
Online: Yes
Removable media: No
Backing store: No backing store
LUN: 1
Type: disk
SCSI ID: deadbeaf1:1
SCSI SN: beaf11
Size: 42950 MB
Online: Yes
Removable media: No
Backing store: /dev/vg1/test
Account information:
ACL information:
ALL
Initiator:
opensm &
iscsiadm -m discovery -t st -p 10.6.0.2
iscsiadm -m node -o update -n node.conn[0].iscsi.HeaderDigest -v None
iscsiadm -m node -T de.inqbus.poseidon:disk1 -p 10.6.0.2 -l
dmesg:
[97061.587777] iser: iser_cma_handler:event: 3, error: -110
[97061.627292] iser: iscsi_iser_ep_poll:ib conn ffff81000c513080 rc = -1
[97065.910414] iser: iscsi_iser_ep_disconnect:ib conn ffff81000c513080
state 4
[97065.910451] iser: iser_conn_terminate:Failed to disconnect, conn:
0xffff81000c513080 err -22
[97065.910496] iser: iser_free_ib_conn_res:freeing conn ffff81000c513080
cma_id ffff81000dd4f200 fmr pool 0000000000000000 qp 0000000000000000
[97065.910550] iser: iser_device_try_release:device ffff81000ddc7540
refcount 0
[97066.179961] scsi13 : iSCSI Initiator over TCP/IP
[97066.434830] scsi 13:0:0:0: RAID IET
Controller 0001 PQ: 0 ANSI: 5
[97066.462533] scsi 13:0:0:1: Direct-Access IET
VIRTUAL-DISK 0001 PQ: 0 ANSI: 5
[97066.462874] sd 13:0:0:1: [sde] 83886080 512-byte hardware sectors
(42950 MB)
[97066.462874] sd 13:0:0:1: [sde] Write Protect is off
[97066.462874] sd 13:0:0:1: [sde] Mode Sense: 79 00 00 08
[97066.462874] sd 13:0:0:1: [sde] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[97066.462874] sd 13:0:0:1: [sde] 83886080 512-byte hardware sectors
(42950 MB)
[97066.462874] sd 13:0:0:1: [sde] Write Protect is off
[97066.462874] sd 13:0:0:1: [sde] Mode Sense: 79 00 00 08
[97066.462874] sd 13:0:0:1: [sde] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[97066.462874] sde: unknown partition table
[97066.481416] sd 13:0:0:1: [sde] Attached SCSI disk
[97066.485675] sd 13:0:0:1: [sde] Synchronizing SCSI cache
[364251.682445] scsi14 : iSCSI Initiator over TCP/IP
[364251.940716] scsi 14:0:0:0: RAID IET
Controller 0001 PQ: 0 ANSI: 5
[364251.976966] scsi 14:0:0:1: Direct-Access IET
VIRTUAL-DISK 0001 PQ: 0 ANSI: 5
[364251.977257] sd 14:0:0:1: [sde] 83886080 512-byte hardware sectors
(42950 MB)
[364251.977257] sd 14:0:0:1: [sde] Write Protect is off
[364251.977257] sd 14:0:0:1: [sde] Mode Sense: 79 00 00 08
[364251.977257] sd 14:0:0:1: [sde] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[364251.977257] sd 14:0:0:1: [sde] 83886080 512-byte hardware sectors
(42950 MB)
[364251.977257] sd 14:0:0:1: [sde] Write Protect is off
[364251.977257] sd 14:0:0:1: [sde] Mode Sense: 79 00 00 08
[364251.977257] sd 14:0:0:1: [sde] Write cache: enabled, read cache:
enabled, doesn't support DPO or FUA
[364251.977257] sde: unknown partition table
[364251.977257] sd 14:0:0:1: [sde] Attached SCSI disk
So I ended up at a iSCSI Connection over TCP/IP over IPoIB. And not over
iSER.
The main difference between our setup is
a) The bios revision of the mellanox cards .
b) The kernel version.
I will try the same thing with a 2.6.24 and report here, soon.
Best Regards
Volker
--
====================================================
inqbus it-consulting +49 ( 341 ) 5643800
Dr. Volker Jaenisch http://www.inqbus.de
Herloßsohnstr. 12 0 4 1 5 5 Leipzig
N O T - F Ä L L E +49 ( 170 ) 3113748
====================================================
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"open-iscsi" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at http://groups.google.com/group/open-iscsi
-~----------~----~----~----~------~----~------~--~---