On Fri, 2012-08-17 at 18:17 -0700, Nicholas A. Bellinger wrote: > On Fri, 2012-08-17 at 14:02 -0500, Andrew Theurer wrote: > > Hello, > > > > First, thanks for this great project! We have been using the FC target > > for a few months now for KVM disk IO scalability analysis, and it has > > been a great resource for us! We're able to do >1.4 M IOPS with > > multiple VMs via PCI-pass-through, and we're now testing virtio > > scalability enhancements, so it's been an incredibly useful feature for > > us! > > > > Thanks for sharing Andrew! Glad to see others are also pushing > 1M > IOPs workloads with the mainline kernel target. Out of curiosity, would > you mind sharing how many LUNs you needed to push 1.4M IOPs..?
We used 7 scsi target hosts, each with a QLogic dual port 8 Gbps adapter. Each server had 8 LUNs which were ramdisks. We could get 100,000 IOPs , 50%/50% read/write with 8K request size, per 8Gbps interface. The servers were dual socket Intel Nehalem variety. The CPU usage was quite low, but I do not recall exactly what it was. The initiator host is a single IBM x3850X5, which has 4 Intel Westmere-EX processors and 7 PCI slots, which were all filled with the same QLogic adapters. > > Also when you say the 'FC Target', I assume you mean tcm_fc(FCoE) fabric > driver, yes..? Actually the tcm_qla2xxx for the above configuration. tcm_fc is what we want to start testing. > > > We are now trying to create a test-bed with FCoE, with only FCoE targets > > and initiators (no FCF's). For the moment, I am trying a > > directly-connected 82599EB adapters from two systems (one the target, > > the other the initiator). These interfaces are configured for IP and > > ping-able. I created vn2vn FC ports and I now have 1 fc_host per > > system. I have created a target on one via targetcli with a single LUN: > > > > > > > /> ls > > > o- / > > > ......................................................................................................... > > > [...] > > > o- backstores > > > .............................................................................................. > > > [...] > > > | o- block > > > .................................................................................... > > > [0 Storage Object] > > > | o- fileio > > > ................................................................................... > > > [1 Storage Object] > > > | | o- lun1 > > > ..................................................................... > > > [/tmp/lun1.img (1.0G) activated] > > > | o- pscsi > > > .................................................................................... > > > [0 Storage Object] > > > o- loopback > > > ........................................................................................... > > > [0 Target] > > > o- tcm_fc > > > ............................................................................................. > > > [1 Target] > > > o- 20:00:00:1b:21:4b:0a:0e > > > ........................................................................... > > > [enabled] > > > o- acls > > > .............................................................................................. > > > [1 ACL] > > > | o- 20:00:00:1b:21:67:5f:2a > > > .................................................................. [1 > > > Mapped LUN] > > > | o- mapped_lun1 > > > ................................................................... [lun1 > > > fileio/lun1 (rw)] > > > o- luns > > > .............................................................................................. > > > [1 LUN] > > > o- lun1 > > > ...................................................................... > > > [fileio/lun1 (/tmp/lun1.img)] > > > > The initiator has a port name of 0x2000001b21675f2a and both target and > > initiator ports are "Online". However, after re-scanning for devices, > > the initiator does not find any new LUNs. > > > > I tried to do a fcping, but I can only successfully ping a FC ID, and > > not a port name: > > > > > [root@spv-21 ~]# fcping -c 3 -h eth6 -F 0x000a0e > > > sending echo to 0xA0E > > > echo 1 accepted 0.468 ms > > > echo 2 accepted 0.428 ms > > > echo 3 accepted 0.462 ms > > > 3 frames sent, 3 received 0 errors, 0.000% loss, avg. rt time 0.453 ms > > > > > [root@spv-21 ~]# fcping -h eth6 -N 0x2000001b214b0a0e > > > GID_NN error: Invalid argument > > > cannot find fcid of destination @ wwnn 0x2000001B214B0A0E > > > > I am wondering if there's still a connectivity problem. [Not knowing > > much about the world of FC] Is there some sort of wwnn-to-fcid mapping > > that I am missing? Or maybe something else? > > > > Mmmm, not sure what is going on here with this particular setup. > > CC'ing MDR & Kiran @ Intel + OpenFCoE list who will have a better idea > how to start debug this.. Thanks. The open-fcoe dev list has been incredibly helpful to me recently. I though this might have been a target specific issue, but the more the merrier! -Andrew _______________________________________________ devel mailing list devel@open-fcoe.org https://lists.open-fcoe.org/mailman/listinfo/devel
