Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-12-08 Thread David Moreau Simard
: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of David Moreau Simard Sent: 05 December 2014 16:03 To: Nick Fisk Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target I've flushed everything - data, pools, configs and reconfigured

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-12-08 Thread Nick Fisk
@lists.ceph.com Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target I've flushed everything - data, pools, configs and reconfigured the whole thing. I was particularly careful with cache tiering configurations (almost leaving defaults when possible) and it's not locking anymore. It looks like

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-12-08 Thread Mike Christie
: Re: [ceph-users] Poor RBD performance as LIO iSCSI target I've flushed everything - data, pools, configs and reconfigured the whole thing. I was particularly careful with cache tiering configurations (almost leaving defaults when possible) and it's not locking anymore. It looks like

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-12-08 Thread Mike Christie
: [ceph-users] Poor RBD performance as LIO iSCSI target Rama, Thanks for your reply. My end goal is to use iSCSI (with LIO/targetcli) to export rbd block devices. I was encountering issues with iSCSI which are explained in my previous emails. I ended up being able to reproduce the problem

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-12-06 Thread Nick Fisk
-boun...@lists.ceph.com] On Behalf Of David Moreau Simard Sent: 05 December 2014 16:03 To: Nick Fisk Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target I've flushed everything - data, pools, configs and reconfigured the whole thing. I was particularly

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-12-05 Thread David Moreau Simard
: [ceph-users] Poor RBD performance as LIO iSCSI target Rama, Thanks for your reply. My end goal is to use iSCSI (with LIO/targetcli) to export rbd block devices. I was encountering issues with iSCSI which are explained in my previous emails. I ended up being able to reproduce

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-20 Thread Nick Fisk
-Original Message- From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of David Moreau Simard Sent: 19 November 2014 10:48 To: Ramakrishna Nishtala (rnishtal) Cc: ceph-users@lists.ceph.com; Nick Fisk Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target Rama, Thanks

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-20 Thread David Moreau Simard
: Tuesday, November 18, 2014 3:49 PM To: Nick Fisk Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target Testing without the cache tiering is the next test I want to do when I have time.. When it's hanging, there is no activity at all

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-20 Thread Nick Fisk
emit } -Original Message- From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of David Moreau Simard Sent: 20 November 2014 20:03 To: Nick Fisk Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target Nick, Can you share more

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-18 Thread David Moreau Simard
Thanks guys. I looked at http://tracker.ceph.com/issues/8818 and chatted with dis on #ceph-devel. I ran a LOT of tests on a LOT of comabination of kernels (sometimes with tunables legacy). I haven't found a magical combination in which the following test does not hang: fio --name=writefile

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-18 Thread Nick Fisk
-users] Poor RBD performance as LIO iSCSI target Thanks guys. I looked at http://tracker.ceph.com/issues/8818 and chatted with dis on #ceph-devel. I ran a LOT of tests on a LOT of comabination of kernels (sometimes with tunables legacy). I haven't found a magical combination in which the following

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-18 Thread David Moreau Simard
Christie Cc: ceph-users@lists.ceph.com; Christopher Spearman Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target Thanks guys. I looked at http://tracker.ceph.com/issues/8818 and chatted with dis on #ceph-devel. I ran a LOT of tests on a LOT of comabination of kernels

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-18 Thread Ramakrishna Nishtala (rnishtal)
: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of David Moreau Simard Sent: Tuesday, November 18, 2014 3:49 PM To: Nick Fisk Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Poor RBD performance as LIO iSCSI target Testing without the cache tiering is the next test I want

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-13 Thread David Moreau Simard
Running into weird issues here as well in a test environment. I don't have a solution either but perhaps we can find some things in common.. Setup in a nutshell: - Ceph cluster: Ubuntu 14.04, Kernel 3.16.7, Ceph 0.87-1 (OSDs with separate public/cluster network in 10 Gbps) - iSCSI Proxy node

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-13 Thread German Anders
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-13 Thread David Moreau Simard
wrote: Is possible that you hit bug #8818 ? German Anders --- Original message --- Asunto: Re: [ceph-users] Poor RBD performance as LIO iSCSI target De: David Moreau Simard dmsim...@iweb.com Para: Christopher Spearman neromaver...@gmail.com Cc

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-13 Thread German Anders
___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-11-13 Thread Mike Christie
On 11/13/2014 10:17 AM, David Moreau Simard wrote: Running into weird issues here as well in a test environment. I don't have a solution either but perhaps we can find some things in common.. Setup in a nutshell: - Ceph cluster: Ubuntu 14.04, Kernel 3.16.7, Ceph 0.87-1 (OSDs with separate

[ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-28 Thread Christopher Spearman
I've noticed a pretty steep performance degradation when using RBDs with LIO. I've tried a multitude of configurations to see if there are any changes in performance and I've only found a few that work (sort of). Details about the systems being used: - All network hardware for data is 10gbe,

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-28 Thread Mike Christie
On 10/27/2014 04:24 PM, Christopher Spearman wrote: - What tested with bad performance (Reads ~25-50MB/s - Writes ~25-50MB/s) * RBD setup as target using LIO * RBD - LVM - LIO target * RBD - RAID0/1 - LIO target - What tested with good performance (Reads ~700-800MB/s - Writes

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-28 Thread Christopher Spearman
Sage: That'd be my assumption, performance looked pretty fantastic over loop until it started being used it heavily Mike: The configs you asked for are at the end of this message I've subtracted changed some info, iqn/wwn/portal, for security purposes. The raw loop target configs are all in

[ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-27 Thread Christopher Spearman
I've noticed a pretty steep performance degradation when using RBDs with LIO. I've tried a multitude of configurations to see if there are any changes in performance and I've only found a few that work (sort of). Details about the systems being used: - All network hardware for data is 10gbe,

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-27 Thread Nick Fisk
Hi Chris, I'm doing something very similar to you, however only in a very early stage of testing, but I don't seem to see the same problem that you are experiencing. My setup is as follows:- 1x HP DL360 Server Running ESX 5.1 8x 10K SAS 146GB drives each configured as a RAID 0 and with a

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-27 Thread Christopher Spearman
Hi Nick, Thanks for the response, I'm glad to hear you've got something that provides reasonable performance, that brings some hope to my situation. I am using the kernel RBD client. Using a different OS for the gateway/iSCSI nodes was going to be my next step. Especially now, seeing that you

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-27 Thread Chen, Xiaoxi
: Tuesday, October 28, 2014 5:24 AM To: ceph-users@lists.ceph.com Subject: [ceph-users] Poor RBD performance as LIO iSCSI target I've noticed a pretty steep performance degradation when using RBDs with LIO. I've tried a multitude of configurations to see if there are any changes in performance

Re: [ceph-users] Poor RBD performance as LIO iSCSI target

2014-10-27 Thread Sage Weil
[mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Christopher Spearman Sent: Tuesday, October 28, 2014 5:24 AM To: ceph-users@lists.ceph.com Subject: [ceph-users] Poor RBD performance as LIO iSCSI target   I've noticed a pretty steep performance degradation when using RBDs with LIO