Re: [Cluster-devel] [PATCH 0/2] GFS2: inplace_reserve performance improvements

2018-09-20 Thread Steven Whitehouse
Hi, On 20/09/18 18:47, Mark Syms wrote: Thanks for that Bob, we've been watching with interest the changes going in upstream but at the moment we're not really in a position to take advantage of them. Due to hardware vendor support certification requirements XenServer can only very occasion

Re: [Cluster-devel] [PATCH 0/2] GFS2: inplace_reserve performance improvements

2018-09-20 Thread Mark Syms
Thanks for that Bob, we've been watching with interest the changes going in upstream but at the moment we're not really in a position to take advantage of them. Due to hardware vendor support certification requirements XenServer can only very occasionally make big kernel bumps that would affect

Re: [Cluster-devel] [PATCH 0/2] GFS2: inplace_reserve performance improvements

2018-09-20 Thread Bob Peterson
- Original Message - > While testing GFS2 as a storage repository for virtual machines we > discovered a number of scenarios where the performance was being > pathologically poor. > > The scenarios are simplfied to the following - > > * On a single host in the cluster grow a number of f

[Cluster-devel] [PATCH 2/2] GFS2: Avoid recently demoted rgrps.

2018-09-20 Thread Mark Syms
When under heavy I/O load from two or more hosts the resource group allocation can result in glocks being bounced around between hosts. Follow the example of inodes and if we have local waiters when asked to demote the glock on a resource group add a delay. Additionally, track when last asked to de

[Cluster-devel] [PATCH 0/2] GFS2: inplace_reserve performance improvements

2018-09-20 Thread Mark Syms
While testing GFS2 as a storage repository for virtual machines we discovered a number of scenarios where the performance was being pathologically poor. The scenarios are simplfied to the following - * On a single host in the cluster grow a number of files to a significant proportion of the

[Cluster-devel] [PATCH 1/2] Add some randomisation to the GFS2 resource group allocator

2018-09-20 Thread Mark Syms
From: Tim Smith When growing a number of files on the same cluster node from different threads (e.g. fio with 20 or so jobs), all those threads pile into gfs2_inplace_reserve() independently looking to claim a new resource group and after a while they all synchronise, getting through the gfs2_rgr

Re: [Cluster-devel] Sending patches for GFS2

2018-09-20 Thread Steven Whitehouse
Hi, On 20/09/18 14:53, Mark Syms wrote: We have a couple of patches for GFS2 which address some performance issues we’ve observed in our testing. What branch would you like the patches to be based on top off (we have a custom patched build so they’ll need to be realigned first). Thanks,

[Cluster-devel] Sending patches for GFS2

2018-09-20 Thread Mark Syms
We have a couple of patches for GFS2 which address some performance issues we've observed in our testing. What branch would you like the patches to be based on top off (we have a custom patched build so they'll need to be realigned first). Thanks, Mark.