Re: [dm-devel] poor thin performance, relative to thick

2016-07-13 Thread Jon Bernard
* Mike Snitzer wrote: > On Mon, Jul 11 2016 at 4:44pm -0400, > Jon Bernard wrote: > > > Greetings, > > > > I have recently noticed a large difference in performance between thick > > and thin LVM volumes and I'm trying to understand why that it the case. > > > > In summary, for the same FIO t

[dm-devel] review:retrigger uevents to try and get the uid through udev

2016-07-13 Thread Zhangguanghui
Hi: For drbd device, we do not have the normal scsi wwid values, the patch about multipath retrigger uevents to try and get the uid through udev may cause a problem. the path become a orphan path, and don't remove, multipathd have been occupying the drbd device, it may fail while mounting. Tha

Re: [dm-devel] Page Allocation Failures/OOM with dm-crypt on software RAID10 (Intel Rapid Storage)

2016-07-13 Thread Matthias Dahl
Hello Ondrej... On 2016-07-13 18:24, Ondrej Kozina wrote: One step after another. Sorry, it was not meant to be rude or anything... more frustration since I cannot be of more help and I really would like to jump in head-first and help fixing it... but lack the necessary insight into the kerne

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Mikulas Patocka
On Wed, 13 Jul 2016, Michal Hocko wrote: > On Wed 13-07-16 10:18:35, Mikulas Patocka wrote: > > > > > > On Wed, 13 Jul 2016, Michal Hocko wrote: > > > > > [CC David] > > > > > > > > It is caused by the commit f9054c70d28bc214b2857cf8db8269f4f45a5e23. > > > > > Prior to this commit, mempool

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Mikulas Patocka
On Wed, 13 Jul 2016, Michal Hocko wrote: > [CC David] > > > > It is caused by the commit f9054c70d28bc214b2857cf8db8269f4f45a5e23. > > > Prior to this commit, mempool allocations set __GFP_NOMEMALLOC, so > > > they never exhausted reserved memory. With this commit, mempool > > > allocations

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Mikulas Patocka
On Wed, 13 Jul 2016, Michal Hocko wrote: > On Tue 12-07-16 19:44:11, Mikulas Patocka wrote: > > The problem of swapping to dm-crypt is this. > > > > The free memory goes low, kswapd decides that some page should be swapped > > out. However, when you swap to an ecrypted device, writeback of eac

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Michal Hocko
On Wed 13-07-16 10:18:35, Mikulas Patocka wrote: > > > On Wed, 13 Jul 2016, Michal Hocko wrote: > > > [CC David] > > > > > > It is caused by the commit f9054c70d28bc214b2857cf8db8269f4f45a5e23. > > > > Prior to this commit, mempool allocations set __GFP_NOMEMALLOC, so > > > > they never exhau

Re: [dm-devel] Page Allocation Failures/OOM with dm-crypt on software RAID10 (Intel Rapid Storage)

2016-07-13 Thread Ondrej Kozina
On 07/13/2016 05:32 PM, Matthias Dahl wrote: No matter what, I have no clue how to further diagnose this issue. And given that I already had unsolvable issues with dm-crypt a couple of months ago with my old machine where the system simply hang itself or went OOM when the swap was encrypted and

Re: [dm-devel] [PATCH 0/6] Delete attributes with default values

2016-07-13 Thread Benjamin Marzinski
On Sat, Jul 09, 2016 at 10:17:05AM +0200, Christophe Varoqui wrote: >I'll wait for comments from distribution maintainers on this patchset. >Because, though we have already deleted the checker_name settings when >equal to the default value, it should be clear that with this patchset >

Re: [dm-devel] Page Allocation Failures/OOM with dm-crypt on software RAID10 (Intel Rapid Storage)

2016-07-13 Thread Matthias Dahl
Hello... On 2016-07-13 15:47, Michal Hocko wrote: This is getting out of my area of expertise so I am not sure I can help you much more, I am afraid. That's okay. Thank you so much for investing the time. For what it is worth, I did some further tests and here is what I came up with: If I c

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Mikulas Patocka
On Wed, 13 Jul 2016, Milan Broz wrote: > On 07/13/2016 02:50 PM, Michal Hocko wrote: > > On Wed 13-07-16 13:10:06, Michal Hocko wrote: > >> On Tue 12-07-16 19:44:11, Mikulas Patocka wrote: > > [...] > >>> As long as swapping is in progress, the free memory is below the limit > >>> (because the

Re: [dm-devel] dm stripe: add DAX support

2016-07-13 Thread Kani, Toshimitsu
On Tue, 2016-07-12 at 22:01 -0400, Mike Snitzer wrote: > On Tue, Jul 12 2016 at  6:22pm -0400, > Kani, Toshimitsu wrote: > > On Fri, 2016-06-24 at 14:29 -0400, Mike Snitzer wrote: > > >    : > Thanks for putting this summary together.  Unfortunately none of the DM > changes can be queued for 4.8 u

Re: [dm-devel] [PATCH 00/26] dm raid: fix/cleanup for dm-4.8 inclusion

2016-07-13 Thread Mike Snitzer
On Wed, Jul 06 2016 at 1:24pm -0400, hei...@redhat.com wrote: > From: Heinz Mauelshagen > > > Patch series vs. kernel.org linux-dm, branch dm-4.8 to address > issues identified: > > - superfluous memory bariers > - missing constructor argument checks (sync/nosync) > - typo in write_mostly co

Re: [dm-devel] poor thin performance, relative to thick

2016-07-13 Thread Mike Snitzer
On Tue, Jul 12 2016 at 11:29pm -0400, Jon Bernard wrote: > * Jack Wang wrote: > > 2016-07-11 22:44 GMT+02:00 Jon Bernard : > > > Greetings, > > > > > > I have recently noticed a large difference in performance between thick > > > and thin LVM volumes and I'm trying to understand why that it the

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Milan Broz
On 07/13/2016 02:50 PM, Michal Hocko wrote: > On Wed 13-07-16 13:10:06, Michal Hocko wrote: >> On Tue 12-07-16 19:44:11, Mikulas Patocka wrote: > [...] >>> As long as swapping is in progress, the free memory is below the limit >>> (because the swapping activity itself consumes any memory over the

Re: [dm-devel] Page Allocation Failures/OOM with dm-crypt on software RAID10 (Intel Rapid Storage)

2016-07-13 Thread Michal Hocko
On Wed 13-07-16 15:18:11, Matthias Dahl wrote: > Hello Michal, > > many thanks for all your time and help on this issue. It is very much > appreciated and I hope we can track this down somehow. > > On 2016-07-13 14:18, Michal Hocko wrote: > > > So it seems we are accumulating bios and 256B objec

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Michal Hocko
On Wed 13-07-16 10:35:01, Jerome Marchand wrote: > On 07/13/2016 01:44 AM, Mikulas Patocka wrote: > > The problem of swapping to dm-crypt is this. > > > > The free memory goes low, kswapd decides that some page should be swapped > > out. However, when you swap to an ecrypted device, writeback of

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Michal Hocko
[CC David] On Wed 13-07-16 22:19:23, Tetsuo Handa wrote: > >> On Mon 11-07-16 11:43:02, Mikulas Patocka wrote: > >> [...] > >>> The general problem is that the memory allocator does 16 retries to > >>> allocate a page and then triggers the OOM killer (and it doesn't take > >>> into > >>> accoun

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Jerome Marchand
On 07/13/2016 01:44 AM, Mikulas Patocka wrote: > The problem of swapping to dm-crypt is this. > > The free memory goes low, kswapd decides that some page should be swapped > out. However, when you swap to an ecrypted device, writeback of each page > requires another page to hold the encrypted da

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Mikulas Patocka
On Mon, 11 Jul 2016, Ondrej Kozina wrote: > On 07/11/2016 01:55 PM, Jerome Marchand wrote: > > On 07/11/2016 01:03 PM, Stanislav Kozina wrote: > > > Hi Jerome, > > > > > > On upstream mailing lists there have been reports of freezing systems > > > due to OOM. Ondra (on CC) managed to reproduce

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Mikulas Patocka
The problem of swapping to dm-crypt is this. The free memory goes low, kswapd decides that some page should be swapped out. However, when you swap to an ecrypted device, writeback of each page requires another page to hold the encrypted data. dm-crypt uses mempools for all its structures and pa

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Michal Hocko
On Tue 12-07-16 19:44:11, Mikulas Patocka wrote: > The problem of swapping to dm-crypt is this. > > The free memory goes low, kswapd decides that some page should be swapped > out. However, when you swap to an ecrypted device, writeback of each page > requires another page to hold the encrypted

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Michal Hocko
On Mon 11-07-16 11:43:02, Mikulas Patocka wrote: [...] > The general problem is that the memory allocator does 16 retries to > allocate a page and then triggers the OOM killer (and it doesn't take into > account how much swap space is free or how many dirty pages were really > swapped out while

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Tetsuo Handa
> On Tue, 12 Jul 2016, Michal Hocko wrote: > >> On Mon 11-07-16 11:43:02, Mikulas Patocka wrote: >> [...] >>> The general problem is that the memory allocator does 16 retries to >>> allocate a page and then triggers the OOM killer (and it doesn't take into >>> account how much swap space is free

Re: [dm-devel] System freezes after OOM

2016-07-13 Thread Michal Hocko
On Wed 13-07-16 13:10:06, Michal Hocko wrote: > On Tue 12-07-16 19:44:11, Mikulas Patocka wrote: [...] > > As long as swapping is in progress, the free memory is below the limit > > (because the swapping activity itself consumes any memory over the limit). > > And that triggered the OOM killer pr

Re: [dm-devel] Page Allocation Failures/OOM with dm-crypt on software RAID10 (Intel Rapid Storage)

2016-07-13 Thread Matthias Dahl
Hello Michal, many thanks for all your time and help on this issue. It is very much appreciated and I hope we can track this down somehow. On 2016-07-13 14:18, Michal Hocko wrote: So it seems we are accumulating bios and 256B objects. Buffer heads as well but so much. Having over 4G worth of b

Re: [dm-devel] Page Allocation Failures/OOM with dm-crypt on software RAID10 (Intel Rapid Storage)

2016-07-13 Thread Michal Hocko
On Wed 13-07-16 13:21:26, Michal Hocko wrote: > On Tue 12-07-16 16:56:32, Matthias Dahl wrote: [...] > > If that support is baked into the Fedora provided kernel that is. If > > you could give me a few hints or pointers, how to properly do a allocator > > trace point and get some decent data out of

Re: [dm-devel] Page Allocation Failures/OOM with dm-crypt on software RAID10 (Intel Rapid Storage)

2016-07-13 Thread Michal Hocko
On Tue 12-07-16 16:56:32, Matthias Dahl wrote: > Hello Michal... > > On 2016-07-12 16:07, Michal Hocko wrote: > > > /proc/slabinfo could at least point on who is eating that memory. > > Thanks. I have made another test (and thus again put the RAID10 out of > sync for the 100th time, sigh) and ma

Re: [dm-devel] NVMeoF multi-path setup

2016-07-13 Thread Sagi Grimberg
On 01/07/16 01:52, Mike Snitzer wrote: On Thu, Jun 30 2016 at 5:57pm -0400, Ming Lin wrote: On Thu, 2016-06-30 at 14:08 -0700, Ming Lin wrote: Hi Mike, I'm trying to test NVMeoF multi-path. root@host:~# lsmod |grep dm_multipath dm_multipath 24576 0 root@host:~# ps aux |grep mu