Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

[E V]

Didn't go so well unfortunately, system ended up panicking: Out of
memory and no killable processes. So I guess I'll be staying on 4.6
for a bit longer.

On Sat, Aug 27, 2016 at 9:57 AM, E V  wrote:
> OOM killer still killed rsync with swappiness 0, so rebuilt and
> rebooted with the patch and restarted the rsync. Seems to be running
> fine atm. Cached mem shoots right up to almost all of RAM and stays
> there per usual. We'll see how it goes.
>
> On Fri, Aug 26, 2016 at 3:02 PM, Tomasz Torcz  wrote:
>> On Fri, Aug 26, 2016 at 03:00:48PM -0400, E V wrote:
>>> Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB
>>> of ram. Only thing that run's on it is an rsync of an NFS filesystem
>>> to the local btrfs. Cached mem tends to hang out around 26-30GB, but
>>> with 4.7.2 the OOM is now going crazy and trying to kill whatever it
>>> can including my ssh and rsync process. Anyone seen anything similar?
>>
>>   That's probably OOM regression in 4.7. Could you please test this patch:
>> https://lkml.org/lkml/2016/8/23/145
>>
>> --
>> Tomasz Torcz  ,,If you try to upissue this patchset I shall be 
>> seeking
>> xmpp: zdzich...@chrome.pl   an IP-routable hand grenade.'' -- Andrew Morton 
>> (LKML)
>>
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
>> the body of a message to majord...@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

[E V]

OOM killer still killed rsync with swappiness 0, so rebuilt and
rebooted with the patch and restarted the rsync. Seems to be running
fine atm. Cached mem shoots right up to almost all of RAM and stays
there per usual. We'll see how it goes.

On Fri, Aug 26, 2016 at 3:02 PM, Tomasz Torcz  wrote:
> On Fri, Aug 26, 2016 at 03:00:48PM -0400, E V wrote:
>> Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB
>> of ram. Only thing that run's on it is an rsync of an NFS filesystem
>> to the local btrfs. Cached mem tends to hang out around 26-30GB, but
>> with 4.7.2 the OOM is now going crazy and trying to kill whatever it
>> can including my ssh and rsync process. Anyone seen anything similar?
>
>   That's probably OOM regression in 4.7. Could you please test this patch:
> https://lkml.org/lkml/2016/8/23/145
>
> --
> Tomasz Torcz  ,,If you try to upissue this patchset I shall be 
> seeking
> xmpp: zdzich...@chrome.pl   an IP-routable hand grenade.'' -- Andrew Morton 
> (LKML)
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
> the body of a message to majord...@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

RE: linux 4.7.2 & btrfs & rsync & OOM gone crazy

[Paul Jones]

> -Original Message-
> From: linux-btrfs-ow...@vger.kernel.org [mailto:linux-btrfs-
> ow...@vger.kernel.org] On Behalf Of E V
> Sent: Saturday, 27 August 2016 5:01 AM
> To: linux-btrfs 
> Subject: linux 4.7.2 & btrfs & rsync & OOM gone crazy
> 
> Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB of
> ram. Only thing that run's on it is an rsync of an NFS filesystem to the local
> btrfs. Cached mem tends to hang out around 26-30GB, but with 4.7.2 the
> OOM is now going crazy and trying to kill whatever it can including my ssh and
> rsync process. Anyone seen anything similar?
> Trying it again with /proc/sys/vm/swappiness at 0 will see if that makes a
> difference.


Yes, I had the same issue on a backup VM that only has 1G ram - rsync 
constantly is killed by OOM. Doesn't happen on the main machine with 24G ram.

Paul.
N�r��yb�X��ǧv�^�)޺{.n�+{�n�߲)w*jg����ݢj/���z�ޖ��2�ޙ&�)ߡ�a�����G���h��j:+v���w��٥

Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

[E V]

Interesting, thanks. Patch doesn't apply clean to 4.7.2, but I get the
gist, delete one version of should_compact_retry() and move ifdef so
it only has __alloc_pages_direct_compact(). I'll try it out if my
rsync gets OOM'd again.

On Fri, Aug 26, 2016 at 3:02 PM, Tomasz Torcz  wrote:
> On Fri, Aug 26, 2016 at 03:00:48PM -0400, E V wrote:
>> Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB
>> of ram. Only thing that run's on it is an rsync of an NFS filesystem
>> to the local btrfs. Cached mem tends to hang out around 26-30GB, but
>> with 4.7.2 the OOM is now going crazy and trying to kill whatever it
>> can including my ssh and rsync process. Anyone seen anything similar?
>
>   That's probably OOM regression in 4.7. Could you please test this patch:
> https://lkml.org/lkml/2016/8/23/145
>
> --
> Tomasz Torcz  ,,If you try to upissue this patchset I shall be 
> seeking
> xmpp: zdzich...@chrome.pl   an IP-routable hand grenade.'' -- Andrew Morton 
> (LKML)
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
> the body of a message to majord...@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

[Tomasz Torcz]

On Fri, Aug 26, 2016 at 03:00:48PM -0400, E V wrote:
> Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB
> of ram. Only thing that run's on it is an rsync of an NFS filesystem
> to the local btrfs. Cached mem tends to hang out around 26-30GB, but
> with 4.7.2 the OOM is now going crazy and trying to kill whatever it
> can including my ssh and rsync process. Anyone seen anything similar?

  That's probably OOM regression in 4.7. Could you please test this patch:
https://lkml.org/lkml/2016/8/23/145

-- 
Tomasz Torcz  ,,If you try to upissue this patchset I shall be 
seeking
xmpp: zdzich...@chrome.pl   an IP-routable hand grenade.'' -- Andrew Morton 
(LKML)

--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html