RE: linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread Paul Jones
> -Original Message- > From: linux-btrfs-ow...@vger.kernel.org [mailto:linux-btrfs- > ow...@vger.kernel.org] On Behalf Of E V > Sent: Saturday, 27 August 2016 5:01 AM > To: linux-btrfs > Subject: linux 4.7.2 & btrfs & rsync & OOM gone crazy > > Just upgraded

Re: [PATCH 0/3] Btrfs: fix free space tree bitmaps+tests on big-endian systems

2016-08-26 Thread Omar Sandoval
On Fri, Aug 26, 2016 at 02:06:29PM +0300, Anatoly Pugachev wrote: > On Thu, Aug 18, 2016 at 11:33 PM, Omar Sandoval wrote: > > On Tue, Jul 19, 2016 at 03:25:16PM -0400, Chris Mason wrote: > >> On 07/19/2016 12:06 PM, Chandan Rajendra wrote: > >> > >> Omar, looks like we need

Re: Btrfs progs release 4.7.1

2016-08-26 Thread Luis Henriques
David Sterba writes: > On Fri, Aug 26, 2016 at 12:24:10AM +0100, Luis Henriques wrote: >> On Thu, Aug 25, 2016 at 07:47:27PM +0200, David Sterba wrote: >> > Hi, >> > >> > btrfs-progs 4.7 have been released. Though it's a minor version release, >> > there >> > are changes that

Re: [PATCH 0/3] Btrfs: fix free space tree bitmaps+tests on big-endian systems

2016-08-26 Thread Anatoly Pugachev
On Thu, Aug 18, 2016 at 11:33 PM, Omar Sandoval wrote: > On Tue, Jul 19, 2016 at 03:25:16PM -0400, Chris Mason wrote: >> On 07/19/2016 12:06 PM, Chandan Rajendra wrote: >> >> Omar, looks like we need to make the patched kernel refuse to mount free >> space trees without a new

Re: Btrfs progs release 4.7.1

2016-08-26 Thread David Sterba
On Fri, Aug 26, 2016 at 12:24:10AM +0100, Luis Henriques wrote: > On Thu, Aug 25, 2016 at 07:47:27PM +0200, David Sterba wrote: > > Hi, > > > > btrfs-progs 4.7 have been released. Though it's a minor version release, > > there > > are changes that could be considered big but I don't see a reason

Re: Switch raid mode without rebalance?

2016-08-26 Thread Austin S. Hemmelgarn
On 2016-08-25 18:32, Gert Menke wrote: Hi, On 2016-08-25 20:26, Justin Kilpatrick wrote: I'm not sure why you want to avoid a balance, I didn't check, but I imagined it would slow down my rsync significantly. It will slow it down, but I can't tell you exactly how much (there are too many

linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread E V
Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB of ram. Only thing that run's on it is an rsync of an NFS filesystem to the local btrfs. Cached mem tends to hang out around 26-30GB, but with 4.7.2 the OOM is now going crazy and trying to kill whatever it can including my ssh

Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread Tomasz Torcz
On Fri, Aug 26, 2016 at 03:00:48PM -0400, E V wrote: > Just upgraded from 4.6.5 to 4.7.2 for my btrfs backup server with 32GB > of ram. Only thing that run's on it is an rsync of an NFS filesystem > to the local btrfs. Cached mem tends to hang out around 26-30GB, but > with 4.7.2 the OOM is now

Re: Switch raid mode without rebalance?

2016-08-26 Thread Gert Menke
Hi, On 2016-08-26 13:52, Austin S. Hemmelgarn wrote: Regular 'df' isn't to be trusted when dealing with BTRFS, the only reason we report anything there is because many things break horribly if we don't. Yeah, I noticed. Seems to produce a reasonable guess, though. Additionally, while

heap-use-after-free in btrfsck v4.7-42-g56e9586

2016-08-26 Thread Lukas Lueg
Hi, let me draw your attention to https://bugzilla.kernel.org/show_bug.cgi?id=153641 which is a heap-use-after-free bug in btrfs-progs v4.7-42-g56e9586 I found while fuzzing btrfs. There are more bugs like this. How do you people want them to be reported? Best regards Lukas -- To unsubscribe

Re: Switch raid mode without rebalance?

2016-08-26 Thread Gert Menke
Hi Chris, first off, thank you for the detailled explanations! On 2016-08-26 01:04, Chris Murphy wrote: No, it's not a file, directory or subvolume specific command. It applies to a whole volume. You are right, but all I was after in the first place was a way to change the mode for new data

Re: Switch raid mode without rebalance?

2016-08-26 Thread Chris Murphy
On Fri, Aug 26, 2016 at 1:18 PM, Gert Menke wrote: > Hi Chris, > > first off, thank you for the detailled explanations! > > On 2016-08-26 01:04, Chris Murphy wrote: >> >> No, it's not a file, directory or subvolume specific command. It >> applies to a whole volume. > > You are

Re: linux 4.7.2 & btrfs & rsync & OOM gone crazy

2016-08-26 Thread E V
Interesting, thanks. Patch doesn't apply clean to 4.7.2, but I get the gist, delete one version of should_compact_retry() and move ifdef so it only has __alloc_pages_direct_compact(). I'll try it out if my rsync gets OOM'd again. On Fri, Aug 26, 2016 at 3:02 PM, Tomasz Torcz

fuzzed segv in btrfsck

2016-08-26 Thread Lukas Lueg
Hi, let me draw your attention to https://bugzilla.kernel.org/show_bug.cgi?id=154021 which is a reproducible segv in btrfs-progs v4.7-42-g56e9586 I found while fuzzing btrfs. Best regards Lukas -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to

[GIT PULL] Btrfs

2016-08-26 Thread Chris Mason
Hi Linus, Please pull my for-linus-4.8 branch: git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs.git for-linus-4.8 We've queued up a few different fixes in here. These range from enospc corners to fsync and quota fixes, and a few targeted at error handling for corrupt

Re: BTRFS constantly reports "No space left on device" even with a huge unallocated space

2016-08-26 Thread Marc Haber
hi, On Thu, Aug 25, 2016 at 05:56:18PM -0600, Chris Murphy wrote: > Anyway it's a known problem, I don't think it's fixed still. There's a > lot of enospc work in 4.8 so eventually it'll make sense to give it a > shot with that kernel. assuming that I'm willing to try that, will a successful