Starting btrfs defrag with xargs -P 2 locks

I was de-fragmenting a BTRFS recently and it was quite slow, so I decided to pipe find output to xargs -P 2 to speed up the file listing process and found out it breaks BTRFS quite fast. In 2 minutes, I had this in dmesg. As expected, btrfs command is deadlocked. btrfs-progs v4.2.2

Re: csum failed on innexistent inode

On Sun, Apr 10, 2016 at 1:25 PM, Henk Slager wrote: > Kernel/tools > versions and btrfs fi us output might also give some hints. I completely forgot to paste those: BTRFS: btrfs-progs v4.4 Kernel: 4.6.0-rc2. -- To unsubscribe from this list: send the line "unsubscribe

Re: csum failed on innexistent inode

Sorry for the confusion, allow me to clarify and I will summarize with what I learned since I now understand that corruption was present before disk went bad. Note that this BTRFS was once on a MD RAID5 on LVM on LUKS before being moved in-place to LVM on LUKS on BTRFS RAID10. But since balance

Re: csum failed on innexistent inode

On Mon, Apr 4, 2016 at 5:42 AM, Henk Slager wrote: > > You might want this patch: > http://www.spinics.net/lists/linux-btrfs/msg53552.html > > As workaround, you can reset the counters on new/healty device with: > > btrfs device stats [-z] | > I did reset the stats and launched

Re: csum failed on innexistent inode

On Mon, Apr 4, 2016 at 4:17 PM, Kai Krakow <hurikha...@gmail.com> wrote: > > Am Mon, 4 Apr 2016 03:50:54 -0400 > schrieb Jérôme Poulin <jeromepou...@gmail.com>: > > > How is it possible to get rid of the referenced csum errors if they do > > not exis

csum failed on innexistent inode

Hi all, I have a BTRFS on disks running in RAID10 meta+data, one of the disk has been going bad and scrub was showing 18 uncorrectable errors (which is weird in RAID10). I tried using --repair-sector with hdparm even if it shouldn't be necessary since BTRFS would overwrite the sector. Repair

Re: [PATCH 2/3] btrfs-progs: add 'du' command

On Wed, Jan 20, 2016 at 4:49 PM, Mark Fasheh wrote: > 'btrfs du' differs from regular du in that it will work to resolve which > blocks are shared between files in its list. This gives the user a more > accurate bytecount from which they can make decisions regarding management >

Out of memory purging snapshots

Hello everyone, I have encountered a weird out of memory problem using BTRFS, snapshots and duperemove. The workload is described as: - Lots of static (400G/1T) data which was deduplicated using duperemove which saved about 50GB. - Backups are saved to the BTRFS every 2 days, backup take about 2

Re: [PATCH] btrfs-progs: convert: show progress by default

On Fri, Feb 27, 2015 at 10:32 AM, David Sterba dste...@suse.cz wrote: + printf(\t-p show converting progress (default)\n); A quick look a this it looks like you've added a mandatory «option» since the case which handle -p can only turn on this flag. Logic should be switched to

Re: Data recovery after RBD I/O error

On Mon, Jan 5, 2015 at 6:59 AM, Austin S Hemmelgarn ahferro...@gmail.com wrote: Secondly, I would highly recommend not using ANY non-cluster-aware FS on top of a clustered block device like RBD For my use-case, this is just a single server using the RBD device. No clustering involved on the

Re: btrfs is related to OOM death problems on my 8GB server with both 3.15.1 and 3.14?

Hi I'd just like to comment that I currently have the same problem, quota are enabled, server can't stay up more than 15 days without hogging all of its memory. Use case is a torrent server which has more read than writes and a desktop. Kmemleak does not detect this leak after 10 days and at

Re: Is btrfs related to OOM death problems on my 8GB server with both 3.15.1 and 3.14?

Hi, For this same problem I once got into single user after 2 weeks of utilisation and killed all, umounted all FS except root which is ext4, rmmod'ed all modules and see by yourself: http://i39.tinypic.com/2rrrjtl.jpg For those who want it textually: 15 days uptime 10 user mode processes

Re: memory leak in =3.11.6

On Tue, Oct 29, 2013 at 12:42 PM, Duncan 1i5t5.dun...@cox.net wrote: So I'd call the qgroups feature broken at this time I agree. I made a page about Quotas on the wiki so to document my findings as documentation is really sparse. If you consult the section Known issues, you will find those: *

Re: memory leak in =3.11.6

On Mon, Oct 28, 2013 at 6:34 PM, Kai Krakow hurikhan77+bt...@gmail.com wrote: If I close all my desktop programs, my system stays at +12 GB RAM usage while after a fresh boot it has 12+ GB free (of 16 GB). Cache stays low at 2 GB while after a few minutes uptime cache is about 5 GB. I

Re: rootfs crash

On Mon, Sep 16, 2013 at 6:48 AM, Jogi Hofmüller j...@mur.at wrote: After btrfs-zero-log the device was still not mountable. Mount attempts fail with i/o erros now. ... All this is happening on an Asus Zen book UX32V with two 128GB SSDs. Did you make sure you aren't working with a dead SSD?

Re: Heavy memory leak when using quota groups

I'm pretty I encountered the same leak over here, 15 days uptime and I had consistent out of memory problems, I got angry and did go in single user mode and noticed that with only systemd-screen-bash(2) I had 2 GB of memory used on 4 GB total. This box mostly has random reads and just before the

Re: query btrfs creation options

I think actual userland tools should be able to do what you want; leafsize, nodesize, sectorsize: btrfs-show-super /dev/dm-6 label: blkid /dev/dm-6 data, metadata: btrfs filesystem df / # btrfs-show-super /dev/dm-6 superblock: bytenr=65536, device=/dev/dm-6

Re: BTRFS and the steadily lit LED

On Wed, Mar 27, 2013 at 4:56 AM, Swâmi Petaramesh sw...@petaramesh.org wrote: After having received strong advice from the people in this list to upgrade my kernel to the latest one, I have installed 3.8.0-14-generic #24-Ubuntu SMP x86_64 on several (4) machines. In the hope of improving

Re: Debian 3.7.1 BTRFS crash

On Tue, Mar 12, 2013 at 10:03 PM, Eric Sandeen sand...@redhat.com wrote: [ 37.176790] BTRFS error (device dm-0) in __btrfs_free_extent:5143: IO failure [ 37.176791] btrfs is forced readonly [ 37.176793] btrfs: run_one_delayed_ref returned -5 It seems the SSD has bad blocks now, BTRFS

Re: mkfs.btrfs broken

On Thu, Mar 7, 2013 at 10:21 AM, Swâmi Petaramesh sw...@petaramesh.org wrote: lstat64(/sqfs_disk, 0xbff57820) = -1 ENOENT (No such file or directory) mkfs.btrfs tries to lookup loop devices by their filenames and fails if any loop device file is missing. -- To unsubscribe from this list:

Re: Kernel panic when scrub is used

On Wed, Feb 20, 2013 at 1:42 PM, Jérôme Poulin jeromepou...@gmail.com wrote: On Wed, Feb 20, 2013 at 8:11 AM, David Sterba dste...@suse.cz wrote: Was the filesystem created with nodesize 4k ? Yes; 64KB. I just noticed I didn't mention that I have raid5/6 code merged in but it never was used

Re: Kernel panic when scrub is used

Here you go, I also added 2 other screenshots of the same problem. http://tinypic.com/r/5ckgug/6 http://tinypic.com/r/t0i9t4/6 http://tinypic.com/r/2r3xdvl/6 On Mon, Feb 18, 2013 at 12:37 PM, Arne Jansen li...@die-jansens.de wrote: On 02/18/13 18:14, Jérôme Poulin wrote: I experience a kernel

Re: kernel BUG at fs/btrfs/extent-tree.c:6185!

I was however able to save my data with btrfs-restore command (it boots into some systemd emergency shell or I can use recovery cd). I tried to mount it manually and after no success (the mount command does not end) mount it with -o recovery option, but it does not do anything nether (well the

Re: Weird Warning

b34b153b89ec3692 ]--- On Fri, Oct 19, 2012 at 6:13 PM, cwillu cwi...@cwillu.com wrote: On Fri, Oct 19, 2012 at 3:51 PM, Jérôme Poulin jeromepou...@gmail.com wrote: After updating to 3.5.5, I get thi on boot and listing some dir freezes. I don't have anything important on that volume but I'm

Re: Weird Warning

Here is an excerpt of btrfsck: # ./btrfsck /dev/nbd1 checking extents corrupt extent record: key 314454016 168 524288 corrupt extent record: key 314978304 168 524288 corrupt extent record: key 315502592 168 524288 corrupt extent record: key 316026880 168 524288 corrupt extent record: key

Re: Weird Warning

, Jérôme Poulin jeromepou...@gmail.com wrote: I've got this weird WARNING in my system log on a freshly created FS, I'm using ACL with Samba, this is the only difference I could tell from any other FSes. It is also using Debian's Wheezy kernel which is quite old. Should I just ignore

Re: Out of memory condition

Right now, with the patches applied on 3.5.0, Chrome didn't freeze under out of memory conditions (2 OOM killer invocation). On Fri, Oct 5, 2012 at 4:44 PM, Josef Bacik jba...@fusionio.com wrote: On Fri, Oct 05, 2012 at 02:23:25PM -0600, Jérôme Poulin wrote: I guess I'll be the guy who

Re: Out of memory condition

I was able to reproduce the problem with the patch, now it fails in extens_io.c instead of the compression module. [ 243.098892] Out of memory: Kill process 4227 (chrome) score 325 or sacrifice child [ 243.098895] Killed process 4227 (chrome) total-vm:969800kB, anon-rss:96824kB, file-rss:1800kB

Re: Out of memory condition

...@fusionio.com wrote: On Fri, Oct 05, 2012 at 11:20:37AM -0600, Jérôme Poulin wrote: I was able to reproduce the problem with the patch, now it fails in extens_io.c instead of the compression module. Yeah so I fixed the compression side, and now it's erroring out further down. So leave

Re: cross-subvolume cp --reflink

On Thu, Aug 16, 2012 at 5:41 PM, james northrup northrup.ja...@gmail.com wrote: dunno if this thread is dead, but im inclined to patch in cp --reflink to fdupes prog. It currently does provide a poor-man's dedupe via md5sum and hardlink, or delete. all the better if the distro-kernels

Re: btrfs panic in 3.5.0

On Tue, Aug 7, 2012 at 1:40 PM, Marc MERLIN m...@merlins.org wrote: System rebooted ok. I just want to be sure that you are aware that your hard drive is currently killing itself. Those READ FPDMA QUEUED mean that your hard disk is relocatting bad sectors and has problem reading those. -- To

Re: [PATCH 3/3] Add btrfs filesystem info man page.

What kind of info does it give? This is really unhelpful in a man page, it just tells the obvious. On Fri, Jun 8, 2012 at 3:12 PM, Goffredo Baroncelli kreij...@inwind.it wrote: Update the man page to document the btrfs filesystem info path command. ---  man/btrfs.8.in |    8  1

Re: New btrfs-progs integration branch

On Tue, Jun 5, 2012 at 3:09 PM, Hugo Mills h...@carfax.org.uk wrote:   I've just pushed out a new integration branch to my git repo. This is purely bugfix patches -- there are no new features in this issue of the integration branch. I've got a stack of about a dozen more patches with new

Re: filesystem full when it's not? out of inodes? huh?

On Sun, Feb 26, 2012 at 1:14 AM, Brian J. Murrell br...@interlinx.bc.ca wrote: # btrfs fi resize 5G /usr; df -h /usr Resize '/usr' of '5G' What would be interesting is getting an eye on btrfs fi df of your filesystem to see what part is getting full, or maybe just do a balance. I have been

Re: [PATCH 00/21] Btrfs: restriper

On Tue, Feb 14, 2012 at 9:18 AM, Ilya Dryomov idryo...@gmail.com wrote: Just to be sure, could you please paste the output of `btrfs-debug-tree -d your device' somewhere ? Here it is: http://paste.pocoo.org/show/550900/ I also had btrsck errors before and still have them with 3 new after

Re: [PATCH 00/21] Btrfs: restriper

On Fri, Jan 6, 2012 at 9:30 AM, Ilya Dryomov idryo...@gmail.com wrote: This is a respin of restriper patch series which adds an initial implementation of restriper (it's a clever name for relocation framework that allows to do selective profile changing and selective balancing with some

Re: Cross-subvolume reflink copy (BTRFS_IOC_CLONE over subvolume boundaries)

On Mon, Feb 13, 2012 at 6:52 PM, Hubert Kario h...@qbs.com.pl wrote: It's been nearly a year since the patches needed to implement a reflinked copy between subvolumes have been posted (http://permalink.gmane.org/gmane.comp.file-systems.btrfs/9865 ) and I still get Invalid cross-device link

Re: Btrfsck gives me errors

On Fri, Jan 20, 2012 at 2:19 AM, Fajar A. Nugraha l...@fajar.net wrote: Then again, most fsck feature has been implemented in kernel space so a mount will automatically fix some types of problems (somewhat similar to what zfs does, which has no fsck whatsoever). So just watch syslog for any

Re: [PATCH 0/2] btrfs: allow cross-subvolume BTRFS_IOC_CLONE

a day, using cp --reflink for whole image copy to test recovery and more. BTRFS is the only module I need to recompile on this machine after each upgrading the kernel to apply this patch. On Mon, Jan 9, 2012 at 8:31 AM, Jérôme Poulin jeromepou...@gmail.com wrote: On Mon, Jan 9, 2012 at 1:58 AM

Re: Btrfsck gives me errors

On Wed, Jan 18, 2012 at 11:59 PM, Fajar A. Nugraha l...@fajar.net wrote: Recent kernels (e.g. 3.1 or 3.2) is smart enough to automatically fix certain types of errors. Watch syslog when you mount the fs, access some files, unmount, and mount it again. If second mount does not show any error

Btrfsck gives me errors

I did a preemptive fsck after a RAID crash and got many errors, is there something I should do if everything I use works? root 412 inode 427 errors 400 root 412 inode 430 errors 400 root 412 inode 434 errors 400 root 412 inode 436 errors 400 root 412 inode 440 errors 400 root 412 inode 446 errors

Re: [PATCH 0/2] btrfs: allow cross-subvolume BTRFS_IOC_CLONE

On Mon, Jan 9, 2012 at 1:58 AM, Marios Titas redneb8...@gmail.com wrote: The simple case of 'cp --reflink' works fine [...] It doesn't work here: cp: failed to clone `/tmp/test': Invalid cross-device link That's with 3.1 + for-linus. This is the problem, it doesn't work because you have to

Re: COW a file from snapshot

BTRFS_IOC_CLONE http://permalink.gmane.org/gmane.comp.file-systems.btrfs/9865 On Tue, Dec 20, 2011 at 12:53 PM, Jérôme Poulin jeromepou...@gmail.com wrote: You would need to apply this patch to your kernel: http://www.mail-archive.com/linux-btrfs@vger.kernel.org/msg09096.html Is there any chance

Re: COW a file from snapshot

You would need to apply this patch to your kernel: http://www.mail-archive.com/linux-btrfs@vger.kernel.org/msg09096.html Is there any chance this patch gets in linux-next ? I use this feature all the time and it never broke on me. On Tue, Dec 20, 2011 at 10:07 AM, Dave d...@thekilempire.com

Re: Snapshot of root makes an undeletable folder

On Sun, Sep 4, 2011 at 5:05 PM, Ilya Dryomov idryo...@gmail.com wrote: On Sun, Sep 04, 2011 at 11:29:43AM -0400, Jérôme Poulin wrote: Then I though about my folder organization again and renamed music to downloads, this is still OK and then create music in downloads, I was told music already

Snapshot of root makes an undeletable folder

I recently converted a long-used ext4 filesystem after e2fsck to btrfs using btrfs-convert, everything went fine and all my files are there. I then decided to make the filesystem more managable so I made a snapshot of the root and removed the rest of the root like: Original listing: ext2_saved

Re: snapshot ctime // Re: [RFC] btrfs auto snapshot

On Wed, Aug 17, 2011 at 11:13 AM, Roman Mamedov r...@romanrm.ru wrote: So until someone cares about snapshot ctime enough to fix this, btrfs will not be a convenient FS to work with timed snapshotting/cleanup. Isn't the ctime the creation date of the original folder? -- To unsubscribe from

Re: [PATCH 0/2] btrfs: allow cross-subvolume BTRFS_IOC_CLONE

I am very happy to see this patch. It was one of the first thing I tried after making a subvolume, cp --reflink, and it failed. I'll have to try this out. Jérôme Poulin On 2011-04-02, at 12:56, Larry D'Anna la...@elder-gods.org wrote: * Ken Drummond (bt...@kendrummond.com) [110402 11:51]: I

Re: Btrfs system won't start on Ubuntu (relationship problems...)

Re-send as non-HTML On Sun, Mar 13, 2011 at 7:46 AM, Peter Stuge pe...@stuge.se wrote: Pau Iranzo wrote: I installed Ubuntu on my girlfriend's laptop using btrfs as a filesystem. But a few weeks ago something happened: the system wouldn't boot and always show these messages:

Re: Btrfs system won't start on Ubuntu (relationship problems...)

On Sun, Mar 13, 2011 at 12:30 PM, Peter Stuge pe...@stuge.se wrote: Jérôme Poulin wrote: Never plug a defective drive on USB if it is the source .. else defective sectors get transferred as good filled with random stuff Interesting! Which USB chipset(s?) have you seen do this? Those I

Stuck in a big loop

Hi, I've got a filesystem I use to compile OpenWRT, it is ordered like: Original firmware, updated once in a while: sources/original-sources/backfire sources/original-sources/trunk Downloads and some other stuff: dl/ stuff/ Test compiles: sources/compiles sources/old-date/old compiles The

Re: Odd mkbtrfs behavior inside of chroot

Did you try using -o bind on /proc and /sys as well? Just in case mkfs uses /sys too, I'm not sure if /proc reacts differently to multiple mounts or bind neither? Envoyé de mon appareil mobile. Jérôme Poulin Solutions G.A. On 2011-01-02, at 14:53, J G yoosty_...@yahoo.com wrote: I just

Re: [PATCH 5/5][REPOST][BTRFS-PROGS] Add the btrfs filesystem label command

On 2010-12-05, at 12:47, Goffredo Baroncelli kreij...@inwind.it wrote: Hi all, this patch adds the command btrfs filesystem label to change (or show) the label of a filesystem. This patch is a subset of the one written previously by Morey Roof. I included the user space part only. So it is

Re: Determine if a given fs is a btrfs fs

On Sun, Oct 24, 2010 at 5:32 PM, Jérôme Poulin jeromepou...@gmail.com wrote: ... p4 jerome # btrfs device scan /dev/dm-22 Scanning for Btrfs filesystems in '/dev/dm-22' p4 jerome # echo $? 0 This is OK. p4 jerome # btrfs device scan /dev/sda Scanning for Btrfs filesystems in '/dev/sda

Re: [PATCH][btrfs progs] Update/clean up btrfs help and man page

On 13.09.2010 21:23, Goffredo Baroncelli wrote: Hi all, enclose you can find a patch which improve the help of the btrfs commands and its man page. Regarding the help of the btrfs command: - moved the subvolume set-default command in the subvolume commands group - removed a wrong new line

Re: Can you please define snapshot and subvolume?

Just to tell you one of my use case, I do compilations of OpenWRT on a Btrfs filesystem, when I snapshot, I only snapshot the subvolume where all the sources are instead of the whole root filesystem, and when I need a snapshot of the root for backup purposes, only the root without all the snapshot

Re: patch intoducing IOctl #21 allowing for waiting for completion of deleted subvol recovery

Hi, On Wed, Oct 6, 2010 at 11:05 AM, David Nicol davidni...@gmail.com wrote: The patches for btrfsctl and btrfs programs will be coming soon; I'm adding support for ISO8061 duration strings instead of (or in addition to) milliseconds and thinking about switching the order of the two args to

Re: File cloning across subvolumes with BTRFS_IOC_CLONE ioctl

/EPV70cD3 However, copying on the same subvolume now works perfectly, so I guess this is fixed. On Wed, Jul 21, 2010 at 11:32 AM, Chris Mason chris.ma...@oracle.com wrote: On Wed, Jul 21, 2010 at 11:11:13AM -0400, Jérôme Poulin wrote: I've got the same problem, and that post clearly seems to say

Re: File cloning across subvolumes with BTRFS_IOC_CLONE ioctl

Here is the real destination, I had pasted the same as source: http://pastebin.com/nyTDeaae On Mon, Jul 26, 2010 at 8:55 AM, Jérôme Poulin jeromepou...@gmail.com wrote: After pulling the new changes, I tried to do the cp --reflink=always and still get files with no data in it. cp --reflink

Re: File cloning across subvolumes with BTRFS_IOC_CLONE ioctl

I've got the same problem, and that post clearly seems to say it is possible. cp --reflink=always source subvolume1/ gives me: cp: failed to clone `': Invalid cross-device link Even on the same subvolume I get 10% of the files telling me the same. btrfs-bcp copy the files in its integrity.

Re: [PATCH] btrfs-convert: add reiserfs support

Hello, I just want to thank you for the ReiserFS convertion patch. Now that the semester's over, I've finally gotten around to finishing this. Ironically, I no longer have a ReiserFS partition I want to convert :P. On my side I had my root filesystem which has been running for quite a while, I