Re: [PATCH 05/18] btrfs-progs: ctree.h: fix btrfs_inode_[amc]time

2014-12-11 Thread Qu Wenruo
Original Message Subject: Re: [PATCH 05/18] btrfs-progs: ctree.h: fix btrfs_inode_[amc]time From: Qu Wenruo quwen...@cn.fujitsu.com To: mwi...@arcor.de, linux-btrfs@vger.kernel.org Date: 2014年12月11日 15:59 Original Message Subject: [PATCH 05/18] btrfs-progs:

Re: out of space warning?

2014-12-11 Thread Duncan
sys.syphus posted on Wed, 10 Dec 2014 16:54:07 -0600 as excerpted: I would like to avoid running out of space. is there a way to know that I am getting close? i'd like to make a script that runs as part of my bash prompt and lets me know when i am getting close. i know there are several ways

ENOSPC after conversion [Was: Fixing Btrfs Filesystem Full Problems typo?]

2014-12-11 Thread Patrik Lundquist
I'll reboot the thread with a recap and my latest findings. * Half full 3TB disk converted from ext4 to Btrfs, after first verifying it with fsck. * Undo subvolume deleted after being happy with the conversion. * Recursive defrag. * Full balance, that ended with 98 enospc errors during balance.

Re: [PATCH] Btrfs: get more accurate output in fd command.

2014-12-11 Thread Dongsheng Yang
On 12/11/2014 03:05 AM, Goffredo Baroncelli wrote: On 12/10/2014 04:02 PM, Dongsheng Yang wrote: On Wed, Dec 10, 2014 at 9:21 PM, Duncan 1i5t5.dun...@cox.net wrote: Robert White posted on Wed, 10 Dec 2014 02:53:40 -0800 as excerpted: [...] And in the example, the mkfs was supplied with two

Re: [PATCH] Btrfs: get more accurate output in fd command.

2014-12-11 Thread Dongsheng Yang
On 12/11/2014 11:53 AM, Duncan wrote: Dongsheng Yang posted on Wed, 10 Dec 2014 23:02:15 +0800 as excerpted: And in the example, the mkfs was supplied with two devices, so there's no dup metadata remaining from a formerly single-device filesystem, either. (Tho there will be the small

Re: [PATCH] Btrfs: get more accurate output in fd command.

2014-12-11 Thread Dongsheng Yang
On 12/11/2014 02:25 AM, Goffredo Baroncelli wrote: On 12/10/2014 11:53 AM, Robert White wrote: On 12/09/2014 05:08 PM, Dongsheng Yang wrote: On 12/10/2014 02:47 AM, Goffredo Baroncelli wrote: Hi Dongsheng On 12/09/2014 12:20 PM, Dongsheng Yang wrote: When function btrfs_statfs() calculate

Re: Balance scrub defrag

2014-12-11 Thread Duncan
sys.syphus posted on Wed, 10 Dec 2014 16:15:17 -0600 as excerpted: I am working on a script that i can run daily that will do maintenance on my btrfs mountpoints. is there any reason not to concurrently do all of the above? possibly including discards as well. also, is there anything

[PATCH v2 1/3] Btrfs: get more accurate output in df command.

2014-12-11 Thread Dongsheng Yang
When function btrfs_statfs() calculate the tatol size of fs, it is calculating the total size of disks and then dividing it by a factor. But in some usecase, the result is not good to user. Example: # mkfs.btrfs -f /dev/vdf1 /dev/vdf2 -d raid1 # mount /dev/vdf1 /mnt # dd

[PATCH v2 2/3] Btrfs: raid56: simplify the parameter of nr_parity_stripes().

2014-12-11 Thread Dongsheng Yang
We just need the type of a chunk to calculate the number of parity stripes, but we have to pass a structure of lookup_map to it. This will prevent some callers to use it where there is no a convenient lookup_map to be passed. This patch replace the parameter of struct map_lookup * with a profile

[PATCH v2 3/3] Btrfs: adapt df command to RAID5/6.

2014-12-11 Thread Dongsheng Yang
When we use btrfs with raid5/6, the output of df is unexpected as below. Example: # mkfs.btrfs -f /dev/vdf1 /dev/vdf2 -d raid5 # mount /dev/vdf1 /mnt # dd if=/dev/zero of=/mnt/zero bs=1M count=1000 # df -h /mnt Filesystem Size Used Avail Use% Mounted on

Re: [PATCH 09/18] btrfs restore: more graceful error handling in copy_file

2014-12-11 Thread Qu Wenruo
Original Message Subject: [PATCH 09/18] btrfs restore: more graceful error handling in copy_file From: mwi...@arcor.de To: linux-btrfs@vger.kernel.org Date: 2014年12月11日 04:51 From: Martin Wilck mwi...@arcor.de Setting size and attributes of a file makes sense even if some

Re: Fixing Btrfs Filesystem Full Problems typo?

2014-12-11 Thread Robert White
On 12/10/2014 05:36 AM, Patrik Lundquist wrote: On 10 December 2014 at 13:17, Robert White rwh...@pobox.com wrote: On 12/09/2014 11:19 PM, Patrik Lundquist wrote: BUT FIRST UNDERSTAND: you do _not_ need to balance a newly converted filesystem. That is, the recommended balance (and recursive

Re: [PATCH 12/18] btrfs restore: check progress of file restoration

2014-12-11 Thread Qu Wenruo
Original Message Subject: [PATCH 12/18] btrfs restore: check progress of file restoration From: mwi...@arcor.de To: linux-btrfs@vger.kernel.org Date: 2014年12月11日 04:51 From: Martin Wilck mwi...@arcor.de extents should be ordered by file offset. Expect no overlaps, and report

Re: [PATCH 05/18] btrfs-progs: ctree.h: fix btrfs_inode_[amc]time

2014-12-11 Thread Qu Wenruo
Original Message Subject: [PATCH 05/18] btrfs-progs: ctree.h: fix btrfs_inode_[amc]time From: mwi...@arcor.de To: linux-btrfs@vger.kernel.org Date: 2014年12月11日 04:51 From: Martin Wilck mwi...@arcor.de make btrfs_inode_[amc]time work like the other btrfs_inode_xxx functions.

Re: out of space warning?

2014-12-11 Thread Erkki Seppala
Robert White rwh...@pobox.com writes: You don't check your car's gas tank every time you put your foot on the brake, you don't want to check your free space every time your system finishes every tiny command you type. Well, actually my car makes a bling every 10 km once it reaches =80 km

Re: Fixing Btrfs Filesystem Full Problems typo?

2014-12-11 Thread Duncan
Robert White posted on Thu, 11 Dec 2014 00:42:38 -0800 as excerpted: TRUTH BE TOLD :: After two very eventful conversions not too long ago I just don't do those any more. The total amount of time I saved by not copying the files was in the negative numbers before I just copied the files onto

Re: out of space warning?

2014-12-11 Thread Robert White
On 12/11/2014 01:01 AM, Erkki Seppala wrote: Robert White rwh...@pobox.com writes: You don't check your car's gas tank every time you put your foot on the brake, you don't want to check your free space every time your system finishes every tiny command you type. Well, actually my car makes a

Re: Fixing Btrfs Filesystem Full Problems typo?

2014-12-11 Thread Patrik Lundquist
On 11 December 2014 at 09:42, Robert White rwh...@pobox.com wrote: On 12/10/2014 05:36 AM, Patrik Lundquist wrote: On 10 December 2014 at 13:17, Robert White rwh...@pobox.com wrote: On 12/09/2014 11:19 PM, Patrik Lundquist wrote: BUT FIRST UNDERSTAND: you do _not_ need to balance a newly

Re: ENOSPC after conversion [Was: Fixing Btrfs Filesystem Full Problems typo?]

2014-12-11 Thread Robert White
So far I don't see a bug. On 12/11/2014 12:18 AM, Patrik Lundquist wrote: I'll reboot the thread with a recap and my latest findings. * Half full 3TB disk converted from ext4 to Btrfs, after first verifying it with fsck. * Undo subvolume deleted after being happy with the conversion. *

Re: Fixing Btrfs Filesystem Full Problems typo?

2014-12-11 Thread Patrik Lundquist
On 11 December 2014 at 05:13, Duncan 1i5t5.dun...@cox.net wrote: Patrik correct me if I have this wrong, but filling in the history as I believe I have it... You're right Duncan, except it began as a private question about an error in a blog and went from there. Not that it matters, except the

Re: Fixing Btrfs Filesystem Full Problems typo?

2014-12-11 Thread Robert White
On 12/11/2014 01:55 AM, Patrik Lundquist wrote: On 11 December 2014 at 09:42, Robert White rwh...@pobox.com wrote: On 12/10/2014 05:36 AM, Patrik Lundquist wrote: On 10 December 2014 at 13:17, Robert White rwh...@pobox.com wrote: On 12/09/2014 11:19 PM, Patrik Lundquist wrote: BUT FIRST

Re: [PATCH v4 00/13] btrfs-progs:fsck: Add inode nlink mismatch and

2014-12-11 Thread Filipe David Manana
On Thu, Dec 11, 2014 at 12:50 AM, Qu Wenruo quwen...@cn.fujitsu.com wrote: Original Message Subject: Re: [PATCH v4 00/13] btrfs-progs:fsck: Add inode nlink mismatch and From: David Sterba dste...@suse.cz To: Qu Wenruo quwen...@cn.fujitsu.com Date: 2014年12月10日 20:37 On

Announcements for btrfs-progs?

2014-12-11 Thread Holger Hoffstätte
David, I was wondering if you could please send out announcements for btrfs-progs when you tag a release or -rc? There doesn't seem to be a good mechanism to track releases and IMHO the more people are notified, the more testing we can get, not to mention faster propagation into distros.

Re: Promote Snapshot to Subvolume? (again)

2014-12-11 Thread Florian Gamböck
Sorry to come up with an old thread, but I'm really interested if something is going on with that idea. It would help in many situations if you could promote snapshots to regular subvolumes. Let's for example take btrfs-restore: It does not restore snapshots by default, which is rather smart,

Re: Announcements for btrfs-progs?

2014-12-11 Thread WorMzy Tykashi
On 11 December 2014 at 12:37, Holger Hoffstätte holger.hoffstae...@googlemail.com wrote: David, I was wondering if you could please send out announcements for btrfs-progs when you tag a release or -rc? There doesn't seem to be a good mechanism to track releases and IMHO the more people are

Re: [PATCH 1/2] Btrfs: qgroup: free reserved in exceeding quota.

2014-12-11 Thread Josef Bacik
On 12/10/2014 03:09 AM, Dongsheng Yang wrote: On 12/09/2014 11:42 PM, Josef Bacik wrote: On 12/09/2014 06:27 AM, Dongsheng Yang wrote: When we exceed quota limit in writing, we will free some reserved extent when we need to drop but not free account in qgroup. It means, each time we exceed

Re: [PATCH] btrfs: add groups for btrfs tests

2014-12-11 Thread Josef Bacik
On 11/20/2014 11:54 PM, Eryu Guan wrote: Some new btrfs groups have been added in the btrfs stress patchset add other tests to proper groups too. Signed-off-by: Eryu Guan eg...@redhat.com This is great, thanks Eryu, Reviewed-by: Josef Bacik jba...@fb.com -- To unsubscribe from this list:

Re: Crazy idea of cleanup the inode_record btrfsck things with SQL?

2014-12-11 Thread Martin Steigerwald
Hi Qu, Am Dienstag, 2. Dezember 2014, 08:37:44 schrieb Qu Wenruo: Original Message Subject: Re: Crazy idea of cleanup the inode_record btrfsck things with SQL? From: Austin S Hemmelgarn ahferro...@gmail.com To: Qu Wenruo quwen...@cn.fujitsu.com, linux-btrfs

Re: Crazy idea of cleanup the inode_record btrfsck things with SQL?

2014-12-11 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 11/30/2014 05:58 PM, Qu Wenruo wrote: 2. Heavy dependency If use it, btrfs-progs will include RDBMS as the make and runtime dependency. Such low level progs depend on high level programs like sqlite3 may be very strange. BTW SQLite is designed

A note on spotting bugs [Was: ENOSPC after conversion]

2014-12-11 Thread Robert White
On 12/11/2014 12:18 AM, Patrik Lundquist wrote: * Full balance, that ended with 98 enospc errors during balance. Assuming that quote is an actual quote from the output of the balance... We can strongly infer that this sort of occurrence is expected since there is code to keep track of it and

Re: ENOSPC after conversion [Was: Fixing Btrfs Filesystem Full Problems typo?]

2014-12-11 Thread Patrik Lundquist
On 11 December 2014 at 11:18, Robert White rwh...@pobox.com wrote: So far I don't see a bug. Fair enough, lets call it a huge problem with btrfs convert. I think it warrants a note in the wiki. On 12/11/2014 12:18 AM, Patrik Lundquist wrote: Running defrag several more times and balance

Re: [PATCH v4 00/13] btrfs-progs:fsck: Add inode nlink mismatch and

2014-12-11 Thread Qu Wenruo
Original Message Subject: Re: [PATCH v4 00/13] btrfs-progs:fsck: Add inode nlink mismatch and From: Filipe David Manana fdman...@gmail.com To: Qu Wenruo quwen...@cn.fujitsu.com Date: 2014年12月11日 19:07 On Thu, Dec 11, 2014 at 12:50 AM, Qu Wenruo quwen...@cn.fujitsu.com wrote:

Re: ENOSPC after conversion [Was: Fixing Btrfs Filesystem Full Problems typo?]

2014-12-11 Thread Robert White
On 12/11/2014 03:01 PM, Patrik Lundquist wrote: On 11 December 2014 at 11:18, Robert White rwh...@pobox.com wrote: So far I don't see a bug. Fair enough, lets call it a huge problem with btrfs convert. I think it warrants a note in the wiki. On 12/11/2014 12:18 AM, Patrik Lundquist wrote:

Re: [PATCH 1/2] Btrfs: qgroup: free reserved in exceeding quota.

2014-12-11 Thread Dongsheng Yang
On 12/12/2014 02:25 AM, Josef Bacik wrote: On 12/10/2014 03:09 AM, Dongsheng Yang wrote: On 12/09/2014 11:42 PM, Josef Bacik wrote: On 12/09/2014 06:27 AM, Dongsheng Yang wrote: When we exceed quota limit in writing, we will free some reserved extent when we need to drop but not free account

Re: Balance scrub defrag

2014-12-11 Thread Russell Coker
On Wed, 10 Dec 2014 17:17:28 Robert White wrote: A _monthly_ scrub is maybe worth scheduling if you have a lot of churn in your disk contents. I do weekly scrubs. I recently had 2 disks in a RAID-1 array develop read errors within a month of each other. The first scrub after replacing sdb

Re: ENOSPC after conversion [Was: Fixing Btrfs Filesystem Full Problems typo?]

2014-12-11 Thread Robert White
TL;DR version On 12/11/2014 03:01 PM, Patrik Lundquist wrote: Of course the filesystem is in a problematic state after the conversion, even if it's not a bug. ~1.5TB of free space and yet out of space and it can't be fixed with a balance. It might not be wrong per se but it's very problematic

Re: Balance scrub defrag

2014-12-11 Thread Robert White
On 12/11/2014 05:00 PM, Russell Coker wrote: On Wed, 10 Dec 2014 17:17:28 Robert White wrote: A _monthly_ scrub is maybe worth scheduling if you have a lot of churn in your disk contents. I do weekly scrubs. I recently had 2 disks in a RAID-1 array develop read errors within a month of each

Re: mkfs.btrfs limits odd [and maybe a failed phantom device?]

2014-12-11 Thread Zygo Blaxell
On Wed, Dec 10, 2014 at 02:18:55PM -0800, Robert White wrote: (3) why can I make a raid5 out of two devices? (I understand that we are currently just making mirrors, but the standard requires three devices in the geometry etc. So I would expect a two device RAID5 to be considered degraded with

Re: Balance scrub defrag

2014-12-11 Thread Zygo Blaxell
On Wed, Dec 10, 2014 at 04:15:17PM -0600, sys.syphus wrote: I am working on a script that i can run daily that will do maintenance on my btrfs mountpoints. is there any reason not to concurrently do all of the above? possibly including discards as well. also, is there anything existing

[PATCH v2] btrfs: add groups for btrfs tests

2014-12-11 Thread Eryu Guan
Some new btrfs groups have been added in the btrfs stress patchset, add other tests to proper groups too. Reviewed-by: Josef Bacik jba...@fb.com Signed-off-by: Eryu Guan eg...@redhat.com --- v2: - rebase and add groups to new test 079 tests/btrfs/group | 110

Re: A note on spotting bugs [Was: ENOSPC after conversion]

2014-12-11 Thread Patrik Lundquist
On 11 December 2014 at 23:00, Robert White rwh...@pobox.com wrote: On 12/11/2014 12:18 AM, Patrik Lundquist wrote: * Full balance, that ended with 98 enospc errors during balance. Assuming that quote is an actual quote from the output of the balance... It is, from dmesg. Bugs are