Re: dduper - Offline btrfs deduplication tool

2018-09-06 Thread Lakshmipathi.G
omparsion check before dedupe. And it will increase time to dedupe files. I believe the risk involved with ficlonerange is minimized by having a backup file(reflinked). We can revert to older original file, if we encounter some problems. > > -- > Have a nice day, > Timofey. Cheers. Lakshmipathi.G

dduper - Offline btrfs deduplication tool

2018-08-23 Thread Lakshmipathi.G
://gitlab.collabora.com/laks/btrfs-progs.git -b dump_csum [4] https://patchwork.kernel.org/patch/10540229/ Please remember its version-0.1, so test it out, if you plan to use dduper real data. Let me know, if you have suggestions or feedback or bugs :) Cheers. Lakshmipathi.G

[PATCH] v3: btrfs-progs: Introduce 'btrfs inspect-internal dump-csum' option

2018-07-23 Thread Lakshmipathi.G
Print csum for a given file on stdout. Sample usage: btrfs inspect-internal dump-csum /btrfs/50gbfile /dev/sda4 Signed-off-by: Lakshmipathi.G --- Makefile | 2 +- cmds-inspect-dump-csum.c | 239 +++ cmds-inspect-dump-csum.h | 22

[PATCH] v2: btrfs-progs: Introduce 'btrfs inspect-internal dump-csum' option

2018-07-15 Thread Lakshmipathi.G
Dump csum for a given file. Sample usage: btrfs inspect-internal dump-csum /btrfs/50gbfile /dev/sda4 csum for /btrfs/50gbfile dumped to /btrfs/50gbfile.csumdump Signed-off-by: Lakshmipathi.G --- Makefile | 2 +- cmds-inspect-dump-csum.c | 256

Re: [PATCH v2.2 04/10] btrfs: qgroup: Use separate meta reservation type for delalloc

2017-12-25 Thread Lakshmipathi.G
900710/linux : [1]: http://btrfs.in:3000/r/Lakshmipathi Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: xfstests/btrfs/100 and 151 failure

2017-12-22 Thread Lakshmipathi.G
> Thanks for the config file, will check with this and update the status. script/100 passed on today's run [1] with my kernel config too. May be a false alarm :-) [1]: https://github.com/Lakshmipathi/btrfsqa/blob/master/results/results_2017-12-22_07:12/ thanks! Cheers, Lakshmipathi.G h

Re: xfstests/btrfs/100 and 151 failure

2017-12-19 Thread Lakshmipathi.G
> > I've attached my master config before compiling a kernel with it I just > do make olddefconfig to sync it with latest kbuild options. > >> Thanks for the config file, will check with this and update the status. Cheers, Lakshmipathi.G http://www.giis.co.in http:

Re: xfstests/btrfs/100 and 151 failure

2017-12-12 Thread Lakshmipathi.G
> Actually 151 has been failing for me as well but not 100 > Okay, can you share the kernel .config file? I'll give it a try with those config and check 100, sometime tomorrow. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list

xfstests/btrfs/100 and 151 failure

2017-12-12 Thread Lakshmipathi.G
Hi. While checking with latest misc-next branch from btrfs-devel. btrfs/100 and 151 failed. Details available on below bugzilla links. thanks https://bugzilla.kernel.org/show_bug.cgi?id=198085 https://bugzilla.kernel.org/show_bug.cgi?id=198087 Cheers, Lakshmipathi.G http://www.giis.co.in

Re: [PATCH 4/4] btrfs: factor __btrfs_open_devices() to create btrfs_open_one_device()

2017-11-29 Thread Lakshmipathi.G
Hi Anand, Applied your fix, now the issue resolved. thanks! Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Mon, Nov 27, 2017 at 5:17 PM, Anand Jain <anand.j...@oracle.com> wrote: > > Hi Lakshmipathi, > > Oops I can see the same. I am try

Re: [PATCH 4/4] btrfs: factor __btrfs_open_devices() to create btrfs_open_one_device()

2017-11-26 Thread Lakshmipathi.G
Hi Anand, With this patch applied, btrfs-progs/misc-test/021 error out. Is this same for you? Without this patch: https://asciinema.org/a/RJmE5469mHlL3S1BIOCifWVn6 With this patch:https://asciinema.org/a/1h5UX6DIFNsvvMXgLo4GiEgdE thanks! Cheers, Lakshmipathi.G http://www.giis.co.in

Re: misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-26 Thread Lakshmipathi.G
/a/OMLXpd69iHaej0Xfsrr2ihKiP [1] btrfs: factor __btrfs_open_devices() to create btrfs_open_one_device() https://github.com/kdave/btrfs-devel/commit/25908a59bb5c54f896c646ed3a1f73b2727ad9b5 Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Fri, Nov 24, 2017 at 5:35 PM

Re: misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-24 Thread Lakshmipathi.G
t; CONFIG_BTRFS_DEBUG=y > CONFIG_BTRFS_ASSERT=y > -- > > So there is something strange happened. > Yes. something strange going on. I use the same kernel config for misc-next, 4.14 and 4.14.2 - issue happens only with misc-next, as you mentioned it may not be up-to-date. Ch

Re: misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-24 Thread Lakshmipathi.G
Linux ip-172-31-33-196.us-west-2.compute.internal 4.14.0 #1 SMP Fri Nov 24 09:48:11 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux - Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the

Re: misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-24 Thread Lakshmipathi.G
Okay thanks for the details on btrfs-image. I was about to try with previous version of btrfs-image. I'll use v4.14 (https://cdn.kernel.org/pub/linux/kernel/v4.x/linux-4.14.tar.xz) and check again. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Fri, Nov 24, 2017

Re: misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-23 Thread Lakshmipathi.G
Let me check further. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Fri, Nov 24, 2017 at 9:55 AM, Lakshmipathi.G <lakshmipath...@gmail.com> wrote: > Hi Qu, > > I'm using the same instance. Let me check again with and without the > commits list on No

Re: misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-23 Thread Lakshmipathi.G
Hi Qu, I'm using the same instance. Let me check again with and without the commits list on Nov-23 (https://github.com/kdave/btrfs-devel/commits/misc-next) and get back with results. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send

Re: misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-22 Thread Lakshmipathi.G
Quick update: It continues to fail: https://asciinema.org/a/8HAL3uZ4MG7eb5gXnlgq3jm7q Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Sat, Nov 18, 2017 at 12:59 PM, Lakshmipathi.G <lakshmipath...@gmail.com> wrote: > Hi. > > Few days back(Nov14th) this

misc/021-image-multi-devices fails on latest btrfs-devel/misc-next

2017-11-17 Thread Lakshmipathi.G
Hi. Few days back(Nov14th) this(misc/021-image-multi-devices) test script used to pass and seems like its failing now. may be due to recent commits? Logs,screen-casts available here: https://lakshmipathi.github.io/btrfsqa/ Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org

btrfs test bed

2017-11-10 Thread Lakshmipathi.G
suggestion/idea/scripts to improve this setup, let me know. thanks! [1] Setup: https://github.com/Lakshmipathi/btrfsqa [2] Results: https://lakshmipathi.github.io/btrfsqa/ Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line

Re: [PATCH 2/2] btrfs-progs: Replace some BUG_ON by return

2017-11-10 Thread Lakshmipathi.G
--check-data-csum btrfs-progs/tests/fuzz-tests/images/bko-156731.raw.restored mayfail: returned code 134 (SIGABRT), not ignored test failed for case 003-multi-check-unmounted Did I miss some other patch? thanks. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Wed

Re: kernel BUG at fs/btrfs/ctree.h:3457

2017-11-05 Thread Lakshmipathi.G
> Please skip that patch, as the check timing has its problem. > Okay, I'll skip the patch and run the tests hereafter. thanks. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs&q

Re: kernel BUG at fs/btrfs/ctree.h:3457

2017-11-05 Thread Lakshmipathi.G
Seems like output is messed by my email client: Here is formatted one: https://bugzilla.kernel.org/show_bug.cgi?id=197587#c6 Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Mon, Nov 6, 2017 at 10:47 AM, Lakshmipathi.G <lakshmipath...@gmail.com> wrote

kernel BUG at fs/btrfs/ctree.h:3457

2017-11-05 Thread Lakshmipathi.G
ip-172-31-32-145.us-west-2.compute.internal kernel: RSP: 0018:bc0f43fd7ed8 EFLAGS: 00010206 Nov 06 05:08:23 ip-172-31-32-145.us-west-2.compute.internal kernel: RAX: bc0f43fd7d40 RBX: 9d2331a48000 RCX: bc0f43fd7d50 Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webmin

btrfs-progs:fuzz-tests/003-multi-check-unmounted broken?

2017-11-05 Thread Lakshmipathi.G
tch/9939881/ still script doesn't succeed. thanks. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: xfstests:btrfs/025, 026 fails

2017-11-04 Thread Lakshmipathi.G
Okay I narrowed it down to /bin/mount -t btrfs -o context=system_u:object_r:root_t:s0 -o compress /dev/xvdc /mnt/scratch command from xfstests/btrfs/026. Cheers. On 11/4/17, Lakshmipathi.G <lakshmipath...@gmail.com> wrote: > Hi . > > While running xfstests with 4.14.0-rc7

xfstests:btrfs/025, 026 fails

2017-11-04 Thread Lakshmipathi.G
89 e5 40 0f 97 c6 0f 92 c1 31 c0 40 38 ce 75 06 80 7a [ 2134.574756] RIP: btrfs_compress_str2level+0x18/0x4e RSP: a90fc886fa10 [ 2134.578890] ---[ end trace 47a5851d0ed3c8fd ]--- https://bugzilla.kernel.org/show_bug.cgi?id=197771 Cheers, Lakshmipathi.G http://www.giis.co.in http

Re: kernel BUG at fs/btrfs/ctree.h:3457!

2017-11-03 Thread Lakshmipathi.G
Yes, the patch works. Enabled both CONFIG_BTRFS_FS_CHECK_INTEGRITY and CONFIG_BTRFS_FS_RUN_SANITY_TESTS. And applied above patch. This method also resolved the issue. thanks. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line

Re: kernel BUG at fs/btrfs/ctree.h:3457!

2017-11-02 Thread Lakshmipathi.G
> BTW, it would be better to see if this patch also solves your problem. > > https://patchwork.kernel.org/patch/10038011/ Okay sure, let me apply this patch and check the results. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this l

Re: kernel BUG at fs/btrfs/ctree.h:3457!

2017-11-02 Thread Lakshmipathi.G
After disabling FS_CHECK_INTEGRITY and FS_RUN_SANITY_TESTS in the config. Now the issue resolved. thanks. cast: https://asciinema.org/a/Dy6eHhhWPEIxotVbVUBWrhFeF Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Thu, Nov 2, 2017 at 12:55 PM, Lakshmipathi.G

Re: kernel BUG at fs/btrfs/ctree.h:3457!

2017-11-02 Thread Lakshmipathi.G
Okay thanks, I'll disable above mentioned entry in kernel config and run the tests. Will get back with updated results. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of

Re: kernel BUG at fs/btrfs/ctree.h:3457!

2017-11-01 Thread Lakshmipathi.G
> > I'll try to reproduce it with FS_CHECK_INTEGRITY enabled. > Okay thanks for the details. Here's the kernel config file which hits this issue: https://github.com/Lakshmipathi/btrfsqa/blob/master/setup/config/kernel.config#L3906 thanks! Cheers, Lakshmipathi.G http://www.giis.c

kernel BUG at fs/btrfs/ctree.h:3457!

2017-11-01 Thread Lakshmipathi.G
, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Building a BTRFS test machine

2017-11-01 Thread Lakshmipathi.G
Last few days, made small progress on this. Though Python/bash script is working, its not yet perfect. Gladly welcome any feedback and/or scripts :-) https://github.com/Lakshmipathi/btrfsqa Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list

Re: btrfs send yields "ERROR: send ioctl failed with -5: Input/output error"

2017-10-29 Thread Lakshmipathi.G
at the btrfs version that I used to mkfs > was not up to date. Is there a way to determine which version was used to > create the filesystem? > If I'm not wrong, i don't think we can get mkfs version from existing file system layout. what was your kernel version? Cheers

[PATCH 1/1] btrfs-progs: tests/common: Display warning only after searching for btrfs kernel module

2017-10-27 Thread Lakshmipathi.G
Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- tests/common | 8 ++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/tests/common b/tests/common index eb525a4..773b1e5 100644 --- a/tests/common +++ b/tests/common @@ -428,8 +428,12 @@ run_check_umount_te

Re: btrfs send yields "ERROR: send ioctl failed with -5: Input/output error"

2017-10-24 Thread Lakshmipathi.G
it is possible. And also you have quite lot of "all mirror(s) corrupted, can't be repaired", which will be hard to recovery. I suggest running offline scrub on all devices. Then online scrub and finally track those corrupted files with the help of extent info. ---- Cheers, Lakshmipa

Re: btrfs send yields "ERROR: send ioctl failed with -5: Input/output error"

2017-10-23 Thread Lakshmipathi.G
> Does anyone know why scrub did not catch these errors that show up in dmesg? Can you try offline scrub from this repo https://github.com/gujx2017/btrfs-progs/tree/offline_scrub and see whether it detects the issue? "btrfs scrub start --offline " Cheers, Lakshm

Re: [PATCH v3] btrfs-progs: RAID5: Inject data stripe corruption and verify scrub fixes it and retains correct parity.

2017-10-10 Thread Lakshmipathi.G
. Lakshmipathi.G On Mon, Feb 20, 2017 at 11:57 PM, Lakshmipathi.G <lakshmipath...@giis.co.in> wrote: > Test script to create file with specific data-stripe layout.Computes stripe > locations. > Inject corruption into data-stripe and verify scrubbing process fixes > corrupted block. &

Re: btrfs-progs task tracking on github

2017-09-08 Thread Lakshmipathi.G
Existing project list is good. Reg: "Project tests: Build and test coverage: pre-built images on docker hub" If we don't have pre-built images on docker hub, I'll pick up this task and start working on it. thanks. ---- Cheers, Lakshmipathi.G On Sat, Sep 9, 2017 at 5:43 AM,

Re: Building a BTRFS test machine

2017-08-14 Thread Lakshmipathi.G
ugs based on mailing-list responses will be little tricky than creating new bugs. something like that can be useful as well. I can help a bit on such testbed setup :-) Thanks! Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Mon, Aug 14, 2017 at 6:31 AM, Ce

Re: [PATCH 4/5] btrfs-progs: tests: fix typo in convert-tests/008-readonly-image

2017-07-31 Thread Lakshmipathi.G
> if [ $? -ne 1 ]; then > echo "after convert ext2_save/image is not read-only" Though this mayn't affect test-script result, please change the typo in this location also. thanks. Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe lin

Re: btrfs-convert --no-datasum & btrfs check: check_owner_ref: BUG_ON `rec->is_root` triggered, value 1

2017-07-02 Thread Lakshmipathi.G
Looked like I missed few patch. After checking with latest branch. Its working. Cheers, Lakshmipathi.G On Sun, Jul 2, 2017 at 7:30 PM, Lakshmipathi.G <lakshmipath...@gmail.com> wrote: > Hi. > While using btrfs-convert with '--no-datasum' option & running btrfs > check

btrfs-convert --no-datasum & btrfs check: check_owner_ref: BUG_ON `rec->is_root` triggered, value 1

2017-07-02 Thread Lakshmipathi.G
iggered, value 1 Is this a bug or something wrong with my environment? More info: https://bugzilla.kernel.org/show_bug.cgi?id=196217 Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org Mo

Re: [PATCH] Btrfs-progs: convert: do not clear nodatasum flag in inode item

2017-06-28 Thread Lakshmipathi.G
Could you please add also a test-script for this interesting issue under tests/convert-tests (If its not already there)?. thanks. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Thu, Jun 29, 2017 at 2:59 AM, Liu Bo <bo.li@oracle.com> wrote: > With th

Re: [PATCH v4] btrfs-progs: btrfs-convert: Add larger device support

2017-06-26 Thread Lakshmipathi.G
is simple. Okay sure, thanks. Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Stability status of btrfs-convert...

2017-06-22 Thread Lakshmipathi.G
te number of people converted their EXT4 to BTRFS . IMO, btrfs-convert is fairly stable, especially if you have only GB's of data Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of

[PATCH v2] btrfs-progs: Fix 'btrfs device stats --check' cli option

2017-06-22 Thread Lakshmipathi.G
Bug 194961 - btrfs device stats --check does not work https://bugzilla.kernel.org/show_bug.cgi?id=194961 Reported-by: Tomas Thiemel<thie...@centrum.cz> Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- cmds-device.c | 1 + 1 file changed, 1 insertion(+) diff --git a/cmd

[PATCH] Fix 'btrfs device stats --check' cli option

2017-06-22 Thread Lakshmipathi.G
Reported by Tomas Thiemel Bug 194961 - btrfs device stats --check does not work --- cmds-device.c | 1 + 1 file changed, 1 insertion(+) diff --git a/cmds-device.c b/cmds-device.c index 5e016a7..4337eb2 100644 --- a/cmds-device.c +++ b/cmds-device.c @@ -400,6 +400,7 @@

Re: [PATCH v4 00/20] Btrfs-progs offline scrub

2017-06-18 Thread Lakshmipathi.G
,20,10 can be found here: https://github.com/Lakshmipathi/btrfs_offline_scrub/blob/master/logs-june18/multiple_corruptions_misc-tests-results.txt Outputs are looking fine, but more testing required with different file-types :-) thanks. Cheers, Lakshmipathi.G -- To unsubscribe from th

Re: btrfs-convert: whats minimum free space requirement?

2017-06-09 Thread Lakshmipathi.G
it's already done, since it's complex, btrfs-convert will try to > calculate it early on, so even it fails to find the needed space, it will > not screw up the old fs. > > Thanks, > Qu > > oh, I didn't realize that, thanks. Will test/try with little free space and check the

Re: btrfs-convert: whats minimum free space requirement?

2017-06-09 Thread Lakshmipathi.G
rt. > > Thanks, > Qu Thanks for the details, Qu. I was thinking about adding a free-space check (based on total blocks/free block stat from source superblock) before btrfs-convert begins, looks like its more complex than i thought. Cheers. Lakshmipathi.G -- To unsubscribe from this

btrfs-convert: whats minimum free space requirement?

2017-06-08 Thread Lakshmipathi.G
Hi. Just wanted to check whether do we have any numbers on whats the minimum free space requirement on source file system for btrfs-convert to work? ex: Like 5% of ext3/4 free space is needed for btrfs-convert to succeed? Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line

[PATCH v4] btrfs-progs: btrfs-convert: Add larger device support

2017-06-03 Thread Lakshmipathi.G
, ext2fs_inode_data_blocks2,ext2fs_read_ext_attr2. (c) use 64bit types with btrfs_convert_context fields. bug: https://bugzilla.kernel.org/show_bug.cgi?id=194795 Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- convert/common.h | 8 convert/source-ext2.c | 11 ++--

Re: [PATCH v2] btrfs-progs: btrfs-convert: Add larger device support

2017-06-01 Thread Lakshmipathi.G
patch. Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH v3 00/19] Btrfs-progs offline scrub

2017-05-23 Thread Lakshmipathi.G
og file (/var/log/nginx_access_20160101.log) I don't need to panic, as I can live without that file. Or possibly delete that file, so that scrub doesn't report errors. -- Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message

Re: [PATCH v3 00/19] Btrfs-progs offline scrub

2017-05-23 Thread Lakshmipathi.G
/btrfs_offline_scrub -- Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH v3 00/19] Btrfs-progs offline scrub

2017-05-22 Thread Lakshmipathi.G
although I have done a lot during > the test) to see if it's good enough to be used as a better scrub > equivalent. > > And of course, any idea on the interface design (--offline under scrub > or other place) is welcomed. > > Thanks, > Qu > > At 05/22/2017 04:30

Re: [PATCH v3 00/19] Btrfs-progs offline scrub

2017-05-22 Thread Lakshmipathi.G
Tree extents scrubbed: 8 Data bytes scrubbed: 192512 Data extents scrubbed: 3 Data bytes without csum: 131072 Read error: 0 Verify error: 0 Csum error: 1 Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message

Re: [PATCH v3 00/19] Btrfs-progs offline scrub

2017-05-22 Thread Lakshmipathi.G
s, > Qu > Ah,my bad. I thought the entire binary is changed, didn't realize its an option. Will check again with 'offline' option. -- Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vge

Re: [PATCH v3 00/19] Btrfs-progs offline scrub

2017-05-22 Thread Lakshmipathi.G
tch/9583455/ > > No fixing yet. > > This part is focusing on error detection and report. > > Feel free to inject corruption and to see if it behave as expected. > > Thanks, > Qu > Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe l

Re: [PATCH 2/2] btrfs-progs: test for restoring multiple devices fs into a single device

2017-05-19 Thread Lakshmipathi.G
uot; can be done after comparing file integrity? This way, if integrity fails, the setup will be there to debug further. thanks. -- Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org

Re: [PATCH] btrfs-progs: tests: remove variable quotation from convert-tests

2017-05-15 Thread Lakshmipathi.G
t; > > Tsutomu Itoh t-i...@jp.fujitsu.com > -- > To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in > the body of a message to majord...@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH v2] btrfs-progs: btrfs-convert: Add larger device support

2017-05-15 Thread Lakshmipathi.G
k_count from u32 to u64? do we also need to change other fields like inodes_count and free_inode_count? Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH v3 00/19] Btrfs-progs offline scrub

2017-05-13 Thread Lakshmipathi.G
> > Ping? > > Any comments? > > Thanks, > Qu Can I inject corruption with existing script [1] and expect offline scrub to fix it? If so, I'll give it try and let you know the results. [1] https://patchwork.kernel.org/patch/9583455/ Cheers, Lakshmipathi.G -- To unsub

[PATCH v2] btrfs-progs: btrfs-convert: Add larger device support

2017-05-13 Thread Lakshmipathi.G
, ext2fs_inode_data_blocks2,ext2fs_read_ext_attr2 bug: https://bugzilla.kernel.org/show_bug.cgi?id=194795 Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- convert/source-ext2.c | 11 ++- 1 file changed, 6 insertions(+), 5 deletions(-) diff --git a/convert/source-ext2.c b/c

Re: [PATCH] btrfs-progs: btrfs-convert: Add larger device support

2017-05-09 Thread Lakshmipathi.G
-- Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] btrfs-progs: btrfs-convert: Add larger device support

2017-05-09 Thread Lakshmipathi.G
run_check fails to detect mke2fs command. Something wrong with my setup or issue with run_check? -- Cheers, Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.

Re: [PATCH 9/9] btrfs-progs: modify: Introduce option to specify the pattern to fill mirror

2017-05-06 Thread Lakshmipathi.G
ps://docs.python.org/2/extending/extending.html Cheers. Lakshmipathi.G On 5/5/17, Qu Wenruo <quwen...@cn.fujitsu.com> wrote: > > > At 05/05/2017 12:53 AM, David Sterba wrote: >> On Sun, Apr 23, 2017 at 01:12:42PM +0530, Lakshmipathi.G wrote: >>> Thanks for the example an

Re: [PATCH] btrfs-progs: btrfs-convert: Add larger device support

2017-05-03 Thread Lakshmipathi.G
rage. Sure, will send the above test script in upcoming days, then look into mkfs.ext4 options. thanks. Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] btrfs-progs: btrfs-convert: Add larger device support

2017-05-02 Thread Lakshmipathi.G
On Tue, May 02, 2017 at 05:06:01PM +0200, David Sterba wrote: > On Thu, Apr 27, 2017 at 03:35:34PM +0530, Lakshmipathi.G wrote: > > Bug: Fail to convert 22TB EXT4 to BTRFS > > https://bugzilla.kernel.org/show_bug.cgi?id=194795 > > Thanks for working on the bug, the proposed

Re: [PATCH 1/1] btrfs-progs: send: fail on first -ENODATA only

2017-05-01 Thread Lakshmipathi.G
Hi Christian, thanks for fixing it quickly :) I don't have permission to change the bug state to fixed, if you or Nazar have those rights, i think this bug can be closed. Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Mon, May 1, 2017 at 6:39 PM, Christian Brauner

Re: [PATCH 1/2 v2] btrfs-progs: fix btrfs send & receive with -e flag

2017-04-28 Thread Lakshmipathi.G
Hi. Adding the bug reporter, Nazar for the discussion (as I'm not familiar with send/receive feature/code). Cheers, Lakshmipathi.G http://www.giis.co.in http://www.webminal.org On Fri, Apr 28, 2017 at 3:25 PM, Christian Brauner <christian.brau...@canonical.com> wrote: > > Hi

Re: [PATCH] btrfs-progs: btrfs-convert: Add larger device support

2017-04-27 Thread Lakshmipathi.G
Hi Qu, Seems like its a known issue with older bitmaps. http://linux-ext4.vger.kernel.narkive.com/wkNbJe0b/patch-debugfs-open-with-ext2-flag-64bits Cheers. Lakshmipathi.G On Fri, Apr 28, 2017 at 09:48:10AM +0800, Qu Wenruo wrote: > > > At 04/28/2017 09:27 AM, Qu Wenruo wrote: > &g

[PATCH] btrfs-progs: btrfs-convert: Add larger device support

2017-04-27 Thread Lakshmipathi.G
Bug: Fail to convert 22TB EXT4 to BTRFS https://bugzilla.kernel.org/show_bug.cgi?id=194795 Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- convert/source-ext2.c | 11 ++- 1 file changed, 6 insertions(+), 5 deletions(-) diff --git a/convert/source-ext2.c b/convert/

[PATCH] btrfs-progs: Introduce 'btrfs inspect-internal dump-csum' option

2017-04-24 Thread Lakshmipathi.G
Example usage: btrfs inspect-internal dump-csum /btrfs/50gbfile /dev/sda4 csum for /btrfs/50gbfile dumped to /btrfs/50gbfile.csumdump Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- Makefile | 3 +- cmds-inspect-dump-csum.c

[PATCH] btrfs-progs: tests: add variable quotation to fsck-tests

2017-04-24 Thread Lakshmipathi.G
Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- tests/fsck-tests/006-bad-root-items/test.sh| 6 +++--- tests/fsck-tests/012-leaf-corruption/test.sh | 24 +++--- tests/fsck-tests/013-extent-tree-rebuild/test.sh | 22 ++-- test

[PATCH] btrfs-progs: tests: add variable quotation to convert-tests

2017-04-23 Thread Lakshmipathi.G
Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- tests/convert-tests.sh | 2 +- tests/convert-tests/001-ext2-basic/test.sh | 4 ++-- tests/convert-tests/002-ext3-basic/test.sh | 4 ++-- tests/convert-tests/003-ext4-basic/t

Re: [PATCH 9/9] btrfs-progs: modify: Introduce option to specify the pattern to fill mirror

2017-04-23 Thread Lakshmipathi.G
pected to find this and fix it) where as optype xor => should flip the bits at given offset. -- Cheers, Lakshmipathi.G FOSS Programmer. http://www.giis.co.in http://www.webminal.org On Thu, Apr 20, 2017 at 6:30 AM, Qu Wenruo <quwen...@cn.fujitsu.com> wrote: > > >

Re: [PATCH 9/9] btrfs-progs: modify: Introduce option to specify the pattern to fill mirror

2017-04-18 Thread Lakshmipathi.G
Nice. With this new option, it should be possible to achieve something like RAID56 corruption test-script say, https://patchwork.kernel.org/patch/9583455/ right? Cheers, Lakshmipathi.G FOSS Programmer. http://www.giis.co.in http://www.webminal.org On Mon, Apr 17, 2017 at 8:56 AM, Qu Wenruo

Re: [PATCH] btrfs-progs: cli-tests: Convert non-raid filesystem to raid

2017-04-15 Thread Lakshmipathi.G
On Mon, Mar 13, 2017 at 06:47:50PM +0100, David Sterba wrote: > On Sun, Jan 29, 2017 at 08:14:55PM +0530, Lakshmipathi.G wrote: > > Simple script to verify non-raid filesystem conversion. > > The cli (command line interface) tests are supposed to cover the common > useca

Re: [PATCH v3] btrfs-progs: misc-tests: Superblock corruption and recovery using backup.

2017-04-15 Thread Lakshmipathi.G
On Mon, Mar 13, 2017 at 06:15:04PM +0100, David Sterba wrote: > On Fri, Feb 17, 2017 at 04:01:59AM +0530, Lakshmipathi.G wrote: > > Test script to recover damaged primary superblock using backup superblock. > > > > Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in&g

[PATCH v4] btrfs-progs: misc-tests: Superblock corruption and recovery using backup

2017-04-15 Thread Lakshmipathi.G
Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- .../020-fix-superblock-corruption/test.sh | 35 ++ 1 file changed, 35 insertions(+) create mode 100755 tests/misc-tests/020-fix-superblock-corruption/test.sh diff --git a/tests/misc-tests/0

[PATCH v4] btrfs-progs: fsck-tests: verify 'btrfs check --repair' fixes corrupted nlink field

2017-04-15 Thread Lakshmipathi.G
commit 5cdcc57b8d599f03fe692e0285ee9e17f32267fa Author: Lakshmipathi.G <lakshmipath...@giis.co.in> Date: Sat Apr 15 14:26:20 2017 +0530 btrfs-progs: fsck-tests: verify 'btrfs check --repair' fixes corrupted nlink field Signed-off-by: Lakshmipathi.G <lakshmipath...@g

Re: [PATCH v3] btrfs-progs: fsck-tests: verify 'btrfs check --repair' fixes corrupted nlink field

2017-04-15 Thread Lakshmipathi.G
On Thu, Mar 30, 2017 at 05:52:11PM +0200, David Sterba wrote: > On Thu, Feb 02, 2017 at 01:35:02PM +0530, Lakshmipathi.G wrote: > > Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> > > --- > > tests/fsck-tests/026-check-inode-link/test.sh | 30 > > ++

Re: List of corruption cases for scrub

2017-02-27 Thread Lakshmipathi.G
On Mon, Feb 27, 2017 at 11:40:31AM +0800, Qu Wenruo wrote: > > > At 02/24/2017 10:32 AM, Lakshmipathi.G wrote: > >Hi. > > > >I tried to a create list of corruption test scenarios for scrubbing process > >with RAID5. > >Here's the list: >

Re: List of corruption cases for scrub

2017-02-26 Thread Lakshmipathi.G
On Fri, Feb 24, 2017 at 06:39:20PM +0100, Goffredo Baroncelli wrote: > Hi, > On 2017-02-24 03:32, Lakshmipathi.G wrote: > > Hi. > > > > I tried to a create list of corruption test scenarios for scrubbing process > > with RAID5. > > Here's the list: > &g

List of corruption cases for scrub

2017-02-23 Thread Lakshmipathi.G
entries or suggest new corrupt ideas! Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Large no.of extents for a single small file with a fresh RAID5 setup

2017-02-21 Thread Lakshmipathi.G
pping from logical->physical chunks on RAID5. I was wondering how these 4KB extents will fit into 64KB data-stripe? I didn't have idea about read-modify-write, just found few wiki links on it, will check. thanks Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the l

Re: [PATCH] btrfs-progs: RAID5:Inject data stripe corruption and verify scrub fixes it.

2017-02-21 Thread Lakshmipathi.G
es and 64 parity stripe location seems fine. It constantly hit the parity bug with the script. If the script gets accepted, will add slightly other corruption variants likes: - corrupt all even stripe (D2,D4..) - corrupt all odd stripe (D1,D3..) - corrupt all parity stripes - corrupt all both da

Re: Large no.of extents for a single small file with a fresh RAID5 setup

2017-02-21 Thread Lakshmipathi.G
iextent output. one more curious thing, is it fine to have extents with size 4096 on RAID5 setup? Cheers. Lakshmipathi.G #time /root/check_extents.sh f2MB 32 real1m30.284s user1m22.796s sys 0m39.324s laks/btrfs-progs# ./btrfs-debugfs -f tests/mnt/f2MB (263 0): ram 110592 disk 151015

[PATCH v3] btrfs-progs: RAID5: Inject data stripe corruption and verify scrub fixes it and retains correct parity.

2017-02-20 Thread Lakshmipathi.G
Test script to create file with specific data-stripe layout.Computes stripe locations. Inject corruption into data-stripe and verify scrubbing process fixes corrupted block. It also validates the corresponding parity stripe. Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co

Re: Large no.of extents for a single small file with a fresh RAID5 setup

2017-02-20 Thread Lakshmipathi.G
On Mon, Feb 20, 2017 at 03:53:15PM +0800, Qu Wenruo wrote: > > > At 02/18/2017 10:07 AM, Lakshmipathi.G wrote: > >Hi, > > > >With RAID5, using 3 loop-back devices each has 4GB. On a fresh setup, > >created a 2mb file. > >While checking no.of extents,it

Large no.of extents for a single small file with a fresh RAID5 setup

2017-02-17 Thread Lakshmipathi.G
disk size 2113536 logical size 2097152 ratio 0.99 Is this expected behaviour? Is there any mount option to minimize no.of extents for a smaller file? Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message

[PATCH v2] btrfs-progs: RAID5:Inject data stripe corruption and verify scrub fixes it.

2017-02-16 Thread Lakshmipathi.G
Test script to create file with specific data-stripe layout and pre-computed parity values. Inject corruption into data-stripe and verify scrubbing process fixes corrupted block. It also attempts to validate the corresponding parity block value. Signed-off-by: Lakshmipathi.G <lakshmip

Re: [PATCH v2] btrfs-progs: misc-tests: Superblock corruption and recovery using backup.

2017-02-16 Thread Lakshmipathi.G
On Thu, Feb 16, 2017 at 09:05:02AM +0800, Qu Wenruo wrote: > > > At 02/16/2017 04:50 AM, Lakshmipathi.G wrote: > >Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> > > Looks good to me. > > Reviewed by: Qu Wenruo <quwen...@cn.fujitsu.com> &g

[PATCH v3] btrfs-progs: misc-tests: Superblock corruption and recovery using backup.

2017-02-16 Thread Lakshmipathi.G
Test script to recover damaged primary superblock using backup superblock. Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> --- .../019-fix-superblock-corruption/test.sh | 36 ++ 1 file changed, 36 insertions(+) create mode 100755 tests/misc-tests/0

Re: [PATCH] btrfs-progs: RAID5:Inject data stripe corruption and verify scrub fixes it.

2017-02-16 Thread Lakshmipathi.G
On Thu, Feb 16, 2017 at 09:12:31AM +0800, Qu Wenruo wrote: > > > At 02/16/2017 04:56 AM, Lakshmipathi.G wrote: > >On Wed, Feb 15, 2017 at 05:29:33PM +0800, Qu Wenruo wrote: > >> > >> > >>At 02/15/2017 05:03 PM, Lakshmipathi.G wrote: > >>>Si

Re: How to dump/find parity of RAID-5 file?

2017-02-16 Thread Lakshmipathi.G
it should be possible to access parity/data-stripes more sensible manner instead using expensive "cat /device/ | hexdump | grep" combination. thanks. Cheers. Lakshmipathi.G -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [PATCH] btrfs-progs: RAID5:Inject data stripe corruption and verify scrub fixes it.

2017-02-15 Thread Lakshmipathi.G
On Wed, Feb 15, 2017 at 05:29:33PM +0800, Qu Wenruo wrote: > > > At 02/15/2017 05:03 PM, Lakshmipathi.G wrote: > >Signed-off-by: Lakshmipathi.G <lakshmipath...@giis.co.in> > >--- > > .../020-raid5-datastripe-corruption/test.sh| 224 > > ++

  1   2   >