On Mon, Mar 8, 2021 at 5:04 PM Josef Bacik <jo...@toxicpanda.com> wrote: > > On 3/8/21 3:01 PM, Neal Gompa wrote: > > On Mon, Mar 8, 2021 at 1:38 PM Josef Bacik <jo...@toxicpanda.com> wrote: > >> > >> On 3/5/21 8:03 PM, Neal Gompa wrote: > >>> On Fri, Mar 5, 2021 at 5:01 PM Josef Bacik <jo...@toxicpanda.com> wrote: > >>>> > >>>> On 3/5/21 9:41 AM, Neal Gompa wrote: > >>>>> On Fri, Mar 5, 2021 at 9:12 AM Josef Bacik <jo...@toxicpanda.com> wrote: > >>>>>> > >>>>>> On 3/4/21 6:54 PM, Neal Gompa wrote: > >>>>>>> On Thu, Mar 4, 2021 at 3:25 PM Josef Bacik <jo...@toxicpanda.com> > >>>>>>> wrote: > >>>>>>>> > >>>>>>>> On 3/3/21 2:38 PM, Neal Gompa wrote: > >>>>>>>>> On Wed, Mar 3, 2021 at 1:42 PM Josef Bacik <jo...@toxicpanda.com> > >>>>>>>>> wrote: > >>>>>>>>>> > >>>>>>>>>> On 2/24/21 10:47 PM, Neal Gompa wrote: > >>>>>>>>>>> On Wed, Feb 24, 2021 at 10:44 AM Josef Bacik > >>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>> > >>>>>>>>>>>> On 2/24/21 9:23 AM, Neal Gompa wrote: > >>>>>>>>>>>>> On Tue, Feb 23, 2021 at 10:05 AM Josef Bacik > >>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> On 2/22/21 11:03 PM, Neal Gompa wrote: > >>>>>>>>>>>>>>> On Mon, Feb 22, 2021 at 2:34 PM Josef Bacik > >>>>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> On 2/21/21 1:27 PM, Neal Gompa wrote: > >>>>>>>>>>>>>>>>> On Wed, Feb 17, 2021 at 11:44 AM Josef Bacik > >>>>>>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> On 2/17/21 11:29 AM, Neal Gompa wrote: > >>>>>>>>>>>>>>>>>>> On Wed, Feb 17, 2021 at 9:59 AM Josef Bacik > >>>>>>>>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> On 2/17/21 9:50 AM, Neal Gompa wrote: > >>>>>>>>>>>>>>>>>>>>> On Wed, Feb 17, 2021 at 9:36 AM Josef Bacik > >>>>>>>>>>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> On 2/16/21 9:05 PM, Neal Gompa wrote: > >>>>>>>>>>>>>>>>>>>>>>> On Tue, Feb 16, 2021 at 4:24 PM Josef Bacik > >>>>>>>>>>>>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> On 2/16/21 3:29 PM, Neal Gompa wrote: > >>>>>>>>>>>>>>>>>>>>>>>>> On Tue, Feb 16, 2021 at 1:11 PM Josef Bacik > >>>>>>>>>>>>>>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>> On 2/16/21 11:27 AM, Neal Gompa wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>> On Tue, Feb 16, 2021 at 10:19 AM Josef Bacik > >>>>>>>>>>>>>>>>>>>>>>>>>>> <jo...@toxicpanda.com> wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> On 2/14/21 3:25 PM, Neal Gompa wrote: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hey all, > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> So one of my main computers recently had a disk > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> controller failure > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> that caused my machine to freeze. After > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> rebooting, Btrfs refuses to > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> mount. I tried to do a mount and the following > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> errors show up in the > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> journal: > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> info (device sda3): disk space caching is > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> enabled > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> info (device sda3): has skinny extents > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> critical (device sda3): corrupt leaf: root=401 > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> block=796082176 slot=15 ino=203657, invalid > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> inode transid: has 888896 expect [0, 888895] > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> error (device sda3): block=796082176 read time > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> tree block corruption detected > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> critical (device sda3): corrupt leaf: root=401 > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> block=796082176 slot=15 ino=203657, invalid > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> inode transid: has 888896 expect [0, 888895] > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> error (device sda3): block=796082176 read time > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> tree block corruption detected > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> warning (device sda3): couldn't read tree root > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Feb 14 15:20:49 localhost-live kernel: BTRFS > >>>>>>>>>>>>>>>>>>>>>>>>>>>>>> error (device sda3): open_ctree failed > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> I've tried to do -o recovery,ro mount and get > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> the same issue. I can't > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> seem to find any reasonably good information on > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> how to do recovery in > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> this scenario, even to just recover enough to > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> copy data off. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> I'm on Fedora 33, the system was on Linux > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> kernel version 5.9.16 and > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> the Fedora 33 live ISO I'm using has Linux > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> kernel version 5.10.14. I'm > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> using btrfs-progs v5.10. > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>>> Can anyone help? > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Can you try > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> btrfs check --clear-space-cache v1 /dev/whatever > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> That should fix the inode generation thing so > >>>>>>>>>>>>>>>>>>>>>>>>>>>> it's sane, and then the tree > >>>>>>>>>>>>>>>>>>>>>>>>>>>> checker will allow the fs to be read, hopefully. > >>>>>>>>>>>>>>>>>>>>>>>>>>>> If not we can work out some > >>>>>>>>>>>>>>>>>>>>>>>>>>>> other magic. Thanks, > >>>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>>> Josef > >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>>> I got the same error as I did with btrfs-check > >>>>>>>>>>>>>>>>>>>>>>>>>>> --readonly... > >>>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>>> Oh lovely, what does btrfs check --readonly > >>>>>>>>>>>>>>>>>>>>>>>>>> --backup do? > >>>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> No dice... > >>>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>>> # btrfs check --readonly --backup /dev/sda3 > >>>>>>>>>>>>>>>>>>>>>>>>>> Opening filesystem to check... > >>>>>>>>>>>>>>>>>>>>>>>>>> parent transid verify failed on 791281664 wanted > >>>>>>>>>>>>>>>>>>>>>>>>>> 888893 found 888895 > >>>>>>>>>>>>>>>>>>>>>>>>>> parent transid verify failed on 791281664 wanted > >>>>>>>>>>>>>>>>>>>>>>>>>> 888893 found 888895 > >>>>>>>>>>>>>>>>>>>>>>>>>> parent transid verify failed on 791281664 wanted > >>>>>>>>>>>>>>>>>>>>>>>>>> 888893 found 888895 > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> Hey look the block we're looking for, I wrote you > >>>>>>>>>>>>>>>>>>>>>>>> some magic, just pull > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> https://github.com/josefbacik/btrfs-progs/tree/for-neal > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> build, and then run > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> btrfs-neal-magic /dev/sda3 791281664 888895 > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>>> This will force us to point at the old root with > >>>>>>>>>>>>>>>>>>>>>>>> (hopefully) the right bytenr > >>>>>>>>>>>>>>>>>>>>>>>> and gen, and then hopefully you'll be able to > >>>>>>>>>>>>>>>>>>>>>>>> recover from there. This is kind > >>>>>>>>>>>>>>>>>>>>>>>> of saucy, so yolo, but I can undo it if it makes > >>>>>>>>>>>>>>>>>>>>>>>> things worse. Thanks, > >>>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> # btrfs check --readonly /dev/sda3 > >>>>>>>>>>>>>>>>>>>>>>>> Opening filesystem to check... > >>>>>>>>>>>>>>>>>>>>>>>> ERROR: could not setup extent tree > >>>>>>>>>>>>>>>>>>>>>>>> ERROR: cannot open file system > >>>>>>>>>>>>>>>>>>>>>>> # btrfs check --clear-space-cache v1 /dev/sda3 > >>>>>>>>>>>>>>>>>>>>>>>> Opening filesystem to check... > >>>>>>>>>>>>>>>>>>>>>>>> ERROR: could not setup extent tree > >>>>>>>>>>>>>>>>>>>>>>>> ERROR: cannot open file system > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> It's better, but still no dice... :( > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> Hmm it's not telling us what's wrong with the extent > >>>>>>>>>>>>>>>>>>>>>> tree, which is annoying. > >>>>>>>>>>>>>>>>>>>>>> Does mount -o rescue=all,ro work now that the root > >>>>>>>>>>>>>>>>>>>>>> tree is normal? Thanks, > >>>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> Nope, I see this in the journal: > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS info > >>>>>>>>>>>>>>>>>>>>>> (device sda3): enabling all of the rescue options > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS info > >>>>>>>>>>>>>>>>>>>>>> (device sda3): ignoring data csums > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS info > >>>>>>>>>>>>>>>>>>>>>> (device sda3): ignoring bad roots > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS info > >>>>>>>>>>>>>>>>>>>>>> (device sda3): disabling log replay at mount time > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS info > >>>>>>>>>>>>>>>>>>>>>> (device sda3): disk space caching is enabled > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS info > >>>>>>>>>>>>>>>>>>>>>> (device sda3): has skinny extents > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS error > >>>>>>>>>>>>>>>>>>>>>> (device sda3): tree level mismatch detected, > >>>>>>>>>>>>>>>>>>>>>> bytenr=791281664 level expected=1 has=2 > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS error > >>>>>>>>>>>>>>>>>>>>>> (device sda3): tree level mismatch detected, > >>>>>>>>>>>>>>>>>>>>>> bytenr=791281664 level expected=1 has=2 > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS warning > >>>>>>>>>>>>>>>>>>>>>> (device sda3): couldn't read tree root > >>>>>>>>>>>>>>>>>>>>>> Feb 17 09:49:40 localhost-live kernel: BTRFS error > >>>>>>>>>>>>>>>>>>>>>> (device sda3): open_ctree failed > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> Ok git pull for-neal, rebuild, then run > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> btrfs-neal-magic /dev/sda3 791281664 888895 2 > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>>> I thought of this yesterday but in my head was like > >>>>>>>>>>>>>>>>>>>> "naaahhhh, whats the chances > >>>>>>>>>>>>>>>>>>>> that the level doesn't match??". Thanks, > >>>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>>> Tried rescue mount again after running that and got a > >>>>>>>>>>>>>>>>>>> stack trace in > >>>>>>>>>>>>>>>>>>> the kernel, detailed in the following attached log. > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> Huh I wonder how I didn't hit this when testing, I must > >>>>>>>>>>>>>>>>>> have only tested with > >>>>>>>>>>>>>>>>>> zero'ing the extent root and the csum root. You're going > >>>>>>>>>>>>>>>>>> to have to build a > >>>>>>>>>>>>>>>>>> kernel with a fix for this > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> https://paste.centos.org/view/7b48aaea > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>>> and see if that gets you further. Thanks, > >>>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>> I built a kernel build as an RPM with your patch[1] and > >>>>>>>>>>>>>>>>> tried it. > >>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>> [root@fedora ~]# mount -t btrfs -o rescue=all,ro /dev/sdb3 > >>>>>>>>>>>>>>>>> /mnt > >>>>>>>>>>>>>>>>> Killed > >>>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>>> The log from the journal is attached. > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> Ahh crud my bad, this should do it > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>>> https://paste.centos.org/view/ac2e61ef > >>>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> > >>>>>>>>>>>>>>> Patch doesn't apply (note it is patch 667 below): > >>>>>>>>>>>>>> > >>>>>>>>>>>>>> Ah sorry, should have just sent you an iterative patch. You > >>>>>>>>>>>>>> can take the above > >>>>>>>>>>>>>> patch and just delete the hunk from volumes.c as you already > >>>>>>>>>>>>>> have that applied > >>>>>>>>>>>>>> and then it'll work. Thanks, > >>>>>>>>>>>>>> > >>>>>>>>>>>>> > >>>>>>>>>>>>> Failed with a weird error...? > >>>>>>>>>>>>> > >>>>>>>>>>>>> [root@fedora ~]# mount -t btrfs -o rescue=all,ro /dev/sda3 /mnt > >>>>>>>>>>>>> mount: /mnt: mount(2) system call failed: No such file or > >>>>>>>>>>>>> directory. > >>>>>>>>>>>>> > >>>>>>>>>>>>> Journal log with traceback attached. > >>>>>>>>>>>> > >>>>>>>>>>>> Last one maybe? > >>>>>>>>>>>> > >>>>>>>>>>>> https://paste.centos.org/view/80edd6fd > >>>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>>> Similar weird failure: > >>>>>>>>>>> > >>>>>>>>>>> [root@fedora ~]# mount -t btrfs -o rescue=all,ro /dev/sdb3 /mnt > >>>>>>>>>>> mount: /mnt: mount(2) system call failed: No such file or > >>>>>>>>>>> directory. > >>>>>>>>>>> > >>>>>>>>>>> No crash in the journal this time, though: > >>>>>>>>>>> > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS info (device sdb3): > >>>>>>>>>>>> enabling all of the rescue options > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS info (device sdb3): > >>>>>>>>>>>> ignoring data csums > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS info (device sdb3): > >>>>>>>>>>>> ignoring bad roots > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS info (device sdb3): > >>>>>>>>>>>> disabling log replay at mount time > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS info (device sdb3): disk > >>>>>>>>>>>> space caching is enabled > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS info (device sdb3): has > >>>>>>>>>>>> skinny extents > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS warning (device sdb3): > >>>>>>>>>>>> failed to read fs tree: -2 > >>>>>>>>>>>> Feb 24 22:43:19 fedora kernel: BTRFS error (device sdb3): > >>>>>>>>>>>> open_ctree failed > >>>>>>>>>>> > >>>>>>>>>>> > >>>>>>>>>> > >>>>>>>>>> Sorry Neal, you replied when I was in the middle of something and > >>>>>>>>>> promptly > >>>>>>>>>> forgot about it. I figured the fs root was fine, can you do the > >>>>>>>>>> following so I > >>>>>>>>>> can figure out from the error messages what might be wrong > >>>>>>>>>> > >>>>>>>>>> btrfs check --readonly > >>>>>>>>>> btrfs restore -D > >>>>>>>>>> btrfs restore -l > >>>>>>>>>> > >>>>>>>>> > >>>>>>>>> It didn't work.. Here's the output: > >>>>>>>>> > >>>>>>>>> [root@fedora ~]# btrfs check --readonly /dev/sdb3 > >>>>>>>>> Opening filesystem to check... > >>>>>>>>> ERROR: could not setup extent tree > >>>>>>>>> ERROR: cannot open file system > >>>>>>>>> [root@fedora ~]# btrfs restore -D /dev/sdb3 /mnt > >>>>>>>>> WARNING: could not setup extent tree, skipping it > >>>>>>>>> Couldn't setup device tree > >>>>>>>>> Could not open root, trying backup super > >>>>>>>>> parent transid verify failed on 796082176 wanted 888894 found 888896 > >>>>>>>>> parent transid verify failed on 796082176 wanted 888894 found 888896 > >>>>>>>>> parent transid verify failed on 796082176 wanted 888894 found 888896 > >>>>>>>>> Ignoring transid failure > >>>>>>>>> WARNING: could not setup extent tree, skipping it > >>>>>>>>> Couldn't setup device tree > >>>>>>>>> Could not open root, trying backup super > >>>>>>>>> ERROR: superblock bytenr 274877906944 is larger than device size > >>>>>>>>> 263132807168 > >>>>>>>>> Could not open root, trying backup super > >>>>>>>>> [root@fedora ~]# btrfs restore -l /dev/sdb3 /mnt > >>>>>>>>> WARNING: could not setup extent tree, skipping it > >>>>>>>>> Couldn't setup device tree > >>>>>>>>> Could not open root, trying backup super > >>>>>>>>> parent transid verify failed on 796082176 wanted 888894 found 888896 > >>>>>>>>> parent transid verify failed on 796082176 wanted 888894 found 888896 > >>>>>>>>> parent transid verify failed on 796082176 wanted 888894 found 888896 > >>>>>>>>> Ignoring transid failure > >>>>>>>>> WARNING: could not setup extent tree, skipping it > >>>>>>>>> Couldn't setup device tree > >>>>>>>>> Could not open root, trying backup super > >>>>>>>>> ERROR: superblock bytenr 274877906944 is larger than device size > >>>>>>>>> 263132807168 > >>>>>>>>> Could not open root, trying backup super > >>>>>>>>> > >>>>>>>>> > >>>>>>>> > >>>>>>>> Hmm OK I think we want the neal magic for this one too, but before > >>>>>>>> we go doing > >>>>>>>> that can I get a > >>>>>>>> > >>>>>>>> btrfs inspect-internal -f /dev/whatever > >>>>>>>> > >>>>>>>> so I can make sure I'm not just blindly clobbering something. > >>>>>>>> Thanks, > >>>>>>>> > >>>>>>> > >>>>>>> Doesn't work, did you mean some other command? > >>>>>>> > >>>>>>> [root@fedora ~]# btrfs inspect-internal -f /dev/sdb3 > >>>>>>> btrfs inspect-internal: unknown token '-f' > >>>>>> > >>>>>> Sigh, sorry, btrfs inspect-internal dump-super -f /dev/sdb3 > >>>>>> > >>>>> > >>>> > >>>> Ok I've pushed to the for-neal branch in my btrfs-progs, can you pull > >>>> and make > >>>> and then run > >>>> > >>>> ./btrfs-print-block /dev/sdb3 791281664 > >>>> > >>>> and capture everything it prints out? Thanks, > >>>> > >>> > >>> Here's the output from the command. > >>> > >>> > >> > >> Hmm looks like the fs is offset a bit, can you do > >> > >> ./btrfs-print-block /dev/sdb3 799670272 > >> > > > > This command caused my session to crash, but I do have a log of what > > was captured before it crashed and attached it. > > > >> also while we're here can I get > >> > >> btrfs-find-root /dev/sdb3 > >> > > > > This ran successfully and I've attached the output. > > > > Ok we're going to try this again, and if it doesn't work it looks like your > chunk root is ok, so I'll rig something up to make the translation work right, > but for now lets do > > ./btrfs-print-block /dev/sdb3 792395776 >
I've attached the output from that command, which did run successfully. -- 真実はいつも一つ！/ Always, there's only one truth!
leaf 784007168 items 53 free space 7414 generation 757286 owner 401 leaf 784007168 flags 0x1(WRITTEN) backref revision 1 fs uuid f993ffa4-8801-4d57-a087-1c35fd6ece00 chunk uuid 7eff154b-3550-427e-98cb-7300b3d69ab3 item 0 key (147591 XATTR_ITEM 3817753667) itemoff 16207 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 1 key (147591 EXTENT_DATA 0) itemoff 16154 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798076416 nr 8192 extent data offset 0 nr 8192 ram 8192 extent compression 0 (none) item 2 key (147592 INODE_ITEM 0) itemoff 15994 itemsize 160 generation 757286 transid 757286 size 6248 nbytes 8192 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.226158833 (2021-01-01 21:23:23) ctime 1609554203.226158833 (2021-01-01 21:23:23) mtime 1603831043.0 (2020-10-27 16:37:23) otime 1609554203.226158833 (2021-01-01 21:23:23) item 3 key (147592 INODE_REF 146020) itemoff 15966 itemsize 28 index 498 namelen 18 name: kcoreaddons5_qt.qm item 4 key (147592 XATTR_ITEM 3817753667) itemoff 15890 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 5 key (147592 EXTENT_DATA 0) itemoff 15837 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798084608 nr 8192 extent data offset 0 nr 8192 ram 8192 extent compression 0 (none) item 6 key (147593 INODE_ITEM 0) itemoff 15677 itemsize 160 generation 757286 transid 757286 size 1222 nbytes 1222 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.226158833 (2021-01-01 21:23:23) ctime 1609554203.226158833 (2021-01-01 21:23:23) mtime 1603831030.0 (2020-10-27 16:37:10) otime 1609554203.226158833 (2021-01-01 21:23:23) item 7 key (147593 INODE_REF 146020) itemoff 15649 itemsize 28 index 500 namelen 18 name: kdbusaddons5_qt.qm item 8 key (147593 XATTR_ITEM 3817753667) itemoff 15573 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 9 key (147593 EXTENT_DATA 0) itemoff 14330 itemsize 1243 generation 757286 type 0 (inline) inline extent data size 1222 ram_bytes 1222 compression 0 (none) item 10 key (147594 INODE_ITEM 0) itemoff 14170 itemsize 160 generation 757286 transid 757286 size 5830 nbytes 8192 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.226158833 (2021-01-01 21:23:23) ctime 1609554203.226158833 (2021-01-01 21:23:23) mtime 1603831044.0 (2020-10-27 16:37:24) otime 1609554203.226158833 (2021-01-01 21:23:23) item 11 key (147594 INODE_REF 146020) itemoff 14139 itemsize 31 index 502 namelen 21 name: kde5_xml_mimetypes.qm item 12 key (147594 XATTR_ITEM 3817753667) itemoff 14063 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 13 key (147594 EXTENT_DATA 0) itemoff 14010 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798092800 nr 8192 extent data offset 0 nr 8192 ram 8192 extent compression 0 (none) item 14 key (147595 INODE_ITEM 0) itemoff 13850 itemsize 160 generation 757286 transid 757286 size 8349 nbytes 12288 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.226158833 (2021-01-01 21:23:23) ctime 1609554203.226158833 (2021-01-01 21:23:23) mtime 1606453733.0 (2020-11-27 00:08:53) otime 1609554203.226158833 (2021-01-01 21:23:23) item 15 key (147595 INODE_REF 146020) itemoff 13824 itemsize 26 index 504 namelen 16 name: kdeclarative5.mo item 16 key (147595 XATTR_ITEM 3817753667) itemoff 13748 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 17 key (147595 EXTENT_DATA 0) itemoff 13695 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798100992 nr 12288 extent data offset 0 nr 12288 ram 12288 extent compression 0 (none) item 18 key (147596 INODE_ITEM 0) itemoff 13535 itemsize 160 generation 757286 transid 757286 size 2601 nbytes 4096 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.226158833 (2021-01-01 21:23:23) ctime 1609554203.226158833 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.226158833 (2021-01-01 21:23:23) item 19 key (147596 INODE_REF 146020) itemoff 13508 itemsize 27 index 506 namelen 17 name: kdeconnect-app.mo item 20 key (147596 XATTR_ITEM 3817753667) itemoff 13432 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 21 key (147596 EXTENT_DATA 0) itemoff 13379 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798113280 nr 4096 extent data offset 0 nr 4096 ram 4096 extent compression 0 (none) item 22 key (147597 INODE_ITEM 0) itemoff 13219 itemsize 160 generation 757286 transid 757286 size 5693 nbytes 8192 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.226158833 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.226158833 (2021-01-01 21:23:23) item 23 key (147597 INODE_REF 146020) itemoff 13192 itemsize 27 index 508 namelen 17 name: kdeconnect-cli.mo item 24 key (147597 XATTR_ITEM 3817753667) itemoff 13116 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 25 key (147597 EXTENT_DATA 0) itemoff 13063 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798117376 nr 8192 extent data offset 0 nr 8192 ram 8192 extent compression 0 (none) item 26 key (147598 INODE_ITEM 0) itemoff 12903 itemsize 160 generation 757286 transid 757286 size 3122 nbytes 4096 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.227159091 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.227159091 (2021-01-01 21:23:23) item 27 key (147598 INODE_REF 146020) itemoff 12875 itemsize 28 index 510 namelen 18 name: kdeconnect-core.mo item 28 key (147598 XATTR_ITEM 3817753667) itemoff 12799 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 29 key (147598 EXTENT_DATA 0) itemoff 12746 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798125568 nr 4096 extent data offset 0 nr 4096 ram 4096 extent compression 0 (none) item 30 key (147599 INODE_ITEM 0) itemoff 12586 itemsize 160 generation 757286 transid 757286 size 608 nbytes 608 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.227159091 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.227159091 (2021-01-01 21:23:23) item 31 key (147599 INODE_REF 146020) itemoff 12548 itemsize 38 index 512 namelen 28 name: kdeconnect-fileitemaction.mo item 32 key (147599 XATTR_ITEM 3817753667) itemoff 12472 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 33 key (147599 EXTENT_DATA 0) itemoff 11843 itemsize 629 generation 757286 type 0 (inline) inline extent data size 608 ram_bytes 608 compression 0 (none) item 34 key (147600 INODE_ITEM 0) itemoff 11683 itemsize 160 generation 757286 transid 757286 size 2243 nbytes 4096 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.227159091 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.227159091 (2021-01-01 21:23:23) item 35 key (147600 INODE_REF 146020) itemoff 11650 itemsize 33 index 514 namelen 23 name: kdeconnect-indicator.mo item 36 key (147600 XATTR_ITEM 3817753667) itemoff 11574 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 37 key (147600 EXTENT_DATA 0) itemoff 11521 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798129664 nr 4096 extent data offset 0 nr 4096 ram 4096 extent compression 0 (none) item 38 key (147601 INODE_ITEM 0) itemoff 11361 itemsize 160 generation 757286 transid 757286 size 668 nbytes 668 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.227159091 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.227159091 (2021-01-01 21:23:23) item 39 key (147601 INODE_REF 146020) itemoff 11327 itemsize 34 index 516 namelen 24 name: kdeconnect-interfaces.mo item 40 key (147601 XATTR_ITEM 3817753667) itemoff 11251 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 41 key (147601 EXTENT_DATA 0) itemoff 10562 itemsize 689 generation 757286 type 0 (inline) inline extent data size 668 ram_bytes 668 compression 0 (none) item 42 key (147602 INODE_ITEM 0) itemoff 10402 itemsize 160 generation 757286 transid 757286 size 3276 nbytes 4096 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.227159091 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.227159091 (2021-01-01 21:23:23) item 43 key (147602 INODE_REF 146020) itemoff 10375 itemsize 27 index 518 namelen 17 name: kdeconnect-kcm.mo item 44 key (147602 XATTR_ITEM 3817753667) itemoff 10299 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 45 key (147602 EXTENT_DATA 0) itemoff 10246 itemsize 53 generation 757286 type 1 (regular) extent data disk byte 5798133760 nr 4096 extent data offset 0 nr 4096 ram 4096 extent compression 0 (none) item 46 key (147603 INODE_ITEM 0) itemoff 10086 itemsize 160 generation 757286 transid 757286 size 959 nbytes 959 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.227159091 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.227159091 (2021-01-01 21:23:23) item 47 key (147603 INODE_REF 146020) itemoff 10058 itemsize 28 index 520 namelen 18 name: kdeconnect-kded.mo item 48 key (147603 XATTR_ITEM 3817753667) itemoff 9982 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0 item 49 key (147603 EXTENT_DATA 0) itemoff 9002 itemsize 980 generation 757286 type 0 (inline) inline extent data size 959 ram_bytes 959 compression 0 (none) item 50 key (147604 INODE_ITEM 0) itemoff 8842 itemsize 160 generation 757286 transid 757286 size 1033 nbytes 1033 block group 0 mode 100644 links 1 uid 0 gid 0 rdev 0 sequence 14 flags 0x0(none) atime 1609554203.227159091 (2021-01-01 21:23:23) ctime 1609554203.227159091 (2021-01-01 21:23:23) mtime 1601653667.0 (2020-10-02 11:47:47) otime 1609554203.227159091 (2021-01-01 21:23:23) item 51 key (147604 INODE_REF 146020) itemoff 8815 itemsize 27 index 522 namelen 17 name: kdeconnect-kio.mo item 52 key (147604 XATTR_ITEM 3817753667) itemoff 8739 itemsize 76 location key (0 UNKNOWN.0 0) type XATTR transid 757286 data_len 30 name_len 16 name: security.selinux data system_u:object_r:locale_t:s0
