Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
Am 7.9.2018 17:46, schrieb Chris Murphy: On Fri, Sep 7, 2018 at 3:56 AM, Jürgen Herrmann wrote: Hello! I'm having a problem with btrfs send which stops after several seconds. The process hangs with 100% cpu time on one cpu. The system is still responsive to input but no io is happening anymore so the system basically becomes unuseable. What kernel? Latest stable is 4.18.6. but I want to make sure that's what you're using, someone else has reported btrfs send problems in another thread with 4.18.5 that sound similar. Hello again! I was away from home for the last few days and I could not reproduce the problem with any kernel and aný version of the btrfs tools while on the road and the btrfs receive end was only connected via relatively slow wan connection. Now I'm back home and I can reproduce the hang of btrfs send with the following versions: kernels: - ubuntu kernel 4.15.0-33-generic - latest stable from kernel.org 4.18.6 btrfs-progs: - ubuntu shipped 4.15.1 - latest stable compiled from source 4.17.1 btrfs send does indeed send some data over the ssh connection to the receiving machine as the snapshot is newly created there and contains some data: t-5@t-5:/mnt/backup_laptop/2018-08-16_20-00-01/@$ du -h --max-depth=0 140M. The sending of data very quickly stops (<1s) and the process takes up 100% cpu time on the sending laptop. about two or three seconds later all io is blocked and the system is practically unuseable. A "btrfs send /path/to/subvol > /dev/null" also shows the same behaviour. As this is the first snapshot to be trasferred there are no -c or -p arguments on the command line. What can i do to help debug this? Best regards, Jürgen -- Jürgen Herrmann https://t-5.eu ALbertstraße 2 94327 Bogen
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
On Fri, Sep 7, 2018 at 3:56 AM, Jürgen Herrmann wrote: > Hello! > > I'm having a problem with btrfs send which stops after several seconds. > The process hangs with 100% cpu time on one cpu. The system is still > responsive to input but no io is happening anymore so the system > basically becomes unuseable. What kernel? Latest stable is 4.18.6. but I want to make sure that's what you're using, someone else has reported btrfs send problems in another thread with 4.18.5 that sound similar. -- Chris Murphy
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
Am 7.9.2018 13:13, schrieb Qu Wenruo: On 2018/9/7 下午6:45, Jürgen Herrmann wrote: Am 7.9.2018 12:15, schrieb Qu Wenruo: On 2018/9/7 下午5:56, Jürgen Herrmann wrote: Hello! I'm having a problem with btrfs send which stops after several seconds. The process hangs with 100% cpu time on one cpu. The system is still responsive to input but no io is happening anymore so the system basically becomes unuseable. Do you have a lot of snapshots or reflinked files (common for offline dedupe)? If so, send can spend a lot of time trying to iterate all referencers. Linux Mint 19 uses timeshift-btrfs which i find very handy. here's a list of snapshot directories, each containing two subvolumes for @ and @home: drwxr-xr-x 1 root root 30 Aug 16 20:00 2018-08-16_20-00-01 drwxr-xr-x 1 root root 30 Aug 17 14:00 2018-08-17_14-00-02 drwxr-xr-x 1 root root 30 Aug 23 20:00 2018-08-23_20-00-01 drwxr-xr-x 1 root root 30 Aug 30 20:00 2018-08-30_20-00-01 drwxr-xr-x 1 root root 30 Aug 31 17:00 2018-08-31_17-00-01 drwxr-xr-x 1 root root 30 Sep 1 20:00 2018-09-01_20-00-02 drwxr-xr-x 1 root root 30 Sep 2 20:00 2018-09-02_20-00-02 drwxr-xr-x 1 root root 30 Sep 3 22:00 2018-09-03_22-00-01 drwxr-xr-x 1 root root 30 Sep 4 22:00 2018-09-04_22-00-02 drwxr-xr-x 1 root root 30 Sep 5 22:00 2018-09-05_22-00-01 drwxr-xr-x 1 root root 30 Sep 6 20:00 2018-09-06_20-00-01 drwxr-xr-x 1 root root 30 Sep 6 22:00 2018-09-06_22-00-01 Considering the number of snapshots, it's not that many, so it may be another bug. Not sure about mint, but most deb/ubuntu based distributions don't ship the latest kernel, while latest kernel may have a chance to solve it. I'm on linux mint 19, freshly installed on a new laptop about 6 weeks ago. So i wanted to compile latest btrfs-progs and latest stable kernel first before reporting that here, BUT: I cannot compile btrfs-progs 4.17.1 because of the following error: Your configure detects reiserfs support but it seems that your reiserfs progs is not up-to-date. You could disable reiserfs convert support by: $ ./configure --with-convert=ext2 This gives me the following error: [LD] btrfs-convert convert/main.o: In function `convert_open_fs': /home/jh/Documents/src/_external/btrfs-progs/convert/main.c:1066: undefined reference to `reiserfs_convert_ops' /home/jh/Documents/src/_external/btrfs-progs/convert/main.c:1066: undefined reference to `reiserfs_convert_ops' collect2: error: ld returned 1 exit status Makefile:506: recipe for target 'btrfs-convert' failed make: *** [btrfs-convert] Error 1 This is strange, did you clean (make clean) your previous build before re-configure? If it still fails, you could disable convert completely by: $ ./configure --disable-convert Thanks, Qu Sorry, another noob mistake :/ after cleaning the src dir it compile fine. I will report back on the original issue as i now have btrfs progs 4.17.1 compiled and am running 4.18.6 vanilla kernel. If the problem with btrfs send is still there, I guess I should post to a new thread? Best regards, Jürgen Best regards, Jürgen Thanks, Qu [CC] convert/source-reiserfs.o In file included from convert/source-reiserfs.c:30:0: ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such file or directory #include ^ compilation terminated. Makefile:309: recipe for target 'convert/source-reiserfs.o' failed make: *** [convert/source-reiserfs.o] Error 1 A google search did not turn up any help nor does apt know of any reiserfs related libs that i could install. Best regards, Jürgen -- Jürgen Herrmann https://t-5.eu ALbertstraße 2 94327 Bogen
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
On Fri, Sep 07, 2018 at 12:51:54PM +0200, Jürgen Herrmann wrote: > Am 7.9.2018 12:38, schrieb David Sterba: > > On Fri, Sep 07, 2018 at 11:56:18AM +0200, Jürgen Herrmann wrote: > >> I'm on linux mint 19, freshly installed on a new laptop about 6 weeks > >> ago. So i wanted to compile latest btrfs-progs and latest stable > >> kernel > >> first before reporting that here, BUT: I cannot compile btrfs-progs > >> 4.17.1 > >> because of the following error: > >> > >> [CC] convert/source-reiserfs.o > >> In file included from convert/source-reiserfs.c:30:0: > >> ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No > >> such > >> file or directory > >> #include > >>^ > >> compilation terminated. > >> Makefile:309: recipe for target 'convert/source-reiserfs.o' failed > >> make: *** [convert/source-reiserfs.o] Error 1 > >> > >> A google search did not turn up any help nor does apt know of any > >> reiserfs related libs that i could install. > > > > The build dependencies are in the file INSTALL. > > I admit that this was a noob mistake to not read that file :) I partly blame the generic INSTALL file that's in GNU projects that is useless and everybody now ignores it. > There's no libreiserfscore on linux mint 19 though. The distributions choose different names or packaging the libraries separately from the base reiserfs package. > Here's what apt finds for "reiser" > > p libguestfs-reiserfs - guest disk > image management system - ReiserFS support > p libguestfs-reiserfs:i386- guest disk > image management system - ReiserFS support > i libreiser4-dev - Reiser4's > filesystem access and manipulation library. Devel fi > p libreiser4-dev:i386 - Reiser4's > filesystem access and manipulation library. Devel fi > p reiser4progs- administration > utilities for the Reiser4 filesystem > p reiser4progs:i386 - administration > utilities for the Reiser4 filesystem > i reiserfsprogs - User-level > tools for ReiserFS filesystems > p reiserfsprogs:i386 - User-level > tools for ReiserFS filesystems > > As you can see, libreiser4-dev is installed. libbreiser4-dev is a different package and not the one expected for build. You need the development package for the v3 of reisers, which should be derived from 'reiserfsprogs'.
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
On 2018/9/7 下午6:45, Jürgen Herrmann wrote: > Am 7.9.2018 12:15, schrieb Qu Wenruo: >> On 2018/9/7 下午5:56, Jürgen Herrmann wrote: >>> Hello! >>> >>> I'm having a problem with btrfs send which stops after several seconds. >>> The process hangs with 100% cpu time on one cpu. The system is still >>> responsive to input but no io is happening anymore so the system >>> basically becomes unuseable. >> >> Do you have a lot of snapshots or reflinked files (common for offline >> dedupe)? >> >> If so, send can spend a lot of time trying to iterate all referencers. > > Linux Mint 19 uses timeshift-btrfs which i find very handy. here's > a list of snapshot directories, each containing two subvolumes for > @ and @home: > > drwxr-xr-x 1 root root 30 Aug 16 20:00 2018-08-16_20-00-01 > drwxr-xr-x 1 root root 30 Aug 17 14:00 2018-08-17_14-00-02 > drwxr-xr-x 1 root root 30 Aug 23 20:00 2018-08-23_20-00-01 > drwxr-xr-x 1 root root 30 Aug 30 20:00 2018-08-30_20-00-01 > drwxr-xr-x 1 root root 30 Aug 31 17:00 2018-08-31_17-00-01 > drwxr-xr-x 1 root root 30 Sep 1 20:00 2018-09-01_20-00-02 > drwxr-xr-x 1 root root 30 Sep 2 20:00 2018-09-02_20-00-02 > drwxr-xr-x 1 root root 30 Sep 3 22:00 2018-09-03_22-00-01 > drwxr-xr-x 1 root root 30 Sep 4 22:00 2018-09-04_22-00-02 > drwxr-xr-x 1 root root 30 Sep 5 22:00 2018-09-05_22-00-01 > drwxr-xr-x 1 root root 30 Sep 6 20:00 2018-09-06_20-00-01 > drwxr-xr-x 1 root root 30 Sep 6 22:00 2018-09-06_22-00-01 Considering the number of snapshots, it's not that many, so it may be another bug. Not sure about mint, but most deb/ubuntu based distributions don't ship the latest kernel, while latest kernel may have a chance to solve it. > >> >>> >>> I'm on linux mint 19, freshly installed on a new laptop about 6 weeks >>> ago. So i wanted to compile latest btrfs-progs and latest stable kernel >>> first before reporting that here, BUT: I cannot compile btrfs-progs >>> 4.17.1 >>> because of the following error: >> >> Your configure detects reiserfs support but it seems that your reiserfs >> progs is not up-to-date. >> >> You could disable reiserfs convert support by: >> >> $ ./configure --with-convert=ext2 > > This gives me the following error: > > [LD] btrfs-convert > convert/main.o: In function `convert_open_fs': > /home/jh/Documents/src/_external/btrfs-progs/convert/main.c:1066: > undefined reference to `reiserfs_convert_ops' > /home/jh/Documents/src/_external/btrfs-progs/convert/main.c:1066: > undefined reference to `reiserfs_convert_ops' > collect2: error: ld returned 1 exit status > Makefile:506: recipe for target 'btrfs-convert' failed > make: *** [btrfs-convert] Error 1 This is strange, did you clean (make clean) your previous build before re-configure? If it still fails, you could disable convert completely by: $ ./configure --disable-convert Thanks, Qu > > Best regards, Jürgen > >> >> Thanks, >> Qu >> >>> >>> [CC] convert/source-reiserfs.o >>> In file included from convert/source-reiserfs.c:30:0: >>> ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such >>> file or directory >>> #include >>> ^ >>> compilation terminated. >>> Makefile:309: recipe for target 'convert/source-reiserfs.o' failed >>> make: *** [convert/source-reiserfs.o] Error 1 >>> >>> A google search did not turn up any help nor does apt know of any >>> reiserfs related libs that i could install. >>> >>> Best regards, >>> Jürgen >>> > signature.asc Description: OpenPGP digital signature
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
Am 7.9.2018 12:15, schrieb Qu Wenruo: On 2018/9/7 下午5:56, Jürgen Herrmann wrote: Hello! I'm having a problem with btrfs send which stops after several seconds. The process hangs with 100% cpu time on one cpu. The system is still responsive to input but no io is happening anymore so the system basically becomes unuseable. Do you have a lot of snapshots or reflinked files (common for offline dedupe)? If so, send can spend a lot of time trying to iterate all referencers. I'd like to point out that the first few sends were either interrupted by me or did succeed without problems (one full send/receive was actually successful). I'm in the process of scripting the whole thing... then this error turned up. the hang does not go away after waiting for more than one hour. The laptop is not slow by any means, it's a core i5 with a 1TB samsung 860 m.2 ssd and 16GB of RAM. Best regards, Jürgen I'm on linux mint 19, freshly installed on a new laptop about 6 weeks ago. So i wanted to compile latest btrfs-progs and latest stable kernel first before reporting that here, BUT: I cannot compile btrfs-progs 4.17.1 because of the following error: Your configure detects reiserfs support but it seems that your reiserfs progs is not up-to-date. You could disable reiserfs convert support by: $ ./configure --with-convert=ext2 Thanks, Qu [CC] convert/source-reiserfs.o In file included from convert/source-reiserfs.c:30:0: ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such file or directory #include ^ compilation terminated. Makefile:309: recipe for target 'convert/source-reiserfs.o' failed make: *** [convert/source-reiserfs.o] Error 1 A google search did not turn up any help nor does apt know of any reiserfs related libs that i could install. Best regards, Jürgen -- Jürgen Herrmann https://t-5.eu ALbertstraße 2 94327 Bogen
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
Am 7.9.2018 12:38, schrieb David Sterba: On Fri, Sep 07, 2018 at 11:56:18AM +0200, Jürgen Herrmann wrote: I'm on linux mint 19, freshly installed on a new laptop about 6 weeks ago. So i wanted to compile latest btrfs-progs and latest stable kernel first before reporting that here, BUT: I cannot compile btrfs-progs 4.17.1 because of the following error: [CC] convert/source-reiserfs.o In file included from convert/source-reiserfs.c:30:0: ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such file or directory #include ^ compilation terminated. Makefile:309: recipe for target 'convert/source-reiserfs.o' failed make: *** [convert/source-reiserfs.o] Error 1 A google search did not turn up any help nor does apt know of any reiserfs related libs that i could install. The build dependencies are in the file INSTALL. I admit that this was a noob mistake to not read that file :) There's no libreiserfscore on linux mint 19 though. Here's what apt finds for "reiser" p libguestfs-reiserfs - guest disk image management system - ReiserFS support p libguestfs-reiserfs:i386- guest disk image management system - ReiserFS support i libreiser4-dev - Reiser4's filesystem access and manipulation library. Devel fi p libreiser4-dev:i386 - Reiser4's filesystem access and manipulation library. Devel fi p reiser4progs- administration utilities for the Reiser4 filesystem p reiser4progs:i386 - administration utilities for the Reiser4 filesystem i reiserfsprogs - User-level tools for ReiserFS filesystems p reiserfsprogs:i386 - User-level tools for ReiserFS filesystems As you can see, libreiser4-dev is installed. Best regards, Jürgen -- Jürgen Herrmann https://t-5.eu ALbertstraße 2 94327 Bogen
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
Am 7.9.2018 12:15, schrieb Qu Wenruo: On 2018/9/7 下午5:56, Jürgen Herrmann wrote: Hello! I'm having a problem with btrfs send which stops after several seconds. The process hangs with 100% cpu time on one cpu. The system is still responsive to input but no io is happening anymore so the system basically becomes unuseable. Do you have a lot of snapshots or reflinked files (common for offline dedupe)? If so, send can spend a lot of time trying to iterate all referencers. Linux Mint 19 uses timeshift-btrfs which i find very handy. here's a list of snapshot directories, each containing two subvolumes for @ and @home: drwxr-xr-x 1 root root 30 Aug 16 20:00 2018-08-16_20-00-01 drwxr-xr-x 1 root root 30 Aug 17 14:00 2018-08-17_14-00-02 drwxr-xr-x 1 root root 30 Aug 23 20:00 2018-08-23_20-00-01 drwxr-xr-x 1 root root 30 Aug 30 20:00 2018-08-30_20-00-01 drwxr-xr-x 1 root root 30 Aug 31 17:00 2018-08-31_17-00-01 drwxr-xr-x 1 root root 30 Sep 1 20:00 2018-09-01_20-00-02 drwxr-xr-x 1 root root 30 Sep 2 20:00 2018-09-02_20-00-02 drwxr-xr-x 1 root root 30 Sep 3 22:00 2018-09-03_22-00-01 drwxr-xr-x 1 root root 30 Sep 4 22:00 2018-09-04_22-00-02 drwxr-xr-x 1 root root 30 Sep 5 22:00 2018-09-05_22-00-01 drwxr-xr-x 1 root root 30 Sep 6 20:00 2018-09-06_20-00-01 drwxr-xr-x 1 root root 30 Sep 6 22:00 2018-09-06_22-00-01 I'm on linux mint 19, freshly installed on a new laptop about 6 weeks ago. So i wanted to compile latest btrfs-progs and latest stable kernel first before reporting that here, BUT: I cannot compile btrfs-progs 4.17.1 because of the following error: Your configure detects reiserfs support but it seems that your reiserfs progs is not up-to-date. You could disable reiserfs convert support by: $ ./configure --with-convert=ext2 This gives me the following error: [LD] btrfs-convert convert/main.o: In function `convert_open_fs': /home/jh/Documents/src/_external/btrfs-progs/convert/main.c:1066: undefined reference to `reiserfs_convert_ops' /home/jh/Documents/src/_external/btrfs-progs/convert/main.c:1066: undefined reference to `reiserfs_convert_ops' collect2: error: ld returned 1 exit status Makefile:506: recipe for target 'btrfs-convert' failed make: *** [btrfs-convert] Error 1 Best regards, Jürgen Thanks, Qu [CC] convert/source-reiserfs.o In file included from convert/source-reiserfs.c:30:0: ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such file or directory #include ^ compilation terminated. Makefile:309: recipe for target 'convert/source-reiserfs.o' failed make: *** [convert/source-reiserfs.o] Error 1 A google search did not turn up any help nor does apt know of any reiserfs related libs that i could install. Best regards, Jürgen -- Jürgen Herrmann https://t-5.eu ALbertstraße 2 94327 Bogen
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
On Fri, Sep 07, 2018 at 11:56:18AM +0200, Jürgen Herrmann wrote: > I'm on linux mint 19, freshly installed on a new laptop about 6 weeks > ago. So i wanted to compile latest btrfs-progs and latest stable kernel > first before reporting that here, BUT: I cannot compile btrfs-progs > 4.17.1 > because of the following error: > > [CC] convert/source-reiserfs.o > In file included from convert/source-reiserfs.c:30:0: > ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such > file or directory > #include >^ > compilation terminated. > Makefile:309: recipe for target 'convert/source-reiserfs.o' failed > make: *** [convert/source-reiserfs.o] Error 1 > > A google search did not turn up any help nor does apt know of any > reiserfs related libs that i could install. The build dependencies are in the file INSTALL.
Re: compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
On 2018/9/7 下午5:56, Jürgen Herrmann wrote: > Hello! > > I'm having a problem with btrfs send which stops after several seconds. > The process hangs with 100% cpu time on one cpu. The system is still > responsive to input but no io is happening anymore so the system > basically becomes unuseable. Do you have a lot of snapshots or reflinked files (common for offline dedupe)? If so, send can spend a lot of time trying to iterate all referencers. > > I'm on linux mint 19, freshly installed on a new laptop about 6 weeks > ago. So i wanted to compile latest btrfs-progs and latest stable kernel > first before reporting that here, BUT: I cannot compile btrfs-progs 4.17.1 > because of the following error: Your configure detects reiserfs support but it seems that your reiserfs progs is not up-to-date. You could disable reiserfs convert support by: $ ./configure --with-convert=ext2 Thanks, Qu > > [CC] convert/source-reiserfs.o > In file included from convert/source-reiserfs.c:30:0: > ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such > file or directory > #include > ^ > compilation terminated. > Makefile:309: recipe for target 'convert/source-reiserfs.o' failed > make: *** [convert/source-reiserfs.o] Error 1 > > A google search did not turn up any help nor does apt know of any > reiserfs related libs that i could install. > > Best regards, > Jürgen > signature.asc Description: OpenPGP digital signature
compiling btrfs-progs 4.17.1 gives error "reiserfs/misc.h: No such file or directory"
Hello! I'm having a problem with btrfs send which stops after several seconds. The process hangs with 100% cpu time on one cpu. The system is still responsive to input but no io is happening anymore so the system basically becomes unuseable. I'm on linux mint 19, freshly installed on a new laptop about 6 weeks ago. So i wanted to compile latest btrfs-progs and latest stable kernel first before reporting that here, BUT: I cannot compile btrfs-progs 4.17.1 because of the following error: [CC] convert/source-reiserfs.o In file included from convert/source-reiserfs.c:30:0: ./convert/source-reiserfs.h:23:10: fatal error: reiserfs/misc.h: No such file or directory #include ^ compilation terminated. Makefile:309: recipe for target 'convert/source-reiserfs.o' failed make: *** [convert/source-reiserfs.o] Error 1 A google search did not turn up any help nor does apt know of any reiserfs related libs that i could install. Best regards, Jürgen -- Jürgen Herrmann https://t-5.eu ALbertstraße 2 94327 Bogen
