Ok, so that's the issue - your version of perl on arm only uses 32 bit IVs. I'm surprised it is built that way - does anyone know if that is default for perl on arm generally?
That means the file size (and mtime) are limited to 2^32. Fortunately rsync-bpc doesn't suffer from this, so your backups of large files are fine. However, viewing their metadata in the CGI interface, or using BackupPC_tarCreate, BackupPC_ls or BackupPC_attribPrint will not show the right file size. Let me think about how to do a workaround in the perl BackupPC::XS module. Craig On Tue, Oct 13, 2020 at 3:02 AM David Walton <dks...@gmail.com> wrote: > I am using this gussietorres/backuppc:armhf-v2019102601 docker container > from here https://hub.docker.com/r/gussietorres/backuppc/tags which I > believe is based on this container > https://hub.docker.com/r/adferrand/backuppc > > This is running on omv version 4.1.36-1, kernel version 4.14.150-odroidxu4 > > BackupPC version 4.3.1 > BackupPC::XS VERSION = '0.59' > > perl -V returns: > perl5 (revision 5 version 28 subversion 2) > uname='linux build-3-10-armv7 4.14.78-1-vanilla #2-alpine smp fri oct 26 > 20:28:28 utc 2018 armv8l linux ' > ivtype='long' > ivsize=4 > > os is Alpine Linux v3.10.1 > > On Tue, 13 Oct 2020 at 10:07, Craig Barratt via BackupPC-users < > backuppc-users@lists.sourceforge.net> wrote: > >> This might be because BackupPC::XS (which is used by BackupPC_attribPrint >> and BackupPC_tarCreate, but not rsync_bpc) is using a 4 byte int instead of >> an 8 byte long. >> >> What's the value of ivtype and ivsize in the output of perl -V? What's >> the perl version, os, and BackupPC::XS version? >> >> Craig >> >> On Mon, Oct 12, 2020 at 1:44 PM David Walton <dks...@gmail.com> wrote: >> >>> BackupPC_attribPrint returns for basemap.vg >>> 'basemap.vg' => { >>> 'compress' => 3, >>> 'digest' => '8f1cc9a413ed1ed97f5772df02e6515f', >>> 'gid' => 100, >>> 'inode' => 307011, >>> 'mode' => 436, >>> 'mtime' => 1387843913, >>> 'name' => 'basemap.vg', >>> 'nlinks' => 0, >>> 'size' => 0, >>> 'type' => 0, >>> 'uid' => 0 >>> } >>> >>> XferMethod is rsync. >>> >>> I can't find basemap.vg in the XferLOG files. All the XferLOG files are >>> small, even for the full backups. >>> >>> The RestoreLOG for a restore initiated by the web interface contains the >>> following line: >>> send <f+++++++++ rw-rw-r-- 0, 100 4294967296 GIS/Garmin/ >>> basemap.vg >>> >>> >>> On Tue, 13 Oct 2020 at 02:13, Craig Barratt via BackupPC-users < >>> backuppc-users@lists.sourceforge.net> wrote: >>> >>>> BackupPC_tarCreate can restore large files. >>>> >>>> The error you are seeing happens when the metadata file size (stored in >>>> the directory's attrib file) doesn't match the uncompressed file size. It >>>> appears in this case, for some reason, the attribute file in that directory >>>> says the file size for basemap.vg is 0. >>>> >>>> What's the output from (trying to guess the correct path from your >>>> email): >>>> >>>> BackupPC_attribPrint /data/backuppc >>>> /pc/fsdata.local/262/f%2fsrv%2fdev-disk-by-label-datadrive%2fdat/fGIS/fGarmin/attrib >>>> >>>> Look for the entry for basemap.vg. >>>> >>>> What XferMethod are you using for fsdata.local? Look in a full backup >>>> XferLOG file and see what it says for basemap.vg. >>>> >>>> >>>> Craig >>>> >>>> On Mon, Oct 12, 2020 at 2:59 AM David Walton <dks...@gmail.com> wrote: >>>> >>>>> I just restored a backup using the web interface and that worked well. >>>>> I would still like to know if there is a command line restore option that >>>>> will work with backups that contain large files. >>>>> The files that BackupPC_tarCreate restores are ok, it just skipped >>>>> large files. >>>>> >>>>> On Sat, 10 Oct 2020 at 07:49, David Walton <dks...@gmail.com> wrote: >>>>> >>>>>> I tried doing a backup restore using BackupPC_tarCreate piped over >>>>>> ssh. This failed for all large files. >>>>>> >>>>>> Running >>>>>> /usr/local/BackupPC/bin/BackupPC_tarCreate -h fsdata.local -n 262 -s >>>>>> /srv/dev-disk-by-label-datadrive/data / | ssh david@htpc1.local "(cd >>>>>> /media/david/omv071020/bpc262/; tar -xpf -)" >>>>>> >>>>>> Resulted in error messages for all large files like the following: >>>>>> Error: truncating >>>>>> /data/backuppc/cpool/8e/1c/8f1cc9a413ed1ed97f5772df02e6515f to 0 bytes >>>>>> (for >>>>>> ./GIS/Garmin/basemap.vg) >>>>>> >>>>>> Using the web interface, I can download these large files >>>>>> individually, so they have been stored ok. >>>>>> >>>>>> I am currently using BackupPC version 4.3.1 >>>>>> >>>>>> Is there a way around this? >>>>>> >>>>>> What is the best way to restore backups that contain large files? >>>>>> >>>>>> >>>>>> -- >>>>>> David Walton >>>>>> >>>>> >>>>> >>>>> -- >>>>> David Walton >>>>> _______________________________________________ >>>>> BackupPC-users mailing list >>>>> BackupPC-users@lists.sourceforge.net >>>>> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >>>>> Wiki: https://github.com/backuppc/backuppc/wiki >>>>> Project: https://backuppc.github.io/backuppc/ >>>>> >>>> _______________________________________________ >>>> BackupPC-users mailing list >>>> BackupPC-users@lists.sourceforge.net >>>> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >>>> Wiki: https://github.com/backuppc/backuppc/wiki >>>> Project: https://backuppc.github.io/backuppc/ >>>> >>> >>> >>> -- >>> David Walton >>> _______________________________________________ >>> BackupPC-users mailing list >>> BackupPC-users@lists.sourceforge.net >>> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >>> Wiki: https://github.com/backuppc/backuppc/wiki >>> Project: https://backuppc.github.io/backuppc/ >>> >> _______________________________________________ >> BackupPC-users mailing list >> BackupPC-users@lists.sourceforge.net >> List: https://lists.sourceforge.net/lists/listinfo/backuppc-users >> Wiki: https://github.com/backuppc/backuppc/wiki >> Project: https://backuppc.github.io/backuppc/ >> > > > -- > David Walton > _______________________________________________ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List: https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki: https://github.com/backuppc/backuppc/wiki > Project: https://backuppc.github.io/backuppc/ >
_______________________________________________ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List: https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki: https://github.com/backuppc/backuppc/wiki Project: https://backuppc.github.io/backuppc/