Ok, so that's the issue - your version of perl on arm only uses 32 bit IVs.
I'm surprised it is built that way - does anyone know if that is default
for perl on arm generally?

That means the file size (and mtime) are limited to 2^32.  Fortunately
rsync-bpc doesn't suffer from this, so your backups of large files are
fine.  However, viewing their metadata in the CGI interface, or using
BackupPC_tarCreate, BackupPC_ls or BackupPC_attribPrint will not show the
right file size.

Let me think about how to do a workaround in the perl BackupPC::XS module.

Craig



On Tue, Oct 13, 2020 at 3:02 AM David Walton <dks...@gmail.com> wrote:

> I am using this gussietorres/backuppc:armhf-v2019102601 docker container
> from here https://hub.docker.com/r/gussietorres/backuppc/tags which I
> believe is based on this container
> https://hub.docker.com/r/adferrand/backuppc
>
> This is running on omv version 4.1.36-1, kernel version 4.14.150-odroidxu4
>
> BackupPC version 4.3.1
> BackupPC::XS VERSION = '0.59'
>
> perl -V returns:
> perl5 (revision 5 version 28 subversion 2)
> uname='linux build-3-10-armv7 4.14.78-1-vanilla #2-alpine smp fri oct 26
> 20:28:28 utc 2018 armv8l linux '
> ivtype='long'
> ivsize=4
>
> os is Alpine Linux v3.10.1
>
> On Tue, 13 Oct 2020 at 10:07, Craig Barratt via BackupPC-users <
> backuppc-users@lists.sourceforge.net> wrote:
>
>> This might be because BackupPC::XS (which is used by BackupPC_attribPrint
>> and BackupPC_tarCreate, but not rsync_bpc) is using a 4 byte int instead of
>> an 8 byte long.
>>
>> What's the value of ivtype and ivsize in the output of perl -V?  What's
>> the perl version, os, and BackupPC::XS version?
>>
>> Craig
>>
>> On Mon, Oct 12, 2020 at 1:44 PM David Walton <dks...@gmail.com> wrote:
>>
>>> BackupPC_attribPrint returns for basemap.vg
>>>   'basemap.vg' => {
>>>     'compress' => 3,
>>>     'digest' => '8f1cc9a413ed1ed97f5772df02e6515f',
>>>     'gid' => 100,
>>>     'inode' => 307011,
>>>     'mode' => 436,
>>>     'mtime' => 1387843913,
>>>     'name' => 'basemap.vg',
>>>     'nlinks' => 0,
>>>     'size' => 0,
>>>     'type' => 0,
>>>     'uid' => 0
>>>   }
>>>
>>> XferMethod is rsync.
>>>
>>> I can't find basemap.vg in the XferLOG files. All the XferLOG files are
>>> small, even for the full backups.
>>>
>>> The RestoreLOG for a restore initiated by the web interface contains the
>>> following line:
>>> send <f+++++++++ rw-rw-r--        0,     100 4294967296 GIS/Garmin/
>>> basemap.vg
>>>
>>>
>>> On Tue, 13 Oct 2020 at 02:13, Craig Barratt via BackupPC-users <
>>> backuppc-users@lists.sourceforge.net> wrote:
>>>
>>>> BackupPC_tarCreate can restore large files.
>>>>
>>>> The error you are seeing happens when the metadata file size (stored in
>>>> the directory's attrib file) doesn't match the uncompressed file size.  It
>>>> appears in this case, for some reason, the attribute file in that directory
>>>> says the file size for basemap.vg is 0.
>>>>
>>>> What's the output from (trying to guess the correct path from your
>>>> email):
>>>>
>>>> BackupPC_attribPrint /data/backuppc
>>>> /pc/fsdata.local/262/f%2fsrv%2fdev-disk-by-label-datadrive%2fdat/fGIS/fGarmin/attrib
>>>>
>>>> Look for the entry for basemap.vg.
>>>>
>>>> What XferMethod are you using for fsdata.local?  Look in a full backup
>>>> XferLOG file and see what it says for basemap.vg.
>>>>
>>>>
>>>> Craig
>>>>
>>>> On Mon, Oct 12, 2020 at 2:59 AM David Walton <dks...@gmail.com> wrote:
>>>>
>>>>> I just restored a backup using the web interface and that worked well.
>>>>> I would still like to know if there is a command line restore option that
>>>>> will work with backups that contain large files.
>>>>> The files that BackupPC_tarCreate restores are ok, it just skipped
>>>>> large files.
>>>>>
>>>>> On Sat, 10 Oct 2020 at 07:49, David Walton <dks...@gmail.com> wrote:
>>>>>
>>>>>> I tried doing a backup restore using BackupPC_tarCreate piped over
>>>>>> ssh. This failed for all large files.
>>>>>>
>>>>>> Running
>>>>>> /usr/local/BackupPC/bin/BackupPC_tarCreate -h fsdata.local -n 262 -s
>>>>>> /srv/dev-disk-by-label-datadrive/data / | ssh david@htpc1.local "(cd
>>>>>> /media/david/omv071020/bpc262/; tar -xpf -)"
>>>>>>
>>>>>> Resulted in error messages for all large files like the following:
>>>>>> Error: truncating
>>>>>> /data/backuppc/cpool/8e/1c/8f1cc9a413ed1ed97f5772df02e6515f to 0 bytes 
>>>>>> (for
>>>>>> ./GIS/Garmin/basemap.vg)
>>>>>>
>>>>>> Using the web interface, I can download these large files
>>>>>> individually, so they have been stored ok.
>>>>>>
>>>>>> I am currently using BackupPC version 4.3.1
>>>>>>
>>>>>> Is there a way around this?
>>>>>>
>>>>>> What is the best way to restore backups that contain large files?
>>>>>>
>>>>>>
>>>>>> --
>>>>>> David Walton
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> David Walton
>>>>> _______________________________________________
>>>>> BackupPC-users mailing list
>>>>> BackupPC-users@lists.sourceforge.net
>>>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>>>> Wiki:    https://github.com/backuppc/backuppc/wiki
>>>>> Project: https://backuppc.github.io/backuppc/
>>>>>
>>>> _______________________________________________
>>>> BackupPC-users mailing list
>>>> BackupPC-users@lists.sourceforge.net
>>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>>> Wiki:    https://github.com/backuppc/backuppc/wiki
>>>> Project: https://backuppc.github.io/backuppc/
>>>>
>>>
>>>
>>> --
>>> David Walton
>>> _______________________________________________
>>> BackupPC-users mailing list
>>> BackupPC-users@lists.sourceforge.net
>>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>>> Wiki:    https://github.com/backuppc/backuppc/wiki
>>> Project: https://backuppc.github.io/backuppc/
>>>
>> _______________________________________________
>> BackupPC-users mailing list
>> BackupPC-users@lists.sourceforge.net
>> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
>> Wiki:    https://github.com/backuppc/backuppc/wiki
>> Project: https://backuppc.github.io/backuppc/
>>
>
>
> --
> David Walton
> _______________________________________________
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:    https://github.com/backuppc/backuppc/wiki
> Project: https://backuppc.github.io/backuppc/
>
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Reply via email to