Re: [BackupPC-users] Real Time View of What Is Being Copied

2022-03-04 Thread Les Mikesell
On Fri, Mar 4, 2022 at 2:39 PM Kenneth Porter  wrote:
>
> rsync over the network should use compression. If you're doing it inside
> ssh, then use ssh's compression, which is more reliable. The run of
> nulls will be compressed down to a count and one null. Their transfer
> will be almost instantaneous.
>
Yes, but it still goes through the motions of 'reading' what could
potentially be many TB of data even from a small file with the
filesystem delivering all those nulls.  It has been a long time since
I had that problem but it did in fact cause trouble at least with the
rsync back then and slower CPUs.   It could be that rsync tried to
write them all at the other end too.

-- 
   Les Mikesell
 lesmikes...@gmail.com


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] Real Time View of What Is Being Copied

2022-03-04 Thread Kenneth Porter

On 3/4/2022 7:21 AM, Les Mikesell wrote:

Unix/Linux has something calle 'sparse' files used by some types of
databases where you can seek far into a file and write without
using/allocating any space up to that point.  The file as stored may
not be large but most tools to copy it will act as though the empty
parts were filled with nulls. Rsync might handle them these days but
may still take the time to send the stream of nulls.  But in any case
they are rarely used on Windows.


rsync over the network should use compression. If you're doing it inside 
ssh, then use ssh's compression, which is more reliable. The run of 
nulls will be compressed down to a count and one null. Their transfer 
will be almost instantaneous.





___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] Real Time View of What Is Being Copied

2022-03-04 Thread Les Mikesell
On Fri, Mar 4, 2022 at 7:16 AM G.W. Haywood via BackupPC-users
 wrote:
>
> Another possibility (and the only time I've ever seen this happen) is
> that there might be a large file which is causing a timeout.  It was
> on a Linux box here, something went off the reservation and started
> writing gigabytes of messages to a file called '.xsession-errors'.

Unix/Linux has something calle 'sparse' files used by some types of
databases where you can seek far into a file and write without
using/allocating any space up to that point.  The file as stored may
not be large but most tools to copy it will act as though the empty
parts were filled with nulls. Rsync might handle them these days but
may still take the time to send the stream of nulls.  But in any case
they are rarely used on Windows.

-- 
   Les Mikesell
 lesmikes...@gmail.com


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] rsync ACL Support

2022-03-04 Thread ralph strebbing
On Thu, Mar 3, 2022 at 11:03 AM ralph strebbing
 wrote:
> I'm attempting an upgrade to 4 now.
So the upgrade to 4 works. Is there any reason that the Ubuntu/Debian
repos aren't using the latest?


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/


Re: [BackupPC-users] Real Time View of What Is Being Copied

2022-03-04 Thread G.W. Haywood via BackupPC-users

Hi there,

On Fri, 4 Mar 2022, Les Mikesell wrote:

On Mon, Feb 28, 2022 at 3:34 PM Akibu Flash wrote:
>
> I backup a couple of Windows machines to a linux machine via rsync.
> However, the backup for one of the Windows machines never finishes
> and results in a partial backup.  In the CGI user interface Count
> column, the backup always seems to hang at 311941 for hours ...
> 
> Is there a way to start a backup from the command line and have the

> screen show what in real time is actually being backed up?

Not exactly what you are asking for, but since the problem target is
windows you are probably hitting a file that windows has locked, and
the solution might be to use windows VSS snapshots.


Another possibility (and the only time I've ever seen this happen) is
that there might be a large file which is causing a timeout.  It was
on a Linux box here, something went off the reservation and started
writing gigabytes of messages to a file called '.xsession-errors'.

On Linux, by default, filenames beginning with a dot aren't displayed
by the command 'ls -l' so it took longer to spot than it should have. :/

--

73,
Ged.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/