Hi Akibu

One of two ways.
1.  On the Win10 machine: set up a new shares with paths describing parts of the drive e.g. d:\Documents and d:\not_Documents rather than just d:\    And on backuppc create new hosts with the new share names under 'RsyncShareName'. 2.  Or leave the Win10 share the same.  In backuppc duplicate the relevant host (and give it a different but similar name).  Edit one host Xfer settings so 'BackupFilesOnly' refers to /Documents and in the other host 'BackupFilesExclude' also refers to /Documents.

If you suspect one folder on the Windows machine is where it always stalls (using the Resource Monitor approach I described) - try excluding that folder and seeing if it runs to completion. Narrow the exclusion until you have worked out what's stopping it.  Mine consistent stopped in one folder - I still don't know why.  They were just tiff files and opened fine on the native machine so I don't think there was corruption.

George

On 03/03/2022 16:52, Akibu Flash wrote:

Thanks George for responding.

With respect to your reference to: “split the host into two”, how does one actually do that?  My host references a certain computer consisting of various drives to be backed up.  How does one split that host into two separate hosts and (presumably) back up each of those hosts?  Thanks.

Akibu

*From:* George King <geo...@kings-windsor.net>
*Sent:* Thursday, March 3, 2022 10:44 AM
*To:* backuppc-users@lists.sourceforge.net
*Subject:* Re: [BackupPC-users] Real Time View of What Is Being Copied

No great suggestions for resolution from me but I have some sympathy with you having had similar issues occasionally in the past.

I have a number of rsyncd hosts set up on my main Win10 desktop - basically one for each disk or part of to keep the backups down to a reasonable duration.   I'm running DeltaCopy Server.

When one of my backups 'stalled' after having worked for a while, it would do as you have found and stall at the same place each time.  Other disks/hosts were not affected and completed fine, so it was nothing intrinsically wrong with DeltaCopy or backuppc.  I could monitor the file transfer via the Win10 Task Manager>Performance Tab > Resource Monitor > Disk tab and selecting the right rsync process for the problematic disk.  At least that gave me confidence that the transfer was starting properly and progressing - and I could tell when it properly stuck, and at which folder on the Win10 machine.

I couldn't find any informative messages in the backuppc logs to help me solve it.  When I manually stopped the backups, the partial backups were generally removed or merged and the logs just showed that I had aborted the xfer.

What seems to have helped overcome the problem is, although I fail to understand quite why, are:
- splitting the host into two, and
- copying the files from the folder at which the transfer stalled into another folder, and - I probably checked the Win10 folder permissions were OK and inherited by sub-folders.

George

On 03/03/2022 14:23, Akibu Flash wrote:

    Just bumping this up… any suggestions for a resolution?  Thanks.

    *From:* Akibu Flash <akibufl...@outlook.com>
    <mailto:akibufl...@outlook.com>
    *Sent:* Monday, February 28, 2022 4:32 PM
    *To:* BackupPC-users@lists.sourceforge.net
    *Subject:* [BackupPC-users] Real Time View of What Is Being Copied

    Dear All,

    I backup a couple of Windows machines to a linux machine via
    rsync.  However, the backup for one of the Windows machines never
    finishes and results in a partial backup.  In the CGI user
    interface Count column, the backup always seems to hang at 311941
    for hours and hours.  Then at some point, the backup apparently
    stops and afterwards another backup which by that time has queued
    up starts anew.  Never do I get a completed backup only a partial
    (at least for the last year or so).

    Is there a way to start a backup from the command line and have
    the screen show what in real time is actually being backed up?  If
    so, what would that command be?  It may be that the BackupPC is
    somehow getting stuck on a file but that is only speculation.

    Any other ideas as to what my be happening?

    I decompressed the partial backup log file (backup #884) using the
    command BackupPC_zcat XferLOG.884.z.  I have reproduced the bottom
    portion below.

    Any assistance in helping to track down what is happening is
    appreciated.  I do see in the log that there is an error message
    indicating an “error in the rsync protocol data stream (code 12)
    at io.c(226).

    Thanks in advance.

    Best, Akibu

    G bpc_open(Downloads/Downloads/BackupPC-4.3.2/images/logo.gif,
    0x0, 00) -> 3

    G bpc_read(3 (Downloads/Downloads/BackupPC-4.3.2/images/logo.gif),
    buf, 1394) tmpFd = -1

    G bpc_close(3 (Downloads/Downloads/BackupPC-4.3.2/images/logo.gif))

    G bpc_fileDescFree: fdNum = 3, tmpFd = -1, tmpFileName = NULL

    G bpc_lstat(Downloads/Downloads/BackupPC-4.3.2/images/logo320.png)

    G
    bpc_file_checksum(Downloads/Downloads/BackupPC-4.3.2/images/logo320.png)

    G bpc_open(Downloads/Downloads/BackupPC-4.3.2/images/logo320.png,
    0x0, 00) -> 3

    G bpc_read(3
    (Downloads/Downloads/BackupPC-4.3.2/images/logo320.png), buf,
    7814) tmpFd = -1

    G bpc_close(3 (Downloads/Downloads/BackupPC-4.3.2/images/logo320.png))

    G bpc_fileDescFree: fdNum = 3, tmpFd = -1, tmpFileName = NULL

    rsync_bpc: connection unexpectedly closed (23961310 bytes received
    so far) [receiver]

    R bpc_sysCall_cleanup: doneInit = 1

    Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0
    filesTotal, 0 sizeTotal, 0 filesNew, 0 sizeNew, 0 sizeNewComp,
    24467705 inode

    Parsing done: nFilesTotal = 0

    rsync error: error in rsync protocol data stream (code 12) at
    io.c(226) [receiver=3.1.3.0]

    rsync_bpc: connection unexpectedly closed (24012481 bytes received
    so far) [generator]

    G bpc_sysCall_cleanup: doneInit = 1

    DoneGen: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp,
    311942 filesTotal, 569449707538 sizeTotal, 0 filesNew, 0 sizeNew,
    0 sizeNewComp, 24467704 inode

    Parsing done: nFilesTotal = 311942

    rsync error: error in rsync protocol data stream (code 12) at
    io.c(226) [generator=3.1.3.0]

    rsync_bpc exited with fatal status 12 (3072) (rsync error: error
    in rsync protocol data stream (code 12) at io.c(226)
    [generator=3.1.3.0])

    Xfer PIDs are now

    Got fatal error during xfer (rsync error: error in rsync protocol
    data stream (code 12) at io.c(226) [generator=3.1.3.0])

    Backup aborted (rsync error: error in rsync protocol data stream
    (code 12) at io.c(226) [generator=3.1.3.0])

    BackupFailCleanup: nFilesTotal = 311942, type = full, BackupCase =
    4, inPlace = 0, lastBkupNum = 883

    Removing prior partial backup #883

    Xfer PIDs are now 38440

    BackupPC_backupDelete: removing #883

    BackupPC_backupDelete: Merge into backup 327

    mergeDir: name = attrib, path = .

    bpc_attrib_backwardCompat: WriteOldStyleAttribFile = 0,
    KeepOldAttribFiles = 0

    mergeDir: skipping name = refCnt, path = ./refCnt

    mergeDir: skipping name = needFsck.newDir, path =
    ./refCnt/needFsck.newDir

    mergeDir: skipping name = noPoolCntOk, path = ./refCnt/noPoolCntOk

    mergeDir: skipping name = backupInfo, path = ./backupInfo

    removing remaining directory tree
    /var/lib/backuppc/pc/mark-desktop/883

    Xfer PIDs are now 38441,38440

    BackupPC_refCountUpdate: host mark-desktop #321: gotFsck = ,
    gotDelta = , gotPoolCnt = 1, gotNoPoolCntOk =

    BackupPC_refCountUpdate: host mark-desktop #327: gotFsck = 1,
    gotDelta = , gotPoolCnt = 1, gotNoPoolCntOk =

    BackupPC_refCountUpdate: host mark-desktop #884: gotFsck = 1,
    gotDelta = , gotPoolCnt = 1, gotNoPoolCntOk =

    BackupPC_refCountUpdate: processing host mark-desktop #327 (fsck = 1)

    BackupPC_refCountUpdate: processing host mark-desktop #327
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/327/refCnt/poolCntDelta_1_0_0_38441
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #327
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/327/refCnt/poolCntDelta_1_0_1_38441
    with 638055 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884 (fsck = 1)

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_2_38441
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_3_38441
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_4_38441
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_5_38441
    with 409030 entries

    BackupPC_refCountUpdate: computing totals for host mark-desktop

    BackupPC_refCountUpdate: host mark-desktop got 0 errors (took 909
    secs)

    BackupPC_refCountUpdate total errors: 0

    Xfer PIDs are now 38440

    BackupPC_backupDelete: got 0 errors

    Xfer PIDs are now

    Finished BackupPC_backupDelete, status = 0 (running time: 910 sec)

    Xfer PIDs are now

    Running BackupPC_refCountUpdate -h mark-desktop -f on mark-desktop

    Xfer PIDs are now 38457

    BackupPC_refCountUpdate: host mark-desktop #321: gotFsck = ,
    gotDelta = , gotPoolCnt = 1, gotNoPoolCntOk =

    BackupPC_refCountUpdate: host mark-desktop #327: gotFsck = ,
    gotDelta = , gotPoolCnt = 1, gotNoPoolCntOk =

    BackupPC_refCountUpdate: host mark-desktop #884: gotFsck = ,
    gotDelta = , gotPoolCnt = 1, gotNoPoolCntOk =

    BackupPC_refCountUpdate: processing host mark-desktop #327 (fsck = 1)

    BackupPC_refCountUpdate: processing host mark-desktop #327
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/327/refCnt/poolCntDelta_1_0_0_38457
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #327
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/327/refCnt/poolCntDelta_1_0_1_38457
    with 638055 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884 (fsck = 1)

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_2_38457
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_3_38457
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_4_38457
    with 1048577 entries

    BackupPC_refCountUpdate: processing host mark-desktop #884
    deltaFile
    /var/lib/backuppc/pc/mark-desktop/884/refCnt/poolCntDelta_1_0_5_38457
    with 409030 entries

    BackupPC_refCountUpdate: computing totals for host mark-desktop

    BackupPC_refCountUpdate: host mark-desktop got 0 errors (took 595
    secs)

    BackupPC_refCountUpdate total errors: 0

    Xfer PIDs are now

    Finished BackupPC_refCountUpdate (running time: 596 sec)

    Xfer PIDs are now

    [backuppc@fuegoberlin mark-desktop]$




    _______________________________________________

    BackupPC-users mailing list

    BackupPC-users@lists.sourceforge.net

    List:https://lists.sourceforge.net/lists/listinfo/backuppc-users

    Wiki:https://github.com/backuppc/backuppc/wiki

    Project:https://backuppc.github.io/backuppc/



_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project:https://backuppc.github.io/backuppc/
_______________________________________________
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:    https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Reply via email to