Re: [BackupPC-users] Backup Running Forever

2016-11-02 Thread Holger Parplies 
Hi,

Christian V?lker wrote on 2016-11-02 19:04:58 +0100 [Re: [BackupPC-users] 
Backup Running Forever]:
> [...]
> > If you tail the transfer log:
> > /usr/share/backuppc/bin/BackupPC_zcat ~backuppc/pc//XferLOG.z|tail
> > what file does it stop on, and does it always stop there?
> I will restart an see if it stops on the same file. Up to now the
> command shows me:
> same 644   0/0 8618994 usr/share/cracklib/pw_dict.pwd
>   same 644   0/0  458640 usr/share/cracklib/pw_dict.pwi
>   create d 755   0/04096 usr/share/davical
>   create d 755   0/04096 usr/share/davical/dba
>   same 644   0/01635 
> usr/share/davical/dba/appuser_permissions.txt
>   same 644   0/02

as you can see, output to the XferLOG is buffered (and compressed), so the
file it is hanging on can be anything between the next file (after the one
whose name you can't see) to some thousands of files later. If you could get
the BackupPC_dump process to terminate and flush the buffer, that might help
you, but I don't think you can ...

My quick guess is attrib file corruption, apparently causing a
misunderstanding between Xfer::Rsync and rsync on the client, where each end
is expecting protocol data from the other. The most non-invasive thing to try
would seem to be setting

$Conf {PartialAgeMax} = 0;

and seeing if BackupPC really does ignore the partial on the next backup. If
that doesn't help, you might need to delete the partial backup.

Hope that helps.

Regards,
Holger

--
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Backup Running Forever

2016-11-02 Thread Christian Völker 
Hi Carl,


> If you watch the traffic with a tool such as 'iftop' is there still data
> flowing?
No traffic according to tcpdump.

> If you tail the transfer log:
> /usr/share/backuppc/bin/BackupPC_zcat ~backuppc/pc//XferLOG.z|tail
> what file does it stop on, and does it always stop there?
I will restart an see if it stops on the same file. Up to now the
command shows me:
same 644   0/0 8618994 usr/share/cracklib/pw_dict.pwd
  same 644   0/0  458640 usr/share/cracklib/pw_dict.pwi
  create d 755   0/04096 usr/share/davical
  create d 755   0/04096 usr/share/davical/dba
  same 644   0/01635
usr/share/davical/dba/appuser_permissions.txt
  same 644   0/02
> I recently had a case where ntpd was running in a chroot jail, and the jail
> had /proc mounted within it. So the backup was trying to back up the
> client's memory, leading to the situation you describe.
>
Well, no chroot jail on this server. Pretty sure.

Greetingsa

Christian

--
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Backup Running Forever

2016-11-02 Thread Carl Wilhelm Soderstrom 
On 11/02 01:29 , Christian Völker wrote:
> Hi all,
> 
> BackupPC 3.x backing up Linux hosts. Runs fine since years now.
> 
> But currently I have an issue with one of my hosts. The backup starts,
> but runs forever and does never finish. I do not know why this happens.

If you watch the traffic with a tool such as 'iftop' is there still data
flowing?

If you tail the transfer log:
/usr/share/backuppc/bin/BackupPC_zcat ~backuppc/pc//XferLOG.z|tail
what file does it stop on, and does it always stop there?

I recently had a case where ntpd was running in a chroot jail, and the jail
had /proc mounted within it. So the backup was trying to back up the
client's memory, leading to the situation you describe.

-- 
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

--
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Backup Running Forever

2016-11-02 Thread Dan LeVasseur 
I actually have this problem using SMB against windows clients.  2-3 of
them that just at random run forever until I stop them.  The next time,
it'll run fine.


On Wed, Nov 2, 2016 at 10:23 AM, Les Mikesell  wrote:

> On Wed, Nov 2, 2016 at 7:29 AM, Christian Völker 
> wrote:
> > Hi all,
> >
> > BackupPC 3.x backing up Linux hosts. Runs fine since years now.
> >
> > But currently I have an issue with one of my hosts. The backup starts,
> > but runs forever and does never finish. I do not know why this happens.
> > These are the last log entries:
> >
> > 2016-10-24 03:00:07 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> > 2016-10-24 03:00:09 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> > 2016-10-24 03:00:09 incr backup started back to 2016-10-18 02:00:05
> (backup #2418) for directory /
> > 2016-10-24 03:14:59 incr backup started back to 2016-10-18 02:00:05
> (backup #2418) for directory /boot
> > 2016-10-24 03:15:00 incr backup 2424 complete, 5450 files, 2233152544
> bytes, 0 xferErrs (0 bad files, 0 bad shares, 0 other)
> > 2016-10-24 03:15:00 removing incr backup 2417
> > 2016-10-25 03:00:05 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> > 2016-10-25 03:00:07 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> > 2016-10-25 03:00:07 full backup started for directory / (baseline backup
> #2424)
> > 2016-10-25 04:41:33 Got fatal error during xfer (Child exited
> prematurely)
> > 2016-10-25 04:41:39 Backup aborted (Child exited prematurely)
> > 2016-10-25 04:41:39 Saved partial dump 2425
> > [...]
> > Here it got an error during full backup. Since then none of the
> following backups completed:
> >
> > 2016-10-25 04:42:00 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> > 2016-10-25 04:42:03 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> > 2016-10-25 04:42:03 full backup started for directory /; updating
> partial #2425
> > 2016-10-28 04:26:37 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> > 2016-10-28 04:26:39 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> > 2016-10-28 04:26:39 full backup started for directory /; updating
> partial #2425
> > [...]
> >
> > This goes on like this. Backups never complete nor do I see any error
> messages.
> >
> > I did an lsof | grep rsync on the target host, but it does not show any
> open files (except libs from rsync). Same on backuppc (except logfiles).
> >
> > What is going on here and how can I recover so I will get proper future
> backups?
> >
>
> It looks like the backuppc side thinks the remote side disconnected.
> If rsync is actually still running on the client it is probably some
> sort of network issue like a nat gateway or stateful firewall timing
> out.   If rsync did exit it could be out of memory or a filesystem or
> disk error.
>
> --
>Les Mikesell
>  lesmikes...@gmail.com
>
> 
> --
> Developer Access Program for Intel Xeon Phi Processors
> Access to Intel Xeon Phi processor-based developer platforms.
> With one year of Intel Parallel Studio XE.
> Training and support from Colfax.
> Order your platform today. http://sdm.link/xeonphi
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Backup Running Forever

2016-11-02 Thread Les Mikesell 
On Wed, Nov 2, 2016 at 7:29 AM, Christian Völker  wrote:
> Hi all,
>
> BackupPC 3.x backing up Linux hosts. Runs fine since years now.
>
> But currently I have an issue with one of my hosts. The backup starts,
> but runs forever and does never finish. I do not know why this happens.
> These are the last log entries:
>
> 2016-10-24 03:00:07 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> 2016-10-24 03:00:09 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> 2016-10-24 03:00:09 incr backup started back to 2016-10-18 02:00:05 (backup 
> #2418) for directory /
> 2016-10-24 03:14:59 incr backup started back to 2016-10-18 02:00:05 (backup 
> #2418) for directory /boot
> 2016-10-24 03:15:00 incr backup 2424 complete, 5450 files, 2233152544 bytes, 
> 0 xferErrs (0 bad files, 0 bad shares, 0 other)
> 2016-10-24 03:15:00 removing incr backup 2417
> 2016-10-25 03:00:05 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> 2016-10-25 03:00:07 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> 2016-10-25 03:00:07 full backup started for directory / (baseline backup 
> #2424)
> 2016-10-25 04:41:33 Got fatal error during xfer (Child exited prematurely)
> 2016-10-25 04:41:39 Backup aborted (Child exited prematurely)
> 2016-10-25 04:41:39 Saved partial dump 2425
> [...]
> Here it got an error during full backup. Since then none of the following 
> backups completed:
>
> 2016-10-25 04:42:00 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> 2016-10-25 04:42:03 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> 2016-10-25 04:42:03 full backup started for directory /; updating partial 
> #2425
> 2016-10-28 04:26:37 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
> 2016-10-28 04:26:39 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
> 2016-10-28 04:26:39 full backup started for directory /; updating partial 
> #2425
> [...]
>
> This goes on like this. Backups never complete nor do I see any error 
> messages.
>
> I did an lsof | grep rsync on the target host, but it does not show any open 
> files (except libs from rsync). Same on backuppc (except logfiles).
>
> What is going on here and how can I recover so I will get proper future 
> backups?
>

It looks like the backuppc side thinks the remote side disconnected.
If rsync is actually still running on the client it is probably some
sort of network issue like a nat gateway or stateful firewall timing
out.   If rsync did exit it could be out of memory or a filesystem or
disk error.

-- 
   Les Mikesell
 lesmikes...@gmail.com

--
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

[BackupPC-users] Backup Running Forever

2016-11-02 Thread Christian Völker 
Hi all,

BackupPC 3.x backing up Linux hosts. Runs fine since years now.

But currently I have an issue with one of my hosts. The backup starts,
but runs forever and does never finish. I do not know why this happens.
These are the last log entries:

2016-10-24 03:00:07 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
2016-10-24 03:00:09 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
2016-10-24 03:00:09 incr backup started back to 2016-10-18 02:00:05 (backup 
#2418) for directory /
2016-10-24 03:14:59 incr backup started back to 2016-10-18 02:00:05 (backup 
#2418) for directory /boot
2016-10-24 03:15:00 incr backup 2424 complete, 5450 files, 2233152544 bytes, 0 
xferErrs (0 bad files, 0 bad shares, 0 other)
2016-10-24 03:15:00 removing incr backup 2417
2016-10-25 03:00:05 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
2016-10-25 03:00:07 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
2016-10-25 03:00:07 full backup started for directory / (baseline backup #2424)
2016-10-25 04:41:33 Got fatal error during xfer (Child exited prematurely)
2016-10-25 04:41:39 Backup aborted (Child exited prematurely)
2016-10-25 04:41:39 Saved partial dump 2425
[...]
Here it got an error during full backup. Since then none of the following 
backups completed:

2016-10-25 04:42:00 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
2016-10-25 04:42:03 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
2016-10-25 04:42:03 full backup started for directory /; updating partial #2425
2016-10-28 04:26:37 Output from DumpPreUserCmd: mysqld beenden:  [  OK  ]
2016-10-28 04:26:39 Output from DumpPreUserCmd: mysqld starten:  [  OK  ]
2016-10-28 04:26:39 full backup started for directory /; updating partial #2425
[...]

This goes on like this. Backups never complete nor do I see any error messages.

I did an lsof | grep rsync on the target host, but it does not show any open 
files (except libs from rsync). Same on backuppc (except logfiles).

What is going on here and how can I recover so I will get proper future backups?

Thanks!

Christian





--
Developer Access Program for Intel Xeon Phi Processors
Access to Intel Xeon Phi processor-based developer platforms.
With one year of Intel Parallel Studio XE.
Training and support from Colfax.
Order your platform today. http://sdm.link/xeonphi
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/