Re: [BackupPC-users] bakuppc is not running.
ok, let me try and ask my question a deferent way.
when i did du on a full backup folder of a spesific pc i saw it to be 300GB.
i then run the script i mentioned and it not only removed the full
backup but its coresponding incornly backups, which is quite logical.
however, the free space on my backup drive was not changed and was not
added the 300+GB that was deleted by the script.
now, i have at the very least would expect that backuppc will run a
"cleanup" or as you say nightly cleanup, will free some space.
however, it looks like nightly was not running at all, new backups were
not taken, and i have to find something on this drive to delete in order
to make it at least continue to backup.
now, it has run a backup, but still not freeing space.
my question is where has the deleted backups gone to, and how to run the
nightly cleanup manually in a spesific mode that will actually free some
space for me?
Here are the parameters asked:
$Conf{WakeupSchedule} = [
'1',
'2',
'3',
'4',
'5',
'6',
'7',
'8',
'9',
'10',
'11',
'12',
'13',
'14',
'15',
'16',
'17',
'18',
'19',
'20',
'21',
'22',
'23'
];
$Conf{MaxBackupPCNightlyJobs} = '2';
$Conf{BackupPCNightlyPeriod} = '1';
as for the log, my guess is it is running, but not doing what it
supposed to:
2011-09-12 02:38:31 BackupPC_nightly now running BackupPC_sendEmail
2011-09-12 02:39:16 Finished admin (BackupPC_nightly -m 0 127)
2011-09-12 02:39:16 Pool nightly clean removed 0 files of size 0.00GB
2011-09-12 02:39:16 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0
max links), 1 directories
2011-09-12 02:39:16 Cpool nightly clean removed 233720 files of size 42.78GB
2011-09-12 02:39:16 Cpool is 1346.20GB, 1022043 files (145 repeated, 27
max chain, 23731 max links), 4369 directories
and version: 3.2.0 on ubuntu server.
Regards,
*Adi Spivak*
IT Manager
17 HaYetzira St, "Mordot HaCarmel" Industrial Park, Yokneam Elite
Mail: P.O Box 687, Yokneam 20692. Israel
TelFax.: (+972) 48-290-124. (+972) 48-290-100
www.fit-pc.com
Re: [BackupPC-users] automatic waking and shutting down Linux clients
Hi,
Robert E. Wooden wrote on 2011-09-11 16:29:32 -0500 [[BackupPC-users] automatic
waking and shutting down Linux clients]:
> First, I am very much a novice at bash scripting, so bare with me as I
> learn by doing.
depends on what you want us to bare ;-).
> [...]
> So, I simply placed
> '/usr/local/bin/shutdown.sh' into the client config file line
> "DumpPostUserCmd". That shutdown script is: "ssh -T root@[my client
> static IP address] /sbin/shutdown -h now >/dev/null" (minus the
> quotation marks, of course.)
>
> I now know that I can WOL a client and shut it down when the backup has
> completed. Now, time to refine and simplify my shutdown script. I have
> to study the manpage of ssh to see if "-T" means the same as the
> ">/dev/null" term at the end of the string. If I don't need both then . . .
>
> I am sure someone will have some thoughts and opinions?
I'm not quite sure what your question is. Should you read the ssh man page?
Yes. Does the ssh '-T' option redirect stdout to /dev/null? No. Is it
important to clean up your (working) script? No, but go ahead if you like to.
Remember what worked for you so you can always go back to that.
If your goal is to get rid of the script and put the command in
DumpPostUserCmd, you should be able to do that as it is (the output
redirection won't be handled locally, because BackupPC doesn't use a shell to
execute DumpPostUserCmd - it will be passed to the remote shell invoked by
ssh, which will handle it just fine). I don't really see why redirecting
*stdout* is important anyway (except for keeping your log file clean). As for
*stdin*, you could look at the '-n' option of ssh. '-q' works well for
backups, so you might as well add it here, too. '-T' doesn't seem to have any
effect - at least I wouldn't expect a tty to be allocated without it either
(but I might be wrong - try 'ssh root@host tty' to find out).
You could call your script with a parameter $host or $hostIP and then use
ssh root@$1 ...
instead of hard-coding the static IP into shutdown.sh. That way, you could use
the same script for any of your clients (should you ever want to shut down
more than one of them). For readability/documentation, you might want to give
a name to your parameter, as in
#!/bin/sh
host=$1
ssh root@$host ...
or even
#!/bin/sh
host=${1:-[default hostname]}
ssh root@$host ...
if you want to shut down [default hostname] (replace by name or IP) if no
parameter is given (I don't know why you'd want to do that, but since you're
learning bash scripting, I thought I'd mention it anyway). Note that
'localhost' is probably *not* a good default in this case ;-).
Being prepared for someone forgetting the argument is always a good idea,
though you might prefer printing an error message and exiting the script
instead:
#!/bin/sh
host=${1:?Host name argument to $0 missing - check your hostname.pl}
ssh root@$host ...
If you're experimenting with those examples, you'll probably want to run
something like 'date' instead of 'shutdown' ;-).
I can also recommend reading the bash man page. Long, but interesting.
Regards,
Holger
--
Doing More with Less: The Next Generation Virtual Desktop
What are the key obstacles that have prevented many mid-market businesses
from deploying virtual desktops? How do next-generation virtual desktops
provide companies an easier-to-deploy, easier-to-manage and more affordable
virtual desktop model.http://www.accelacomm.com/jaw/sfnl/114/51426474/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] automatic waking and shutting down Linux clients
First, I am very much a novice at bash scripting, so bare with me as I learn by doing. I found Salik Rafiq's blog (http://blog.chameeya.com/2011/08/backuppc-and-waking-machines.html) about waking his client machines with WOL and it worked perfectly. (I believe I may have posted that fact recently and failed to give Salik credit, sorry about that.) But, here are the recent changes. I placed my 'wolping.sh' in /usr/local/bin. This was done per Michael Stowe's suggestion on this forum. Thank you, Michael. I then gave it 'chmod 750 [filename]' permissions and 'chown backuppc:www-data' ownership. Then, as per Salik Rafiq's blog, remove the "NmbLookupFindHostCmd" string under the 'Backup Settings' tab of the _server_ config file. Then, via the 'Server' tab, changed the "PingPath" to /usr/local/bin/wolping.sh. This sufficiently wakes all my Linux client machines (that have already been setup to WOL. Check your distro for instructions.) Now, shutting down clients after BackupPC has completed that client's backup (whether it was incremental or full backup.) I have a small four computer household. Of the four (as of today) I only want to shutdown one of them after the client backup has completed. So, I simply placed '/usr/local/bin/shutdown.sh' into the client config file line "DumpPostUserCmd". That shutdown script is: "ssh -T root@[my client static IP address] /sbin/shutdown -h now >/dev/null" (minus the quotation marks, of course.) I now know that I can WOL a client and shut it down when the backup has completed. Now, time to refine and simplify my shutdown script. I have to study the manpage of ssh to see if "-T" means the same as the ">/dev/null" term at the end of the string. If I don't need both then . . . I am sure someone will have some thoughts and opinions? -- Robert Wooden Nashville, TN. USA Computer Freedom? . . . Linux -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Dead server nagging
Kenneth Porter wrote:
> I've had a server die and I'm getting nag messages that I haven't backed
> it up recently. How can I keep the data but disable the nagging reminders?
>
>
--
> Using storage to extend the benefits of virtualization and iSCSI
> Virtualization increases hardware utilization and delivers a new level of
> agility. Learn what those decisions are and how to modernize your storage
> and backup environments for virtualization.
> http://www.accelacomm.com/jaw/sfnl/114/51434361/
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
You should disable backup -> $Conf{BackupsDisable} = '2';
See Backupplan within the GUI
br
Matthias
--
Don't Panic
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your storage
and backup environments for virtualization.
http://www.accelacomm.com/jaw/sfnl/114/51434361/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] Dead server nagging
I've had a server die and I'm getting nag messages that I haven't backed it up recently. How can I keep the data but disable the nagging reminders? -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] bakuppc is not running.
Hi,
Adi Spivak wrote on 2011-09-11 08:25:46 +0300 [[BackupPC-users] bakuppc is not
running.]:
> [...]
> hi.
> backuppc has stopped working 5 days ago.
> it was due to lack of storage space.
> i used this script:
>
> href="http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=How_to_delete_backups";>http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=How_to_delete_backups
> which should have released hundreds of GB just from deleteing the
> backups of one PC but it does not, even though in the GUI it shows
> that the backups are gone.
> now, backuppc is just stuck or somthing and is doing nothing for the
> past 5 days, no reorginazing the backups, no incrementals, nothing.
> how can i fix this?
> how can i force it do remove the backups that were deleted by the
> script to free room?thanks.
> --
>
>
> color="#00">Regards,
> color="#00">Adi Spivak
> color="#00" size="3">IT Manager class="Apple-style-span" style="border-collapse: separate;
> color: rgb(0, 0, 0); font-family: 'Times New Roman';
> font-style: normal; font-variant: normal; font-weight: normal;
> letter-spacing: normal; line-height: normal; orphans: 2;
> text-indent: 0px; text-transform: none; white-space: normal;
> widows: 2; word-spacing: 0px; font-size: medium;"> class="Apple-style-span" style=""> size="2">
>
> <.../>
the title of your message says BackupPC is not running. Presuming you mean
this as in "BackupPC is not running", then it is not surprising it is not
freeing up the space. Start BackupPC. The nightly cleanup will free the space.
It is run on the first wakeup listed in $Conf {WakeupSchedule}. What
are the following variables set to in config.pl?
$Conf {WakeupSchedule}
$Conf {MaxBackupPCNightlyJobs}
$Conf {BackupPCNightlyPeriod}
Which version of BackupPC are you using? Do the log files show that the
nightly cleanup is run regularly (as in "each night")?
Regards,
Holger
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your storage
and backup environments for virtualization.
http://www.accelacomm.com/jaw/sfnl/114/51434361/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] md4 doesn't match even though VSS is used
Matthias Meyer wrote at about 15:29:09 +0200 on Sunday, September 11, 2011: > Dear all, > > I've a problem by backing up a large file (9GB) because the internet > connection of the client interrupts every 24 hours. > > BackupPC (V3.1.0) can rsync this file once with status: > "md4 doesn't match: will retry in phase 1; file removed" > With "lsof /var/lib/backuppc" I can see this "phase 1" transfer some minutes > later. > But the internet connection will interrupt shortly before this second > transfer were finished :-( > > I am sure that the source file (Windows client) is on a volume shadow copy > and rsync is using this source because: > - /etc/rsyncd.conf contains only one "path = /cygdrive/Z/" > - ls /cygdrive/ shows only the drives C and D > - ls /cygdrive/Z lists the same files as ls /cygdrive/C > > So it should not possible that the source was changed. > > Did /usr/share/backuppc/lib/BackupPC/Xfer/RsyncFileIO.pm compare the md4 > diggest from the begin of a transfer with a recalculated md4 diggest at the > end of the transfer? > > Somebody else have a similiar problem? > > Is there any known solution to solving my problem? > > What happens if I patch the RsyncFileIO.pm so that it will ignore the "md4 > doesn't match"? > > I know I should try it instead asking for it. But I'm not sure what the > meaning of md4 is and hopefully someone can give me a hint. > I would not ignore the md4 mismatch. md4sums are used on block sums and file sums both to ensure the transfer was errorless and also as part of rsync's delta matching algorithm that allows it to only transfer over changed blocks. I'm not sure what is the cause of your problem. But I would first try naked rsync (without BackupPC) and with protocol manually set to protocol 28 so that md4 sums are used rather than md5sums. See what happens when you try to transfer the file... -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] bakuppc is not running.
Adi Spivak wrote: > hi. > backuppc has stopped working 5 days ago. > it was due to lack of storage space. > i used this script: >href="http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=How_to_delete_backups";>http://sourceforge.net/apps/mediawiki/backuppc/index.php?title=How_to_delete_backups > which should have released hundreds of GB just from deleteing the > backups of one PC but it does not, even though in the GUI it shows > that the backups are gone. > now, backuppc is just stuck or somthing and is doing nothing for the > past 5 days, no reorginazing the backups, no incrementals, > nothing. how can i fix this? > how can i force it do remove the backups that were deleted by the > script to free room? > thanks. First please send plain text mails. Second: What the content of your BackupPC Status page? BackupPC will stop working if the pool file system is more then (configurable) 95% full. What is the output of "df -h /var/lib/backuppc" Do you find the "deleted" backups on device? Do you find /var/lib/backuppc/pc/ or numeric directories in it? For your understanding: /var/lib/backuppc/pc//backups contains the informations shiown by GUI /var/lib/backuppc/pc// contains the backups itself. br Matthias -- Don't Panic -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] md4 doesn't match even though VSS is used
Dear all, I've a problem by backing up a large file (9GB) because the internet connection of the client interrupts every 24 hours. BackupPC (V3.1.0) can rsync this file once with status: "md4 doesn't match: will retry in phase 1; file removed" With "lsof /var/lib/backuppc" I can see this "phase 1" transfer some minutes later. But the internet connection will interrupt shortly before this second transfer were finished :-( I am sure that the source file (Windows client) is on a volume shadow copy and rsync is using this source because: - /etc/rsyncd.conf contains only one "path = /cygdrive/Z/" - ls /cygdrive/ shows only the drives C and D - ls /cygdrive/Z lists the same files as ls /cygdrive/C So it should not possible that the source was changed. Did /usr/share/backuppc/lib/BackupPC/Xfer/RsyncFileIO.pm compare the md4 diggest from the begin of a transfer with a recalculated md4 diggest at the end of the transfer? Somebody else have a similiar problem? Is there any known solution to solving my problem? What happens if I patch the RsyncFileIO.pm so that it will ignore the "md4 doesn't match"? I know I should try it instead asking for it. But I'm not sure what the meaning of md4 is and hopefully someone can give me a hint. Thanks in advance Matthias -- Don't Panic -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
