Re: [BackupPC-users] Encryption
Hi On Mon, 25 Jun 2018 11:50:46 +0200, Kbtest Testar wrote: > We must encrypt according > to GDPR and the ISO we are follwing, Is this OK or is their any best > practise we should follow for ecrypting the backed up data? I wanted to store the backup encrypted, so i used this: https://rsyncrypto.lingnu.com/index.php/Home_Page Basically i "rsync and encrypt" on the local machine to another directory (only important files, not all the backup) and then setup backuppc to backup the encrypted result. The main crypt key i store in a (offsite) ISO and pendrive and the local keys i keep on the local machine, so it easier to restore. I like this setup and to improve would be great that backuppc could manage it directly and avoid the local encrypted copy ;) Good luck -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpt0pg3WZ05y.pgp Description: OpenPGP digital signature ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backup to Cloud
Hi > backups? Last week, Oracle announced their "archive" storage is > available for $1/Tb/month; seems almost like a "no brainer". I'm > considering just doing the "archive" and then using a script to move > the archive to the Oracle cloud. I didn't notice this release, but looks good for of-site storage! If you do implement this, consider sharing how you have done it, so other (like me) can use it also :) Thanks higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgphbLVXKQHLD.pgp Description: OpenPGP digital signature -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BPC4: shared files from pool and compression
On Thu, 21 Sep 2017 16:58:09 +0200, Gandalf Corvotempesta wrote: >> It's ok to change the compression level (eg, from 3 to 1). Notice that compressing a already compressed file, whatever compression level used in the first compression, will not save any space. So using compression level of 1, 3, or even 9, compression it again will give almost no compression gain. > I'll go with compression 0. ZFS is compressing, there is no need to > add an additiona layer. Backuppc compression should be more efficient, as it compress the file instead of disk blocks and most of the time, file size do not match the disk block size. Add this to the fact that the zfs compression block is usually 128k and in gzip is dynamic and can be much, much larger. Finally backuppc uses zlib and zfs usually uses LZ4, but even if you set it to uses zlib, it usually waste more cpu compressing unused block data and due the block size difference, it compress less: https://superuser.com/questions/562381/why-is-zfs-gzip-9-compression-so-much-worse-than-actually-using-zip-files So if this is a dedicated partition for backups and specially for backuppc (as its compression usage is very efficient), i would recommend disable zfs compression and use backuppc compression. If you are using the partition not only for backuppc, then you need to check if you prefer a faster and flexible but weaker compression (zfs) or a less flexible but more efficient compression (backuppc zlib). Also notice that you can create several zpools, one with compressions and other without good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpGuTrDR_WJC.pgp Description: OpenPGP digital signature -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Consequence of "always incremental" after first full backup
Hi To start, next time start a new thread instead of replying to a existent thread. This makes everything harder to read and follow > What would be the consequences of setting the backuppc parameters so > this host never gets another full backup? Use backuppc v4! It is possible in v3, but V4 already brings that out of the box for all rsync backups as last backup always have all files already, next one backup will always only copy what changed. good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgp7lkZlB3Pig.pgp Description: OpenPGP digital signature -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] get host by script
Hi I want to backup some cluster that needs a script to know what machine is the master. So this mean that i can not use the ClientNameAlias directly, but i'm using it to define the cluster name so i can use more freedom for the backup name. As backuppc uses the netbios if the dns fails, I'm trying to "abuse" the NmbLookupFindHostCmd and by running manually i can see it is working... the problem is that via backuppc, it then tried to do the reverse NmbLookup for that IP and of course, it fails. As the $host in NmbLookupCmd is the IP, i can not know what cluster it should return for the reverse lookup. So the end result is the error: "Dump failed: host clusterA has mismatching netbios name" So is there any workaround for this? What other people that need to get the host by a script do? @Craig Barratt: How about adding a option to disable the reverse netbios lookup? Thanks Higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpThHaSMZMcX.pgp Description: OpenPGP digital signature -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] [BackupPC-devel] Troubleshoot full pool for 4.0 worth it?
> du -csh /backuppc/cpool/?/?/? I do recommend ncdu, it uses ncurses to show and navigate the disk so basically it is a improved du that helps a lot finding space allocation problems higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpE_BntD95G7.pgp Description: OpenPGP digital signature -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] [BackupPC-devel] Troubleshoot full pool for 4.0 worth it?
Hi On Tue, 4 Apr 2017 23:04:44 -0700, Bill Broadley wrote: > root@node1:/backuppc# ls -al cpool/0/0/0 | head -10 > total 384 > drwxr-x--- 2 backuppc backuppc 114688 Mar 28 21:58 . > drwxr-x--- 18 backuppc backuppc 4096 Aug 24 2011 .. > -rw-r- 3 backuppc backuppc 32 Apr 23 2014 > 2564f9012849e45bfa1f4fd47578 > -rw-r- 2 backuppc backuppc159 Apr 23 2014 > 26b5ae9afbffa56382c6019dbfe1 > -rw-r- 2 backuppc backuppc 40 Oct 29 2014 > c32069243ef9cb6fd5113bd0891c > -rw-r- 1 backuppc backuppc 35 Feb 15 20:07 > c34a3e2faf9ccf2c31c6ded1c849 > -rw-r- 2 backuppc backuppc 55 Dec 28 22:00 > c50fe18070ca0ae0d11aaed2f261 > -rw-r- 2 backuppc backuppc133 Apr 23 2014 > feef14f3c8f589894b983456389a > -rw-r- 1 backuppc backuppc145 Feb 11 2015 > 00012f3df3fef9176f4a08f470d1f5e6 ^ | This field is the number of hardlinks. So you have entries >1, then you still have backups pointing to the v3 pool. Try to find what backups are still in V3 format Best regards -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpyqRLhP4N9X.pgp Description: OpenPGP digital signature -- Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backuppc performance
Hi On Mon, 26 Dec 2016 22:52:39 +0100, Pince Sans Rire wrote: > Everything works okay, *except* the backup thoughput. Here is a copy of > the "File size/count reuse summary" for one of the backed-up computers : You do not say what type of backup are you using, usually rsync+ssh is the more flexible one, but is also uses ssh that will default for security, not speed. Rsync+rsyncd will be faster, but without any encryptation. You can request some special ciphers to try to workaround this, in the past, arcfour was the fastest (but more insecure), today many CPUs have AES extensions and ciphers that use that will usually be faster: https://blog.famzah.net/2015/06/26/openssh-ciphers-performance-benchmark-update-2015/ Test your cipher performance (both on server and client) and choose the best one for your system. If arcfour, you will have to enable it on the server, by adding it to the end of the list. Then you enforce the best cipher in the backuppc rsync command with the -e "ssh -c (cipher)" or by adding the cipher to the backuppc .ssh/config Of course, CPU, IO and network may also be a problem, so check each one to see if you do not have any bottleneck on any of then. Use htop, vmstat, iostat, bmon for that > This seems really, really low (but even the 1.1 MB/sec maximum is > exceedingly low). I have full backups (around 400 Gb to copy) that time > out after 15 or 20 hours of backup. This is bothersome. Another reason may be a very high number of files/directories, that may be forcing rsync to check many entries. Even if you exclude most of it, many directories may still need to be checked to find other files not excluded. If the backup size is really big and slow to check, you can break the backup in several ones, so each one be smaller and faster. I do this on a server with several million of files and directories and took almost one day to finish. After breaking it in about 10 blocks, each one takes about 2hours... but resuming and incremental backups are much faster. You may need to tune a little the blackout hours so you do not have many parallel backups on the same machine. good luck Higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgp8NH_Hfaozs.pgp Description: OpenPGP digital signature -- Check out the vibrant tech community on one of the world's most engaging tech sites, SlashDot.org! http://sdm.link/slashdot___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] FullKeepCnt
On Wed, 2 Dec 2015 09:05:09 +0100 (CET), "absolutely_f...@libero.it"
wrote:
> $Conf{FullKeepCnt} = [ '1' ];$Conf{FullKeepCntMin} = '1';
(...)
> ;$Conf{FullKeepCnt} = [ '2'];$Conf{FullKeepCntMin} = '2'
You say you have =1 both, but then on the copy of the config
we can read the value 2 :)
best regards
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
pgpfrkLCnIONT.pgp
Description: OpenPGP digital signature
--
Go from Idea to Many App Stores Faster with Intel(R) XDK
Give your users amazing mobile app experiences with Intel(R) XDK.
Use one codebase in this all-in-one HTML5 development environment.
Design, debug & build mobile apps & 2D/3D high-impact games for multiple OSs.
http://pubads.g.doubleclick.net/gampad/clk?id=254741911&iu=/4140___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] Feature request: remote pools (was: Is it possible to split a large pool?)
Hi On Tue, 10 Nov 2015 10:21:18 -0600, Russell Poyner wrote: > I have a single BackupPC 3.3 backing up 110 machines. We are in the > process of getting a second server and I'm wondering if it's possible > to split the pool to move machines to the new server without losing > their backup history. This make me recall that i also had a similar problem and that all this could be solved with "remote pools" So this is a new feature, where a central backuppc server could use other remote pool to store the backups. So imagine one main office with 2 other remote offices (and with slow internet connections). The main office would backup to it own storage, but when backing up the remote offices, it would connect to a branch backuppc located in the remote office and start the backup of the remote office machines locally. On each backup, report back to the main backuppc. This allow one to have a central backuppc with the list of all backups have 3 different pools (to keep things simple, not shared, hardlinks are unique only in each pool). One can make backups of different kind of machines or remote branches or expand the backup pool to several machines. This also allow one to "migrate" backups by reconfiguring a host from one pool to another and wait some days to have new backups on the new pool and expire old backups on the old pool. Yes, this would require a new full total backup on the new pool, but any server migration always require a full read© of the data, one way or another. This would help several setups and would not require many changes. Each node is almost independent of the other, host config could be shared via ssh/rsync. Backuppc would need code for map a host to a pool, connect to that pool to start the backup (again ssh to locally run backuppc commands) and report (pull or push) the status to main backuppc (or all nodes if no master setup)... again, ssh could be used to transfer status to the other nodes. Logs and browser backups would use the ssh and request the same info on the remote backuppc node. So does this sound good and simple solution for a flexible pool management Thanks higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpiiYTEs3oue.pgp Description: OpenPGP digital signature -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Best to Move a Large Pool to Different FS?
Hi On Mon, 9 Nov 2015 20:02:23 +0100, Christian Völker wrote: > I want to transfer my pool from ext4 to xfs. The pool is around 1.3TB > with approx 15 hosts backing up. I haven't test with a big pool, but you can try using plain old tar, as it also takes care of hardlinks cd /var/lib/backuppc; tar cf - . | (cd /mnt ;tar xf -) It will take time, but it will read and transfer all the files and hardlinks will be referenced inside the tar and later rebuild. Again, i will not know how it will behave with so many files/hardlinks, but tar is one old backup tool where almost all corner cases were taken care, so it should work. You can pipe to a ssh host "cd /mnt ;tar xf -" if you want to transfer the files to other server Good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpSqtf3vNvWk.pgp Description: OpenPGP digital signature -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Windows VSS Snapshot and cygwin-rsyncd
Hi! > > I would recommend using this: > > http://www.michaelstowe.com/backuppc/ > to manage remote backup over internet. So I had to open 2 ports on > ADSL router (I can recall winexe is 139), two port on windows > firewall; compiling the package and I don't have too much control over DO NOT EVER OPEN windows RPC ports to the net!! For a remote windows, you must create a vpn or similar... You can install openvpn (server or client, you choose who starts the connection) or install a ssh in windows and use it instead of the winexe. There are many docs in the net how to install a ssh in windows and use it with backuppc... but you might need to fine tune the scripts to add the shadow copy scripts to it. Either ways you will only open one port with a safer service (don't forget to keep it updated) good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpIsfI1ZPEO8.pgp Description: OpenPGP digital signature -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] [BackupPC-devel] Feature request: exec type backup
Hi > > I want to execute a remote script to do a backup. The backup > > will not be store in backuppc, so all i need is to execute a script > > and save the status and the script log. > > > > Right now i workaround with tar, i replace the tar command > > with a script that will execute my command and then tars the log, so (...) > You should be able to use the DumpPreUserCmd for that, then perhaps > back up a directory containing the log of the operation. You'd get > scheduling and the ability to see failures in one place. This is also a workaround, just like mine with tar :) They work, but i think a simple "exec" backup type could be useful for more people and should be simple to implement as almost everything is already there. The fun of it is that is very powerful and flexible and can be used and abused in ways we can even imagine. > > Restore could also be a script. The script status code and > > stdout and stderr should be captured and logged by backuppc. No files > > are transfered to backuppc, so the size for this type of backups could > > always be zero in the status (or show it inside a [], to flag a remote > > backup) > > Not sure how you would control what was restored, though. Just execute the restore script. backuppc will just have the logs of the "exec" backup, so the user will have also create a restore script for what he wants. A CD/DVD will require one thing, a remote rsynced HD will require other and a other yet for any other special backup program. Maybe the remote backup script could report a list of files stored in the log and the restore could also take a file list as argument... but this should be optional and maybe with a regexp option to extract that file list (as each script could generate different logs) Either way, the only required thing is the restore script and one option for the backup number and/or date of the selected backup. More elaborated backups and restores require the admin to proper configure the scripts Thanks higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 pgpjJqmcw2FAd.pgp Description: OpenPGP digital signature -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel software development, from weekly thought leadership blogs to news, videos, case studies, tutorials and more. Take a look and join the conversation now. http://goparallel.sourceforge.net/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC_Link takes ages
Hi > But on this topic, my new server seems slow, with only a 3-4 MB/s speed > rating on a GB network (Windows backup over SMB). Is this normal? What > kind of speeds should I be expecting? smb can be VERY slow with many small files, totally killing its average speed. Try testing with a smb with just a few very big files to check the speed. You may also need some optimization, in a GB network is recommended to enable jumbo frames... and samba might need the some tuned up linux settings: socket options = TCP_NODELAY SO_KEEPALIVE SO_RCVBUF=65536 SO_SNDBUF=65536 deadtime = 15 add the IPTOS_LOWDELAY if you have many small files, it decrease delay (helps on the small files), but also decrease throughput, so (bad for the big ones) Good luck higuta -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] rsync: incremental vs. full backups
On Wed, 20 Jun 2012 11:02:51 -0500, Les Mikesell wrote: > timestamps and length match.If you have checksum caching enabled, > after the 2nd full the server side will not have to read/uncompress > the data of unchanged files but the target system still has to do the If you dont know what is the checksum caching, add this to the rsync options: --checksum-seed=32761 > read. Also, rsync sends the entire directory listing before starting > which might be a problem if your server does not have much RAM or does > many backups concurrently. depending also the number of disks and their connection (sata/esata vs usb or network/iscsi) you may have too much parallel backups. Use the vmstat and iostat to monitor your server and check where you might have a bottleneck. good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Update on BackupPC Development / Is backuppc dead?
On Thu, 14 Jun 2012 22:21:46 +0200, Philipp Raschdorff wrote: > No updates in nearly two years sounds strange to me. > Questions: > 1) Is BackupPC development dead? Backuppc always had a slow and silent development and version 4 will change many things, so its normal to not see any changes But dont worry, taking a few minor errors (most with patchs or workarounds over the net), current backuppc works well. > 2) Windows 7 and BackupPC ... will it work? It works fine, you can use it with several types of backup, but these is what mot people want, backup via rsyncd (started only when the backup is needed via windows rpc calls) and with VSS support http://www.goodjobsucking.com/?p=62 that gave 2 packages to help the admin to setup things: http://caravela.homelinux.net/~higuita/backuppc/ (mine) http://www.michaelstowe.com/backuppc/ (Michael Stowe) Mine is easier to install for unix/linux admins (its a simple copy, with smbnetfs its great for scripting), Michael one is easier for windows admins, for user knowledge users or for few machines. Also, Micheal also have WOL support, but i want to add that also in a few weeks. Either way, any VSS problem, please check the goodjobsucking.com site, as i add all the problems and solutions i found when i installed over 500 windows clients with windows xp, vista, 7, 2003, 2008, 32bit and 64bit. After the initial setup, it usually works well (any problem just reboot the windows and confirm that you have enough free space) Other method popular is to use ssh in windows: http://majentis.com/2011/01/03/backuppc-with-sshrsyncvss-on-windows-server/ http://www.cs.umd.edu/~cdunne/projs/backuppc_guide.html So yes, BackupPC works fine on Unix/Linux/*BSD, MacOSX and all Windows above 2000 (below XP you don't have VSS, but can still backup without it) Good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] On/off again Internal Server Error 500
Hi
On Thu, 17 Nov 2011 22:04:34 -0800, umiwangu
wrote:
> Is it possible that the machine doesn't have any swap file? I opened up
> System Monitor, and under Memory and Swap History, memory is generally
> running at 85% (640 Mb), and Swap says 0 bytes of 0 bytes...
Its possible, but not recommended (even by the kernel guys,
the kernel need at least a few bytes of swap so that some functions
dont fail under memory pressure)
confirm if you have or not swap by running in the command line:
swapon -s or free
> Should I create a swap file?
Yes... if you can, add a partition swap, if not, just
dd if=/dev/zero of=/swapfile bs=1M count=1024 to create a file
with 1GB (1024 blocks of 1MB) of size, format it with
mkswap /swapfile and add it to the fstab and do a swapon /swapfile
Tune the size for what you want and your free space
Good luck
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
--
All the data continuously generated in your IT infrastructure
contains a definitive record of customers, application performance,
security threats, fraudulent activity, and more. Splunk takes this
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] *** GMX Spamverdacht *** Re: On/off again Internal Server Error 500
Hi Just to clean things out, as i see many times people saying that they dont need swap in modern machines... and this "talk" might push more people in to thinking about that (not that you are really saying this) On Wed, 2 Nov 2011 20:44:43 -0400, Timothy J Massey wrote: > > Swap might keep the process from failing, > war, but for the most part the days of swap are over. I don't care how > much RAM you have, if you have a swap file of 1GB residing on a single > SATA spindle and you're actually using all 1GB, your system will be > unusable *anyway*, so who cares if it crashed a little sooner? (The Dont forget that swap is also "used" to extend the total virtual memory of the machine... people that use java know this already, but other apps also do it... many apps reserve memory for future use, but arent really using it. That memory is wasted without swap, and create "out of memory" errors when the machine just have a few MBs of RAM used. Apps that require a lot of virtual memory, even if they only use a few MBs, usually need swap files... sometime very big ones! Say you configure a java to use a max RAM of 4GB... it will require that memory to exist, even it its just using a few hundred MB. A 2GB of ram +2GB of swap will start the java, but a 2GB of ram + 100MB of swap will not. the java app will not use really the swap until it demands about 2GB. this is a stupid example, but instead of one app put many apps requesting RAM and the example and result is the same. With a very small swap, you are "eating" real memory that will not be used, but with swap, that "unallocated memory" is mapped to swap. This way you are "using" swap and dont even put a real byte on the disk. you dont lose performance, only gain as you have more free RAM and can support more simultaneous process. many apps over-commit ram... almost all languages with virtual machines do this, mysql can be configure to reserve more memory, apache, loading many modules and external process also allocate a lot more ram that its really using. hey, i have several chrome threads requesting +- 800MB of ram, but only using about 150... my firefox with MANY tabs open is requesting 3GB of ram and using about 2GB So some swap usage is normal for long live process, even with many RAM, but even if the swap usage is zero, having some swap already have the potential to free that same size of memory on the machine. Swap sizing depends on what the machine will do, but at least the same size as RAM or at least 2GB (whatever is bigger) should be considered the minimum. A machine with 4GB of ram and 100MB of swap is wasting ram to save a few GB of a (usually) giant, multi GB or TB HD Linux hides a little all this, but in solaris you clearly see 2 swap usages in parallel, the real swap usage and virtual memory swap usage. so... please dont shrink your swap too much, even if you have enough RAM and dont see swap usage... it is still useful! higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 -- All the data continuously generated in your IT infrastructure contains a definitive record of customers, application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-novd2d ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] backuppc and Win7
Hi On Sun, 5 Jun 2011 13:15:16 -0700, ow...@netptc.net wrote: > all other machines on the LAN) and pings work fine. Backuppc fires off > the error "Get fatal error during xfer (no files dumped for share C$). > Any suggestions? Yes... share the c drive... depending on your config, you might not have the c$ share enabled by default (or restricted by the firewall and network settings). good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Discover what all the cheering's about. Get your free trial download today. http://p.sf.net/sfu/quest-dev2dev2 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Root disk grows linearly 1GB between 07h-09 and then drops back - each morning
Hi On Sat, 04 Jun 2011 11:11:44 +0100, "Tyler J. Wagner" wrote: > > *Each* morning my root disk free space drops by one 1GB, > > starting at 07:00 linearly until 09:00. > This sounds like a job for lsof or 'find / -mmin 5 2> /dev/null'. Run Better, dont cross filesystems (so dont enter backuppc mount) and find LESS than 5 minutes (with some bad luck, no files would be created on exactly 5 minutes) find / -xdev -mmin -5 2> /dev/null also run lsof and ps xua or pstree... with this you can see what is using the space. i bet a file in /tmp, a result from a compression or a backup Good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Simplify data backup and recovery for your virtual environment with vRanger. Installation's a snap, and flexible recovery options mean your data is safe, secure and there when you need it. Discover what all the cheering's about. Get your free trial download today. http://p.sf.net/sfu/quest-dev2dev2 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Windows backups with vss/rsync?
Hi all > I've found that vshadow (Using this method) doesn't work under Windows > 7/Vista. Been there... its a pain, but i already have all the shadow executable for XP, vista and 7, 32bit and 64bit (i ignore XP 64bit, no one uses it) in this link: http://caravela.homelinux.net/~higuita/backuppc/backuppc/windows/BackupPC/ All of then where extracted from the Microsoft web site packages, namely the MS-multi-GB-one-for-each-version-dev ISOs, so you can trust me or download the ISOs and extract then yourself... either way you need the correct shadow.exe version and arch of windows Have fun higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- WhatsUp Gold - Download Free Network Management Software The most intuitive, comprehensive, and cost-effective network management toolset available today. Delivers lowest initial acquisition cost and overall TCO of any competing solution. http://p.sf.net/sfu/whatsupgold-sd___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] pre-load backup
Hi i have a machine that have about 100GB of data to backup, via ssh+rsync, but its network connection is about 1Mb, so it will take ages to do even the first backup. i already have on the backuppc server one old backup of that machine, done via plain rsync (not backuppc). so my question is: Is there any way to pre-load that "big, but slow" machine backup in backuppc, so that it doesnt need to transfer those 100GB again on a full backup? i use compression, but found no easy way to compress the files and put then in the cpool dir... even if i have, how to generate the support files? are they even required? will this even work at all!? Does any one tried to pre-fill a backup with existent data that could give me some tip how to do it? Thanks in advance! best regards higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC Graph at status page
Hi
On Wed, 20 Oct 2010 15:56:41 -0200, Rangel Caio wrote:
> >> could anyone tell me why the "graph" function at the status page (at
> >> the start) doenst work correctly? How can i setup this? I can just
> > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=556729
> Could someone explain me how to install that patch?
Pick up the attached path (its just copy paste of the bug
page, starting in the --- line )
then go the the backuppc dir... in my systems are in
/usr/share/backuppc/
this the folder should have this contents.
drwxr-xr-x 2 root root 4096 Ago 10 11:44 bin
drwxr-xr-x 2 root root 4096 Ago 10 11:44 cgi-bin
drwxr-xr-x 2 root root 4096 Ago 10 11:44 conf
drwxr-xr-x 2 root root 4096 Mai 21 2008 doc
drwxr-xr-x 2 root root 4096 Ago 10 11:44 image
drwxr-xr-x 3 root root 4096 Jul 22 2008 lib
so do:
cd /usr/share/backuppc/
patch -p0 --dry-run < patch
this command should return successful on both changes... if true,
remove the --dry-run to really apply the patch
If the --dry-run didn't return successful , try to edit the file
lib/BackupPC/Lib.pm around lines 485 and 553 and compare then with the patch
and see if isn't already applied
More info about patchs: http://en.wikipedia.org/wiki/Diff
good luck
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
--- lib/BackupPC/Lib.pm 2007-11-26 04:00:07.0 +0100
+++ lib/BackupPC/Lib.pm 2008-04-13 12:52:03.938619979 +0200
@@ -485,10 +485,15 @@
from_to($path, "utf8", $need->{charsetLegacy})
if ( $need->{charsetLegacy} ne "" );
-return if ( !opendir(my $fh, $path) );
+my ($fh);
+if ( !opendir($fh, $path) ) {
+ print "log ERROR: opendir ($path) failed\n";
+ return;
+}
+
if ( $IODirentOk ) {
@entries = sort({ $a->{inode} <=> $b->{inode} } readdirent($fh));
-map { $_->{type} = 0 + $_->{type} } @entries; # make type numeric
+map { $_->{type} = 0 + $_->{type}; $_->{type} = undef if ($_->{type} eq BPC_DT_UNKNOWN); } @entries; # make type numeric, unset unknown types
} else {
@entries = map { { name => $_} } readdir($fh);
}
@@ -553,9 +559,11 @@
return if ( !chdir($dir) );
my $entries = $bpc->dirRead(".", {inode => 1, type => 1});
#print Dumper($entries);
+#print ("log got ",scalar(@$entries)," entries for $dir\n");
foreach my $f ( @$entries ) {
next if ( $f->{name} eq ".." || $f->{name} eq "." && $dontDoCwd );
$param->{wanted}($f->{name}, "$dir/$f->{name}");
+#if ( $f->{type} != BPC_DT_DIR ) { print ("log skipping non-directory ", $f->{name}, " type: ", $f->{type}, "\n"); }
next if ( $f->{type} != BPC_DT_DIR || $f->{name} eq "." );
chdir($f->{name});
$bpc->find($param, "$dir/$f->{name}", 1);
signature.asc
Description: PGP signature
--
Nokia and AT&T present the 2010 Calling All Innovators-North America contest
Create new apps & games for the Nokia N8 for consumers in U.S. and Canada
$10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing
Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store
http://p.sf.net/sfu/nokia-dev2dev___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC Graph at status page
Hi On Mon, 18 Oct 2010 05:30:48 -0400, MASTEQ wrote: > could anyone tell me why the "graph" function at the status page (at > the start) doenst work correctly? How can i setup this? I can just see > the graphs, but there ist no content inside we dont know what you are using, you give no info, but check if your problems is this one: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=556729 you have there a patch to fix the graphs in xfs and reiserfs and that might fix your problem if you are using those filesystems (and maybe others too) good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Download new Adobe(R) Flash(R) Builder(TM) 4 The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly Flex(R) Builder(TM)) enable the development of rich applications that run across multiple browsers and platforms. Download your free trials today! http://p.sf.net/sfu/adobe-dev2dev___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Add NAS to LWM
Hi On Thu, 30 Sep 2010 18:55:18 +0200, Leif Gunnar Einmo wrote: > Anyone that could help me how to expand this LWM withe the space on the > NAS? if possible well, assuming that LWM is LVM :) if the NAS dont have iscsi support, the only way is to create BIG files, setup then as raw devices with losetup and create the LVM on top of that... you get a little less performance, as you have to use yet another layer of software/filesystem and possible a not optimal network transport protocol for reaching the real HDs... but should work Good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Virtualization is moving to the mainstream and overtaking non-virtualized environment for deploying applications. Does it make network security easier or more difficult to achieve? Read this whitepaper to separate the two and get a better understanding. http://p.sf.net/sfu/hp-phase2-d2d___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC for Windows and ESXi best practices
Hi > > Windows, OTOH, is a completely new animal for me. Can anyone give me > > some best practices on what to back up on a Windows VM? Or would it > > be better to just back up the VM lock, stock and snapshot? The VM is > > running on VMware ESXi 4.0, so I am still learning how snapshots and > > what not work. For plain window machine, i use the backup+rsync server+VSS: http://www.goodjobsucking.com/?p=62 as the windows disk are in a snapshot state due to the VSS, you can copy everything. To restore, install a windows, boot from knoppix or something and rsync everything back. *Please note* that metadata, permissions and probably more things are lost, because rsync is unable to save this info (there is a app/script to store the permissions/acl to a file in the net). i still didnt test this restore, but should work...famous last words, right ;) i just do full backup on 2 machines, all others i just backup the c:\Users and any special work dir... people have too much junk installed (i use backuppc only for workstations, not servers) the only problem that i'm having is that i have about 3 machines that the VSS fail and i suspect that is because they are win64 machines, but i have to debug it a little more when i have more free time. For ESX, i read wonders about this script: http://communities.vmware.com/docs/DOC-8760 i don't use it, but i plan to test it. Backing up full VMs requires alot of space, usually backing up the machine file system you can use the backuppc deduplication, where in the VM backup it will be useless (the backuppc deduplication is file bases, for deduplicate VMs you need block level deduplication)... on the other hand, restores are plain easy with backup of the VMs have fun! higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- This SF.net email is sponsored by Sprint What will you do first with EVO, the first 4G phone? Visit sprint.com/first -- http://p.sf.net/sfu/sprint-com-first___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Automatized configuration
Hi all On Sat, 22 May 2010 03:01:40 +0100, Lluis wrote: > Any idea about this. The objective is to achive an almost automatic > configuration for my backup system. there is no silver bullet, as each setup might be different, but i use a couple of scripts: script to install the ssh keys for root user, run by "install-root.sh backup_machine_name" #!/bin/bash if [ -z $1 ] ; then echo install-root.sh [hostname] exit 1 fi scp ~/.ssh/id_rsa.pub ~/Scripts/fix-key.sh r...@$1:/tmp/ ssh r...@$1 '/tmp/fix-key.sh cp ~/.ssh/known_hosts ~backuppc/.ssh/known_hosts echo "add to backuppc?" read a if [ "$a" == "y" ] ; then ~/Scripts/new-pc.sh $1 fi This script copies the fix-key.sh to the machine and run it (if the remote machine dont have root active, just use the "sudo /tmp/fix-key.sh"). In the fix-key.sh i have: #!/bin/bash test -d ~root/.ssh/ || mkdir ~root/.ssh/ cat /tmp/id_rsa.pub >> ~root/.ssh/authorized_keys # fix owner chown -R root:root ~root/.ssh || chown -R root:wheel ~root/.ssh # only root and admin can use ssh echo AllowUsers root admin >> /etc/sshd_config rm /tmp/id_rsa.pub /tmp/fix-key.sh >/dev/null 2>&1 Its not perfect, running several times will add several AllowUsers lines and the chown may give error output, but i can live with it :) after the remote install, i add the new machine to the backuppc, the new-pc.sh is this: #!/bin/bash set -x if [ -z $1 ] ; then echo new-pc.sh [hostname] exit 1 fi i=$1 cd /root/Scripts || exit 2 test -f /etc/backuppc/$i.pl && echo $i already there && exit 3 echo "$i0 admin unix" >> /etc/backuppc/hosts cp -i /etc/backuppc/+template+.pl /etc/backuppc/$i.pl chown backuppc:www-data /etc/backuppc/$i.pl # edit any special requirement for the new host nano /etc/backuppc/$i.pl /etc/init.d/backuppc reload I have the +template+.pl the normal config for my hosts and edit that file to fine tune any special requirement for a host this is the generic unix script, macosx is almost the same, the initial script is the install-admin.sh, that just change the remote user to admin and uses the sudo to execute the remote script. For windows its almost the same, and i already publish it in this comment (next with a ready to use zip client package) http://www.goodjobsucking.com/?p=62&cpage=2#comment-3777 so, to finish, this isnt totally automatic, but requires little input (mostly the passwords, specially if you comment the nano entry) If you do a list of machines to install, doing a for cycle to install then all isnt hard. if the password is the same, perfect, copy it to the clipboard and you just have to paste it. Good luck -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Error: Unable to connect to BackupPC server
Hi On Sat, 19 Sep 2009 03:27:30 +0200, Holger Parplies wrote: > err, no. Not even maybe. You edit BackupPC/CGI/Lib.pm and change line > 297 ... ok, that is cheating! :) that requires changing the code and my programming experience is very small... but strace would have found the same error, only with alot more work. :) > [OT] > Aside from that, I totally agree on your remark about quoting practises > from August 27th, but I find *your* quoting style confusing, too, point taken :) this is a very old habit from the time of BBS and console email, where quoting didnt exists, at least in a functional way... i will try to "fix" this bad habit, there is really no reason for me to keep doing it. Thanks! higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now! http://p.sf.net/sfu/devconf___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Error: Unable to connect to BackupPC server
Hi On Fri, 18 Sep 2009 13:53:42 -0500, Bruno Faria wrote: > How can I check to see where apache is looking for the socket file? You can strace -fefile -p (pid of the backuppc -d) for debugginh the backuppc side (i'm assuming a linux machine) For the apache side, you can start it in single thread mode with the -X option... with it, you can gdb or strace the apache and requests. here is a good apache debugging resource: http://httpd.apache.org/dev/debugging.html Boa sorte :) higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now! http://p.sf.net/sfu/devconf___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC and DRBD - My experience so far
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 hi all On Wed, 16 Sep 2009 11:58:27 +1000, Adam Goryachev wrote: > Hmmm, so I discovered something new (DRBD), I've been using NBD for you also have glusterfs, a fuse based filesystem, for building FS clusters/replications and we have good experience with it on replication a filesystem to several computers. http://gluster.com we dont use it for backuppc, dont know how it scales with thousands of files/hardlinks good luck higuita - -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) iEYEARECAAYFAkqy0n8ACgkQrv1jazsMcrP1jQCggDJ1LN1tU8P5Lo2Cy2M+B6Ij Sq8AoL94lVC053vBlgQrvd/fc5hRd1cX =ovb/ -END PGP SIGNATURE- -- Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now! http://p.sf.net/sfu/devconf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Anecdote about backup of changing zip files
hi all On Thu, 10 Sep 2009 12:04:09 +0100, "Nigel Kendrick" wrote: > domain DOS command called WHAT.COM that returns ERRORLEVEL set to 0-6 > according to the day of week. we use the cygwin gnu date in several scripts, its a lot more useful gdate -d "last week" +%a\\%Y-%m-%d this outputs today : Qui\2009-09-03 You can do whatever you want with it and always work fine Gnu date is a must in almost all mine DOS scrips :) higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] periodically e2fsck the device /var/lib/backuppc
On Mon, 7 Sep 2009 18:04:55 +1200, Michael wrote: > Why not ext4? > works very well on my setup well, AFAIK, it also have a inode limit, but the max its too large to be a problem... yet, i dont know what default limit it have but the main reason is the same: its too new... i can use it in my home, in places where i dont care about the data, but i will not use it in my company servers yet. each one have its own "age limit" for trusting a new filesystem, my personal limit is about 1 year AND the main distros already including support for it for about 3 months your opinion may vary, of course :) cya higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Which FS? (was: Keeping servers in sync)
hi > Now the typically > circumstance is that if you copy 1000 files during a backup, those files > will likely be accessed someone in sequence when you want to retrieve the > files or whatever. The problem is that some of the files are physically > located somewhere else on the disk due to the hardlinks. So you are talking about filesystem fragmentation and spread HD usage... this is not a problem of backuppc, but for all apps, everytime a file is updated, there is a high chance of increasing the "fragmentation" with related data. there is little you can do against it, smart defrags and smarter filesystems are the only solutions > de-duplicated. performance wise, it would be better to have backed up > those files again and have their data and inodes close together > clustered with the rest of the files that were backed up from that host > so that the disk head wouldnt have to continuously go to the beginning > of the disk. unless you have thousands of very small files, it is always faster to just check where is the file in the HD than transfer it again, no matter the random access even if its the same, there is no way to be sure that a new copy is store near the next copied file, the filesystem decides where to allocate the inode and over time you have a lot of scatter holes > more hardlinks = worse seek performance. this is not because of some > technical limit, simply logistics of platter size and seek latency when > data is spread around the disk. of course this have a performance hit, but not as much as you think... firt you already have concurrent backup processes, so the HD heads might not even be near the last copied/checked file second, using rsync with checksum caching, you really do little reads, specially when compared with the time spent writing new files and waiting for the remote client sends the file. checking the cached checksum is just a btree check (at least in the recommended backuppc filesystems) and so is very fast you can check with iostat, the number of reads is a lot less than the writes (unless of course, your clients didnt changed any file) cya higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] just one email
Hi all i'm having a small problem... i'm the user for almost all machines and when i have one with no backups, i get one email warning about it... everything perfect... but when i have more than one machine without backups, i still only get one email. is there any limit to the number of emails one user can receive? thanks higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] problem : No files dumped for share C $
On Sun, 06 Sep 2009 20:38:10 -0400, baradoss wrote: > > Hello, > > I try to set up backuppc as backup and > restore my server, I installed it on my backuppc > machine running Debian and I configure ssh to not ask > password root of the machine back up. you are using samba/cifs backup, so the ssh doesnt apply in here... > > Connection to 111.111.11.103 failed (Error > > NT_STATUS_CONNECTION_REFUSED) Connection to 111.111.11.103 failed the remote server isnt responding in its samba/cifs ports, have you checked if its the correct IP, if its have the file sharing enabled and if isnt running some firewall? good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Which FS?
Hi again On Sat, 5 Sep 2009 18:27:45 -0600, dan wrote: > Earlier releases of ZFS did this. I had this same issue until I > updated. Is good to know that, i liked ZFS, but this and specially the unrecoverable ZFS made me change my mind. when update to the latest solaris version, i will give it another test > I am more interested in the upcoming btrfs. It is a lot simpler code > and already has more people contributing. i too have a lot of faith in btrfs :) cya higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] periodically e2fsck the device /var/lib/backuppc
Hi On Sun, 6 Sep 2009 08:17:42 -0500, "Michael Stowe" wrote: > By the way, what's the point of doing this? Are your drives unreliable? even worst... why are you using ext3? ever think in switching to reiserfs, xfs or jfs? they should perform better and dont have inode limit as ext3 have. cya higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Tuning for disk contention
Hi
On Sat, 5 Sep 2009 18:52:35 -0600, dan wrote:
> >the "perfect" max load should be the number of cpus you have,
> >so a quad-core server can sustain a load of 4 without any
> >problem... after that number, the higher the load, the higher
> >will be the performance lost
> I dont agree here at all. backuppc is not generally CPU bound. If
> your target is to max out a quad core then you really need to beef up your
i'm not saying that backuppc is cpu bound, i'm describing what
is the "perfect" load, as he asked...
the "s in the perfect is because its not the only metric needed
to check how a machine is going, but is one of the most important.
the load is the number of process requiring CPU during a set of
time, but isnt just equal to the % of cpu usage, other
operations, like IO, require cpu slots even if they dont really
use cpu (DMA transfers and like). If load=# of cpus, no process
is waiting for cpu slot, when load > # cpus, you have process
that will be waiting for cpu slot in each cpu cycle...
the higher the load, the more process will be stopped, waiting
for their turn to use a cpu slot
He have a load of 9, we dont know how much cpu he have, but
even if its a quad-core, seems to me a high load, so he is
probably running too much concurrent backups at same time.
for sure the problem is in the IO, not in the cpu, but the
load shows that is doing more work than he can manage.
Solving the bottleneck (in this case is adding more disks for
sure) will decrease the load, as each operation will terminate
sooner and freeing the cpu slots for other process
> You make a lot more sence here, but I think you overestimate CPU usage.
see above :)
> a dual core 2Ghz Opteron with 2GB of ram and 8 drives in a linux raid10
> and hard disk speed is still my bottleneck. I run 4 concurrent backups
> on that machine and it does give high system load numbers but still
> handles the desktops in the office faster than 3 concurrent while 5
> concurrent takes quite a bit longer to complete.
how much is the "high system load"?
have you checked the 15 minutes load average with 3, 4 and
5 concurrent backups?
i suspect that with 3, you have a load around 1.5, with 4,
a load around 2.5, with 5, a load around 4.5... that is, you
are getting a higher jump from 4 to 5 than from 3 to 4
having a load of 6 during one minute isnt important, if its
just one minute
but again, load isnt the only metric, iostat gives the rest
of the info needed.
> filesystem choice and
> io scheduler do make a difference but faster disks is the only real
> cure.
faster HD or more disk to spread the load for more HDs...
for most people, this is true
cya
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
signature.asc
Description: PGP signature
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Failing incr backup marking all files deleted
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi Adam On Thu, 03 Sep 2009 14:52:57 +1000, Adam Goryachev wrote: > create 777 4294967295/51322273119 Document/62307.zip > create 777 4294967295/5131067 Document/62308.zip > create 777 4294967295/513 7393215 Document/62309.zip > create 777 4294967295/513 6771169 Document/62310.zip > create 777 4294967295/51344064821 Document/62311.zip > create 777 4294967295/513 1806527 Document/H2312.zip > create 777 4294967295/513 2429316 Document/H2313.zip > Read EOF: > Tried again: got 0 bytes > finish: removing in-process file Document/62314.zip > delete 777 544/5131435 Document/7160.zip > delete 777 544/5131142 Document/7654.zip > delete 777 544/5131182 Document/908.zip > delete 777 544/513 868 Document/8428.zip > delete 777 544/5131166 Document/977.zip > delete 777 544/513 992 Document/9628.zip please note the sizes reported by the create log... i assume that all zips in that dir are at last as big... then see that it gave one error and deleted all files that where considered incomplete (the see the deleted sizes and compare with the original file size) removing incomplete files is normal, you dont want to restore a broken file this backup is a partial, it manage to transfer about 7 files, you probably can confirm it in the client backup list cya higuita - -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) iEYEARECAAYFAkqh2ccACgkQrv1jazsMcrNdSwCaAkCexytF4oBKdTnMjlVnD71K TT4AoJ2Vj9Mn5kM9nhyLWUSuJVbPgnEh =m9Qi -END PGP SIGNATURE- -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Tuning for disk contention
Hi On Fri, 4 Sep 2009 14:39:22 -0700, James Ward wrote: > What's a good IO/WAIT average to shoot for? Load average? Other > things I might not be thinking of? the "perfect" max load should be the number of cpus you have, so a quad-core server can sustain a load of 4 without any problem... after that number, the higher the load, the higher will be the performance lost a high load and still having cpu idle is a sign of IO load. high system cpu usage is a sign of the kernel spending too much time managing the IO for IO load can be 99/100%, but only as long the IO wait doesnt increase alot... this values depends of the HD type, raid layout, number of disks, bus, etc in modern HDs (sata, scsi, sas) IO waits between 5-20 are normal... 100 is high load...if you see times above 150, that HD is probably getting too much load and is slowing down a lot the rest of the system (but again, this values depend of your OS/config/FS/HD layout) dont forget that writes usually put more load on a HD than reads, the HDs cache helps a lot, but usually write cache is not enabled use iostat (like iostat -kx 30 ) to monitor the HD loads and see how the io load and wait is going... sporadic high loads/times are normal, specially in small check times, but sustained high loads/times are a sign of problems if you want to try to get a little more from your HDs and the data isnt critical in case of a powerloss (usually backups arent, next backup would "fix" the bad data), you can enable the write cache. be aware that at least xfs doesnt like to lose data with powerloss+write cache, its format assumes that data hits the HD when it tells and can miss behave if the cache just decided to only really write half of the data before the powerloss. that is why is highly recommended to use xfs with a UPS and do a controlled shutdown in case of powerloss good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Which FS?
Hi again On Wed, 2 Sep 2009 19:26:29 -0600, dan wrote: > This is somewhat dependant on filesystem and IO Scheduler of the OS. > Some filesystems excel under IO loads (ZFS) but shrivel and die under RAM > pressure(ZFS) strange, was not really my experience... before i used backuppc, i used a hand made rsync script on a solaris with ZFS and during the backups the machine as dog slow and trying to use the ZFS filesystem took seconds and even minutes...but still had free ram (about 2GB) maybe because i had just 2 HDs and for several times i manage to fill 100% the ZFS (i found that with 0 bytes free, you cant delete anything, just a echo > big_file would help there). it was still too new and buggy for sure, and i probably stressed too much that poor XFS :) i gave up that ZFS and script after a powerlost and the ZFS didnt come online no matter what i did... after 2 days of unsuccessful tries, i installed backuppc. cya higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Windows Excludes
Hi all
On Thu, 3 Sep 2009 09:16:18 -0500, "Michael Stowe"
wrote:
> '/Documents and Settings/*/Local Settings/Temporary Internet Files',
> '/Documents and Settings/*/Local Settings/Temporary Internet Files',
do you know you have a duplicated here :)
i usually also exclude *.vmdk (vmware), *vdi (virtual box), i
dont know anyone that used the MS virtual machine, but they
should have also a extension for their virtual HDs
google earth, google search, MS search also create big files
that are always changing
java also create a cache dir, but *cache* is always a good
candidate, as *tmp and *tmp/*
IE cookied, flash cookies, as they dont deserve the cpu/io spent
with then
i also exclude the download, music, images, etc folders of
some users... i also exclude the *no-backup* and tell users
to put inside folders with that name all things they dont
need backup
*.ost and *.pst.. ost are the offline exchange mailbox,
is recreated if needed, the *.pst because they are too big,
change alot and are always locked...they are the worst backup
thing that one could ask...
our users know that they should store the emails in the
server only and this way we say goodbye to this problem.
without .pst, the need for VSS is also smaller
finally, antivirus updates and definitions... some
keep older virus definitions around and its a waste of
space and IO
good luck
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
signature.asc
Description: PGP signature
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Which FS?
Hi again
On Tue, 1 Sep 2009 03:32:00 +0200, Holger Parplies wrote:
> > wrong, the ls -l doesnt need to move to the files inode to do
> > anything, the directory have all the necessary info.
> sorry, but that is just not true. 'ls -l' needs to do a stat() to
Oops, you are right... i was thinking on the plain ls, the -l
option will fetch alot more info
> more disk activity than on a 'normal' directory. Sorting the stat()
> calls by inode number would help, but I doubt 'ls' is optimized for
> such an unusual usage case (but I haven't checked, so I might be wrong).
that is the job of the SCSI (and not SATA) command queuing,
reorder the requests to optimize the head seeks... that is
also why IDE suck so much
But anyway, if someone is working under RAM pressure or
IO pressure, you have no cache, and without cache, all
HDs/OS/filesystems will take a HUGE performance hit
cya
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
signature.asc
Description: PGP signature
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Which FS?
Hi all On Mon, 31 Aug 2009 15:42:50 -0500, Les Mikesell wrote: > And the new directory entry may be all the way across the disk from the > existing inode - and far from any other inode in this directory. true, but system cache takes care of most directory access, so unless you are doing a find, isnt as huge performance hit as in windows > And, assuming you have enough disk activity to keep the cache out of > date, that 'ls -l' will have to move the disk head to the directory > location and then the inode to get the data - if you list many files in wrong, the ls -l doesnt need to move to the files inode to do anything, the directory have all the necessary info. in the files inodes there is the file data, you only need to go there when you need to read that file data > the same directory that were links to existing files, the head may have > to seek all over the place to get the inoded data. when you list a directory, you just read the directory inodes, if you use a filesystem with index (like reiserfs, xfs and ext3 with the dir_index enabled, etc) the dir of the all dir or just one file will take almost the same time, even if there are many files on that dir cya higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Is there a speed setting?
Hi On Sun, 30 Aug 2009 01:30:25 -0400, "Jeffrey J. Kosowsky" wrote: > >well, under normal conditions (ie: unix), i would say rsyncd is > >faster, as doesnt have the ssh overhead... > But if bandwidth is your limitation (which it frequently is on any > decent system) then rsync+ssh may be faster if there is a lot of fresh > data to be transferred due to the compression of ssh transfers. bandwidth is the limit if you can both encrypt and compress faster than the network bandwidth... also, the bonus of the compression depends of the data and can also be gained by the normal rsync-rsyncd... backuppc rsync cant because doesnt support compression, so the main question might be how much the data compress Cya higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Excludes not working
hi all
Sorry, this is a little offtopic, but maybe isnt just me...
On Thu, 27 Aug 2009 12:23:51 +0200, "Koen Linders" wrote:
> [quoted text]
[unquoted text]
[reply]
{unquoted text]
[reply]
this email was hard to read, there is almost no indication
where the old text stop and starts the reply.
Koen (and any other), please configure your email client to
quote the text with a character (more common is >) and if
possible, remove not needed quotes so people doesnt have
to search on a long email where is the reply
html quote is useless, the mailling list removes the html
part and even if it didnt, there are still many clients
without html support (usually by choice).
Thanks and sorry about the noise :)
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
signature.asc
Description: PGP signature
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Solved! (Was: Sub directories of modules impossible?)
Hi On Tue, 25 Aug 2009 06:47:03 +0200, chin wrote: > Also thank you for that tip! I did configure BackupPC as much as > possible from the web interface. So indeed I did not look very far in > the config.pl. IIRC, you can also setup that via the webinterface, no need to direct edit the config.pl good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Is there a speed setting?
Hi all
On Mon, 24 Aug 2009 15:05:55 -0500, Jim Leonard wrote:
> This brings up a good point: What is faster, using rsyncd or
> rsync+ssh? You'd think that rsyncd would be faster, yet I'm not getting
> times anywhere near these.
well, under normal conditions (ie: unix), i would say rsyncd is
faster, as doesnt have the ssh overhead... in windows i still
didnt test...
> Higuita: How many of these are windows clients and how many
> non-windows?
all are MacOSX or Linux, i will try to configure some windows
machines during the next days.
We already have a internal rsync script for windows, but its
hard to manage and i finally manage to get a little more space
for backuppc to migrate some windows to it and test how all
works.
i will report when i have more info
cya
higuita
--
Naturally the common people don't want war... but after all it is the
leaders of a country who determine the policy, and it is always a
simple matter to drag the people along, whether it is a democracy, or
a fascist dictatorship, or a parliament, or a communist dictatorship.
Voice or no voice, the people can always be brought to the bidding of
the leaders. That is easy. All you have to do is tell them they are
being attacked, and denounce the pacifists for lack of patriotism and
exposing the country to danger. It works the same in every country.
-- Hermann Goering, Nazi and war criminal, 1883-1946
signature.asc
Description: PGP signature
--
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Is there a speed setting?
Hi all here is my example, my top speed backups: icorreiadleite 4 3.4 7.1834.02 3 0.4 0.4 idleidle antonio-trind-l ajtrindade 46.1 10.90 34.17 15 0.1 0.1 idleidle drusso dleite 5 4.5 85.71 34.93 15 0.5 0.5 idleidle ltrindade dleite 4 2.1 94.77 35.11 15 0.1 0.1 idledone aacesar dleite 4 5.1 42.96 39.85 15 1.0 1.0 idleidle tvanez dleite 4 4.1 103.76 41.17 15 0.1 0.1 idledone jferreira dleite 5 4.5 13.72 41.21 14 18.34.5 idleno ping (no ping response) aprafaeldleite 5 4.1 50.43 45.10 15 2.1 2.1 idleno ping (no ping response) poliveira dleite 5 2.6 126.52 46.21 10 0.6 0.6 idleidle spimentadleite 4 8.1 62.63 46.43 15 3.1 3.1 idleno ping (no ping response) jppinto dleite 5 5.0 1374.13 55.76 12 3.0 3.0 idleno ping (no ping response) I even checked the first full backup of recent added machines and its giving also 20-40MB/s transfers. Please note that this are rsync backups, not rsyncd, and my backuppc ssh settings are this: Protocol 2 Ciphers arcfour,blowfish-cbc,aes128-cbc,aes192-cbc,aes256-cbc,3des-cbc,cast128-cbc BatchMode yes Compression no i have several HDs for backuppc to sustain this transfers rates. maybe you are using bad ssh settings if using rsync? good luck higuita -- Naturally the common people don't want war... but after all it is the leaders of a country who determine the policy, and it is always a simple matter to drag the people along, whether it is a democracy, or a fascist dictatorship, or a parliament, or a communist dictatorship. Voice or no voice, the people can always be brought to the bidding of the leaders. That is easy. All you have to do is tell them they are being attacked, and denounce the pacifists for lack of patriotism and exposing the country to danger. It works the same in every country. -- Hermann Goering, Nazi and war criminal, 1883-1946 signature.asc Description: PGP signature -- Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
