Re: Bug when using rsync -r --delete -b --backup-dir

2021-01-02 Thread Henri Shustak via rsync
You may wish to take a look at LBackup : http://www.lbackup.orgPlease note as one of the developers I am biased.On 24/11/2020, at 10:33 AM, CRTS via rsync wrote:Consider following directory structure:mkdir -p src/empty tgt bkpwhen making an initial backup withrsync -r src/ tgtthen the empty

Re: RAM speedup

2020-07-01 Thread Henri Shustak via rsync
You may need a lot of ram. Take a look at how much RAM ZFS needs to operate well. Henri > On 27/06/2020, at 7:58 AM, Rupert Gallagher via rsync > wrote: > > Hello, > > As disks are slow and rsync reads and writes so much that for the bus this is > the equivalent

Re: RAM speedup

2020-07-01 Thread Henri Shustak via rsync
Not sure if it is useful. Will put a plug in for a rsync hard based backup system primarily focused on macOS. If it is speed you are after, then this is probably not the right / helpful tool. But feel free to pick out what ever is useful for you : http://www.lbackup.org Henri > On 29/06/2

Re: osx permission issue

2020-05-13 Thread Henri Shustak via rsync
If you are talking about SIP, then at present SSH will have full disk access (as much as it can) by default. Take a look at this LBackup page which discusses this in more detail : http://www.lbackup.org/developer/dealing_with_sip Hope that helps. -- Please use reply-all for most replies to

Re: Advanced rsync includes and excludes

2019-10-09 Thread Henri Shustak via rsync
t; + private/var/*** > + home/*** > - * Henri > I'm a happy camper @ rsync (and rsnapshot) since years. Thanks for this major > piece of software. > > In an attempt to reorganize my rsnapshot backups, I stumbled across an issue, > that I'm trying to seeking a more sophis

Re: rsync many processes and slow backup

2019-10-09 Thread Henri Shustak via rsync
://www.lbackup.org There is even a pre-script you can enable (in the example resources) so that the script can run a maximum of once a day / once a month etc (even if you start it many times from cron. Hope you have it all working now :) Henri >> Hi all! :-) >> >> I have a small rsync scri

Re: Huge directory tree: Get files to sync via tools like sysdig

2017-02-09 Thread Henri Shustak
That sounds like it certinally would not hurt! This email is protected by LBackup, an open source backup solution http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To

Re: Huge directory tree: Get files to sync via tools like sysdig

2017-02-09 Thread Henri Shustak
As Ben mentioned, ZFS snapshots is one possible approach. Another approach is to have a faster storage system. I have seen considerable speed improvements with rsync on similar data sets by say upgrading the storage sub system.

Re: downloading only specific directories from directory tree

2017-01-22 Thread Henri Shustak
The following URL may also be helpful in terms of another example : http://www.lbackup.org/developer/advanced_excludes_file_examples Hope that link is helpful. HTRAX 2013 Revitalised : EGYPTIAN HUMP HTRAX : Direct URL download

Re: Robustness: sometimes write times after having renamed the temp file

2016-11-30 Thread Henri Shustak
I believe some work on this was happening at one point in rsync (not specific to OS X). In terms of your issues specifically, would the fuzzy option possibly help you? > --fuzzy find similar file for basis if no dest file Could you report if it makes a difference for your use case?

Re: rsync: connection unexpectedly closed

2016-10-16 Thread Henri Shustak
>> Have you tried performing a copy to a known good local device? If a >> local copy fails, then I would start checking the file system of the >> source and also the hardware of that system. > > That's a good idea. I just tried that and it copied no problem. Do you have another system you could

Re: rsync failure on corrupted source data

2016-06-28 Thread Henri Shustak
+1 for ddrescue :) > https://www.gnu.org/software/ddrescue/ This email is protected by LBackup, an open source backup solution http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing

Re: rsync with overlay tree

2016-04-10 Thread Henri Shustak
If you are looking at overlays specifically have you checked out RADMIND? http://rsug.itd.umich.edu/software/radmind/macosx.html Note : The link above is more specific to the MacOSX release but it is a good starting point Hope that helps!

Re: OS X and rsync: unpack_smb_acl errors and --numeric-ids

2016-04-06 Thread Henri Shustak
o look at it immediately. Just (A) pinging the bug and (B) wondering how patches are submitted or if there is a patch already in existance? Thanks Henri InstallPKG, an open source installation system. Install multiple apple .pkg and .mpkg fil

Re: Empty directories aren't backed up in backup-dir

2016-03-07 Thread Henri Shustak
Using the link-dest option would be one way to solve this. If you are seeking a backup system which uses hard links (link-dest), then you may wish to take a look at LBackup Hope this helps. This email

Re: Verifying backups

2016-03-07 Thread Henri Shustak
Just chiming in slightly off topic. As a first step if you are going to be backing up files to some media with a computer it would be a really good idea to ensure, that the hardware being used is not faulty. I am not saying that your hardware is faulty. However, it would be worth checking this

Re: Recycling directories and backup performance. Was: Re: rsync --link-dest won't link even if existing file is out of date (fwd)

2015-04-16 Thread Henri Shustak
Our backup procudures have provision for looking back at previous directories, but there is not much to be gained with recycled directories. Without recycling, and after a failure, the latest available backup may not have much in it. Just wanted to point out that LBackup has a number of

Re: Recycling directories and backup performance. Was: Re: rsync --link-dest won't link even if existing file is out of date (fwd)

2015-04-16 Thread Henri Shustak
How do you handle snapshotting? or do you leave that to the block/fs virtualization layer? I am guessing this question is directed at me. Firstly, when I used the word snapshot, I was referring to the snapshot in the LBackup context. It is outlined at the following page

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
Ill take a look but I imagine I cant backup the 80 Million files I need to in under the 5 hours i have for nightly maintenance/backups. Currently it's possible by recycling directories... To cover that many files in that much time you will require a high speed system. Just another thought.

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
Hi Ken, You may wish to take a quick look at LBackup (disclaimer I am a developer on this project) which is a wrapper to rsync ; designed for reliable user data backups. LBackup always starts a new backup snapshot with an empty directory. I have been looking at extending --link-dest options

Re: rsync to multiple destinations

2015-02-01 Thread Henri Shustak
I am looking for a way to start one rsync command with multiple destinations. My use case: I have one (slow) usb drive which should be synced to two other harddrives. It would be great if rsync could read one file which is to be copied to both hard drives only once, so the slow usb connection

Re: rsync with 8bit file names?

2014-09-18 Thread Henri Shustak
When trying to sync my TV folder to a mirror drive, episodes with non-ASCII characters in them cannot be processed by rsync. Anything I can do about this? (Q1) What do you mean by a mirror drive? Is this a RAID1 external enclosure or some sort of softRAID? Or is it just a copy of the TV

Re: rsync with 8bit file names?

2014-09-17 Thread Henri Shustak
When trying to sync my TV folder to a mirror drive, episodes with non-ASCII characters in them cannot be processed by rsync. Anything I can do about this? (Q1) What do you mean by a mirror drive? Is this a RAID1 external enclosure or some sort of softRAID? Or is it just a copy of the TV

Re: rsync with 8bit file names?

2014-09-17 Thread Henri Shustak
Hello again, Three further questions : (Q2-1) Have you tried this same setup when booted from another OS (e.g. 10.9)? (Q2-2) Have you tried this using some other hardware? (Q2-3) Have you tried coping this specific file over using the Finder (say to the Desktop) and then using rsync to copy

Re: rsync with 8bit file names?

2014-09-11 Thread Henri Shustak
Hello, Guessing the source drive is formatted HFS+ or HFS+J. What is the file system on the destination drive? I know that rsync is capable of correctly coping over file and folder names on Mac OS X which contain non-ASCII characters. Hence my question relating to the destination file system?

Re: rsync with 8bit file names?

2014-09-11 Thread Henri Shustak
by LBackup, an open source backup solution. http://www.lbackup.org On 12/09/2014, at 12:40 PM, LuKreme krem...@kreme.com wrote: On 11 Sep 2014, at 16:22 , Henri Shustak henri.shus...@gmail.com wrote: Guessing the source drive is formatted HFS+ or HFS+J. The source drive is a Drobo

Re: Backup scripts

2014-09-09 Thread Henri Shustak
Hello, The --link-dest approach is the way LBackup works and this is also what allows the lcd command (part of LBackup) to move you back and forth in time while you remain in the same directory relative directory. This makes finding a particular data quite easy during a partial restore. In

Re: Backup scripts

2014-09-04 Thread Henri Shustak
Hello, You may want to check out the LBackup source code as a possible starting point if you are looking to create your own customised backup script : http://www.lbackup.org/source Disclaimer : I am involved with the development of LBackup.

Re: Beating a dead horse

2014-04-03 Thread Henri Shustak
Every year or two I get stuck on this same problem involving excluding. This reply assumes that you would like to backup specific directories via the excludes file, which is believe is what you are attempting to accomplish. Take a look at the information at the following URL :

Re: silent data corruption with rsync

2014-03-13 Thread Henri Shustak
Anyway, if They care about their data , They use checksumming for storing their data on disk, do They ? ;) snip silent bitrot on disks _does_ happen I totally agree. Storage devices fail and if you need to know if the data is the same then a checksum is your best bet. If you want to do your

Re: Contents of rsync digest

2014-02-18 Thread Henri Shustak
When I try to run a scheduled backup I get the following error: Error in socket I/O (code 10) How do I fix this error? Are you connecting to a remote system to pull or push data? If so are you able to ping the remote system or connect to that system on the specified port using telnet?

Re: Bugg when using Extended Attributes flag -X

2014-02-10 Thread Henri Shustak
the initialisation scripts could eventually extend well beyond the scripting subsystem and into other areas in order to simplify the setup monitoring and verification of backups on multiple servers. Hope this helps. Henri This email

Re: need help with an rsync patch

2013-08-27 Thread Henri Shustak
The solution is not to refuse to backup any file that is a hard link. There are legitimate reasons to have hard links and ignoring them means you aren't backing up everything. I agree that preserving hard links may be important in some situation. There are certainly legitimate reasons to

Re: Password from the stdout

2013-06-11 Thread Henri Shustak
Use an ssh key instead. To get started, the following URL offers introductory information : http://www.lbackup.org/network_backup#creating_ssh_keys_for_testing Hope this helps. - This email is protected by LBackup, an open

Re: rsync 3.0.9 partial file left after CTRL-C WITHOUT using --partial

2013-04-06 Thread Henri Shustak
Hello, I was unable to reproduce this issue on an OS X system with rsync 3.0.9 (compiled from source) or 2.6.9 (default on 10.8.2). Output from the testing I performed is below. snip ╭─henri@mac /tmp/test_rsync_2.6.9_osx/src ‹› 13-04-07 - 0:41:08 ╰─$ dd if=/dev/urandom of=source_file bs

Re: rsync 3.0.9 partial file left after CTRL-C WITHOUT using --partial

2013-04-06 Thread Henri Shustak
source) or 2.6.9 (default on 10.8.2). Output from the testing I performed is below. snip ╭─henri@mac /tmp/test_rsync_2.6.9_osx/src ‹› 13-04-07 - 0:41:08 ╰─$ dd if=/dev/urandom of=source_file bs=10 count=1 1+0 records in 1+0 records out 10 bytes transferred in 105.312418 secs

Re: Is there a howto/tutorial on backups/rsync that covers the use of hard and soft links?

2013-01-31 Thread Henri Shustak
You may be interested in having a look at LBackup http://www.lbackup.org, an open source (released under the GNU GPL) backup system. Essentially, LBackup is a wrapper for rsync. If you are working on your own script. Feel free to look at how LBackup works (primely written in bash at present)

Re: Time rsYnc Machine (tym)

2012-08-01 Thread Henri Shustak
Push is when you run your backup program (rsync and whatever script) on the machine being backed up and you push/upload your data to the backup system. Pull is when you run your backup program on the backup system and pull/download the data from the machine being backed up. You may also

Re: rsync based on checksum only

2012-07-07 Thread Henri Shustak
Wow! Thanks for making it so easy. I will try that asap. If you do not have any luck with the patched version of rsync there are various projects which spring to mind which offer this kind of functionality. However, I would suggest that rsync is the most stable project I have ever seen

Re: [Bug 8712] --link-dest doesn't work if target file exists (but needs updating)

2012-05-28 Thread Henri Shustak
I'm also hit by this issue. Is there any prediction as to whether and, if so, when something is going to happen? :) Until such time as the situation with --link-dest changes consider syncing into an empty directory (if at all possible). If you are using rsync for backup then you may wish

Re: --link-dest isn't linking

2012-04-22 Thread Henri Shustak
rsync -Ha --link-dest=/media/4tb/bak/panic-2012-01-01 /media/2tb/bak/panic-2012-02-01 /media/4tb/bak/ It seems that you may be attempting to hard-link between two file systems. One is mounted as /media/4tb the other is mounted as media/2tb. My understanding is that it is not normally

Re: --link-dest doesn't work if target file exists (but needs updating)

2012-01-22 Thread Henri Shustak
On 12-01-20 06:01 PM, Kevin Korb wrote: Someone has requested it: https://bugzilla.samba.org/show_bug.cgi?id=7870 I'm not really sure that is the same bug. Maybe it is. Not convinced though. I guess I can file my own bug and ask 7870's OP to see if it's the same issue. But is seems

Re: securing rsync backup solutions?

2011-12-28 Thread Henri Shustak
- - laptop-to-server: the laptop tends to roam a lot, network conditions vary from place to place, and the rsync will be initiated manually, so it is likely to be a `push' operation, the ssh keys will definitely need to be encrypted and unlocked manually, but even with that security, I want

Re: Raise an error if file exists on destination

2011-12-15 Thread Henri Shustak
I am trying to use rsync to copy files from several origins to a single destination. I would like to detect when a file gets overwritten because it is present with the same relative path/name in several origins: Origin1: foo/bar.txt Origin2: foo/bar.txt Destination after copy:

Re: Mac OS X : get_xattr_names: llistxattr(some/path/here, 1024) failed error

2011-12-14 Thread Henri Shustak
Hi, I'm trying to make a small script to get rid of Apple's TimeMachine. The aim is to backup the files of my company. I setup a MacMini with a lot of storage attached to it. The MacMini connects every once in a while to our data server (XServe) through SSH and pulls the files that

Re: [Bug 8566] Spotlight comments (extended attributes) are not synced

2011-12-03 Thread Henri Shustak
I downloaded 3.0.9 source + patches, patched in the 2 patches: patch -p1 patches/fileflags.diff patch -p1 patches/crtimes.diff And although running with the appropriate arguments (as in the original report), the comments still do not get synced! Help please! I believe this issue has been

Re: Replacing rsync on OSX servers.

2011-11-21 Thread Henri Shustak
Having built and tested 3.0.7 and ready to send it out into production, can anybody point me to 'best practices' for updating the binary and man pages and other issues around upgrading from the dodgy v2.6.9 that ships with late-10.4-thru-10.7? You could use /usr/local/bin as the install

Re: Strange bug (buffer overflow) happening only under cron

2011-10-30 Thread Henri Shustak
Hi Pedro, Mmh, I put uname -a into the cron job and it says: core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited file size (blocks, -f) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited

Re: rsync connection/transfer error

2011-10-26 Thread Henri Shustak
Hello, Is your output on this problematic network similar to the following : $ telnet mirrors.usc.edu 873 Trying 68.181.195.4... Connected to hpc-mirror.usc.edu. Escape character is '^]'. @RSYNCD: 30.0 Also, what happens if you add -n (--dry-run) to the following command : rsync -artv

Re: rsync connection/transfer error

2011-10-26 Thread Henri Shustak
Hello, It seems that the issue is todo with the network. However, I would suggest you try with a different computer system to be sure. Additional notes follow : -- server: iperf -s -D -p 873 (problematic network) client: iperf -c iperf.server.com -L 873

Re: With rsync --link-dest, is it possible to determine which files are new?

2011-10-23 Thread Henri Shustak
SHA1 You may also find fingerprint to be a useful tool. However, it will require ruby. --- This email is protected by LBackup http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options:

Re: Estimating backup usage with dir-merge filter

2011-10-06 Thread Henri Shustak
It sounds like you missed the point of Kevin's message (in the other fork of this thread). The point wasn't to use `du`, it was that you can run your stats against the backed-up files, not the source. Then you're only running stats against the results of running the backup using the

Re: [Bug 8456] improve --link-dest bahaviour

2011-09-18 Thread Henri Shustak
In general - --link-dest works as expected *only*, if the destination directory is empty. Going along with this idea of ensuring the destination directory is empty. LBackup is a rsync backup wrapper system which may be of assistance in this regard. ---

Re: [Bug 8450] New: --link-dest seems not to work mounted NTFS file systems

2011-09-18 Thread Henri Shustak
Just to clarify, Is the destination file system NTFS? Also, is this storage directly attached or is it mounted via the network? Finally, you mentioned it is mounted read-only would you please clarify why the drive you are writing to is mounted in this way? Thanks. Henri

Re: [Bug 8456] improve --link-dest bahaviour

2011-09-18 Thread Henri Shustak
I'd like to use rsync as an efficient (== do not store the same file twice at the backup media) backup solution. The backup should be made into N remote directories (rotating each day) _without_ the need to delete the remote directory before. This is essentially, what LBackup is doing.

Re: rsync and encryption

2011-09-04 Thread Henri Shustak
Which operating system are you running on the system which currently has your personal documents? Ubuntu/Debian Do you know if there is a virtual file system encryption system which breaks the data into bands? I know that Mac OS X has support for breaking an encrypted disk image into

Re: Brandysnap -- a new rsync-based snapshot management script

2011-07-05 Thread Henri Shustak
Hi Chris, https://github.com/StarsoftAnalysis/brandysnap I am involved with the LBackup project. Would you be okay with a link being generated to the Brandy on github page from the LBackup alternativeshttp://www.lbackup.org/alternatives page? Yes, that would be great. Done.

Re: Brandysnap -- a new rsync-based snapshot management script

2011-07-03 Thread Henri Shustak
under, perhaps in the future Brandysnap functionality could be incorporated into the LBackup project? Sounds like a good project. Thank you for posting the link and explanation. Keep in touch. Henri - This email is protected

Re: Using rsync as an incremental backup

2011-06-26 Thread Henri Shustak
I'm using rsync to do an incremental backup of my desktop here, to a remote server as follows: #/usr/bin/bash old=$(date -d 'now - 1 week' +%Y-%m-%d) new=$(date +%Y-%m-%d) rsync -avP --delete --link-dest=../$dir /home/bakers bak...@perturb.org:/home/bakers/backup/$new/ This is

Re: Being VERY careful while using the --delete option

2011-05-12 Thread Henri Shustak
On UNIX, I am executing an rsync command, from within a script. The command goes something like this: /usr/bin/rsync --verbose --progress --stats --compress --recursive --times --perms --links --safe-links source_dir/ user@target_machine:/parent_path/source_dir In other words, I

Re: thank you wayne, andrew, paul and everyone else

2011-04-30 Thread Henri Shustak
+2! :) -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: files not moved immediately to final destination from temp location after rsync returns with success

2011-04-20 Thread Henri Shustak
I am using rsync version 3.0.7 on an arm linux based embedded device. The device pulls data periodically from a rsync server and stores the files on an SD card. The partial, temp and final rsync destinations all reside on the SD card. I came across an issue where it seems that the rsync

Re: rsync not reporting diskfull error

2011-02-09 Thread Henri Shustak
If pushing data (e.g. a local copy or copy from local to remote), there is a failure where the receiver can try to report an error, die, and the sender gets the error trying to write to the receiver before it gets the error message from around the horn (it would have gone to the generator,

rsync not reporting diskfull error

2011-02-05 Thread Henri Shustak
I am involved with the development of lbackup. This message to the rsync mailing list is related to the following thread on the lbackup-disccussion mailing list : http://tinyurl.com/lbackup-discussion-diskfull Essentially, I am curious to if any one using rsync 3.0.7 on Mac OS (10.6) Server

Re: Protocol stream error on extended attribute, silent failure to copy all attributes

2011-02-02 Thread Henri Shustak
I'm using rsync 3.0.7 on Mac OS X 10.6, compiled according to Mike Bombich's instructions at http://www.bombich.com/rsync.html. Rsync repeatedly exits with a protocol data stream error when trying to copy some com.apple.FinderInfo extended attributes. While testing this issue, I found that

Re: Disk image with rsync/rsnapshot

2011-01-18 Thread Henri Shustak
I want to make a full disk image backup of my disk with rsnapshot/rsync that I can restore on a new disk. Part of my /etc/rsnapshot.conf looks like follows: exclude /proc exclude lost+found exclude /media exclude /sys exclude /dev exclude /tmp exclude /dev backup

Re: Simple Question

2010-12-08 Thread Henri Shustak
I have been using rsync on my laptop for some time to safeguard an extensive image collection. My usage has been: .. rsync -av --delete ~/Pictures /media/disk I have found this exceptionally fast ... just as advertised! I now have set up a new computer system where I want to back up my

Re: Writing to the wrong directory

2010-11-29 Thread Henri Shustak
Hello, Recording the output (standard error and standard out) to a log file will help with investigating this issue if it is reproducible. Perhaps another person on this list will provide a better suggestion. In addition, perhaps adding some additional debugging information before and after

Re: [Bug 3653] Reduce the need for the vanished files warning

2010-10-03 Thread Henri Shustak
Doing nightly backups from cron is an *extremely* common use-case of rsync, and telling each and every user of rsync that they should either A) write their own shell script to filter and discard error messages, or B) play a constant game of whack-a-mole chasing down new --exclude options

Re: How to mirror only specified directories

2010-10-01 Thread Henri Shustak
I'm still struggling to get just the directory(ies) that I want... You may find this http://tinyurl.com/rsync-exclude-all-include-some post to the LBackup mailing list helpful. The example listed (link above) revolves around specifying the root directory as the source and then

Re: rsync as a deliberately slow copy?

2010-09-29 Thread Henri Shustak
I'm looking for a way to deliberately copy a large directory tree of files somewhat slowly, rather than as fast as the hardware will allow. Just do it to localhost - that way it's still a network connection, and you can use --bwlimit. Also, you could try nice to lower the priority rsync

Re: How to mirror only specified directories

2010-09-28 Thread Henri Shustak
I'm still struggling to get just the directory(ies) that I want... You may find this http://tinyurl.com/rsync-exclude-all-include-some post to the LBackup mailing list helpful. The example listed (link above) revolves around specifying the root directory as the source and then specifying a

Re: Intermittent rsync Issues

2010-09-15 Thread Henri Shustak
I posted this to a couple online forums already am am already doubting anyone will be able to directly help me solve my problems. So I am here to query the experts directly: I have a number of rsync clients trying to connect to an rsync server routinely, and they're intermittently

Re: Backing up a stand alone system to a usb drive with rsync

2010-09-09 Thread Henri Shustak
I have a stand alone system with two drives / and /home on one and /var on the the other. I'd like to backup the complete system to a usb drive. I've tried dd however since it copies over everything, even empty space it didn't seem very practical since for instance root only has 10GiB out

Re: Options to copy modified files

2010-09-05 Thread Henri Shustak
We use rsync to copy files and directories from one server to the other. What options should I give to rsync so that it only copies the modified files? For example server1 may contain a dir which contains just one file that has been modified, how do I get rsync to copy just that one file

Re: OSX 10.6.4 error with -R option

2010-09-02 Thread Henri Shustak
I have had reports of problems with the -R option on OSX 10.6.4. Just tested it myself and found this odd result: When I run this dtruss -f path/to/rsync -aHAXNR --fileflags --force-change --protect-decmpfs --stats -v /Users/astrid/Documents/main.m /Users/astrid/Desktop/rrr it

Re: compare a directory with itself -- differences found

2010-09-02 Thread Henri Shustak
well, when I tell rsync to compare my home directory with itself, it reports many differences. I'm using rsync version 3.0.7 protocol version 30. I was hoping to use it to verify my backup. What kind of differences are reported. Also are you using the the --check-sum option for

Re: compare a directory with itself -- differences found

2010-09-02 Thread Henri Shustak
I think an important question is what kind of differences do you need to check with regards integrity of your copy / backup? In addition, I suggest that you actually use rsync to copy the data to a separate directory and then compare two different directories. The reason I suggest this is

Re: DO NOT REPLY [Bug 7629] New: Blank filter file option to ignore whole directory

2010-08-18 Thread Henri Shustak
I know that there are external ways to do this, but I thought it would be fastest and best as an rsync feature. I've been using rsync for a while now in some fairly advanced backup schemes and I'm extremely impressed by it. I was thinking it would be quite helpful if there were an option to

Re: Scripting rsync against a filesystem with a quota

2010-08-15 Thread Henri Shustak
On another note I'm getting an error: copyfile(.._..v6AxMh,./., COPYFILE_UNPACK) failed:13 When trying to run with -E. Upstream rsync has no such error message. If you're using the Apple-modified rsync, we don't support it here. You may wish to compile a version of rsync from

Re: HDB, a hard drive backup program

2010-08-11 Thread Henri Shustak
Hey all, I'm writing a tool: http://www.subspacefield.org/security/hdb/ This is an interesting approach. I look forward to seeing the project develop. Thanks for the link. -- This email is protected by LBackup http://www.lbackup.org -- Please use

Re: backup option

2010-08-11 Thread Henri Shustak
I am using rsync to backup files. Is it possible to specify an option not to delete files from backup directory if the files are deleted from source? In that way, I can always keep something I may or may not need in the backup disk, but remove it from a work computer. As Alex mentioned the

Re: IO error causing file deletion failure?

2010-08-07 Thread Henri Shustak
readlink_stat(/home/morgan/.gvfs) failed: Permission denied (13) I believe the error above is a problem with the rsync user not being able to read the file /home/morgan/.gvfs. I suggest that you check the permissions on this file and also check that the sudo command is in fact granting

Re: Getting rsync to store timing information in its logs

2010-07-27 Thread Henri Shustak
Is there a way to know from the rsync logs how long it took to do a backup? The only timing info,. I see is this at the end: sent 3067328 bytes received 7853035429 bytes 1187888.83 bytes/sec total size is 1559866450336 speedup is 198.55 The latest alpha release of LBackup supports new

Re: rsync algorithm

2010-07-22 Thread Henri Shustak
Check file size makes sense, but how rsync checks times? If a file is copied from one side to another remote side, the time will be different, right? Sorry wrong question, the copy file should be able to reserve the mtime. If the rsync --times option is used then rsync will attempt to

Re: How to block this fiel name from being transfered via rsync?

2010-07-21 Thread Henri Shustak
Are you specifying this lines in an excludes file? yes -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Rsync sequence

2010-07-20 Thread Henri Shustak
Can I just list them one after the other like so in crontab -e You may wish to also consider using a single rsync command : rsync -auv --delete \ /Godfather/Documents \ /Godfather/Setups \ /Godfather/Pictures \ /Godfather/Backups \ /Godfather/Videos \ /Backup # backup destination With this

Re: --compare-dest weirdness

2010-07-20 Thread Henri Shustak
the -i shows that most are being copied due to time differences, so in theory -t should work? This does in fact work on a little test setup on my work laptop, i will test it properly when i get home tonight. I am glad that the -t option is working with your test. If you decide to use

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-19 Thread Henri Shustak
I did think about remotely executing a mkdir before the backup, but one blocker is that I will be using Thecus NAS boxes as some off-site locations and I don't have shell access. You could mkdir the directory locally somewhere (anywhere), and rsync just that directory to the remote side,

Re: --compare-dest weirdness

2010-07-19 Thread Henri Shustak
interestingly, i tried to see if something was wrong with my statments by doing: mkdir ~/rsynctest/dir1 mkdir ~/rsynctest/dir2 mkdir ~/rsynctest/dir3 nano ~/rsynctest/dir1/file1 (wrote the line hello world and saved) nano ~/rsynctest/dir1/file2 (wrote the line hello and saved) cp

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-15 Thread Henri Shustak
I really want to put the logic in the script so it is easy to bring another backup location online easily. If you have shell access to the destination system from your backup script then one option may be to issue 'mkdir -p' via ssh. Creating the directories manually on the destination

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-15 Thread Henri Shustak
Below is a link to a script (which currently only supporting Mac OS X) which will synchronize a sparse bundle image to a remote server. Sorry I forgot the link in the previous email. - http://www.lbackup.org/synchronizing_disk_images_between_machines Finally, yes I would be very

Re: --recursive and -H

2010-06-28 Thread Henri Shustak
Aaah, thanks for the insight. RSYNC must transfer the file regardless of the link count, but it also takes note of the missing link. So, it probably considers an inode with multiple links resolved only after it finds a brother/sister link and deletes the duplicate. You may also be

Re: where is backup-dir rooted?

2010-06-22 Thread Henri Shustak
[What I am trying to achieve is to backup (part of) my home directory to a backup server such that a) I have a reasonably up to date (within a day if I do it overnight) of my current state b) If I have deleted or updated a file the old version of it gets placed into a special snapshot

Re: few questions on rsync

2010-06-22 Thread Henri Shustak
Reversing --backup logic: Currently, if --backup is used (and --backup-dir), a copy of existing file that is replaced on rsync will be placed there. Is there a way to keep original copy (ie. base) the same, but just place whatever has changed to a different location? Taking backup to a

Re: Simple whole volume copy

2010-05-27 Thread Henri Shustak
Sorry, I'm only going to be doing this a single time. I don't really need a script, just a simple command I urge to to read this great write up Cloning Mac OS X disks by Mike Bombich : http://www.bombich.com/mactips/image.html If you have access to a test computer system running Mac OS

Re: Simple whole volume copy

2010-05-27 Thread Henri Shustak
Sorry, I'm only going to be doing this a single time. I don't really need a script, just a simple command which will preserve all the flags. Also, another question, what kind of data is on this volume that you are backing up? -- This email is protected by

Re: Simple whole volume copy

2010-05-26 Thread Henri Shustak
I have a volume at 192.168.0.2 on my local network. I'd like to rsync the entire volume to a backup volume, skip all files already present on the backup volume (same name and the same or earlier timestamp) Firstly, I would recommend that on both machines you compile and install a copy of the

Re: Simple whole volume copy

2010-05-26 Thread Henri Shustak
same name and the same or earlier timestamp Would you please provide some clarification on your desired result in the following situation. file_a : /Volumes/src/file.txt file_b : /Volumes/dst/file.txt If file_b has a newer modification time than file_a will you want file_a to overweight

Re: Simple whole volume copy

2010-05-26 Thread Henri Shustak
Right. That's why I need rsync. I'm really not looking for a utility, but a command line program which will do incremental backup, and rsync is the only one I'm aware of that does that in Mac OS. There are also some other options available. Although, I have not tested them on Mac OS X 10.6.

  1   2   >