rsync with 8bit file names?
When trying to sync my TV folder to a mirror drive, episodes with non-ASCII characters in them cannot be processed by rsync. Anything I can do about this? For example, I get this: building file list ... file has vanished: /Volumes/TV/Raising Hope/Raising Hope - S04E01 - De?\#201ja Vu Man.mkv This is rsync under OS X: $ rsync --version rsync version 2.6.9 protocol version 29 Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others. http://rsync.samba.org/ Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, inplace, IPv6, 64-bit system inums, 64-bit internal inums I'd check macports, but since it's not been updated for 10.10 yet I'll need to wait a while. -- Passion is the pill you can swallow forever Taking them one by one One by One --Agents of Good Roots Come On -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync with 8bit file names?
On 11 Sep 2014, at 06:36 , LuKreme krem...@kreme.com wrote: $ rsync --version rsync version 2.6.9 protocol version 29 (I did install rsync 3.1.1, same results) -- U is for UNA who slipped down a drain V is for VICTOR squashed by a train -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync with 8bit file names?
On Thu, 11 Sep 2014 07:58:15 -0600, LuKreme wrote: On 11 Sep 2014, at 06:36 , LuKreme krem...@kreme.com wrote: $ rsync --version rsync version 2.6.9 protocol version 29 (I did install rsync 3.1.1, same results) I have no problems rsync-ing files with German characters, but this is on Linux. I've noticed that it is built with iconv support, so maybe that's missing on your end(s)? -h -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync with 8bit file names?
On 11 Sep 2014, at 17:05, Holger Hoffstätte holger.hoffstae...@googlemail.com wrote: On Thu, 11 Sep 2014 07:58:15 -0600, LuKreme wrote: On 11 Sep 2014, at 06:36 , LuKreme krem...@kreme.com wrote: $ rsync --version rsync version 2.6.9 protocol version 29 (I did install rsync 3.1.1, same results) I have no problems rsync-ing files with German characters, but this is on Linux. I've noticed that it is built with iconv support, so maybe that's missing on your end(s)? No problems here under OS X 10.9.5. iconv and libiconv.2.dylib are present in /usr/bin and /usr/lib (it comes with OS X). -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync with 8bit file names?
Hello,
Guessing the source drive is formatted HFS+ or HFS+J. What is the file system
on the destination drive? I know that rsync is capable of correctly coping over
file and folder names on Mac OS X which contain non-ASCII characters. Hence my
question relating to the destination file system?
The following command should provide you with an answer :
diskutil info /Volumes/TV | grep File System Personality | awk -F File
System Personality: '{print $2}'
Maybe someone has a better way to work out the FileSystem volume which they can
share? Typically there are many ways to skin a cat and that some approaches are
more elegant than others.
This email is protected by LBackup, an open source backup solution
http://www.lbackup.org
On 12/09/2014, at 12:36 AM, LuKreme krem...@kreme.com wrote:
When trying to sync my TV folder to a mirror drive, episodes with non-ASCII
characters in them cannot be processed by rsync. Anything I can do about this?
For example, I get this:
building file list ...
file has vanished: /Volumes/TV/Raising Hope/Raising Hope - S04E01 -
De?\#201ja Vu Man.mkv
This is rsync under OS X:
$ rsync --version
rsync version 2.6.9 protocol version 29
Copyright (C) 1996-2006 by Andrew Tridgell, Wayne Davison, and others.
http://rsync.samba.org/
Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles,
inplace, IPv6, 64-bit system inums, 64-bit internal inums
I'd check macports, but since it's not been updated for 10.10 yet I'll need
to wait a while.
--
Passion is the pill you can swallow forever Taking them one by one One
by One --Agents of Good Roots Come On
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options:
https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync with 8bit file names?
Hello, Is the source Drobo a NAS or DAS unit? Also, I am guessing that the /Volumes/TV is the source for the rsync. Is it possible that the file has actually moved or been renamed? If the Drobo (hosted) volume is the source for the rsync command, then perhaps checking the file system format of that device is also worth while? Hope this helps. Perhaps someone else on the list has some ideas? I would suggest you consider compiling a recent version of rsync for your system. This should be quite straight forward on 10.10 (beta release). However, I must admit I have yet to try compiling rsync on 10.10 : http://www.lbackup.org/developer/rsync_hfs Finally, what is the actual command you are running. This information may shed some light on why the command is failing. Hope this helps. - This email is protected by LBackup, an open source backup solution. http://www.lbackup.org On 12/09/2014, at 12:40 PM, LuKreme krem...@kreme.com wrote: On 11 Sep 2014, at 16:22 , Henri Shustak henri.shus...@gmail.com wrote: Guessing the source drive is formatted HFS+ or HFS+J. The source drive is a Drobo. The destination is Journaled HFS+. -- 'I cannot! He has been kindness itself to me!' 'And you can be Death itself to him.' -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Backup scripts - recycling old backup directories
Folks, Kevin Korb wrote: Have you considered more advanced methods such as subvolume snapshots provided by ZFS and BTRFS? At work we were forced to abandon rsync - --link-dest because of the amount of time it takes to delete old backups when the data is primarily many millions of small files (shared web hosting company). We don't have more advanced methods like subvolume snapshots available to us. However, we can recycle backup directories. When we started using rsync with --link-dest back in about 2007, we deleted old backups, but realised soon after that we could recycle old backups. With daily backups, we find about 1.5% of the data and 0.5% of the files change from one day to the next, so a directory from about 5 days ago will typically be only 5-10% wrong and can be recycled to be the target of the latest directory - that's a lot better than recreating the whole directory tree for a new backup, and then deleting a whole old directory tree. We use --delete of course. Hope this helps someone. Rob. Dr Robert C. Bell HPC National Partnerships | Scientific Computing Information Management and Technology CSIRO T +61 3 9669 8102 Alt +61 3 8601 3810 Mob +61 428 108 333 robert.b...@csiro.aumailto:robert.b...@csiro.au | www.csiro.au | wiki.csiro.au/display/ASC/ Street: CSIRO ASC Level 11, 700 Collins Street, Docklands Vic 3008, Australia Postal: CSIRO ASC Level 11, GPO Box 1289, Melbourne Vic 3001, Australia PLEASE NOTE The information contained in this email may be confidential or privileged. Any unauthorised use or disclosure is prohibited. If you have received this email in error, please delete it immediately and notify the sender by return email. Thank you. To the extent permitted by law, CSIRO does not represent, warrant and/or guarantee that the integrity of this communication has been maintained or that the communication is free of errors, virus, interception or interference. Please consider the environment before printing this email. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
