error in IPC Code (code 14) at main.c(669) [receiver=2.6.9cvs]
Hi, I am using rsync 2.6.9 and recently I got a error with the setup. I searched in the forums but I couldn't find much clues on this. Once I restarted the rsync daemon and rerunning the job didn't gave any errors further. I also tried to reproduce the issue for much details. But I couldn't do that even after hours. The rsync log says opening tcp connection to 172.21.3.148 port 874 opening connection using --server --sender -vvulgtprxz --timeout=38400 --safe-links . job_27825 receiving file list ... 23 files to consider rsync: pipe failed in do_recv: Too many open files (24) rsync error: error in IPC code (code 14) at main.c(669) [receiver=2.6.9cvs] If anybody has already faced similar kind error let me know what was the issue and how this has been suppressed. Regards, Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: error in IPC Code (code 14) at main.c(669) [receiver=2.6.9cvs]
On Tue, Sep 11, 2007 at 03:41:48AM -0700, Suresh Kumar Pedamallu wrote: rsync: pipe failed in do_recv: Too many open files (24) This is the error that caused the failure. Your system had too many open files on it for some reason, causing the pipe() system call to fail. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync include partial files in list to send?
Hi, I looked as best I could and didn't see my question addressed (which doesn't mean it isn't), so apologies if this is in a faq and i missed it. i am hoping to use rsync with the --remove-sent-files option. the sending side of the transaction will very likely include files that are being written to when rsync is run. will rsync include these partial files in it's list? i want to avoid the copying of the partial files and obviously their removal from the source. source system, is osx, remote is freebsd 6.x best regards Brad - Brad Miele IPNstock.com [EMAIL PROTECTED] -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync include partial files in list to send?
On 9/11/07, brad miele [EMAIL PROTECTED] wrote: i am hoping to use rsync with the --remove-sent-files option. the sending side of the transaction will very likely include files that are being written to when rsync is run. will rsync include these partial files in it's list? i want to avoid the copying of the partial files and obviously their removal from the source. Yes, unfortunately, rsync will send the partially written files and delete them from the source. This is one of several weaknesses in its handling of concurrent modifications to the source. If you can modify the program that is writing the files, I suggest you have it write to a file with a temporary name (say ending with .tmp) and then rename the file to the real name. Then, tell rsync to --exclude='*.tmp' and you'll be all set. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Batch mode scenario (use case)
Matt wrote: Suresh Govindachar wrote: How about the following scheme? open /e/cmds/foo do till end-of-file: begin-continue discard lines till there is a match to some/path/projects/c_a keep lines till there is a match to a directory outside c_a Note that the lines being kept could be data/commands corresponding to files inside c_a end-continue end-do write kept lines to new batch file This is a clever idea, but I think it would be very difficult to subset the batch file correctly since the rsync protocol is quite complex (and binary). For one thing, the new batch file would need to contain the protocol initialization and at least the relevant portion of the file list. You might be able to accomplish this by keeping everything until the first file transfer is logged, but that won't work if the sender used incremental recursion because the relevant portion of the file list will be randomly interspersed with file transfers. If you need to restore a subtree from a batch file, another thing you could do is make a modified copy of rsync just for the job with a strncmp thrown in to skip all file transfers except the ones in the subtree. Also, instead of a batch file, you might consider copying to a new destination with --compare-dest to the original; that gives you a tree of changed files from which you can easily restore files or subtrees. Thanks for pointing out --compare-dest: I verified it on a test directory and this feature does indeed offer a resolution to the situation described in the original post. (I have a follow up question which belongs to another thread.) --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Verifying understanding of backup-dir vs compare-dest
Hello, Say one starts with creating an archive rsync work - archive and periodically (below, i = 1 to N) does rsync --backup-dir=a_i work - archive and rsync --compare-dest=archive work - b_i Then suppose one wants to recover the work directory as it was at time k. Using the b_i directories, one would merely merge b_k with the archive directory. But using the a_i directories one would have to merge a_j with archive starting with j=N and going down sequentially to j=k. Is my understanding correct? More importantly, I would like to know under what conditions and for what goals people use --backup-dir; and likewise when and why do people use --compare-dest? Thanks, --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html