error in IPC Code (code 14) at main.c(669) [receiver=2.6.9cvs]

2007-09-11 Thread Suresh Kumar Pedamallu
Hi,

I am using rsync 2.6.9 and recently I got a error with the setup. I
searched in the forums but I couldn't find much clues on this. Once I
restarted the rsync daemon and rerunning the job didn't gave any errors
further. I also tried to reproduce the issue for much details. But I
couldn't do that even after hours. 

 

The rsync log says 

 

opening tcp connection to 172.21.3.148 port 874

opening connection using --server --sender -vvulgtprxz --timeout=38400
--safe-links . job_27825 

receiving file list ... 

23 files to consider

rsync: pipe failed in do_recv: Too many open files (24)

rsync error: error in IPC code (code 14) at main.c(669)
[receiver=2.6.9cvs]  

 

 

If anybody has already faced similar kind error let me know what was the
issue and how this has been suppressed.

 

Regards,

Suresh

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: error in IPC Code (code 14) at main.c(669) [receiver=2.6.9cvs]

2007-09-11 Thread Wayne Davison
On Tue, Sep 11, 2007 at 03:41:48AM -0700, Suresh Kumar Pedamallu wrote:
 rsync: pipe failed in do_recv: Too many open files (24)

This is the error that caused the failure.  Your system had too many
open files on it for some reason, causing the pipe() system call to
fail.

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync include partial files in list to send?

2007-09-11 Thread brad miele

Hi,

I looked as best I could and didn't see my question addressed (which 
doesn't mean it isn't), so apologies if this is in a faq and i missed it.


i am hoping to use rsync with the --remove-sent-files option. the sending 
side of the transaction will very likely include files that are being 
written to when rsync is run. will rsync include these partial files in 
it's list? i want to avoid the copying of the partial files and obviously 
their removal from the source.


source system, is osx, remote is freebsd 6.x

best regards

Brad
-
Brad Miele
IPNstock.com
[EMAIL PROTECTED]
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync include partial files in list to send?

2007-09-11 Thread Matt McCutchen
On 9/11/07, brad miele [EMAIL PROTECTED] wrote:
 i am hoping to use rsync with the --remove-sent-files option. the sending
 side of the transaction will very likely include files that are being
 written to when rsync is run. will rsync include these partial files in
 it's list? i want to avoid the copying of the partial files and obviously
 their removal from the source.

Yes, unfortunately, rsync will send the partially written files and
delete them from the source.  This is one of several weaknesses in its
handling of concurrent modifications to the source.

If you can modify the program that is writing the files, I suggest you
have it write to a file with a temporary name (say ending with .tmp)
and then rename the file to the real name.  Then, tell rsync to
--exclude='*.tmp' and you'll be all set.

Matt
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Batch mode scenario (use case)

2007-09-11 Thread Suresh Govindachar
Matt wrote: 
Suresh Govindachar wrote:

 How about the following scheme?

   open /e/cmds/foo
   do till end-of-file:
   begin-continue

   discard lines till there is a match to some/path/projects/c_a

   keep lines till there is a match to a directory outside c_a
 Note that the lines being kept could be
 data/commands corresponding to files inside c_a

   end-continue
   end-do
   write kept lines to new batch file

 This is a clever idea, but I think it would be very difficult to
 subset the batch file correctly since the rsync protocol is quite
 complex (and binary).  For one thing, the new batch file would
 need to contain the protocol initialization and at least the
 relevant portion of the file list.  You might be able to
 accomplish this by keeping everything until the first file
 transfer is logged, but that won't work if the sender used
 incremental recursion because the relevant portion of the file
 list will be randomly interspersed with file transfers.
 
 If you need to restore a subtree from a batch file, another thing
 you could do is make a modified copy of rsync just for the job
 with a strncmp thrown in to skip all file transfers except the
 ones in the subtree.  Also, instead of a batch file, you might
 consider copying to a new destination with --compare-dest to the
 original; that gives you a tree of changed files from which you
 can easily restore files or subtrees.
  
  Thanks for pointing out --compare-dest:  I verified it on a test
  directory and this feature does indeed offer a resolution to the
  situation described in the original post.  

  (I have a follow up question which belongs to another thread.)

  --Suresh

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Verifying understanding of backup-dir vs compare-dest

2007-09-11 Thread Suresh Govindachar
Hello,

  Say one starts with creating an archive 

   rsync work - archive

  and periodically (below, i = 1 to N) does 
  
   rsync --backup-dir=a_i  work - archive
  and  rsync --compare-dest=archive  work - b_i

  Then suppose one wants to recover the work directory as it was at
  time k.

  Using the b_i directories, one would merely merge b_k with the
  archive directory.

  But using the a_i directories one would have to merge a_j with
  archive starting with j=N and going down sequentially to j=k.

  Is my understanding correct?  More importantly, I would like to
  know under what conditions and for what goals people use
  --backup-dir;  and likewise when and why do people use
  --compare-dest?
  
  Thanks,
  
  --Suresh 

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html