Re: Unable to rsync files of size 30 GB
Hi, I m using rsync on AIX 4.3 for backing up a huge database. Rsync gives error on bringing files greater than 2 GB. I tried the 64 bit version of Rsync 2.5.6 (on 64bit file system) also, but it didnt worked. Command i m giving is: rsync -avz --ignore-errors 10.10.10.10::backup /backupdir OUTPUT IS AS FOLLOWS (with error message) receiving file list ... done ./ 1 ABC.0.db2abc.NODE.CATN.20031012072506.001 write failed on ABC.0.db2abc.NODE.CATN.20031012072506.001 : Error 0 rsync error: error in file IO (code 11) at receiver.c(243) rsync: connection unexpectedly closed (182 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(165) I repeated command 2-3 times (to check for any network errors) and it always gave the error after bringing approximately 2 GB of data. The file size is 13GB. Machines on which i m running this command are RS 6000 with PowerPC Power 3 processors (4 CPU @ 350 MHz each) Memory is 2.5 GB (approx,.) Please help Thanks in advance Nitin Agarwal jw schultz wrote: > On Mon, Oct 13, 2003 at 02:34:00PM +0100, Andy Henson wrote: > > Rsync maps files into memory, so it cannot handle files larger than the > > program's address space. On 32 bit machines this is likely to be less > > than 2GB. > > > > You don't say what processor you are running on? Can it map files of > > bigger than 2GB into memory? > > Not true. It uses a rolling mapping that is actually done > by read not mmap for portability reasons. > > The most likely cause of his problems is an incorrect build > but since the error messages, version number and > command-lines were not provided i have no way to know why he > is having this problem. > > -- > > J.W. SchultzPegasystems Technologies > email address: [EMAIL PROTECTED] > > Remember Cernan and Schmitt > -- > To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html > > ---NOTICE-- > This E-mail (including the attachment/(s) if any ) has been scanned for viruses and > dangerous > content before delivering to your Mailbox. For more information please contact > Technical > Support Cell - Mumbai. [EMAIL PROTECTED] > --- -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
Yap... but these can be downloaded from net... all of them are available. [EMAIL PROTECTED] wrote: > You should perhaps also mention that the tools you refer to are part of the > Resource Kit and are not available as such in Windows. > > Kind regards, > > Bart Coninckx > Network Administrator > CNE, ASE > * > Sita ICT Services > Lilsedijk 19 > B-2340 Beerse > Belgium > > e-mail: [EMAIL PROTECTED] > Tel: + 32 (0) 14 62 28 22 > Fax: + 32 (0) 14 62 41 47 > > > Nitin Agarwal > <[EMAIL PROTECTED]>To: Dmitry >Melekhov <[EMAIL PROTECTED]> > Sent by: cc: >[EMAIL PROTECTED] > rsync-bounces+bart.coninckx=watco.be@listsSubject: >Re: rsync in cygwin as service > .samba.org > > > 11/02/2003 14:40 > Please respond to nitin.agarwal > > > > Hi! > U can try the following way > > 1) Make a directory called RSYNC and copy rsync.exe, supporting dll files > (cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory > 2) now go to dos prompt .. (c:\rsync) and give command "instsrv "Rsync" > c:\rsync\srvany.exe" > 3) this will install the service in win2k... > 4) now u need to give all parameters in services in control panel...for > running it > in daemon. > > Nits. > > Dmitry Melekhov wrote: > > > Hello! > > > > I want to start rsync on w2k as service. > > > > If I try to start rsync from command line it simply do nothig: > > > > $ rsync --daemon > > > > Administrator@dm-w2ks /usr/bin > > > > $ ps > >PIDPPIDPGID WINPID TTY UIDSTIME COMMAND > >480 1 480480 con 500 04:15:03 /usr/bin/bash > > 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps > > > > Administrator@dm-w2ks /usr/bin > > > > So I'm trying to set it as service: > > > > C:\cygwin\bin>cygrunsrv -I "RSYNC" -d "Rsync" -p /bin/rsync.exe -a > > "--daemon --n > > o-detach" > > > > C:\cygwin\bin>cygrunsrv -S "RSYNC" > > cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error > 1062: > > The service has not been started. > > > > And I see in event log: > > > > The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found. > > The local computer may not have the necessary registry information or > > message DLL files to display messages from a remote computer. The > > following information is part of the event: RSYNC : Win32 Process Id = > > 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed: > > signal 11 raised. > > > > $ rsync --version > > rsync version 2.5.5 protocol version 26 > > > > Any ideas? > > > > Thank you! > > > > -- > > To unsubscribe or change options: > http://lists.samba.org/mailman/listinfo/rsync > > Before posting, read: > http://www.tuxedo.org/~esr/faqs/smart-questions.html > > -- > To unsubscribe or change options: > http://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html > > -- > To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
Hi! U can try the following way 1) Make a directory called RSYNC and copy rsync.exe, supporting dll files (cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory 2) now go to dos prompt .. (c:\rsync) and give command "instsrv "Rsync" c:\rsync\srvany.exe" 3) this will install the service in win2k... 4) now u need to give all parameters in services in control panel...for running it in daemon. Nits. Dmitry Melekhov wrote: > Hello! > > I want to start rsync on w2k as service. > > If I try to start rsync from command line it simply do nothig: > > $ rsync --daemon > > Administrator@dm-w2ks /usr/bin > > $ ps >PIDPPIDPGID WINPID TTY UIDSTIME COMMAND >480 1 480480 con 500 04:15:03 /usr/bin/bash > 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps > > Administrator@dm-w2ks /usr/bin > > So I'm trying to set it as service: > > C:\cygwin\bin>cygrunsrv -I "RSYNC" -d "Rsync" -p /bin/rsync.exe -a > "--daemon --n > o-detach" > > C:\cygwin\bin>cygrunsrv -S "RSYNC" > cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error 1062: > The service has not been started. > > And I see in event log: > > The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found. > The local computer may not have the necessary registry information or > message DLL files to display messages from a remote computer. The > following information is part of the event: RSYNC : Win32 Process Id = > 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed: > signal 11 raised. > > $ rsync --version > rsync version 2.5.5 protocol version 26 > > Any ideas? > > Thank you! > > -- > To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Win32 Version?
I dont think so.. because problem is not coming in service. In the service manager control box, rsync service is running, but problem comes only once i log off from the server. And as i mentioned in previous mails, the rsync.exe process is also terminated after i log off. This may be something to do with version... (i m using 2.1.1 and Bart told me that he is having no problems with version 2.5.5) Further i studied the problem, and concluded that this kind of problem always comes when the application is not using any Console event handler (via SetConsoleCtrlHandler) to ignore CTRL_LOGOFF_EVENT event. This problem could have been addressed in further releases. Thanks and Regards Nitin Agarwal Max Bowsher wrote: > Nitin Agarwal <[EMAIL PROTECTED]> wrote: > > > Hi > > I have used the rsync.exe (precompiled binary) from the net. > > I installed rsync as service in Windows NT server using SRVANY and > > INSTSRV. > > I don't know whether it makes any difference or not, but if your rsync.exe > is Cygwin-based (and it must be, because there is no native Windows port), > then using Cygwin's own service tool (cygrunsrv) is probably a good idea. > > Max. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Win32 Version? MODIFICATION NEEDED
Hi!! There is one programming consideration which need to be programmed in RSYNC for Windows.. PROBLEM Whenever Rsync is installed as service on Windows Platform, the rsync application gets terminated while logging off the server. POSSIBLE SOLUTION - An Event Handler should be added in Rsync for windows binaries.: following is the explanation for that: For WIN32 applications (i.e. Rsync): when the currently logged-in user is logging-off, all Console applications receive a CTRL_LOGOFF_EVENT event from the Console. If your Console application has registered a Console event handler (via SetConsoleCtrlHandler), it must ignore CTRL_LOGOFF_EVENT in order to survive the logoff. _ Can we expect some help on this regard? Thanks in Advance Nitin Agarwal -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re:
Thanks for all the suggestions u gave... After reading your mail and the site address that u had given, i feel that there is NO WAY for installing Rsync as Service (as per the standards given by MS) as of now. I strongly support your proposal for rewriting Rsync for Windows Platforms (not necessarily for 98 or similar versions but for NT based platforms) in order to run the same as service or to have some module which can assist the same. Please let me know if i can be a contributor for the same (having in depth knowledge of Networking protocols and standards). Thanks Nitin Agarwal [EMAIL PROTECTED] wrote: Howdy... I guess I was clear enough before on the topic, as you had to stretch your mind to see the underlying problem, which I briefly touched upon. The basic problem is that you have an application that is not a Windows Service, but rather has been entered into the Windows registry through the utilities that you have used, such that it looks like a Windows service. Here is the URL for NT Services, which you may find helpful in developing a better understanding of what a service is in Windows: http://msdn.microsoft.com/library/default.asp?url="/library/en-us/vbcon/html/vbconCreatingNTServiceApplications.asp In this discussion, you will notice that it references the use of templates which reference the appropriate classes, namespaces, setting up the inheritence from the base class, and more automatically service applications. In your case, you appear to be using utilities that allows you to install an application into the Microsoft Services, but this does not make it a service, per se, as it does not conform to the standards by which Microsoft has specified for designing services for its platform. My proposal is to rewrite rsync for Windows 98, ME, NT, 2000, XP, and .NET, such that it conforms to the standards for a service under the Microsoft platform, as specified by Microsoft. I have all of the current platforms from Microsoft, excluding Windows 95, in addition to the support SDKs for each platform, in addition to Microsoft Visual Studio 6.0 Professional, Microsoft Visual Studio 6.0 Enterprise, and Microsoft Visual Studio .NET Enterprise Architect.
Re: Win32 Version?
Hi I have used the rsync.exe (precompiled binary) from the net. I installed rsync as service in Windows NT server using SRVANY and INSTSRV. Further whenever i logoff and logon again, and go to services windows, I still see RSYNC service as running. (whereas as soon as i logoff, the rsync daemon on this server stops working.) I checked the application (rsync.exe) using TASK Manager... it was running prior to logging off, but is not running after I logoff and logon again. I have analysed it like: whenever I log off, all the applications are also closed, hence closing rsync.exe as well., and if I can prevent this application to be closed when I log off, I am done. Please Suggest! Thanks Nitin Agarwal [EMAIL PROTECTED] wrote: > Howdy... > > I am going to take a stab at this in regards to the problems that you are > experiencing. > > I am going under the presumption that the source code was compiled to an EXE > using the GNU-WIN compiler. This is the same source code that is used for > Unix, Linux, or any one of number of different platforms, and was designed > to be platform independent. > > Under that presumption, the EXE is NOT a Windows Service, as it makes no > calls to the Windows API, whereby it registers itself as a service. > Otherwise, it would be platform specific, and thereby could not be compiled > on a different platform without modification. > > I am not sure how you are determining that rsync is still running, but it > would be my guess that you are logging into the machine locally, and > checking in that manner. If this is the case, there are utilities that are > much better at checking remote processes that are not furnished by > Microsoft. > > Richard -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Win32 Version?
Hi Everybody! We are using Rsync on NT/2000 platform to backup files from NT to NT and NT to Unix Platforms. There is one problem (could be a bug in cygwin) which i m facing. The problem is described below: Rsync services run well till the time the server is logged off (i.e... Server is switched on... booted... logon screen comes ... rsync workes well then we logon to the serverrsync works well. then as soon as we logoff from the server. rsync HANGS!!) After this, we have to restart the service. (Although Rsync service shows as running and no error events in event viewer as well) i have tried many possibilities but no success... please help. Thanks in Advance Nitin Agarwal [EMAIL PROTECTED] wrote: > We use Rsync on NT very intensively. In fact, right now I backup about 25 > servers across WAN-links with the lates version of Rsync. You can compile > it yourself to a Win32 binary by using the incredible Cygwin utilities > (www.cygwin.com). > > Rgds, > > Bart Coninckx > Network Administrator > CNE, ASE > * > Watco ICT Services > Lilsedijk 19 > B-2340 Beerse > Belgium > > e-mail: [EMAIL PROTECTED] > Tel: + 32 (0) 14 60 99 42 > Fax: + 32 (0) 14 62 41 47 > * > > > <[EMAIL PROTECTED] > et> To: <[EMAIL PROTECTED]> > Sent by: cc: > rsync-admin@listsSubject: Win32 Version? > .samba.org > > > 10/25/2002 07:27 > > > > Howdy... > > I have searched the archives, and even read what has been posted on the > site regarding a Win32 port of rsync. Though I have found a problem with > everything. The URLs for building your own, or downloading the compiled > binaries for the Win32 platform are no longer valid. Therein the problem > lies, as the information is outdated, and still easily available on the > site publicly. > > I imagine there are a few, and I mean a spare few, that are still using > Windows 95, but most have moved onto either Windows 98, Windows ME, Windows > NT 4.0, Windows 2000, Windows XP, or Windows .NET, but not necessarily to > Unix, Linux, Solaris, AIX, or other non-Microsoft platform. > > I have downloaded the source code, and though I have not had a chance in > which to look over it thoroughly, I hope to eventually develop enough > familiarity so that I can port it over to the Win32, Win64, and .NET > platforms. > > I know some of you may think that I am off my rocker when I mention the > Win64 platform, but what you don't know is that Microsoft now has a 64-bit > version of Windows XP, which can address 16 terabytes > (18,446,744,073,709,551,616 bytes) of memory. I am just not sure if they > have released it yet for purchase, but I do have authorized access to it, > along with its support/diagnostic utilities. > > Now here is my question/suggestion... > > What is the current interest in a port of rsync to the Microsoft Windows > platform? > > Is anyone interested in helping port rsync to the Microsoft Windows > platform? > > I have a currently active Universal MSDN subscription, which includes > Visual Studio 6.0 Enterprise, and Visual Studio .NET Enterprise Architect, > and would be willing to provide any resources I have to this project if > there is enough interest. In addition to this, I also have the Catalyst > SocketTools Enterprise Edition library, should it be needed. > > For those who are interested, I would prefer an off-list reply, otherwise I > may miss the message as it passes through my e-mail filters, and is placed > in a different folder. > > Richard > > -- > To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Rsync from Windows to Windows
Hi.. Can anybody please help me in configuring RSYNC to copy files from WINDOWS NT to WINDOWS NT Thanks Nitin -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Rsync from WinNT to UNIX Box
Dear All... I want to transfer the files and directories FROM WinNT to UNIX box. I have downloaded rsync211.exe and Cygwin.dll and am successfull in running rsync211 (i mean when i type rsync211 on DOS prompt, it works... and shows me list of options). Can anybody please tell me how to go next I am totally lost. I am already using rsync between two Unix Boxes. Please help... Thanks n Regards Nitin Agarwal -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: --include option
Hi Leaw
Follow the following steps
1) Make the file "includelist" and "excludelist" in any directory for example
in: /rs/
2) Make entries of all the Directories as follows in "includelist" (the files to
be included)
clock_speed
dir1
dir4
dir5
3) Make entries of all the Directories as follows in "excludelist" (the files to
be excluded)
dir2
dir3
dir6
I tried * in this case.. but this excludes all.. because include and exclude
works in conjunction.
4) give the command as: "rsync -avz --progress --include-from=/rs/includelist
--exclude-from=/rs/excludelist ... rest command follows..
please let me know the result after running this way...
Nitin
"Leaw, Chern Jian" wrote:
> Hi Nitin,
>
> How should I include the patterns to be included for the
> --include-from=include_list? I've tried the method suggested from Wayne, but
> could not work.
>
> I've also tried having the --exclude-from=exclude-list in use together with
> the --include-from=include_list, but seems to me that the
> --exclude-from=exclude_list is doing the trick in excluding those dirs/files
> and hence transferring the remaining files over. This seems true when I
> excluded the --exclude-from=exclude-list option, and only have the
> --include-from=include_list specified, it ended up transferring the entire
> files across.
>
> I tried having the following for the file to be specified in the
> --include-from option:
> > + /*/clock_speed
> > + /*/fub_layout
> > - /*
> >
> > AND
> > + circuit_design/clock_speed
> > + circuit_design/fub_layout
> > - /*
> >
> > AND
> > + /stor/circuit_design/clock_speed
> > + /stor/circuit_design/fub_layout
> > - /*
> >
> AND
> > + /clock_speed
> > + /fub_layout
> > - /*
>
> Could you please help me out?
>
> Thanks.
>
> -Original Message-
> From: Nitin Agarwal [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, August 14, 2002 3:49 PM
> To: Leaw, Chern Jian
> Cc: 'Wayne Davison'; '[EMAIL PROTECTED]'
> Subject: Re: --include option
>
> Rather u can make two files, name the first one as includelist and second
> one as
> exclude list.
> Make entries of all the files u want to include in rsync in file
> "includelist" and
> entries of files to be excluded in "excludelist".
>
> then give the command:
> rsync -avz .. --include-from=includelist --exclude-from=excludelist
> ...rest command continues
>
> This will work well..
>
> If anybody has faced any problems in doing the synchronisation this way,
> please let
> me know, so that i can be prepared for them..
>
> :-)
>
> Nits
>
> "Leaw, Chern Jian" wrote:
>
> > Hi Wayne,
> >
> > I tried your suggestion, but did not work. It still copied the entire
> > filesystem across to the destination machine.
> > I tried having the following:
> > + /*/clock_speed
> > + /*/fub_layout
> > - /*
> >
> > AND
> > + circuit_design/clock_speed
> > + circuit_design/fub_layout
> > - /*
> >
> > AND
> > + /stor/circuit_design/clock_speed
> > + /stor/circuit_design/fub_layout
> > - /*
> >
> > Could you explain to me the idea of having the +, -, and /* ? Do the
> number
> > of /* indicate the subdirectory levels before arriving at the directory to
> > include?
> >
> > The other alternative you suggested below works well:
> > rsync -avz /stor/circuit_design/{clock_speed,fub_layout}
> > mickey.willowglen.com:/stor/circuit_design/
> >
> > But I would like to have these include list into a file, as I'd be having
> > many other sub-directories to include, yet exclude.
> >
> > Appreciate it if you could help me out.
> >
> > Thanks.
> >
> > -Original Message-
> > From: Wayne Davison [mailto:[EMAIL PROTECTED]]
> > Sent: Tuesday, August 13, 2002 12:57 AM
> > To: Leaw, Chern Jian
> > Cc: '[EMAIL PROTECTED]'
> > Subject: Re: --include option
> >
> > On Mon, 12 Aug 2002, Leaw, Chern Jian wrote:
> > > # rsync -avz --include-from=files_included /stor/circuit_design/
> > > mickey.willowglen.com:/stor/circuit_design/
> >
> > The problem with your command is that it contains include directives but
> > no exclusions, so nothing limits the default operation of sending the
> > entire subdirectory contents. An easier way to go for this specific
> > problem is to ignore includes and specify two source dirs, like this:
> >
> >
Re: --include option
Rather u can make two files, name the first one as includelist and second one as
exclude list.
Make entries of all the files u want to include in rsync in file "includelist" and
entries of files to be excluded in "excludelist".
then give the command:
rsync -avz .. --include-from=includelist --exclude-from=excludelist
...rest command continues
This will work well..
If anybody has faced any problems in doing the synchronisation this way, please let
me know, so that i can be prepared for them..
:-)
Nits
"Leaw, Chern Jian" wrote:
> Hi Wayne,
>
> I tried your suggestion, but did not work. It still copied the entire
> filesystem across to the destination machine.
> I tried having the following:
> + /*/clock_speed
> + /*/fub_layout
> - /*
>
> AND
> + circuit_design/clock_speed
> + circuit_design/fub_layout
> - /*
>
> AND
> + /stor/circuit_design/clock_speed
> + /stor/circuit_design/fub_layout
> - /*
>
> Could you explain to me the idea of having the +, -, and /* ? Do the number
> of /* indicate the subdirectory levels before arriving at the directory to
> include?
>
> The other alternative you suggested below works well:
> rsync -avz /stor/circuit_design/{clock_speed,fub_layout}
> mickey.willowglen.com:/stor/circuit_design/
>
> But I would like to have these include list into a file, as I'd be having
> many other sub-directories to include, yet exclude.
>
> Appreciate it if you could help me out.
>
> Thanks.
>
> -Original Message-
> From: Wayne Davison [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, August 13, 2002 12:57 AM
> To: Leaw, Chern Jian
> Cc: '[EMAIL PROTECTED]'
> Subject: Re: --include option
>
> On Mon, 12 Aug 2002, Leaw, Chern Jian wrote:
> > # rsync -avz --include-from=files_included /stor/circuit_design/
> > mickey.willowglen.com:/stor/circuit_design/
>
> The problem with your command is that it contains include directives but
> no exclusions, so nothing limits the default operation of sending the
> entire subdirectory contents. An easier way to go for this specific
> problem is to ignore includes and specify two source dirs, like this:
>
> rsync -avz /stor/circuit_design/{clock_speed,fub_layout}
> mickey.willowglen.com:/stor/circuit_design/
>
> The above assumes your shell has {} expansion, like bash and zsh. If it
> does not, just mention both directories separately (without any trailing
> slash). The trailing slash on the destination isn't required, but it
> doesn't hurt either, so I left it in.
>
> To make things work with your include-using command, you'd need to use
> something like this in your include file:
>
> + /clock_speed
> + /fub_layout
> - /*
>
> This allows the two directories you want, and excludes everything else
> in the base directory of the transfer. Since none of the rules apply to
> files deeper than the base dir, none of them will be excluded.
>
> ..wayne..
> --
> To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
How to rsync selective subdirectories
Hi My directory structure is something like following: List of files in /abc/dir/ 20020811 20020812 20020814 20020815 (where directory name above is the date, and daily changes i.e. directories are added and deleted) list of files in /abc/dir/20020811 toid toil etd dt (all the date directories contain the directories as above and there are many subdirectories in the aboce directories) I want to rsync all the dates directories but only the "toid" subdirectory. MY QUESTION IS: How can i rsync only the selected subdirectories? Please help in this matter... Thanks Nitin -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Error in Rsync.. Value too large
Hi David, We are not operating on Windows... we are using rsync on AIX 4.3. We are able to transfer the files which are less then 30 GB successfully. Thanks Nitin Agarwal David Starks-Browning wrote: > On Friday 28 Jun 02, Nitin Agarwal writes: > > Hi... > > > > I am encountering the following error while syncing the data > > > > error message is: "send_files failed to open > > abcdata1/PABCBTABD.container000 : Value too large to be stored in data > > type" > > > > Size of the files for which the error is coming are: 31 GB, 35 GB, 40 > > GB, 52 GB, and 59 GB each. > > You aren't dealing with these large files on Windows, are you? Cygwin > does not support large files (>2GB?). > > David -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Error in Rsync.. Value too large
Hi... I am encountering the following error while syncing the data error message is: "send_files failed to open abcdata1/PABCBTABD.container000 : Value too large to be stored in data type" Size of the files for which the error is coming are: 31 GB, 35 GB, 40 GB, 52 GB, and 59 GB each. Please help I will be highly thankful to you. Thanks & Regards Nitin Agarwal
Re: [Fwd: Re: meaning of "IO Error: skipping the delete...."]]
Dear Mr. Rusty, Today I recd one more error while running rsync: "Unexpected EOF in read_timeout" Further, as I told u our data is very huge (i.e. 100 GB), and it consists of large no. of files and not few files of large sizes. Kindly advice. Regards Nitin Agarwal Rusty Carruth wrote: > Nitin Agarwal <[EMAIL PROTECTED]> wrote: > > Dear Mr. Rusty, > > Thanks for the reply. The problem was sorted out by changing the uid option in > > rsyncd.conf file to root. > > We are facing two more problem now > > 1) while transferring the files, sometimes the transfer breaks in between and gives > > us the error message: "readerror: connection reset by peer" > > I know that there's a patch someone submitted a while back that > may (or may not) fix that one. I don't remember where it is, so I'm > sending this to the list also in hopes that this will jog someone's memory ;-) > > > 2) sometimes it shows error message: "Erroring writing 4092 bytes - exiting". > > It may be related to (1) above (that's what I'd guess first, anyway). > Again, hopefully someone on the list (probably the patch author) will chime > in with the info. > > > Thanks & Regards > > > > We are having a large file system (approx. 100 GB). > > Oh - now that's an interesting fact. Do you perhaps have LOTS of little > files, or a few really big files? I recall that there's a possible issue > of one side deciding that the other side had gone away because that other > side was busy calculating and did not reply in time. There's a timeout > value somewhere that you can make longer that may fix the problem also - > I'd try that first. Unfortunately I'm not sure of the name of the config > option - check the documents and also look in the config file itself... > > > Regards > > Nitin Agarwal > > Hope this helps! > > rc
Error in RSYNC
Dear Sir, We encountered one more error while running 'rsync' on our data. The error is : "Erroring writing 4092 bytes - exiting" Kindly let us know the reason and solution for the same. Thanks & Regards Nitin Agarwal
One More error in RSYNC
Dear Mr. Martin, We encountered one more error while running 'rsync' on our data. The error is : "Erroring writing 4092 bytes - exiting" Kindly let us know the reason and solution for the same. Thanks & Regards Nitin Agarwal
Re: meaning of "IO Error: skipping the delete...."
Dear Mr. Martin, Thanks for the replies. Our problems are sorted out upto an extend. We are facing one more problem i.e. while transferring the files, sometimes the transfer breaks in between and gives us the error message: readerror: connection reset by peer We are having a large file system (approx. 100 GB). Kindly let us know the reason behind this. Regards Nitin Agarwal Martin Pool wrote: > On 25 Jan 2002, Nitin Agarwal <[EMAIL PROTECTED]> wrote: > > Dear Mr. Martin, > > Thanks for the reply. > > We tried as per your advice. Now, its not showing us any errors. > > > > But, we observed that while copying the files from the main server to the backup > > machine, rsync is changing the file names of those files having last extension as >any > > single digit integer (e.g. ".3", ".2", ".1"). While copying it shows us copying the > > file with name "12345.1234554321.3" to the destination as "12345.1234554321.0003". > > i.e. it is adding "000" to the extension. > > This is very strange behaviour. I cannot at the moment think of any > aspect of rsync that would cause it to manipulate the filenames in > this way. > > What operating system and what version of rsync are you using? > > Can you please find a minimal set of instructions that recreate the > problem: in other words, the commands to run to create files with the > names that are causing problems, and then the rsync command that > copies them. > > -- > Martin
[Fwd: Re: meaning of "IO Error: skipping the delete...."]]
Hi, I am doing the testing over this. As soon as the error will repeat, I will send u a snapshot of the same, and the command i used that time. Right now, we are facing another problem, it is showing the following error: "send_files failed to open dir1/dir2/dir3/abcde.eps : permission denied" Kindly let us know the reason. Thanks & Regards Nitin Agarwal Martin Pool wrote: > On 25 Jan 2002, Nitin Agarwal <[EMAIL PROTECTED]> wrote: > > Dear Mr. Martin, > > Thanks for the reply. > > We tried as per your advice. Now, its not showing us any errors. > > > > But, we observed that while copying the files from the main server to the backup > > machine, rsync is changing the file names of those files having last extension as >any > > single digit integer (e.g. ".3", ".2", ".1"). While copying it shows us copying the > > file with name "12345.1234554321.3" to the destination as "12345.1234554321.0003". > > i.e. it is adding "000" to the extension. > > This is very strange behaviour. I cannot at the moment think of any > aspect of rsync that would cause it to manipulate the filenames in > this way. > > What operating system and what version of rsync are you using? > > Can you please find a minimal set of instructions that recreate the > problem: in other words, the commands to run to create files with the > names that are causing problems, and then the rsync command that > copies them. > > -- > Martin
Re: meaning of "IO Error: skipping the delete...."
Hi, I am doing the testing over this. As soon as the error will repeat, I will send u a snapshot of the same, and the command i used that time. Right now, we are facing another problem, it is showing the following error: "send_files failed to open dir1/dir2/dir3/abcde.eps : permission denied" Kindly let us know the reason. Thanks & Regards Nitin Agarwal Martin Pool wrote: > On 25 Jan 2002, Nitin Agarwal <[EMAIL PROTECTED]> wrote: > > Dear Mr. Martin, > > Thanks for the reply. > > We tried as per your advice. Now, its not showing us any errors. > > > > But, we observed that while copying the files from the main server to the backup > > machine, rsync is changing the file names of those files having last extension as >any > > single digit integer (e.g. ".3", ".2", ".1"). While copying it shows us copying the > > file with name "12345.1234554321.3" to the destination as "12345.1234554321.0003". > > i.e. it is adding "000" to the extension. > > This is very strange behaviour. I cannot at the moment think of any > aspect of rsync that would cause it to manipulate the filenames in > this way. > > What operating system and what version of rsync are you using? > > Can you please find a minimal set of instructions that recreate the > problem: in other words, the commands to run to create files with the > names that are causing problems, and then the rsync command that > copies them. > > -- > Martin
