Re: Rsync help
> SUN box, 2gig ram, hard drive space to spare. Rsync 2.5.5, solaris 5.7
> version 7.
> Half moon, I think it only seems to work on full moon nights.
>
> Here's the command I run as well .
> /usr/local/bin/rsync --delete --partial -P -p -z -e /usr/local/bin/ssh /dir1
> systemname:/storage
>
> [snip]
>
> > I get the following transering a large file use rsync over ssh.
> >
> > root@pbodb bin$ ./ausbk.sh
> > building file list ...
> > 10 files to consider
> > ERROR: out of memory in generate_sums
> > rsync: connection unexpectedly closed (8 bytes read so far)
> > rsync error: error in rsync protocol data stream (code 12) at io.c(150)
How big are the files you are trying to rsync? It is probably failing
here:
if (verbose > 3)
rprintf(FINFO,"count=%d rem=%d n=%d flength=%.0f\n",
s->count,s->remainder,s->n,(double)s->flength);
s->sums = (struct sum_buf *)malloc(sizeof(s->sums[0])*s->count);
if (!s->sums) out_of_memory("generate_sums");
sizeof(s->sums[0]) is at least 32, and s->count is ceil() of file size
divided by the block size (default is 700). So this malloc should be
around 5% of the largest file size (eg: approx 500MB for a 10GB file).
If VM is tight on your machine (you say it is intermittent) then this
might fail.
You could try - and see what the previous rprintf() shows --
unfortunately inside the loop below it also prints every checksum
when verbose > 3 so you will get a huge amount of output; just
tailing the output should be enough.
A solution is to increase the block size (eg --block-size=4096), which
reduces the malloc() needs proportionally.
Craig
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
RFE: using rsync as a backup tool (preserve access time & compress destination files) ?
Hi, I know those questions have been asked before but that was more than an year ago. I'm hoping the situation has evolved now. I'd like to use rsync as a backup tool to move around some data. I often have to move hundreds of GB, and that takes some time. I'd like to use rsync so that if something happens, I can restart the migration without loosing what has already been transfered. But I noticed that every time I use rsync to backup some data, it "corrupts"/updates the access time of the source file. All the backup tools I've previously used preserve the access time (otherwise, you'll loose your access time if you backup everyday). Gnu tar has a "--atime-preserve". I use both the access time (last read) & modification time (last write) to identify which files to remove from the fast file server. (I've written a tiny perl script to identify which files are "old"). I wish there was an rsync option to preserve access times (sce & dst). I would also be delighted if there was another option that would allow to compress/gzip/bzip files on the destination. I believe that by having almost same filename -> filename.gz, and having all times (A, C, M) identical, would be sufficient for a match ? Why compressing files ? it's the best trade-off between ease of use and compression. having no compression at all for old files leads to waste of space (even on a cheap slow file server). Compressing everyfile into a big tarfile makes it difficult to browse a huge archive (I don't know of a "tar shell"). Keeping the directories uncompressed allows for browsing the data easily. please ? Thanks in advance, --Gilles-Eric DESCAMPS
Re: configuration question.
The only way you could give someone shell access and keep them from using rsync would be to find a way to prevent their access to any rsync binary through that shell. Frankly, if they're already in, and can read these files as themselves, you gain nothing from preventing their use of a single application, as they can 'rsh host cat /etc/passwd', 'rsh host "cd /;tar -cf - ." |dd of=everythingonremotehost.tar', rlogin to the host and just poke around, whatever. If this is a problem, then SHUT OFF RSH ACCESS oh, and if your network is not secure, that is, in fact, a problem. if you don't want people looking at stuff, don't let them have shell access. If they can't get access to anything on the system except through your rsync daemon (I'm assuming the rsyncd.conf you referenced before is in /etc, and you started rsync either by typing 'rsync --daemon' or by appropriate setup of inetd), you can use the rsyncd.conf to define exactly what they can and cannot access. If they can rsh, or even telnet, to the system, they can already read whatever they want. Tim Conway [EMAIL PROTECTED] reorder name and reverse domain 303.682.4917 office, 303.921.0301 cell Philips Semiconductor - Longmont TC 1880 Industrial Circle, Suite D Longmont, CO 80501 Available via SameTime Connect within Philips, caesupport2 on AIM "There are some who call me Tim?" "Armin Safarians" <[EMAIL PROTECTED]> 10/29/2002 03:23 PM To: Tim Conway/LMT/SC/PHILIPS@AMEC cc: Subject:Re: configuration question. Classification: Thank you for the informatoin. That is exactly what I was looking for. So what I'm to understand is you can get someone shell access but not rsync ability? AMS :-) [EMAIL PROTECTED] wrote: >Your users have rsh access to the machine, and are getting wherever they >want, using the server:/path syntax. >if they were using the server::module syntax, they would be restricted to >only what's provided by the modules. If you don't want them getting >everything all over the system, you will need to prevent shell access. > >Tim Conway >[EMAIL PROTECTED] reorder name and reverse domain >303.682.4917 office, 303.921.0301 cell >Philips Semiconductor - Longmont TC >1880 Industrial Circle, Suite D >Longmont, CO 80501 >Available via SameTime Connect within Philips, caesupport2 on AIM >"There are some who call me Tim?" > > > > >"Armin Safarians" <[EMAIL PROTECTED]> >Sent by: [EMAIL PROTECTED] >10/29/2002 01:11 PM > > >To: [EMAIL PROTECTED] >cc: (bcc: Tim Conway/LMT/SC/PHILIPS) >Subject:configuration question. >Classification: > > > >How do you restrict rsync transfers to only modules in the configuration >file? >It seems like even though I have a module configured, users can transfer >files >that they had permission to which is not under the directory of the >module. > >I.E. >modulename >path=/web >... >... >... > >Users can get /etc/passwd from this machine. How do I restrict that. > > >Thanks, >AMS > > > > -- Armin M. Safarians Safeway Inc. VOICE: 925.944.4246 EMAIL:[EMAIL PROTECTED] We all stand poised on the brink of greatness "WorldSecure Server " made the following annotations on 10/29/02 15:23:29 -- Warning: All e-mail sent to this address will be received by the Safeway corporate e-mail system, and is subject to archival and review by someone other than the recipient. This e-mail may contain information proprietary to Safeway and is intended only for the use of the intended recipient(s). If the reader of this message is not the intended recipient(s), you are notified that you have received this message in error and that any review, dissemination, distribution or copying of this message is strictly prohibited. If you have received this message in error, please notify the sender immediately. == -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
RE: important caveat with Rsync on NT and dayligt savings time
Howdy... I have a printout of the manpage, and the -t states to transfer the modificaiton time along with the file. This is to place the same modication time on the file when it is transferred, rather than the current time. The easiest way to get around this issue is to use the -c or --checksum option. This instructs rsync to EXPLICITLY check the checksum against both, and if they are the same, teh file is skipped. Note, this DOES increase the transfer time, as the 128-bit MD4 checksum is used. Wolfe -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: important caveat with Rsync on NT and dayligt savings time
If I understand the manpages correctly, if you use -t, the criterium for syncing files is the difference in timestamp, not in size. There are plenty of situations where the size of a file stays identical, while it's contents has changed. If you omit -t, all files are synced. Rgds, Bart Coninckx Network Administrator CNE, ASE * Watco ICT Services Lilsedijk 19 B-2340 Beerse Belgium e-mail: [EMAIL PROTECTED] Tel: + 32 (0) 14 60 99 42 Fax: + 32 (0) 14 62 41 47 * == Disclaimer == The information in this email is confidential, and is intended solely for the addressee(s). If you are not the intended recipient of this email please let us know by reply and then delete it from your system; you should not copy this message or disclose its contents to anyone, not even by forwarding it. Due to the integrity risk of sending emails over the Internet, Sita ICT will accept no liability for any comments and/or attachments contained within this email. == Disclaimer == Lachlan Cranswick cc: Sent by: Subject: Re: important caveat with Rsync on NT and dayligt savings time rsync-admin@lists .samba.org 10/29/2002 21:35 I think this "day light savings" time stamp issue also affects Win98 as well - at least on a Win98 PC I use. Rsync insists on updating all the files fully. Shouldn't it just be resetting the times on the files if the files are the same size - or am I missing something here? Lachlan. >Your description is as confusing as the KB article (at least >to me). Part of the problem with the KB article is that it >focuses on localtime displays rather than internals. > >.From what i can tell FAT stores timestamps in localtime. >NTFS uses a GMT based timestamp. > >I can see one of two places where we get bit. As a matter >of curiosity i'd like to know which. > >1. When the FAT timestamps are converted to GMT it is done > based on the current TZ offset rather than the TZ offset > in effect when the timestamp was made. > >2. The NT equivalent of stat(2) is converting the NTFS > timestamps to localtime and then the cygwin libs convert > it back to GMT. > >It would appear that the problem could be avoided either by >using NTFS or FAT filesystems. Yes? It certainly sounds >filesystem dependant. > >I'd guess that the correct place to fix this is in the >cygwin libs. They could be tweaked to recognize the TZ >calculation error of the NT libs. There might need to be a >test for filesystem type (if possible) or a switch to >determine behavior otherwise what fixes some will break >others. --- Lachlan M. D. Cranswick Collaborative Computational Project No 14 (CCP14) for Single Crystal and Powder Diffraction Birkbeck University of London and Daresbury Synchrotron Laboratory Postal Address: CCP14 - School of Crystallography, Birkbeck College, Malet Street, Bloomsbury, WC1E 7HX, London, UK Tel: (+44) 020 7631 6850 Fax: (+44) 020 7631 6803 E-mail: [EMAIL PROTECTED] Room: B091 WWW: http://www.ccp14.ac.uk/ -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: important caveat with Rsync on NT and daylight savings time
On Tue, Oct 29, 2002 at 10:01:58PM +0100, [EMAIL PROTECTED] wrote: > > That's actually a very good suggestion. First I figured that in this way > files changed within the hour after creation would be ignored, but they > probably represent a very small minority anyway. The number of files whose timestamp is less than one hour since the last rsync run and still have the same size will be very small. > On the other hand, this does not really rectify the situation, but will > allow us to postpone the real sync again until, let's say a holiday, where > we have plenty of time to sync. Reducing the window won't work (brain fart on my part). If you run an rsync without the modify-window on part of the trees each night you can get caught up. > > On Tue, Oct 29, 2002 at 09:06:26PM +0100, [EMAIL PROTECTED] wrote: > > > > No matter what my understanding's like: the timestamps on the files > changed > > after last weekend, resulting in a mismatch between source and > destination > > files. I've changed the clock to a timezone one hour ahead to compensate, > > did a "F5" in a particular folder and miraculously the timestamps > followed > > along with one hour. Unfortunately, it was already too late for a lot of > > files ... > > In your situation you might want to use --modify-window=3600 > and each night either reduce the window or apply it to fewer > files. That way you can spread the load. > > You'll need to do this again in April 8-( > > Holloween came early for you. > -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: important caveat with Rsync on NT and daylight savings time
That's actually a very good suggestion. First I figured that in this way files changed within the hour after creation would be ignored, but they probably represent a very small minority anyway. On the other hand, this does not really rectify the situation, but will allow us to postpone the real sync again until, let's say a holiday, where we have plenty of time to sync. Rgds, Bart Coninckx Network Administrator CNE, ASE * Watco ICT Services Lilsedijk 19 B-2340 Beerse Belgium e-mail: [EMAIL PROTECTED] Tel: + 32 (0) 14 60 99 42 Fax: + 32 (0) 14 62 41 47 * jw schultz <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Sent by: cc: rsync-admin@listsSubject: Re: important caveat with Rsync on NT and dayligt savings time .samba.org 10/29/2002 21:30 On Tue, Oct 29, 2002 at 09:06:26PM +0100, [EMAIL PROTECTED] wrote: > > No matter what my understanding's like: the timestamps on the files changed > after last weekend, resulting in a mismatch between source and destination > files. I've changed the clock to a timezone one hour ahead to compensate, > did a "F5" in a particular folder and miraculously the timestamps followed > along with one hour. Unfortunately, it was already too late for a lot of > files ... In your situation you might want to use --modify-window=3600 and each night either reduce the window or apply it to fewer files. That way you can spread the load. You'll need to do this again in April 8-( Holloween came early for you. -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
RE: Rsync help
Title: RE: Rsync help SUN box, 2gig ram, hard drive space to spare. Rsync 2.5.5, solaris 5.7 version 7. Half moon, I think it only seems to work on full moon nights. Here's the command I run as well . /usr/local/bin/rsync --delete --partial -P -p -z -e /usr/local/bin/ssh /dir1 systemname:/storage Kindest Regards, Dave -Original Message- From: jw schultz [mailto:[EMAIL PROTECTED]] Sent: Tuesday, October 29, 2002 1:17 PM To: Green, Paul Cc: 'Walgamotte, David'; '[EMAIL PROTECTED]' Subject: Re: Rsync help On Tue, Oct 29, 2002 at 01:13:19PM -0500, Green, Paul wrote: > What version of rsync? What operating system? What version of the OS? > What is the phase of the moon? C'mon, give us more clues. :-) > > PG > > -Original Message- > From: Walgamotte, David [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, October 29, 2002 12:38 PM > To: '[EMAIL PROTECTED]' > Subject: Rsync help > > > > > I get the following transering a large file use rsync over ssh. > > root@pbodb bin$ ./ausbk.sh > building file list ... > 10 files to consider > ERROR: out of memory in generate_sums > rsync: connection unexpectedly closed (8 bytes read so far) > rsync error: error in rsync protocol data stream (code 12) at io.c(150) > > Regards, > Dave > And how much memory do you have. And start a new thread. "rsync help" is about the worst possible Subject you could have used. Try something like "out of memory in generate_sums" -- J.W. Schultz Pegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt
RE: important caveat with Rsync on NT and dayligt savings time
Howdy... The short answer is the DST issue affects volumes using the NTFS filesystem. The long answer is contained in the Windows KB article that was posted. I am looking at a solution for this problem, along with a few other issues, but the solution is a few months off from now. Wolfe -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: configuration question.
Your users have rsh access to the machine, and are getting wherever they want, using the server:/path syntax. if they were using the server::module syntax, they would be restricted to only what's provided by the modules. If you don't want them getting everything all over the system, you will need to prevent shell access. Tim Conway [EMAIL PROTECTED] reorder name and reverse domain 303.682.4917 office, 303.921.0301 cell Philips Semiconductor - Longmont TC 1880 Industrial Circle, Suite D Longmont, CO 80501 Available via SameTime Connect within Philips, caesupport2 on AIM "There are some who call me Tim?" "Armin Safarians" <[EMAIL PROTECTED]> Sent by: [EMAIL PROTECTED] 10/29/2002 01:11 PM To: [EMAIL PROTECTED] cc: (bcc: Tim Conway/LMT/SC/PHILIPS) Subject:configuration question. Classification: How do you restrict rsync transfers to only modules in the configuration file? It seems like even though I have a module configured, users can transfer files that they had permission to which is not under the directory of the module. I.E. modulename path=/web ... ... ... Users can get /etc/passwd from this machine. How do I restrict that. Thanks, AMS -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: important caveat with Rsync on NT and dayligt savings time
I think this "day light savings" time stamp issue also affects Win98 as well - at least on a Win98 PC I use. Rsync insists on updating all the files fully. Shouldn't it just be resetting the times on the files if the files are the same size - or am I missing something here? Lachlan. >Your description is as confusing as the KB article (at least >to me). Part of the problem with the KB article is that it >focuses on localtime displays rather than internals. > >.From what i can tell FAT stores timestamps in localtime. >NTFS uses a GMT based timestamp. > >I can see one of two places where we get bit. As a matter >of curiosity i'd like to know which. > >1. When the FAT timestamps are converted to GMT it is done > based on the current TZ offset rather than the TZ offset > in effect when the timestamp was made. > >2. The NT equivalent of stat(2) is converting the NTFS > timestamps to localtime and then the cygwin libs convert > it back to GMT. > >It would appear that the problem could be avoided either by >using NTFS or FAT filesystems. Yes? It certainly sounds >filesystem dependant. > >I'd guess that the correct place to fix this is in the >cygwin libs. They could be tweaked to recognize the TZ >calculation error of the NT libs. There might need to be a >test for filesystem type (if possible) or a switch to >determine behavior otherwise what fixes some will break >others. --- Lachlan M. D. Cranswick Collaborative Computational Project No 14 (CCP14) for Single Crystal and Powder Diffraction Birkbeck University of London and Daresbury Synchrotron Laboratory Postal Address: CCP14 - School of Crystallography, Birkbeck College, Malet Street, Bloomsbury, WC1E 7HX, London, UK Tel: (+44) 020 7631 6850 Fax: (+44) 020 7631 6803 E-mail: [EMAIL PROTECTED] Room: B091 WWW: http://www.ccp14.ac.uk/ -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: configuration question.
On Tue, Oct 29, 2002 at 12:11:14PM -0800, Armin Safarians wrote: > How do you restrict rsync transfers to only modules in the configuration > file? > It seems like even though I have a module configured, users can transfer > files > that they had permission to which is not under the directory of the module. > > I.E. > modulename >path=/web >... >... >... > > Users can get /etc/passwd from this machine. How do I restrict that. This is at least the third time you have asked this. You don't provide enough info for anyone to address it. It sounds to me like the rsync transfer isn't even using the rsync daemon. Next time send a copy of your rsyncd.conf file and the exact command-line that is able to get the /etc/passwd file. -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: important caveat with Rsync on NT and dayligt savings time
On Tue, Oct 29, 2002 at 09:06:26PM +0100, [EMAIL PROTECTED] wrote: > > No matter what my understanding's like: the timestamps on the files changed > after last weekend, resulting in a mismatch between source and destination > files. I've changed the clock to a timezone one hour ahead to compensate, > did a "F5" in a particular folder and miraculously the timestamps followed > along with one hour. Unfortunately, it was already too late for a lot of > files ... In your situation you might want to use --modify-window=3600 and each night either reduce the window or apply it to fewer files. That way you can spread the load. You'll need to do this again in April 8-( Holloween came early for you. -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: important caveat with Rsync on NT and dayligt savings time
On Tue, Oct 29, 2002 at 01:25:03PM -0600, [EMAIL PROTECTED] wrote: > Howdy... > > > Fortunately you posted the KB article number, and having read the article, I > see you have a bit of a misunderstanding of what is going on. > > First off, NT/2000 uses a offset from GMT, which does not observe Daylight > Savings Time (DST), for storing the time in the Event Log, and NTFS volumes. > This also affects Windows 95, Windows 98, Windows ME, and Windows XP > platforms viewing the same data remotely. > > On the other side of file systems, the FAT16, and FAT32 filesystems use the > number of seconds that have elapsed since January 1, 1980 to store the time, > rather than a time offset from GMT. > > In case you want to avoid this happening in the future, at least until a > solution can be developed, implemented, and tested, you can turn off DST. > This will mean that for one-half of the year, your clock will be out-of-sync > by 1 hour, but it may be better to be off by 1 hour to avoid this problem in > the future. > > I appreciate you warning others about this, as it has identified a cosmetic > bug that I was completely unaware of. Necessity is the mother of invention, > and this nuance will be addressed in my implementation of rsync as a service > for Win32. Your description is as confusing as the KB article (at least to me). Part of the problem with the KB article is that it focuses on localtime displays rather than internals. .From what i can tell FAT stores timestamps in localtime. NTFS uses a GMT based timestamp. I can see one of two places where we get bit. As a matter of curiosity i'd like to know which. 1. When the FAT timestamps are converted to GMT it is done based on the current TZ offset rather than the TZ offset in effect when the timestamp was made. 2. The NT equivalent of stat(2) is converting the NTFS timestamps to localtime and then the cygwin libs convert it back to GMT. It would appear that the problem could be avoided either by using NTFS or FAT filesystems. Yes? It certainly sounds filesystem dependant. I'd guess that the correct place to fix this is in the cygwin libs. They could be tweaked to recognize the TZ calculation error of the NT libs. There might need to be a test for filesystem type (if possible) or a switch to determine behavior otherwise what fixes some will break others. -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
configuration question.
How do you restrict rsync transfers to only modules in the configuration file? It seems like even though I have a module configured, users can transfer files that they had permission to which is not under the directory of the module. I.E. modulename path=/web ... ... ... Users can get /etc/passwd from this machine. How do I restrict that. Thanks, AMS
RE: important caveat with Rsync on NT and dayligt savings time
No matter what my understanding's like: the timestamps on the files changed after last weekend, resulting in a mismatch between source and destination files. I've changed the clock to a timezone one hour ahead to compensate, did a "F5" in a particular folder and miraculously the timestamps followed along with one hour. Unfortunately, it was already too late for a lot of files ... Rgds, Bart Coninckx Network Administrator CNE, ASE * Watco ICT Services Lilsedijk 19 B-2340 Beerse Belgium e-mail: [EMAIL PROTECTED] Tel: + 32 (0) 14 60 99 42 Fax: + 32 (0) 14 62 41 47 * <[EMAIL PROTECTED] et> To: <[EMAIL PROTECTED]> Sent by: cc: <[EMAIL PROTECTED]> rsync-admin@listsSubject: RE: important caveat with Rsync on NT and dayligt savings time .samba.org 10/29/2002 20:25 Howdy... Fortunately you posted the KB article number, and having read the article, I see you have a bit of a misunderstanding of what is going on. First off, NT/2000 uses a offset from GMT, which does not observe Daylight Savings Time (DST), for storing the time in the Event Log, and NTFS volumes. This also affects Windows 95, Windows 98, Windows ME, and Windows XP platforms viewing the same data remotely. On the other side of file systems, the FAT16, and FAT32 filesystems use the number of seconds that have elapsed since January 1, 1980 to store the time, rather than a time offset from GMT. In case you want to avoid this happening in the future, at least until a solution can be developed, implemented, and tested, you can turn off DST. This will mean that for one-half of the year, your clock will be out-of-sync by 1 hour, but it may be better to be off by 1 hour to avoid this problem in the future. I appreciate you warning others about this, as it has identified a cosmetic bug that I was completely unaware of. Necessity is the mother of invention, and this nuance will be addressed in my implementation of rsync as a service for Win32. Wolfe -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Help on syncing a windows server
On Tue, Oct 29, 2002 at 12:49:30PM -0600, Matthew Bettinger wrote: > Hello, > > At my work we have multiple freebsd machines running samba. Love it, things > are working great. We have several windows 2000 servers that our engineers > store their working drawings on. I need to create a mirror of this > engineering windows 2000 machine to a freebsd machine running samba. The > purpose of this is so that regular employees, welders whatever can just read > the drawings on the mirrored (freebsd) machine and not touch the windows 2000 > server that the engineers work on. Right now I am using Robocopy and I was > hoping I could do this with rsync instead. > > Here is what the freebsd tester box looks like. You can notice the two smbfs > mounts. These are some of the engineering windows 2000 machines that I would > like to mirror to this freebsd box. > > /dev/ad0s1a on / (ufs, NFS exported, local) > /dev/ad0s1f on /tmp (ufs, local, noatime, soft-updates) > /dev/ad0s1g on /usr (ufs, local, noatime, soft-updates) > /dev/ad0s1e on /var (ufs, local, noatime, soft-updates) > /dev/ad1s1e on /depot (ufs, NFS exported, local, noatime, soft-updates) > /dev/ad2s1e on /general (ufs, NFS exported, local, noatime, soft-updates) > /dev/ad3s1e on /Drawings (ufs, local, soft-updates) > procfs on /proc (procfs, local) > 201.201.2.24:/share1/flexbackup on /flexbackup (nfs) > //ADMINO5@EMSCOR_ENG_NT/DWG on /ech_nt (smbfs) > //ADMINISTRATOR@SOLID-EDGE/DWG on /solid_edge (smbfs) > > So in a nutshell I need to know if rsync can mirror the /solid-edge mount and > /ech_nt mount to /drawings. In a word, Yes. Read the docs. The best way would be to put rsync on the W2000 machines and have rsync either push or pull across the network. While you cpuld rsync the smbfs mounts to local storage rsync looses much of its advantage when accessing a network mount. Rsync's biggest advantage is to only send the modified parts of modified files. To do that requires multiple accesses which is fine for local storage but not for remote. If you cannot install rsync on the windows servers rsync with the --whole-file option disabling the transfer optimization should still be a good approach. As i said, read the docs. -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
RE: important caveat with Rsync on NT and dayligt savings time
Howdy... Fortunately you posted the KB article number, and having read the article, I see you have a bit of a misunderstanding of what is going on. First off, NT/2000 uses a offset from GMT, which does not observe Daylight Savings Time (DST), for storing the time in the Event Log, and NTFS volumes. This also affects Windows 95, Windows 98, Windows ME, and Windows XP platforms viewing the same data remotely. On the other side of file systems, the FAT16, and FAT32 filesystems use the number of seconds that have elapsed since January 1, 1980 to store the time, rather than a time offset from GMT. In case you want to avoid this happening in the future, at least until a solution can be developed, implemented, and tested, you can turn off DST. This will mean that for one-half of the year, your clock will be out-of-sync by 1 hour, but it may be better to be off by 1 hour to avoid this problem in the future. I appreciate you warning others about this, as it has identified a cosmetic bug that I was completely unaware of. Necessity is the mother of invention, and this nuance will be addressed in my implementation of rsync as a service for Win32. Wolfe -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Rsync help
On Tue, Oct 29, 2002 at 01:13:19PM -0500, Green, Paul wrote: > What version of rsync? What operating system? What version of the OS? What > is the phase of the moon? C'mon, give us more clues. :-) > > PG > > -Original Message- > From: Walgamotte, David [mailto:david.walgamotte@;wild.net] > Sent: Tuesday, October 29, 2002 12:38 PM > To: '[EMAIL PROTECTED]' > Subject: Rsync help > > > > > I get the following transering a large file use rsync over ssh. > > root@pbodb bin$ ./ausbk.sh > building file list ... > 10 files to consider > ERROR: out of memory in generate_sums > rsync: connection unexpectedly closed (8 bytes read so far) > rsync error: error in rsync protocol data stream (code 12) at io.c(150) > > Regards, > Dave > And how much memory do you have. And start a new thread. "rsync help" is about the worst possible Subject you could have used. Try something like "out of memory in generate_sums" -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Help on syncing a windows server
Hello, At my work we have multiple freebsd machines running samba. Love it, things are working great. We have several windows 2000 servers that our engineers store their working drawings on. I need to create a mirror of this engineering windows 2000 machine to a freebsd machine running samba. The purpose of this is so that regular employees, welders whatever can just read the drawings on the mirrored (freebsd) machine and not touch the windows 2000 server that the engineers work on. Right now I am using Robocopy and I was hoping I could do this with rsync instead. Here is what the freebsd tester box looks like. You can notice the two smbfs mounts. These are some of the engineering windows 2000 machines that I would like to mirror to this freebsd box. /dev/ad0s1a on / (ufs, NFS exported, local) /dev/ad0s1f on /tmp (ufs, local, noatime, soft-updates) /dev/ad0s1g on /usr (ufs, local, noatime, soft-updates) /dev/ad0s1e on /var (ufs, local, noatime, soft-updates) /dev/ad1s1e on /depot (ufs, NFS exported, local, noatime, soft-updates) /dev/ad2s1e on /general (ufs, NFS exported, local, noatime, soft-updates) /dev/ad3s1e on /Drawings (ufs, local, soft-updates) procfs on /proc (procfs, local) 201.201.2.24:/share1/flexbackup on /flexbackup (nfs) //ADMINO5@EMSCOR_ENG_NT/DWG on /ech_nt (smbfs) //ADMINISTRATOR@SOLID-EDGE/DWG on /solid_edge (smbfs) So in a nutshell I need to know if rsync can mirror the /solid-edge mount and /ech_nt mount to /drawings. Thank you for any insight. Matthew Bettinger Champion Elevators, inc. Houston, Texas 77061 0x63707225.asc Description: application/pgp-keys
important caveat with Rsync on NT and dayligt savings time
Hi, just a small warning about something that has, like we experienced just last weekend, great consequences. We rsync more than 20 Netware servers through a mapping on an NT machine to central Rsync destination servers (also NT). Last weekend our clock changed to Daylight Savings Time. It appears that NT changes the file stamps on NTFS volumes accordingly (Q129574 on their suppor site). This means that from Sunday 00:00 AM on, all files on the dest. serves had a timestamp of one hour less than their original counterparts (Netware, which leaves the timestamps alone). The result is that the syncs have been busy for the last 2 days trying to catch up and hence we don't have a backup for the moment. Microsoft calls it a "feature", I call it poor programming. You've been warned. Bart Coninckx Network Administrator CNE, ASE * Watco ICT Services Lilsedijk 19 B-2340 Beerse Belgium e-mail: [EMAIL PROTECTED] Tel: + 32 (0) 14 60 99 42 Fax: + 32 (0) 14 62 41 47 * -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
RE: Rsync help
Title: Rsync help What version of rsync? What operating system? What version of the OS? What is the phase of the moon? C'mon, give us more clues. :-) PG -Original Message-From: Walgamotte, David [mailto:[EMAIL PROTECTED]]Sent: Tuesday, October 29, 2002 12:38 PMTo: '[EMAIL PROTECTED]'Subject: Rsync help I get the following transering a large file use rsync over ssh. root@pbodb bin$ ./ausbk.sh building file list ... 10 files to consider ERROR: out of memory in generate_sums rsync: connection unexpectedly closed (8 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(150) Regards, Dave
Rsync help
Title: Rsync help I get the following transering a large file use rsync over ssh. root@pbodb bin$ ./ausbk.sh building file list ... 10 files to consider ERROR: out of memory in generate_sums rsync: connection unexpectedly closed (8 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(150) Regards, Dave
¹úÇì¹ýµÄ»¹ºÃ°É£¡
×𾴵Ŀͻ§£º ÄúºÃ£¬ÎÒ˾ÊÇרҵÓòÃûÖ÷»úÌṩÉÌ¡£ÓŻݵļ۸ñ¼°¸ßËÙÎȶ¨µÄÖ÷»úÓ®µÃÁËÈ«¹ú¿Í»§µÄ¿Ï¶¨¡£ ¹ú¼ÊÓòÃû 80Ôª ¹úÄÚÓòÃû 300Ôª ÍøÂçʵÃû¡¡500Ôª£¨Ö±½ÓÇÃÈëÖÐÎļ´¿Éµ½´ïÄúµÄÍøÕ¾£¬ÂòÍøÂçʵÃûÔùËÍÒ»¸ö¹ú¼ÊÓòÃû£© 200M(´¿HTML)Ë͹ú¼ÊÓòÃûÖ»Ðè150Ôª 60M(asp,accessµÈ)ËÍÓòÃûºÍÓÊÏäÖ»Ðè236Ôª 200M(asp,accessµÈ)ËÍÓòÃûºÍÓÊÏäÖ»Ðè336Ôª ÍøÒ³ÖÆ×÷£¬ÆÕͨÐÍÆóÒµÍøÕ¾£¬Ö»Ðè2000Ôª¡££¨¹¦Äܶà¶à£¬»¹ÔùËÍÓòÃû£¬¿Õ¼ä¼°ÓÊÏ䣬ȫÌ×·þÎñ15Ìì¼´¿ÉÍê³É£© ¸ü¶à..Ïê¼ûhttp://www.ondns.com ³ÏÕ÷È«¹ú´úÀí£¬ÓŻݶà¶à¡£ ÇëÏòQQ£º1761020 MAIL£º[EMAIL PROTECTED]Ë÷È¡´úÀí¼Û¸ñ±í ÎÒ¹«Ë¾ÊÇÒ»¼ÒרÃÅÖÂÁ¦ÓÚ¸ßÐÂÍøÂç¼¼ÊõÑо¿ºÍ¿ª·¢µÄ¹«Ë¾£¬ÓÐ×ŶàÄêµÄ¾Ñ飬ÔÚ×öÐéÄâÖ÷»ú·½ÃæÎÒÃÇ ÓÐמø¶ÔµÄÓÅÊÆ£º ¢ÙÖ±½Ó½ÓÈë¹ãÖݹú¼Ê¹Ç¸ÉÍø2.5G£¬»ú·¿100M´ø¿í¹²Ïí£» ¢ÚÓµÓÐÒ»Åú¸ß¼¶µÄÍøÂç¹ÜÀíÈËÔ±£¬Ö÷»úÓÉÎÒÃÇ×Ô¼ºÑϸñ¹ÜÀí£» ¢Û¶ÔËùÓеÄÍøÕ¾ÄÚÈÝÎÒÃǶ¼½øÐб¸·Ý£¬²¢½øÐÐʵʱ¼à¿Ø±£Ö¤ÁËÆäÎȶ¨ÐÔ£» лл! ˳ף ÉÌÑw£¡ °ÙæÖдòÈÅÁËÄú£¬Éî¸Ð±§Ç¸¡£Èç²»ÏëÊÕµ½´ËÀàÓʼþ¡£Çë¹ýÂ˾ÜÊÕ´ËÓʼþ£º[EMAIL PROTECTED] ¿Í»§×¨Ô±£ºÐ¤ÏÈÉú ·þÎñµç»°£º0592-5558771ºÍ5557491 5557492 Óʱࣺ361009 ´«Õ棺0592-5557491 http://www.ondns.commail:[EMAIL PROTECTED] ʹÓü«ÐÇÓʼþȺ·¢£¬ÎÞÐëͨ¹ýÓʼþ·þÎñÆ÷£¬Ö±´ï¶Ô·½ÓÊÏ䣬ËٶȾø¶ÔÒ»Á÷£¡ ÏÂÔØÍøÖ·£ºhttp://www.lovexin.com£¬¸ü¶àÃâ·ÑµÄ³¬¿áÈí¼þµÈÄãÀ´Ï¡¡ INFORMATION This message has been sent using a trial-run version of the TSmtpRelayServer Delphi Component. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
ÖÐСÐÍÍøÕ¾Ê×Ñ¡¿Õ¼ä£¡
×ð¾´µÄÐÂÀÏ¿Í»§£º ÄúºÃ£¬ÎÒ¹«Ë¾ÓŻݲúÆ·ÒѽøÈë×îºóµ¹Êý30Ì죬30Ììºó¼Û¸ñ½«Éϵ÷£¬Óû¹º´ÓËÙ£º ΪºÎÎÒÃÇ»áÔÙÉϵ÷¼Û¸ñÄØ£¬ÕâÖ÷ÒªÊÇÎÒÃÇ·þÎñÆ÷ÅäÖÃÔ½À´Ô½ºÃ£¬Ëٶȼ«¿ì£¡ 1¡¢200M£¨´¿HTML¿Õ¼ä£©+ ËÍÒ»¹ú¼ÊÓòÃû£¬½öÊÛ150Ôª/Äê 2¡¢60M¿Õ¼ä+60MÆóÒµÓÊ¾Ö + Ö§³ÖASP£¬CGI + ËÍÒ»¹ú¼ÊÓòÃû£¬½öÊÛ236Ôª/Äê 3¡¢200MP¿Õ¼ä+200MÆóÒµÓÊ¾Ö + Ö§³ÖASP£¬CGI£¬ACCESS + ËÍÒ»¹ú¼ÊÓòÃû£¬½öÊÛ336Ôª/Äê ¸ü¶à¿Õ¼ä×éºÏ£¬¸ü¶àÑ¡Ôñ--Çëµã»÷ÎÒÃǹ«Ë¾Ö÷Õ¾ ¡¡http://www.88dns.com/¡¡Á˽âÏêÇé. ÎÒ¹«Ë¾ÊÇÒ»¼ÒרÃÅÖÂÁ¦ÓÚ¸ßÐÂÍøÂç¼¼ÊõµÄ¹«Ë¾£¬ÓÐ×ŶàÄêµÄ¾Ñ飬ÔÚ×öÐéÄâÖ÷»ú·½ÃæÎÒÃÇ ÓÐמø¶ÔµÄÓÅÊÆ£º ¢ÙÖ÷»ú100MµÄ¿í´ø½ÓÈë(Íøͨ¿í´øÔÚÏÃÃŵÄÖն˽ÓÈëÊÇÓÉÎÒ˾´úÀíµÄ)£» ¢ÚÓµÓÐÒ»Åú¸ß¼¶µÄÍøÂç¹ÜÀíÈËÔ±£¬Ö÷»úÓÉÎÒÃÇ×Ô¼ºÑϸñ¹ÜÀí£¬È·Èϵ¥×Óºó24СʱÄÚ¿ªÍ¨£» ¢Û¶ÔËùÓеÄÍøÕ¾ÄÚÈÝÎÒÃǶ¼½øÐб¸·Ý£¬²¢½øÐÐʵʱ¼à¿Ø±£Ö¤ÁËÆäÎȶ¨ÐÔ£» ÁíÄúÈçÐèÎÒÃÇ°ïÄú×öÍøÒ³»òÓÐÒâ×öÎÒÃǵĴúÀí»¶Ó¸úÎÒÃÇÁªÏµ£¡ ÁªÏµE-mail:¡¡[EMAIL PROTECTED] ¡¡QQ£º40327558¡¡µç»°£º0592-8667174¡¡Ö£ÏÈÉúÁªÏµ лл! ×£ÄúÂíÄ꼪Ïé¡¢ºÃÔËÌìÌìÓС¢ÐÒÔ˳£°éËæ!!! ¡¡ ӯͨԶº½¿Æ¼¼¡¡ --- ·ÐµãȺ·¢Óʼþ,À´×ÔÈí¼þ¹¤³Ìר¼ÒÍø(http://www.21cmm.com) ½øCMMÍøУ(http://www.21cmm.com)£¬³ÉÏîÄ¿¹ÜÀíר¼Ò -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
