Differential file systems?

2003-01-18 Thread Rainer Zocholl

Hello

Is there any progress in differential file systems?

Pardon if i missed that.


Usage Example:
I make a backup(*) copy of a database file, 1GB each file, today.
File size is fixed as the structure is predefined.
There are only a few place where values where changed.
Most of it is static.
Tomorrow i do the next backup and try to hard link to save disc space.
But hard link will fail because only one single byte was changed.
rsync have had all information and did sent only
that one byte, but then generates 999,999,999 Byte overhead.
That's no good for performance and disc usage, or?

Where do i have to look to find such a file system, 
that does hard links on, let's says, 4KB clusters/inodes?

Of cause disc space is not important anymore to day.
But to copy 1GB from one side of the same disc to the other end took time.
And: Backing up a Database daily with one 1GB file, will fill a
30GB disc in approx. 4 weeks...with mostly identical informations.
The problem using rsync is the relatively long time required 
to copy the file locally. 
Crosslink / reuse of inodes would be much faster.










(*) In the sense of versioning. 
protecting against a rm *,bak or vi ;-)


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: .ssh files

2002-12-23 Thread Rainer Zocholl
[EMAIL PROTECTED](Steve Mallett)  23.12.02 08:52

Once upon a time Steve Mallett shaped the electrons to say...

 Seems so.
 The private key file MUST ONLY be readable to the user, no one
 else. chmod 600 

 Rainer

Changing the perms to 600 did it.  Tally Ho.

But of cause many of other files will have it's correct
permissions too!
Check *all* files you restored.
Maybe they are world writeable now.
That's especially bad if they were owned or used by root etc...


Rainer---= Vertraulich
 //  
   //  
 =--ocholl, Kiel, Germany 

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: .ssh files

2002-12-22 Thread Rainer Zocholl
[EMAIL PROTECTED](Steve Mallett)  22.12.02 16:32

Once upon a time Steve Mallett shaped the electrons to say...

I burned an .iso cd of the home dir of a server, 

What kind? Jouliett?
Did you da a tar or cpio first to save all links

my .ssh files are there, but if I restore from the 
cd using rsync -azurvp /mnt/cdrom/.ssh/* 
~/.ssh the permissions seem screwy.

What are they?

I'm trying to use my id_dsa ssh key to login to other servers, but
they don't acknowledge the key because the permission are incorrect.

Any Suggestions?  Did i screwup, by using mkisofs  cdrecord to burn
the cd?

Seems so.
The private key file MUST ONLY be readable to the user, no one else.
chmod 600 

Rainer

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: Totally newbie need to setup rsync

2002-12-18 Thread Rainer Zocholl
[EMAIL PROTECTED](Jose Lerebours)  17.12.02 08:57

Once upon a time Jose Lerebours shaped the electrons to say...

Howdy!

I am totally new to rsync and most UNIX things.

We have two servers running SCO OpenServer 3.2 Ver 5.0.6.
One of the servers is our live operation and the second is
our backup server.

So please first: get one of the supertar products. For example one
of those mentioned in http://aplawrence.com/Reviews/supertars.html.

After you have an reliable backup with desaster recovery
running, you can start playing with synchronizing boxes.
(Ever imagine what will happen (to you) if you mix up the boxes...?)
(One small hint: it is relatively complicate to
change the IP-# of an SCO OSR... The IP-# is compiled into kernel...)


I need to keep data from operation server up-to-date in our
backup server and that's where 'rsync' comes in.

You can do that using cpio too.
Typically by piping it thru ssh, some tried rsh... others use netcat.
(rsh is on you box, ssh need to be installed, netcat is only a 
sinple program, but i don't know if it is ported to SCO OSR)
Just search on google for tar rsh ssh remote 

The advantage of cpio is:
You can be quite sure that all works as expected because 
it is made by the maker of the OS...

The disadvantage is, that it will copy everything it is
told by the find command.
But -if told- it too sees if file to be copied 
is not newer than the existing.
And too: rsync might not bring the time advantage you may expect.

If on the master system databases are running, make sure
that you can really access the files!
Best you should shutdown the database while copying.


I already downloaded binaries, unzipped and restored to disk
but have no idea where to go from here.

rsync-backup or dirvish maybe be usefull?

Image what will happen if a process destroys some of the master
files and your script is copying those files to the backup system...
both systems are identical...as wished...

I have looked and have not found for some black  white that
would, literally, hold me by the hands and guide me through
the steps of properly installing and configuring 'rsync'.

rsnyc does not need an install for those backup jobs.
Just make sure that it can be found on every machine in 
the same directory and you have some kind of remote shell access.
Maybe you want the man page on site, but you read them
as well in samba.org.


We do not have a compiler - but since I downloaded binaries,
not source code, I guess we do not need a compiler.

You should install the -minimal- SCO development system 
(it's on your server CD) and replace the compiler with gcc.
You need to hack the achiver with a link.



I can use all and any information to get me started.  Your
help is truly appreciated.

Do a search for Tony Lawrence

Too have a look into usenet:comp.unix.sco.misc
rsync is currently on topic there.


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: SPAM on List...

2002-12-12 Thread Rainer Zocholl
[EMAIL PROTECTED](Martin Pool)  12.12.02 12:39

People writing from (say) China may be using
a mail client that sends messages in a Chinese character set.  Some of
those character sets contain latin characters, so they may have in
fact been writing a purely English message, or perhaps an English
message with a part-Chinese sig block.

Yepp. that is done by several chinese free email providers...


Discarding these messages was incorrect; what was worse was that the
old system gave no indication of how to fix the problem and the
messages were dropped without review. :-(

Those chinese chars were placed by the providers in the last some 
lines like a signature/footer.




korea-spam:

There is an inforamtion from KISA how to tag legal korean spam:

2.  For the reference, you could filter Korean Spam mails by
using the strings introduced below.

People who would like to advertise adult stuff should put the
sign of '(ù¬àî¡/¢'¡Æí)' at the head of subject.  In case of
general advertisement, they have to attach '(¡/¢'¡Æí)' at the
head of subject.  In both cases, you need round brackets ( )
around the string.

(ù¬àî¡/¢'¡Æí) means (advertisement for adult or 'ADLT') in
English.  
(¡/¢'¡Æí) means (advertisementor 'ADV') in English.

Since you don't understand and write Korean, I introduce the
two text strings for you to use in your filters.

...

Korea Information Security Agency
Secretariat of Personal Information Mediation Committee
Dispute Mediation Team / Researcher

-



And let's not even think about byte sex. :-)

or mSEXchange... ;-)


Rainer

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: Filename character translation

2002-12-07 Thread Rainer Zocholl
[EMAIL PROTECTED](Savin Gorup)  07.12.02 11:54 wrote:


I came across the problem with rsync-2.5.5 on Cygwin/Win2K while
rsyncing with filenames which have 'strange' (non latin-1) characters
in filenames. The problem is that filenames on Windows system are
coded (in our case) in codepage 852, while server (Linux system) has
filename coding according to ISO-8859-2. This two are not fully
compatible, causing rsync to simply skip copying some files (and whole
directories!) to server.

Samba solves this kind of problem by using 'client code page' and
'character set' options. 

but rsync does not work on such funny chars in samba dirs either!
At least 2.5.5 on SCO OSR5 failed. Thought it was a SCO problem
(rdist did work either) so i went back to cpio to make 
remote backup work. Maybe i can find the error messages somewhere. 
IIRC rsync simply stops working on the first file with an Umlaut 
(U (0x9A)) and continues with the next directory...
If someone is not exactly comparing the results -every time- 
he would not become aware the problem: One (samba) user might create 
such a filename meanwhile, and since that day only the half directory 
is backed up...



I propose somewhat simpler solution using
translation table between local and remote file system.

I have developed a patch to address the problem, 
which basically does this: 
- adds command line option --filename-translation (options.c)
- builds two way character translation lookup table in memory (512 bytes) 
(utils.c)

- translates filenames at appropriate places (sender.c, flist.c)
is --filename-translation is present

Note this patch can't handle multibyte encodings. 

That's a problem:

The normal NT _findfirst translates all(!) unicodes  0xff 
to 0x3f ? AFAIK.
On the Unix box the ? (=wildcard!) in the file name gives no problem.
But restore will be impossible, because ? is no legal
character on NTFS/FAT... 
Too your mapping fails, because all unicode chars are already 
mapped when rsync see it (if not _tfindfirst is used!).
But:
i don't know what the cygwin-API is doing.
Maybe it does better than NT?



There has been some interest in that topic before here
(http://www.mail-archive.com/rsync@lists.samba.org/msg03306.html) and
also on some other, local mailing lists. Since inability to copy all
files renders rsync unusable to non-latin-1 users 

Yepp. Was very disappointed about that, but had have no time to work 
on the problem..

I would like to hear some comments about including the patch 
into main source tree (or proposing a better solution, of course).

I would be happy if rsync would be able to copy samba shares 
between unixes...

Wasn't that problem already been solved for CD filesystems?
(Rockridge extensions?)



Thanks for bringing the problem to the list!


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: Filename character translation

2002-12-07 Thread Rainer Zocholl
[EMAIL PROTECTED](Savin Gorup)  07.12.02 11:54

Once upon a time Savin Gorup shaped the electrons to say...

There has been some interest in that topic before here
(http://www.mail-archive.com/rsync@lists.samba.org/msg03306.html) and

From: Martin Bene 
Subject: rsync 2.5.1 on NT/cygwin: can't handle filenames with non-latin1 character 
set 
Date: Sat, 09 Mar 2002 05:25:18 -0800 

when using rsync on NT: rsync can't handle filenames with strange 
  
$ rsync -av /cygdrive/c/data/transfer/Marisa/ Marisa/
building file list ... readlink Imagelep. 10?1: No such file or directory
readlink Imagelep. 11?2: No such file or directory
readlink Imagelep. 9?1: No such file or directory
done

That sounds very much beeing the API problem of _findfirst
converting unicode to 0x3F

Yes, NT-_findfirst delivers filenames which are unusable
for a fileopen! 


One attempt, at least to be able to open that file from
8bit world, maybe using the 8.3 name mangeling..
But on long directories that is very bad for the performance.



-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: SPAM on List...

2002-11-16 Thread Rainer Zocholl


The last spam originates from a computer 
listed in RBL ipwhois.rfc-ignorant.org


I don't think that any regular would have any problem
if emails from boxes listed as RfC Ignorant are rejected, or?




U-Received: from black-wizards (unknown [62.248.1.189]) by lists.samba.org 
(Postfix) with SMTP id 927032C06A for [EMAIL PROTECTED]; Sat, 16 Nov 2002 

inetnum:  62.248.0.0 - 62.248.15.255
netname:  KABLONET
descr:Cable Operator Network of Turk Telekom
descr:Antalya
country:  TR
status:   ASSIGNED PA
notify:   [EMAIL PROTECTED]

role: TT Administrative Contact Role
address:  Turk Telekom
address:  Bilisim Aglari Dairesi
address:  Aydinlikevler


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: SPAM on List...

2002-11-15 Thread Rainer Zocholl
[EMAIL PROTECTED](jw schultz)  14.11.02 12:41

Once upon a time jw schultz shaped the electrons to say...

On Thu, Nov 14, 2002 at 03:01:02PM +, Bruno Ferreira wrote:
 - Hold its message
 - Send an email to that address stating that, once it is not
 a
 subscriber, it must reply to this e-mail (which contains some sort
 of message ID/stamp).
 - If it's a real person on the other side, he/she will reply
 and
 the message gets posted. If no reply is obtained for say... 3 days
 (?) then the original message gets discarded.

Hmm.  Sounds like an ideal candidate for DoS.  Someone sends
a pile of large emails and doesn't confirm.  

That can happen always with any mailing system.

Another problem may be, that the confirmation request
maybe sent to a third guy. Mail bombing him.

But:
That's possible too with a closed list that tells
only the envelope-from that it is closed.

There is no free lunch...



Rainer

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html