apps
work fine over this link - maybe I should say "NT-specific rsync bug" :-)]
--
Cheers
Jason Haar
Unix/Network Specialist, Trimble NZ
Phone: +64 3 9635 377 Fax: +64 3 9635 417
t-of-whack and calls it
corruption...
Can rsync copy the files over to a temp dir, and then move them live as one
move? I know I could do this with ssh directly, but the "--compare-dest" and
"--partial" options make me wonder if rsync can do this itself...
Is it possible?
--
C
definitely be a download-from-scratch repair...
--
Cheers
Jason Haar
Unix/Special Projects, Trimble NZ
Phone: +64 3 9635 377 Fax: +64 3 9635 417
SSL transport layer with
nothing else to worry about, whereas sshd implies accounts with
password/access management,etc,etc.
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
ensuring the
permissions are always set to that value (setting the umask before starting
rsync doesn't do the same thing, as this should be settable at the module
level).
At the moment doesn't there seem to be a bit too much relying on the client
to do the right thing?
--
Cheers
Jason Haar
$ Windows - this just won't be possible BTW - ever hear
of locking? ;-)]
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read
...
BTW: if this is an Exchange server being talked about, NEVER, EVER, TOUCH AN
EXCHANGE DATABASE WHEN IT'S RUNNING. You *will* crash it.
I know: I did :-)
[Apparently it's a feature...]
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3
The rsync.spec file within the rsync tar package is still broken, so here's
a working rsync.spec file.
Simply (as root) copy rsync-2.5.4.tar.gz into /usr/src/redhat/SOURCES then
run rpm -ba rsync.spec to produce rsync-2.5.4-1.i386.rpm
--
Cheers
Jason Haar
Information Security Manager
]
5 rsync transmits files
...etc
That would send a little bit more network traffic, but will it take
up less total dialup time? I don't know...
[guess it's time for a DJB saying: don't speculate - evaluate!]
--
Cheers
Jason Haar
Information Security Manager
Trimble Navigation Ltd.
Phone: +64 3
of RAID'ed-NBD, CODA or
Intermezzo for a similar effect?
The NBD (network block device) looks interesting, it allows you to mount a
remote raw partition - so you can effectively RAID over the network.
Supports transaction logs too (which would be necessary in a rsync-style role)
--
Cheers
Jason Haar
with it, then THEY can do
network rate-limiting :-)
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change options: http://lists.samba.org/mailman
), the drivers make all filenames uppercase, whereas
on others (linux, mac) all the filenames are lowercase.
What's wrong with using check=relaxed when mounting the fat partition?
Doesn't that help (see man mount)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64
client...
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read
they are in use. Whether that's a good idea I leave
for others to discover the hard way... ;-)
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change
that any
partially transmitted file could be kept in a dir separate from the real
data, and when the transfer successfully finishes, renamed/copied into the
live area...
Am I missing something obvious here?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org
really have that massive an
impact for rsync-over-WAN?
BTW: what would be the best way of running rsync for such an environment? We
currently just do rsync -az src_dir/ remote::xxx/dst_dir
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3
On Thu, Jul 22, 2004 at 07:33:21PM -0700, Wayne Davison wrote:
On Fri, Jul 23, 2004 at 02:15:04PM +1200, Jason Haar wrote:
is there any intention of a new improved --partial option whereby
any failed uploads are kept as temp files
I had been contemplating whether we need a new option
Tauya Mhangami wrote:
Can I copy an Oracle database by just copying that Oracle Database
datafiles and moving them to another server with oracle? If
possible can one back up a database using this same method.
Why don't you try it and see?
I don't think it'll work reliably. As you are running
, then splitting into X
separate jobs? Even a rough guess at it could make a difference.
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change
There's also rsnapshot. Defaults to hourly and 7-day rolling backups,
using hard-links to save diskspace (i.e. if files haven't changed from
one run to the next). Saves a tonne of diskspace :-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax
Lawrence D. Dunn wrote:
Renater was using rsync to pull large amounts of data from FermiLab
across a fast,
long link, and was getting poor throughput (~20mbits/sec).
Man - I wish I had your problem ;-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone
in our high
speed, high latency environment?
Thanks!
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change options: https://lists.samba.org
have fat
pipes and yet a single rsync session cannot saturate it due to the
latency. I'm wondering if SCTP could help? (I'm guessing it would as
running multiple copies of rsync in parallel also fixes our problem)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone
- because that means
users and apps (such as rsync) would experience better throughput.
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe
anything regarding the
filenames.
So is there some smoke-n-mirrors going on in there? Why did the client
compress data.gz - even though it was mentioned on the server as dont
compress?
Enquiring minds would like to know :-)
Thanks!
--
Cheers
Jason Haar
Information Security Manager, Trimble
Wayne Davison wrote:
On Fri, Oct 13, 2006 at 01:08:54PM +1300, Jason Haar wrote:
Looks like rsync decided to compress data.gz even though
/etc/rsyncd.conf had *.gz in it's dont compress section...
That setting only affects files being pulled from an rsync daemon, not
pushed to one
- but the final rename on top of
the original file failed.
Rsync didn't return an error. It should?
Help? Is this a bug with rsync, or with Samba (perhaps it returned OK on
the rename when it shouldn't have?)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3
Wayne Davison wrote:
On Thu, Oct 19, 2006 at 03:28:56PM +1300, Jason Haar wrote:
bash$ rsync /tmp/other.txt file.doc
bash$ echo $?
0
Re-run the same command under strace:
strace rsync -av /tmp/other.txt file.doc
Too late - I bet you to it :-) I just replied to the rsync
present (on files only - you can ignore the ones on
dirs), then rename the new files out to a staging dir - then rsync that
instead. It guarantees the files have been finished, and even lets the
Windows users know the files have been picked up (as they disappear)
--
Cheers
Jason Haar
Information
. That works fine -
it's only when called directly that it fails...
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change options: https
doesn't
match your symptoms)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
? If so, how would you manhandle rsync (a TCP app) to be
able to use them? Any such thing as a TCP-to-SCTP proxy?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
command is nearly compressed and so doesn't need it. However,
in my totally unscientific test I just sniffed a transfer, extracted the
file listing data, and compressed it with gzip. Knocked 66% off the size...)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3
in them like it can in
text files/etc.
(hope there's nothing too incorrect in the above. I'm sure someone will
shout at me if I'm wrong ;-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6
to use the --iconv option (all
this language-specific stuff gives me a headache ;-)
Thanks
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all
random filenames I
created and it's fine. But I certainly didn't do it for every language
combination. There just seems to be enough historical noise around this
issue that it was worth asking.
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64
;-) [sometimes more options isn't a good idea...]
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting
could try nice to lower the
priority rsync runs at
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting
: it allows our security
group to use the server group infrastructure for backups/storage,
without giving them access to the data...
Jason
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F
with one of the CIFS mounts?
Jason
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3 9635 417
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting the mailing
did you try scp (although that could be CPU-bound due to crypto), ftp or
wget - ie see how other TCP apps do the same job? If they all show the
same speed - it's not an rsync problem
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +64 3 9635 377 Fax: +64 3
against the gluster service?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change
file copied
somewhere by rsync NOT using the --sparse option be 100% equivalent to
the original?
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all
: an enterprise
competitor to all those cloudy services such as Dropbox/etc. :-) [well,
probably need that VSS patch for rsync-win32 too ;-)]
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
Hi there
That looks very interesting, but can I make suggestion? Don't call it
should. That simply means no-one will ever be able to find it using a
search engine. :-)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407
in another country, and can never
get more than (say) 5Mbs. Parallelizing the data transfer could easily
push that up to 20-30Mbs
...and there is a competitor to rsync that does this - bbcp. Mirror a
directory from hostA to hostB using 'N' tcp streams. Runs like the
clappers :-)
--
Cheers
Jason Haar
to be thought through. It would be nice to
have the ability, but that doesn't mean everyone would use it all the time
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply
for, and joins it all up at the other end
I have tested rsync over a 100Mbs continental link and am lucky to get
10Mbs. Using bbcp with 4-6 channels, I can get 40-50Mbs (that's on a
link with other real traffic on it - so it may have actually got
80-90Mbs byt itself for all I know)
--
Cheers
Jason Haar
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org
under Windows.
(BTW it's openssl s_client - which acts as a I/O pipe. I have also
tried socat - same problem)
--
Cheers
Jason Haar
Information Security Manager, Trimble Navigation Ltd.
Phone: +1 408 481 8171
PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
--
Please use
51 matches
Mail list logo