So at my last job we used to rsync data between isilons across campus, and
isilon to Windows File Cluster (and back).
I recommend using dry run to generate a list of files and then use this to run
with rysnc.
This allows you also to be able to break up the transfer into batches, and
check if
Hi Jonathan,
yes you are correct! but we plan to resync this once or twice every week for
the next 3-4months to be sure everything is as it should be.
Right now we are focused on getting them synced up and then we will run
scheduled resyncs/checks once or twice a week depending on the data
On 17/11/2020 15:55, Simon Thompson wrote:
Fortunately, we seem committed to GPFS so it might be we never have to do
another bulk transfer outside of the filesystem...
Until you want to move a v3 or v4 created file-system to v5 block sizes __
You forget the v2 to v3 for more than
>Fortunately, we seem committed to GPFS so it might be we never have to do
>another bulk transfer outside of the filesystem...
Until you want to move a v3 or v4 created file-system to v5 block sizes __
I hopes we won't be doing that sort of thing again...
Simon
On Tue, Nov 17, 2020 at 01:53:43PM +, Jonathan Buzzard wrote:
> On 17/11/2020 11:51, Andi Christiansen wrote:
> > Hi all,
> >
> > thanks for all the information, there was some interesting things
> > amount it..
> >
> > I kept on going with rsync and ended up making a file with all top
> >
On 17/11/2020 11:51, Andi Christiansen wrote:
Hi all,
thanks for all the information, there was some interesting things
amount it..
I kept on going with rsync and ended up making a file with all top
level user directories and splitting them into chunks of 347 per
rsync session(total 42000 ish
Hi Jan,
We are syncing ACLs, groups, owners and timestamps aswell :)
/Andi Christiansen
> On 11/17/2020 1:07 PM Jan-Frode Myklebust wrote:
>
>
> Nice to see it working well!
>
> But, what about ACLs? Does you rsync pull in all needed metadata, or do
> you also need to sync ACLs
Hi all,
thanks for all the information, there was some interesting things amount it..
I kept on going with rsync and ended up making a file with all top level user
directories and splitting them into chunks of 347 per rsync session(total 42000
ish folders). yesterday we had only 14 sessions
Hi, Andi, sorry I just took your 20Gbit for the sign of 2x10Gbps bons, but
it is over two nodes, so no bonding. But still, I'd expect to open several
TCP connections in parallel per source-target pair (like with several
rsyncs per source node) would bear an advantage (and still I thing NFS
Hi Andi,
what about leaving NFS completeley out and using rsync (multiple rsyncs
in parallel, of course) directly between your source and target servers?
I am not sure how many TCP connections (suppose it is NFS4) in parallel
are opened between client and server, using a 2x bonded interface
10 matches
Mail list logo
