Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-25 Thread Dilger, Andreas
You should be able to push using SSH, which I'd imagine would not be blocked? It is possible to also fetch patches via http and git protocol, but I don't think we allow unauthenticated pushes. Cheers, Andreas > On Nov 25, 2017, at 15:01, Daniel Kobras wrote: > > Hi! > > >> Am 20.11.2017 u

Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-25 Thread Daniel Kobras
Hi! > Am 20.11.2017 um 00:01 schrieb Dilger, Andreas : > > It would be interesting to strace your rsync vs. "lfs migrate" read/write > patterns so that the copy method of "lfs migrate" can be improved to match > rsync. Since they are both userspace copy actions they should be about the > same

Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-24 Thread Dilger, Andreas
, November 19, 2017 4:01 PM > To: Dauchy, Nathan (ARC-TNC)[CSRA, LLC] > Cc: lustre-discuss@lists.lustre.org > Subject: Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout > swap > > It would be interesting to strace your rsync vs. "lfs migrate" read/write

Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-24 Thread Dauchy, Nathan (ARC-TNC)[CSRA, LLC]
[andreas.dil...@intel.com] Sent: Sunday, November 19, 2017 4:01 PM To: Dauchy, Nathan (ARC-TNC)[CSRA, LLC] Cc: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap It would be interesting to strace your rsync vs. "lfs migrate"

Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-20 Thread Dauchy, Nathan (ARC-TNC)[CSRA, LLC]
19, 2017 4:01 PM To: Dauchy, Nathan (ARC-TNC)[CSRA, LLC] Cc: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap It would be interesting to strace your rsync vs. "lfs migrate" read/write patterns so that the copy method of

Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-19 Thread Dilger, Andreas
It would be interesting to strace your rsync vs. "lfs migrate" read/write patterns so that the copy method of "lfs migrate" can be improved to match rsync. Since they are both userspace copy actions they should be about the same performance. It may be that "lfs migrate" is using O_DIRECT to mini

Re: [lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-19 Thread Brian Andrus
I may be off, but I think the big gain with lfs_migrate is with live files. Using rsync, you may end up with a file that is not the same if changes occurred during the sync, whereas lfs_migrate is taking those changes into account so there is no deviation. Such "belt and suspenders" will incur

[lustre-discuss] lfs_migrate rsync vs. lfs migrate and layout swap

2017-11-19 Thread Dauchy, Nathan (ARC-TNC)[CSRA, LLC]
Greetings, I'm trying to clarify and confirm the differences between lfs_migrate's use of rsync vs. "lfs migrate". This is in regards to performance, checksumming, and interrupts. Relevant code changes that introduced the two methods are here: https://jira.hpdd.intel.com/browse/LU-2445 https:/