Yuehui, If you intend to replicate one file system entirely and you want to use lustre tools, you might want to check out lustre_rsync as documented in the lustre wiki. Or, if the intend is to replicate data/files within a filesystem, lfs mirror as pointed out by Collin could be used.
Both documented here: Lustre* Software Release 2.x (whamcloud.com)<https://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml> Other than that, the usual suspects can be used, such as rsync or mpifileutils and so on. Cheers! Andreas From: lustre-discuss <[email protected]> On Behalf Of Colin Faber via lustre-discuss Sent: Monday, February 27, 2023 8:56 AM To: yuehui gan <[email protected]> Cc: lustre-discuss <[email protected]> Subject: Re: [lustre-discuss] How lustre uses the replication I think you're after "lfs mirror" and related commands. On Mon, Feb 27, 2023, 12:53 AM yuehui gan via lustre-discuss <[email protected]<mailto:[email protected]>> wrote: But I can't find the relevant implementation, Is there a third-party lustre replication implementation? any help would be appreciated. Regards, Yuehui ________________________________ From: lustre-discuss <[email protected]<mailto:[email protected]>> on behalf of yuehui gan via lustre-discuss <[email protected]<mailto:[email protected]>> Sent: Monday, February 27, 2023 15:44 To: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> Subject: [lustre-discuss] How lustre uses the replication hello all Does luster have a replication function, is this in the development plan? I have read this article abot lustre file-level replication. https://wiki.lustre.org/images/a/ad/LUG2014-File_Level_Replication-Xiong.pdf<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.lustre.org%2Fimages%2Fa%2Fad%2FLUG2014-File_Level_Replication-Xiong.pdf&data=05%7C01%7C%7Cacbc9146f18d4ce1a4f908db18ca7607%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C638131030060695171%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PA4NiVYNwtb3T%2Bc2FgFYI%2F2N2FMW7xbuMQ6zUOkzQ2s%3D&reserved=0> _______________________________________________ lustre-discuss mailing list [email protected]<mailto:[email protected]> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.lustre.org%2Flistinfo.cgi%2Flustre-discuss-lustre.org&data=05%7C01%7C%7Cacbc9146f18d4ce1a4f908db18ca7607%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C638131030060851392%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=HVfS15HF66OCJemk%2FAKwAdeiZ43DJvUY%2BuXx38IIZ60%3D&reserved=0>
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
