Re: [lustre-discuss] Renaming or Moving directories on Lustre?

2023-02-27 Thread Andreas Dilger via lustre-discuss
On Feb 27, 2023, at 11:57, Grigory Shamov mailto:grigory.sha...@umanitoba.ca>> wrote: Hi All, What happens if a directory on Lustre FS gets moved with a regular CentOS7 mv command, within the same filesystem? On CentOS 7, using mv from the distro, like this, as root: mv /project/TEMP/user

Re: [lustre-discuss] Renaming or Moving directories on Lustre?

2023-02-27 Thread Philippe Weill via lustre-discuss
Le 27/02/2023 à 19:57, Grigory Shamov a écrit : Hi All, What happens if a directory on Lustre FS gets moved with a regular CentOS7 mv command, within the same filesystem? On CentOS 7, using mv from the distro, like this, as root: mv /project/TEMP/user /project/XYZ/user It looks like

[lustre-discuss] About optimize the performance on small files

2023-02-27 Thread 王烁斌 via lustre-discuss
Hi~ About version 2.15.2 of Lustre. Is there any way to optimize the performance on small files? Thanks and regards!___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Question about lustre deduplication?

2023-02-27 Thread Andreas Dilger via lustre-discuss
On Feb 27, 2023, at 05:59, yuehui gan via lustre-discuss mailto:lustre-discuss@lists.lustre.org>> wrote: hello all does lustre have deduplication? is this in the development plan? thanks Lustre on ZFS has dedpulication at the ZFS level. There is no deduplication across OSTs. Cheers,

[lustre-discuss] DUE TOMORROW (Feb 28): LUG 2023 Call for Presentations

2023-02-27 Thread OpenSFS Administration via lustre-discuss
Hello Lustre Community, Tomorrow, February 28th, is the last day to submit abstract submissions for LUG 2023. The Lustre User Group (LUG) conference is the high performance computing industry's primary venue for discussion on the open source

[lustre-discuss] Renaming or Moving directories on Lustre?

2023-02-27 Thread Grigory Shamov
Hi All, What happens if a directory on Lustre FS gets moved with a regular CentOS7 mv command, within the same filesystem? On CentOS 7, using mv from the distro, like this, as root: mv /project/TEMP/user /project/XYZ/user It looks like the content gets copied entirely. Which for large data

Re: [lustre-discuss] How lustre uses the replication

2023-02-27 Thread Andreas Krause via lustre-discuss
Yuehui, If you intend to replicate one file system entirely and you want to use lustre tools, you might want to check out lustre_rsync as documented in the lustre wiki. Or, if the intend is to replicate data/files within a filesystem, lfs mirror as pointed out by Collin could be used. Both

Re: [lustre-discuss] OSTs per OSS question

2023-02-27 Thread James Lam via lustre-discuss
We were building the ZFS based OST and we also found out I/O wait even when 4 OST per shelf. please lower the amount of OST available as the HBA may not be sustainable for that high I/O . we are now using enterprise Linux (like Cray) as they are designed to have high I/O. we would like to see

[lustre-discuss] OSTs per OSS question

2023-02-27 Thread Kurt Strosahl via lustre-discuss
Good Morning, I'm in the early phases of a new lustre file system design. One thing we are observing on our lustre file system from 2019 (running 2.12.9-1) is that the oss systems report a lot of time spent in i/o wait. We are configured with two oss systems connected via sas cables to a

Re: [lustre-discuss] How lustre uses the replication

2023-02-27 Thread Colin Faber via lustre-discuss
I think you're after "lfs mirror" and related commands. On Mon, Feb 27, 2023, 12:53 AM yuehui gan via lustre-discuss < lustre-discuss@lists.lustre.org> wrote: > But I can't find the relevant implementation, Is there a third-party > lustre replication implementation? > any help would be

[lustre-discuss] Question about lustre deduplication?

2023-02-27 Thread yuehui gan via lustre-discuss
hello all does lustre have deduplication? is this in the development plan? thanks regards Yuehui ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] dkms error in zfs

2023-02-27 Thread Nick dan via lustre-discuss
Hi Trying to build lustre with this [root@sv01 lustre-zfs-2.15.2]# dkms build lustre-zfs/2.15.2 checking for LIBNL3... no configure: error: Package requirements (libnl-genl-3.0 >= 3.1) were not met: Package 'libnl-genl-3.0', required by 'virtual:world', not found Consider adjusting the