Re: [lustre-discuss] About Lustre small files performace(8k) improve

2023-03-27 Thread Andreas Dilger via lustre-discuss
Are your performance tests on NFS or on native Lustre clients? Native Lustre clients will likely be faster, and with many clients they can create files in parallel, even in the same directory. With a single NFS server they will be limited by the VFS locking for a single directory. Are you

Re: [lustre-discuss] From ceph to lustre. what is the right setup for high availability in a small cluster?

2023-03-27 Thread Laura Hild via lustre-discuss
Hi Arvid- > This makes me wonder what lustre even adds in this scenario, > since zfs is already doing the heavy lifting of managing > replication and high availability. ZFS by itself is a local filesystem which you can only mount on one host at a time; what Lustre adds is taking several ZFS

Re: [lustre-discuss] About Lustre small files performace(8k) improve

2023-03-27 Thread Cameron Harr via lustre-discuss
I'll assume here you're referring to MPI-IO, which is not really a "feature" but a way to perform parallel I/O using the message passing interface (MPI) stack. There can also be different interpretations of what MPI-IO exactly means: many HPC applications (and benchmarks such as IOR) use MPI