Hi, there’s the Data on MDT feature which does exactly this. See Chapter 20 of the Lustre manual; quote:
The Lustre Data on MDT (DoM) feature improves small file IO by placing small files directly on the MDT, and also improves large file IO by avoiding the OST being affected by small random IO that can cause device seeking and hurt the streaming IO performance. Therefore, users can expect more consistent performance for both small file IO and mixed IO patterns. Cheers, Knut Von: lustre-discuss <[email protected]> Im Auftrag von ??? via lustre-discuss Gesendet: Dienstag, 28. Februar 2023 04:29 An: [email protected] Betreff: [lustre-discuss] About optimize the performance on small files Hi~ About version 2.15.2 of Lustre. Is there any way to optimize the performance on small files? Thanks and regards！
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
