I would recommend *not* to use too many OSTs as this causes fragmentation of the free space, and excess overhead in managing the connections. Today, single OSTs can be up to 500TiB in size (or larger, though not necessarily optimal for performance). Depending on your cluster size and total capacity, it is typical for large systems to have a couple hundred OSTs, 2-4 per OSS balancing the storage and network bandwidth.
On Jan 12, 2024, at 07:37, Backer via lustre-discuss <[email protected]<mailto:[email protected]>> wrote: Hi All, What is the recommendation on the total number of OSTs? In order to maximize throughput, go for more number of OSS with small OSTs. This means that it will end up with 1000s of OSTs. Any suggestions or recommendations? Thank you, Cheers, Andreas -- Andreas Dilger Lustre Principal Architect Whamcloud
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
