I'd recommend using the io500 benchmark. This runs both bandwidth and metadata tests and has checks to run prevent caching from tainting the results (like forcing it to run for a specified amount of time). I've found it useful for benchmarking all of our file systems (lustre, NFS, local, etc.) and is very useful for comparing performance.
https://io500.org/ Darby From: lustre-discuss <[email protected]> on behalf of Athinagoras Skiadopoulos via lustre-discuss <[email protected]> Reply-To: Athinagoras Skiadopoulos <[email protected]> Date: Wednesday, May 19, 2021 at 1:36 PM To: "[email protected]" <[email protected]> Subject: [EXTERNAL] [lustre-discuss] Benchmarking Lustre, reduce caching Hello, We are using Lustre in our cluster as an external service and would like to measure the write/read performance we can achieve. Right now, we are creating a number of files, and iteritavely: - pick a file to open - write/read it in 1MB chunks (block size) - close it Each of our servers has a 3000Mbps bandwidth, but we are often reporting higher read/write throughput. There should be some caching involved. What would be a good way to alleviate this? Thank you in advance.
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
