Re: [lustre-discuss] Data stored in OST [EXT]

2023-06-18 Thread Peter Grandi via lustre-discuss
>> Our last DDN system has OST's using 14TB disks. > That's quite popular. If single-digit transfer rates per-HDD > for HPC clusters are the goal, that's ideal :-). [...] I was just discussing this with someone and they pointed out that can be a reasonable goal, and indeed it can be, even if not

Re: [lustre-discuss] Data stored in OST [EXT]

2023-06-15 Thread Peter Grandi via lustre-discuss
>>> What would be the problem with large 'datacenter' type HDD's >>> for an OST (in raid10 for instance)? > Very, very low IOPS-per-TB, leading to terrifyingly low speed > under combined user and maintenance load. [...] > Our last DDN system has OST's using 14TB disks. That's quite popular. If

Re: [lustre-discuss] Data stored in OST

2023-06-11 Thread Peter Grandi via lustre-discuss
>>> The usual practice is to use RAUD10 for the MDT(s) on >>> "enterprise" high-endurance SSD, and RAID6 for the OST on >>> "professional" mixed-load SSDs or "small" (1-2TB at most) >>> "datacenter" HDDs, fronted by failover-servers. > What would be the problem with large 'datacenter' type HDD's

Re: [lustre-discuss] Data stored in OST

2023-05-23 Thread BALVERS Martin via lustre-discuss
uot;datacenter" HDDs, fronted by failover-servers. What would be the problem with large 'datacenter' type HDD's for an OST (in raid10 for instance)? Thanks, Martin Balvers -Original Message- From: lustre-discuss On Behalf Of Peter Grandi via lustre-discuss Sent: Monday, May 22, 2023 1

Re: [lustre-discuss] Data stored in OST

2023-05-22 Thread Peter Grandi via lustre-discuss
>>> On Mon, 22 May 2023 13:08:19 +0530, Nick dan via lustre-discuss >>> said: > Hi I had one doubt. In lustre, data is divided into stripes > and stored in multiple OSTs. So each OST will have some part > of data. My question is if one OST fails, will there be data > loss? This is extensively

Re: [lustre-discuss] Data stored in OST

2023-05-22 Thread Nick dan via lustre-discuss
Hi Thank you for your reply Yes, the OSTs must provide internal redundancy - RAID-6 typically Can RAID_6 be replaced with mirror/RAID0? Which type of RAID is recommended for MDT and OST? Also can you brief on how data will be read/written in Lustre with ZFS is used as backend filesystem in

Re: [lustre-discuss] Data stored in OST

2023-05-22 Thread Andreas Dilger via lustre-discuss
Yes, the OSTs must provide internal redundancy - RAID-6 typically. There is File Level Redundancy (FLR = mirroring) possible in Lustre file layouts, but it is "unmanaged", so users or other system-level tools are required to resync FLR files if they are written after mirroring. Cheers,

[lustre-discuss] Data stored in OST

2023-05-22 Thread Nick dan via lustre-discuss
Hi I had one doubt. In lustre, data is divided into stripes and stored in multiple OSTs. So each OST will have some part of data. My question is if one OST fails, will there be data loss? Please advise for the same. Thanks and regards Nick ___