Re: [lustre-discuss] 2.14 against mofed 5.5.1.0.3.2-rhel7.9

2022-03-07 Thread Patrick Farrell via lustre-discuss
Michael, Perhaps more importantly, Lustre 2.15 hasn't been released yet. (In general, the recommended matrix is maintenance release to maintenance release - So 2.15 clients and 2.12 servers will be a recommended configuration, once 2.15 is released.) -Patrick

Re: [lustre-discuss] Write Performance is Abnormal for max_dirty_mb Value of 2047

2022-03-27 Thread Patrick Farrell via lustre-discuss
Hasan, Historically, there have been several bugs related to write grant when max_dirty_mb is set to large values (depending on a few other details of system setup). Write grant allows the client to write data in to memory and write it out asynchronously. When write grant is not available to

Re: [lustre-discuss] RE-Fortran IO problem

2022-02-03 Thread Patrick Farrell via lustre-discuss
Denis, FYI, the git link you provided seems to be non-public - it asks for a GSI login. Fortran is widely used for applications on Lustre, so it's unlikely to be a fortran specific issue. If you're seeing I/O rates drop suddenly during​ activity, rather than being reliably low for some

Re: [lustre-discuss] Lustre Client Lockup Under Buffered I/O (2.14/2.15)

2022-01-19 Thread Patrick Farrell via lustre-discuss
Ellis, As you may have guessed, that function just set looks like a node which is doing buffered I/O and thrashing for memory. No particular insight available from the count of functions there. Would you consider opening a bug report in the Whamcloud JIRA? You should have enough for a good

Re: [lustre-discuss] Avoiding system cache when using ssd pfl extent

2022-05-19 Thread Patrick Farrell via lustre-discuss
No, and I'm not sure I agree with you at first glance. Is this just generally an idea that data stored on SSD should not be in RAM? If so, there's no mechanism for that other than using direct I/O. -Patrick From: lustre-discuss on behalf of John Bauer Sent:

Re: [lustre-discuss] Avoiding system cache when using ssd pfl extent

2022-05-19 Thread Patrick Farrell via lustre-discuss
Well, you could use two file descriptors, one for O_DIRECT one otherwise.  SSD is a fast medium but my instinct is the desirability of having data in RAM is much more about I/O pattern and hard to optimize for in advance - Do you read the data you wrote? (Or read data repeatedly?) In any

Re: [lustre-discuss] Mounting lustre on block device

2023-03-16 Thread Patrick Farrell via lustre-discuss
Lustre doesn't show up in lsblk on the client because it isn't a block device on the client. NFS and other network file systems also don't show up lsblk, for the same reason. -Patrick From: lustre-discuss on behalf of Shambhu Raje via lustre-discuss Sent:

Re: [lustre-discuss] Question regarding user access during recovery and journal replay

2023-03-14 Thread Patrick Farrell via lustre-discuss
Marc, [Re-posting to the list...] No, it’s fine to have interaction during those times. The system is designed to do that work online. Depending what you’re trying to do and what you’re accessing, some client operations will experience delays, but that’s it. For example, during

Re: [lustre-discuss] Joining files

2023-03-30 Thread Patrick Farrell via lustre-discuss
preferably 1MB multiples to maintain RAID alignment). > >Is this something that you would be willing to work on with guidance for the >implementation details, or a feature request that you hope someone else will >implement? > >Cheers, Andreas > >On Mar 29, 2023, at 07:41, Pat

Re: [lustre-discuss] Joining files

2023-03-29 Thread Patrick Farrell via lustre-discuss
Sven, The "combining layouts without any data movement" part isn't currently possible. It's probably possible in theory, but it's never been implemented. (I'm curious what your use case is?) Even allowing for data movement, there's no tool to do this for you. Depending what you mean by