Re: [lustre-discuss] Lustre LTS 2.10 on el6.x ... was Re: File locking errors.

2018-02-15 Thread Jones, Peter A
Hi Alex I’m afraid that although the builders are still in place and the patch series remains in the tree, EL6.x servers have not been actively tested or maintained for a long time on master and it would take some testing and engineering effort to ensure that it was in a usable state. It’s poss

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Patrick Farrell
Ah, it sounds like HDF is using file locking to keep *other* possible users out, rather than for its own consistency requirements. It's only trying to use flock on Lustre because configure detects it's on a platform (Linux) that supports flocks. But Lustre doesn't necessarily. That makes sens

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Arman Khalatyan
ok, you are right, localflock might be a problem on parallel access, but at least our code is started to work after that.just for information the thread from hdf is following: https://lists.hdfgroup.org/pipermail/hdf-forum_lists.hdfgroup.org/2016-May/009483.html Am 16.02.2018 12:30 vorm. schrieb

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Patrick Farrell
Localflock will only provide flock between threads on the same node. I would describe it as “likely to result in data corruption unless used with extreme care”. Are you sure HDF only ever uses flocks between threads on the same node? That seems extremely unlikely or maybe impossible for HDF

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Arman Khalatyan
we had similar troubles with hdf1.10 vs hdf1.8.x. on the lustre the new hdf require flock support from the underlying filesystem( due to the security reasons or whatever more info on hdf you can digg in hdf forums) to fix the mounts you should unmount an mount again with the option localflock, this

[lustre-discuss] Lustre LTS 2.10 on el6.x ... was Re: File locking errors.

2018-02-15 Thread Alexander I Kulyavtsev
Eli, since lustre version 2.10.1 intel build server has server rpms for el6.9 with in kernel ofed (but not on download server). e.g. 2.10.3 GA https://build.hpdd.intel.com/job/lustre-b2_10/69/ It means lustre 2.10.x at least builds on el6.9 and I guess it shall be easier with patchless server (zf

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread E.S. Rosenberg
On Fri, Feb 16, 2018 at 12:00 AM, Colin Faber wrote: > If the mount on the users clients had the various options enabled, and > those aren't present in fstab, you'd end up with such behavior. Also 2.8? > Can you upgrade to 2.10 LTS?? > Depending on when they installed their system that may not be

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Colin Faber
If the mount on the users clients had the various options enabled, and those aren't present in fstab, you'd end up with such behavior. Also 2.8? Can you upgrade to 2.10 LTS?? On Feb 15, 2018 1:06 PM, "Prentice Bisbal" wrote: > No. Several others have asked me the same thing, so that seems like

Re: [lustre-discuss] Project quota Lustre/ZFS

2018-02-15 Thread Jones, Peter A
Riccardo That change provides the Lustre changes necessary to provide the support but you would need to be using a version of ZFS that provides this option. As it happens this work just landed to ZFS for the upcoming 0.8 release and so when that is GA it should be possible to use this feature.

[lustre-discuss] Project quota Lustre/ZFS

2018-02-15 Thread Riccardo Veraldi
Hello, is Project quota supported on Lustre 2.10.3/ZFS. Apparently LU-7991 adds it as a feature. Anyone may confirm it does work ? thank you Riccardo ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Prentice Bisbal
No. Several others have asked me the same thing, so that seems like it might be the issue. The only problem with that solution is that the user claimed his program worked just fine up until a couple of weeks ago, so if that is the issue, I'll still be scratching my head trying to figure out how

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Prentice Bisbal
Version 2.8.0 on the clients. Not sure what's on the servers, since I don't manage them, and I can't find the guy who does at the moment. Prentice On 02/15/2018 12:11 PM, Jones, Peter A wrote: Prentice Do you know which version of Lustre is in use? Peter On 2018-02-15, 9:02 AM, "lustre-d

Re: [lustre-discuss] Lustre as /home directory

2018-02-15 Thread E.S. Rosenberg
What will your backup/snapshot strategy going to be and how will you implement it? On Thu, Feb 15, 2018 at 5:30 PM, Mark Hahn wrote: > My question is, Is it advisable to have /home in Lustre since users data >> will be of small files (less than 5MB)? >> > > certainly it works, but is not very pl

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Alexander I Kulyavtsev
Do you have flock option in fstab for lustre mount or in command you use to mount lustre on client? Search for flock on lustre wiki http://wiki.lustre.org/Mounting_a_Lustre_File_System_on_Client_Nodes or lustre manual http://doc.lustre.org/lustre_manual.pdf Here are links where to start learning

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Patrick Shopbell
Hi Prentice, Is it possible that the file system isn't mounted with the "flock" option? We're running an older Lustre 2.5, but we have to mount it with the options "user_xattr,flock" to ensure everything is working. -- Patrick On 2/15/18 9:11 AM, Jones, Peter A wrote: Prentice Do you know whi

Re: [lustre-discuss] File locking errors.

2018-02-15 Thread Jones, Peter A
Prentice Do you know which version of Lustre is in use? Peter On 2018-02-15, 9:02 AM, "lustre-discuss on behalf of Prentice Bisbal" wrote: >Hi. > >I'm an experience HPC system admin, but I know almost nothing about >Lustre administration. The system admin who administered our small >Lust

[lustre-discuss] File locking errors.

2018-02-15 Thread Prentice Bisbal
Hi. I'm an experience HPC system admin, but I know almost nothing about Lustre administration. The system admin who administered our small Lustre filesystem recently retired, and no one has filled that gap yet. A user recently reported they are now getting file-locking errors from a program t

Re: [lustre-discuss] Lustre as /home directory

2018-02-15 Thread Mark Hahn
My question is, Is it advisable to have /home in Lustre since users data will be of small files (less than 5MB)? certainly it works, but is not very pleasant for metadata-intensive activity, such as compiling. ___ lustre-discuss mailing list lustre-d