Hi,
>>Yes, older versions of GPFS don't recognize /dev/nvme*. So you would need /var/mmfs/etc/nsddevices user exit. >>On newer GPFS versions, the nvme devices are also generic
>>>> but has anyone else tried to get lroc running on nvme and how well does it work.
IMHO, the support to recognize /dev/nvme* was added to Spectrum Scale version 5.0.1.
The Spectrum Scale version 5.0.1 has LROC performance enhancements compared to the earlier versions, for file stat/read performance from LROC devices.
Following provides sample performance data using single 1 x mdtest MPI process with LROC data on INTEL SSDPEDMD016T4L for Spectrum Scale version 5.0.0 vs. 5.0.1.
| Benchmark Arguments: | ||||||||||
| mpiexec -f $MACH_FILE -n $MAX_NP $BENCHMARK -i 1 -n $n_files -u -F -T -E -e $file_sz -d $O_DIR | ||||||||||
| Sample: mpiexec -f /mnt/sw_x86/mpich/mf.perf_x86.c72f1m5u27 -n 1 /mnt/sw_x86/benchmarks/mdtest/mdtest -i 1 -n 65536 -u -F -T -E -e '1024' -d /mnt/gpfs3a/lroc_mdtest_out/uniq_dir_1024_65536 | ||||||||||
| 5.0.0 | 5.0.1 | Performance Delta (%) | ||||||||
| File metadata Ops/s | File metadata Ops/s | File Stat | File Read | |||||||
| File Count | File Size (KiB) | File Stat | File Read | File Stat | File Read | |||||
| 16384 | 1 | 4170 | 3979 | 5182 | 4765 | 24.29 | 19.77 | |||
| 16384 | 32 | 3938 | 3585 | 5220 | 4609 | 32.57 | 28.56 | |||
| 65536 | 1 | 1511 | 1319 | 2122 | 1893 | 40.46 | 43.50 | |||
| 65536 | 32 | 1418 | 661 | 2214 | 803 | 56.18 | 21.52 | |||
Best Regards,
-Kums
----- Original message -----
From: "Truong Vu" <[email protected]>
Sent by: [email protected]
To: [email protected]
Cc:
Subject: Re: [gpfsug-discuss] Lroc on NVME
Date: Tue, Jun 12, 2018 9:55 AM
Yes, older versions of GPFS don't recognize /dev/nvme*. So you would need /var/mmfs/etc/nsddevices user exit. On newer GPFS versions, the nvme devices are also generic. So, it is good that you are using the same NSD sub-type.
Cheers,
Tru.gpfsug-discuss-request---06/12/2018 06:47:05 AM---Send gpfsug-discuss mailing list submissions to [email protected]
From: [email protected]
To: [email protected]
Date: 06/12/2018 06:47 AM
Subject: gpfsug-discuss Digest, Vol 77, Issue 15
Sent by: [email protected]
Send gpfsug-discuss mailing list submissions to
[email protected]
To subscribe or unsubscribe via the World Wide Web, visit
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
or, via email, send a message with subject or body 'help' to
[email protected]
You can reach the person managing the list at
[email protected]
When replying, please edit your Subject line so it is more specific
than "Re: Contents of gpfsug-discuss digest..."
Today's Topics:
1. Re: RHEL updated to 7.5 instead of 7.4 (Felipe Knop)
2. Re: RHEL updated to 7.5 instead of 7.4 (Jeffrey R. Lang)
3. Lroc on NVME (Peter Childs)
----------------------------------------------------------------------
Message: 1
Date: Mon, 11 Jun 2018 09:52:16 -0400
From: "Felipe Knop" <[email protected]>
To: gpfsug main discussion list <[email protected]>
Subject: Re: [gpfsug-discuss] RHEL updated to 7.5 instead of 7.4
Message-ID:
<ofe6ed5366.7e225ba2-on002582a9.004c0f93-852582a9.004c3...@notes.na.collabserv.com>
Content-Type: text/plain; charset="utf-8"
Fred,
Correct. The FAQ should be updated shortly.
Felipe
----
Felipe Knop [email protected]
GPFS Development and Security
IBM Systems
IBM Building 008
2455 South Rd, Poughkeepsie, NY 12601
(845) 433-9314 T/L 293-9314
From: "Frederick Stock" <[email protected]>
To: gpfsug main discussion list <[email protected]>
Date: 06/11/2018 07:52 AM
Subject: Re: [gpfsug-discuss] RHEL updated to 7.5 instead of 7.4
Sent by: [email protected]
Spectrum Scale 4.2.3.9 does support RHEL 7.5.
Fred
__________________________________________________
Fred Stock | IBM Pittsburgh Lab | 720-430-8821
[email protected]
From: "Sobey, Richard A" <[email protected]>
To: gpfsug main discussion list <[email protected]>
Date: 06/11/2018 06:59 AM
Subject: Re: [gpfsug-discuss] RHEL updated to 7.5 instead of 7.4
Sent by: [email protected]
Thanks Simon. Do you mean you pinned the minor release to 7.X but yum
upgraded you to 7.Y? This has just happened to me:
[root@ ~]# subscription-manager release
Release: 7.4
[root@ ~]# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 7.5 (Maipo)
Granted I didn?t issue a yum clean all after changing the release however
I?ve never seen this happen before.
Anyway, I need to either downgrade back to 7.4 or upgrade GPFS, whichever
will be the best supported. I need to learn to pay attention to what kernel
version I?m being updated to in future!
Cheers
Richard
From: [email protected]
<[email protected]> On Behalf Of Simon Thompson (IT
Research Support)
Sent: 11 June 2018 11:50
To: gpfsug main discussion list <[email protected]>
Subject: Re: [gpfsug-discuss] RHEL updated to 7.5 instead of 7.4
We have on our DSS-G ?
Have you looked at:
https://access.redhat.com/solutions/238533
?
Simon
From: <[email protected]> on behalf of "Sobey,
Richard A" <[email protected]>
Reply-To: "[email protected]" <
[email protected]>
Date: Monday, 11 June 2018 at 11:46
To: "[email protected]" <[email protected]>
Subject: [gpfsug-discuss] RHEL updated to 7.5 instead of 7.4
Has anyone ever used subscription-manager to set a release to 7.4 only for
the system to upgrade to 7.5 anyway?
Also is 7.5 now supported with the 4.2.3.9 PTF or should I concentrate on
downgrading back to 7.4?
Richard_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180611/d13470c2/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180611/d13470c2/attachment-0001.gif>
------------------------------
Message: 2
Date: Mon, 11 Jun 2018 15:01:48 +0000
From: "Jeffrey R. Lang" <[email protected]>
To: gpfsug main discussion list <[email protected]>
Subject: Re: [gpfsug-discuss] RHEL updated to 7.5 instead of 7.4
Message-ID:
<byapr05mb3944d14f48cddc82f3f29245a8...@byapr05mb3944.namprd05.prod.outlook.com>
Content-Type: text/plain; charset="us-ascii"
Yes, I recently had this happen.
It was determined that the caches had been updated to the 7.5 packages, before I set the release to 7.4/ Since I didn't clear and delete the cache it used what it had and did the update to 7.5.
So always clear and remove the cache before an update.
Jeff
From: [email protected] <[email protected]> On Behalf Of Sobey, Richard A
Sent: Monday, June 11, 2018 5:46 AM
To: '[email protected]' <[email protected]>
Subject: [gpfsug-discuss] RHEL updated to 7.5 instead of 7.4
Has anyone ever used subscription-manager to set a release to 7.4 only for the system to upgrade to 7.5 anyway?
Also is 7.5 now supported with the 4.2.3.9 PTF or should I concentrate on downgrading back to 7.4?
Richard
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180611/f085e78e/attachment-0001.html>
------------------------------
Message: 3
Date: Tue, 12 Jun 2018 10:42:32 +0000
From: Peter Childs <[email protected]>
To: "[email protected]" <[email protected]>
Subject: [gpfsug-discuss] Lroc on NVME
Message-ID:
<[email protected]>
Content-Type: text/plain; charset="utf-8"
We have a new computer, which has an nvme drive that is appearing as
/dev/nvme0 and we'd like to put lroc on /dev/nvme0p1p1. which is a
partition on the drive.
After doing the standard mmcrnsd to set it up Spectrum Scale fails to
see it.
I've added a script /var/mmfs/etc/nsddevices so that gpfs scans them,
and it does work now. What "type" should I set the nvme drives too?
I've currently set it to "generic"
I want to do some tidying of my script, but has anyone else tried to
get lroc running on nvme and how well does it work.
We're running CentOs 7.4 and Spectrum Scale 4.2.3-8 currently.
Thanks in advance.
--
Peter Childs
ITS Research Storage
Queen Mary, University of London
------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
End of gpfsug-discuss Digest, Vol 77, Issue 15
**********************************************
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
