Re: [gpfsug-discuss] what is mmnfs under the hood
It would be nice to know why you cannot use ganesha or mmsmb. You don't have to use protocols or CES. We are migrating to CES from doing our own thing with NFS and samba on Debian. Debian does not have support for CES, so we had to roll our own. We did not use CNFS either. To get to CES we had to change OS. We did this because we valued the support. I'd say the failover works better with CES than with our solution, particularly with regards failing over and Infiniband IP address. -Original Message- From: gpfsug-discuss-boun...@spectrumscale.org [mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Ilan Schwarts Sent: Sunday, 6 August 2017 7:50 PM To: gpfsug main discussion listSubject: Re: [gpfsug-discuss] what is mmnfs under the hood I have read this atricle: https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_ces_migrationcnfstoces.htm So, in a shortcut, CNFS cannot be used when sharing via CES. I cannot use ganesha NFS. Is it possible to share a cluster via SMB and NFS without using CES ? the nfs will be expored via CNFS but what about SMB ? i cannot use mmsmb.. On Sun, Aug 6, 2017 at 12:42 PM, Ilan Schwarts wrote: > I have gpfs (spectrum scale 4.2.2.0) and I wish to create NFS exports, > I cannot use ganesha NFS. > How do I make NFS exports ? just editing all nodes /etc/exports is enough ? > I should i use the CNFS as described here: > https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.2/com.ibm.sp > ectrum.scale.v4r22.doc/bl1adv_cnfssetup.htm > > > > > On Sun, Aug 6, 2017 at 12:10 PM, Simon Thompson (IT Research Support) > wrote: >> Under the hood, the NFS services are provided by IBM supplied Ganesha rpms. >> It's then fully supported by IBM, e.g. the GPFS VFS later to handle locking, >> ACLs, quota etc... >> >> Note it's different from using the cnfs support in Spectrum Scale which uses >> Kernel NFS AFAIK. Using user space Ganesha means they have control of the >> NFS stack, so if something needs patching/fixing, then can roll out new >> Ganesha rpms rather than having to get (e.g.) RedHat to incorporate >> something into kernel NFS. >> >> Mmnfs is a wrapper round the config of Ganesha using CCR to distribute the >> config to the nodes. >> >> Simon >> >> From: gpfsug-discuss-boun...@spectrumscale.org >> [gpfsug-discuss-boun...@spectrumscale.org] on behalf of >> ila...@gmail.com [ila...@gmail.com] >> Sent: 06 August 2017 09:26 >> To: gpfsug main discussion list >> Subject: [gpfsug-discuss] what is mmnfs under the hood >> >> Hi guys, >> >> I see IBM spectrumscale configure the NFS via command: mmnfs >> >> Is the command mmnfs is a wrapper on top of the normal kernel NFS >> (Kernel VFS) ? >> Is it a wrapper on top of ganesha NFS ? >> Or it is NFS implemented by SpectrumScale team ? >> >> >> Thanks >> >> -- >> >> >> - >> Ilan Schwarts >> ___ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss >> ___ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > -- > > > - > Ilan Schwarts -- - Ilan Schwarts ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
Re: [gpfsug-discuss] what is mmnfs under the hood
What do you mean by cannot use mmsmb and cannot use Ganesha? Do you functionally you are not allowed to or they are not working for you? If it's the latter, then this should be resolvable. If you are under active maintenance you could try raising a ticket with IBM, though basic implementation is not really a support issue and so you may be better engaging a business partner or integrator to help you out. Simon From: gpfsug-discuss-boun...@spectrumscale.org [gpfsug-discuss-boun...@spectrumscale.org] on behalf of ila...@gmail.com [ila...@gmail.com] Sent: 06 August 2017 10:49 To: gpfsug main discussion list Subject: Re: [gpfsug-discuss] what is mmnfs under the hood I have read this atricle: https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_ces_migrationcnfstoces.htm So, in a shortcut, CNFS cannot be used when sharing via CES. I cannot use ganesha NFS. Is it possible to share a cluster via SMB and NFS without using CES ? the nfs will be expored via CNFS but what about SMB ? i cannot use mmsmb.. On Sun, Aug 6, 2017 at 12:42 PM, Ilan Schwartswrote: > I have gpfs (spectrum scale 4.2.2.0) and I wish to create NFS exports, > I cannot use ganesha NFS. > How do I make NFS exports ? just editing all nodes /etc/exports is enough ? > I should i use the CNFS as described here: > https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.2/com.ibm.spectrum.scale.v4r22.doc/bl1adv_cnfssetup.htm > > > > > On Sun, Aug 6, 2017 at 12:10 PM, Simon Thompson (IT Research Support) > wrote: >> Under the hood, the NFS services are provided by IBM supplied Ganesha rpms. >> It's then fully supported by IBM, e.g. the GPFS VFS later to handle locking, >> ACLs, quota etc... >> >> Note it's different from using the cnfs support in Spectrum Scale which uses >> Kernel NFS AFAIK. Using user space Ganesha means they have control of the >> NFS stack, so if something needs patching/fixing, then can roll out new >> Ganesha rpms rather than having to get (e.g.) RedHat to incorporate >> something into kernel NFS. >> >> Mmnfs is a wrapper round the config of Ganesha using CCR to distribute the >> config to the nodes. >> >> Simon >> >> From: gpfsug-discuss-boun...@spectrumscale.org >> [gpfsug-discuss-boun...@spectrumscale.org] on behalf of ila...@gmail.com >> [ila...@gmail.com] >> Sent: 06 August 2017 09:26 >> To: gpfsug main discussion list >> Subject: [gpfsug-discuss] what is mmnfs under the hood >> >> Hi guys, >> >> I see IBM spectrumscale configure the NFS via command: mmnfs >> >> Is the command mmnfs is a wrapper on top of the normal kernel NFS >> (Kernel VFS) ? >> Is it a wrapper on top of ganesha NFS ? >> Or it is NFS implemented by SpectrumScale team ? >> >> >> Thanks >> >> -- >> >> >> - >> Ilan Schwarts >> ___ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss >> ___ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > -- > > > - > Ilan Schwarts -- - Ilan Schwarts ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
Re: [gpfsug-discuss] what is mmnfs under the hood
I have read this atricle: https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_ces_migrationcnfstoces.htm So, in a shortcut, CNFS cannot be used when sharing via CES. I cannot use ganesha NFS. Is it possible to share a cluster via SMB and NFS without using CES ? the nfs will be expored via CNFS but what about SMB ? i cannot use mmsmb.. On Sun, Aug 6, 2017 at 12:42 PM, Ilan Schwartswrote: > I have gpfs (spectrum scale 4.2.2.0) and I wish to create NFS exports, > I cannot use ganesha NFS. > How do I make NFS exports ? just editing all nodes /etc/exports is enough ? > I should i use the CNFS as described here: > https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.2/com.ibm.spectrum.scale.v4r22.doc/bl1adv_cnfssetup.htm > > > > > On Sun, Aug 6, 2017 at 12:10 PM, Simon Thompson (IT Research Support) > wrote: >> Under the hood, the NFS services are provided by IBM supplied Ganesha rpms. >> It's then fully supported by IBM, e.g. the GPFS VFS later to handle locking, >> ACLs, quota etc... >> >> Note it's different from using the cnfs support in Spectrum Scale which uses >> Kernel NFS AFAIK. Using user space Ganesha means they have control of the >> NFS stack, so if something needs patching/fixing, then can roll out new >> Ganesha rpms rather than having to get (e.g.) RedHat to incorporate >> something into kernel NFS. >> >> Mmnfs is a wrapper round the config of Ganesha using CCR to distribute the >> config to the nodes. >> >> Simon >> >> From: gpfsug-discuss-boun...@spectrumscale.org >> [gpfsug-discuss-boun...@spectrumscale.org] on behalf of ila...@gmail.com >> [ila...@gmail.com] >> Sent: 06 August 2017 09:26 >> To: gpfsug main discussion list >> Subject: [gpfsug-discuss] what is mmnfs under the hood >> >> Hi guys, >> >> I see IBM spectrumscale configure the NFS via command: mmnfs >> >> Is the command mmnfs is a wrapper on top of the normal kernel NFS >> (Kernel VFS) ? >> Is it a wrapper on top of ganesha NFS ? >> Or it is NFS implemented by SpectrumScale team ? >> >> >> Thanks >> >> -- >> >> >> - >> Ilan Schwarts >> ___ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss >> ___ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > -- > > > - > Ilan Schwarts -- - Ilan Schwarts ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
Re: [gpfsug-discuss] what is mmnfs under the hood
I have gpfs (spectrum scale 4.2.2.0) and I wish to create NFS exports, I cannot use ganesha NFS. How do I make NFS exports ? just editing all nodes /etc/exports is enough ? I should i use the CNFS as described here: https://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.2/com.ibm.spectrum.scale.v4r22.doc/bl1adv_cnfssetup.htm On Sun, Aug 6, 2017 at 12:10 PM, Simon Thompson (IT Research Support)wrote: > Under the hood, the NFS services are provided by IBM supplied Ganesha rpms. > It's then fully supported by IBM, e.g. the GPFS VFS later to handle locking, > ACLs, quota etc... > > Note it's different from using the cnfs support in Spectrum Scale which uses > Kernel NFS AFAIK. Using user space Ganesha means they have control of the NFS > stack, so if something needs patching/fixing, then can roll out new Ganesha > rpms rather than having to get (e.g.) RedHat to incorporate something into > kernel NFS. > > Mmnfs is a wrapper round the config of Ganesha using CCR to distribute the > config to the nodes. > > Simon > > From: gpfsug-discuss-boun...@spectrumscale.org > [gpfsug-discuss-boun...@spectrumscale.org] on behalf of ila...@gmail.com > [ila...@gmail.com] > Sent: 06 August 2017 09:26 > To: gpfsug main discussion list > Subject: [gpfsug-discuss] what is mmnfs under the hood > > Hi guys, > > I see IBM spectrumscale configure the NFS via command: mmnfs > > Is the command mmnfs is a wrapper on top of the normal kernel NFS > (Kernel VFS) ? > Is it a wrapper on top of ganesha NFS ? > Or it is NFS implemented by SpectrumScale team ? > > > Thanks > > -- > > > - > Ilan Schwarts > ___ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > ___ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- - Ilan Schwarts ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
Re: [gpfsug-discuss] what is mmnfs under the hood
Under the hood, the NFS services are provided by IBM supplied Ganesha rpms. It's then fully supported by IBM, e.g. the GPFS VFS later to handle locking, ACLs, quota etc... Note it's different from using the cnfs support in Spectrum Scale which uses Kernel NFS AFAIK. Using user space Ganesha means they have control of the NFS stack, so if something needs patching/fixing, then can roll out new Ganesha rpms rather than having to get (e.g.) RedHat to incorporate something into kernel NFS. Mmnfs is a wrapper round the config of Ganesha using CCR to distribute the config to the nodes. Simon From: gpfsug-discuss-boun...@spectrumscale.org [gpfsug-discuss-boun...@spectrumscale.org] on behalf of ila...@gmail.com [ila...@gmail.com] Sent: 06 August 2017 09:26 To: gpfsug main discussion list Subject: [gpfsug-discuss] what is mmnfs under the hood Hi guys, I see IBM spectrumscale configure the NFS via command: mmnfs Is the command mmnfs is a wrapper on top of the normal kernel NFS (Kernel VFS) ? Is it a wrapper on top of ganesha NFS ? Or it is NFS implemented by SpectrumScale team ? Thanks -- - Ilan Schwarts ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
[gpfsug-discuss] what is mmnfs under the hood
Hi guys, I see IBM spectrumscale configure the NFS via command: mmnfs Is the command mmnfs is a wrapper on top of the normal kernel NFS (Kernel VFS) ? Is it a wrapper on top of ganesha NFS ? Or it is NFS implemented by SpectrumScale team ? Thanks -- - Ilan Schwarts ___ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss