Hi Scale Team, I know but I can't reproduce the problem with a simple kernel NFS server on a RH7.5 with a local filesystem for instance. It seems to be linked somehow with GPFS 4.2.3-9... I don't know what is the behavior with previous release.
But as I said, the downgrade to RHE7.4 has solved the problem... vicious bug for sure. Regards, PM -- HPC center French space agency -----Message d'origine----- De : [email protected] <[email protected]> De la part de [email protected] Envoyé : vendredi 27 juillet 2018 14:22 À : [email protected] Objet : gpfsug-discuss Digest, Vol 78, Issue 68 Send gpfsug-discuss mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) (IBM Spectrum Scale) 2. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) (Lukas Hejtmanek) ---------------------------------------------------------------------- Message: 1 Date: Fri, 27 Jul 2018 06:56:02 -0500 From: "IBM Spectrum Scale" <[email protected]> To: gpfsug main discussion list <[email protected]> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) Message-ID: <of5ff984ee.f4be79c7-on852582d7.004142cc-862582d7.00418...@notes.na.collabserv.com> Content-Type: text/plain; charset="iso-8859-1" errno 521 is EBADHANDLE (a Linux NFS error); it is not from spectrum scale. /* Defined for the NFSv3 protocol */ #define EBADHANDLE 521 /* Illegal NFS file handle */ Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479. If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team. From: Brunet Pierre-Marie <[email protected]> To: "[email protected]" <[email protected]> Date: 07/26/2018 07:17 PM Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) Sent by: [email protected] Hi, We are facing the same issue : we just upgrade our cluster to GPFS 4.2.3-9 and RHEL 7.5 with 4 gateways servers executing Kernel NFS... => random "Unknown error 521" on NFS clients. Thanks to this thread we decided to downgrade to RHEL 7.4 and (fingers crossed !) up to now, it seems to work properly. Is there any official recommendation from IBM on this problem ? Regards, PM -- HPC center French space agency -----Message d'origine----- De?: [email protected] <[email protected]> De la part de [email protected] Envoy??: jeudi 14 juin 2018 13:00 ??: [email protected] Objet?: gpfsug-discuss Digest, Vol 77, Issue 19 Send gpfsug-discuss mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. Re: GPFS 4.2.3-9 and RHEL 7.5 (Tomer Perry) 2. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) ---------------------------------------------------------------------- Message: 1 Date: Wed, 13 Jun 2018 17:45:44 +0300 From: "Tomer Perry" <[email protected]> To: gpfsug main discussion list <[email protected]> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 Message-ID: <of826a0f69.c86bd2ab-onc22582ab.0050fe8e-c22582ab.00511...@notes.na.collabserv.com> Content-Type: text/plain; charset="iso-8859-1" Please open a service ticket Regards, Tomer Perry Scalable I/O Development (Spectrum Scale) email: [email protected] 1 Azrieli Center, Tel Aviv 67021, Israel Global Tel: +1 720 3422758 Israel Tel: +972 3 9188625 Mobile: +972 52 2554625 From: Lukas Hejtmanek <[email protected]> To: gpfsug main discussion list <[email protected]> Date: 13/06/2018 13:14 Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 Sent by: [email protected] On Wed, Jun 13, 2018 at 12:48:14PM +0300, Tomer Perry wrote: > knfs is supported - with or without the cNFS feature ( cNFS will add > HA > to NFS on top of GPFS - > https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.1/com.ibm.spectrum.scale.v5r01.doc/bl1adv_cnfs.htm > ). > > knfs and cNFS can't coexist with CES in the same environment. well, I use knfs and no CNFS n RHEL 7.5 and getting mentioned issues. -- Luk?? Hejtm?nek Linux Administrator only because Full Time Multitasking Ninja is not an official job title _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: < http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180613/3cf6fbce/attachment-0001.html > ------------------------------ Message: 2 Date: Wed, 13 Jun 2018 15:14:53 +0000 From: "Wilson, Neil" <[email protected]> To: gpfsug main discussion list <[email protected]> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 Message-ID: <vi1pr01mb3869195da7652219d5e3c6fdc6...@vi1pr01mb3869.eurprd01.prod.exchangelabs.com> Content-Type: text/plain; charset="utf-8" We are running a cNFS on GPFS 4.2.3-9 on 7.4 and kernel version 3.10.0-693.21.1.el7.x86_64 and are not having any errors. So it's probably just GPFS not being ready for 7.5 yet. Neil. Neil Wilson? Senior IT Practitioner Storage, Virtualisation and Mainframe Team?? IT Services Met Office FitzRoy Road Exeter Devon EX1 3PB United Kingdom -----Original Message----- From: [email protected] <[email protected]> On Behalf Of Jonathan Buzzard Sent: 13 June 2018 10:33 To: gpfsug main discussion list <[email protected]> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 On Wed, 2018-06-13 at 11:10 +0200, Lukas Hejtmanek wrote: > Hello, > > did anyone encountered an error with RHEL 7.5 kernel 3.10.0- > 862.3.2.el7.x86_64 and the latest GPFS 4.2.3-9 with kernel NFS? > > I'm getting random errors: Unknown error 521. It means EBADHANDLE. > Not sure whether it is due to kernel or GPFS. > GPFS being not supported on 7.5 at this time would be the starting point. I am also under the impression that kernel NFS was not supported either it's Ganesha or nothing. The interim fix is probably to downgrade to a 7.4 kernel. Certainly in the past that has worked for me. JAB. -- Jonathan A. Buzzard?????????????????????????Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 77, Issue 19 ********************************************** _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180727/09b0c32c/attachment-0001.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180727/09b0c32c/attachment-0001.gif> ------------------------------ Message: 2 Date: Fri, 27 Jul 2018 14:06:11 +0200 From: Lukas Hejtmanek <[email protected]> To: gpfsug main discussion list <[email protected]> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) Message-ID: <[email protected]> Content-Type: text/plain; charset=utf8 Hello, no it is not. It's a bug in GPFS vfs layer, efix has been already released. On Fri, Jul 27, 2018 at 06:56:02AM -0500, IBM Spectrum Scale wrote: > > errno 521 is EBADHANDLE (a Linux NFS error); it is not from spectrum scale. > > > /* Defined for the NFSv3 protocol */ > #define EBADHANDLE 521 /* Illegal NFS file handle */ > > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > > If you feel that your question can benefit other users of Spectrum > Scale (GPFS), then please post it to the public IBM developerWroks > Forum at > https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479. > > > If your query concerns a potential software error in Spectrum Scale > (GPFS) and you have an IBM software maintenance contract please > contact > 1-800-237-5511 in the United States or your local IBM Service Center > in other countries. > > The forum is informally monitored as time permits and should not be > used for priority messages to the Spectrum Scale (GPFS) team. > > > > From: Brunet Pierre-Marie <[email protected]> > To: "[email protected]" > <[email protected]> > Date: 07/26/2018 07:17 PM > Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) > Sent by: [email protected] > > > > Hi, > > We are facing the same issue : we just upgrade our cluster to GPFS > 4.2.3-9 and RHEL 7.5 with 4 gateways servers executing Kernel NFS... > => random "Unknown error 521" on NFS clients. > > Thanks to this thread we decided to downgrade to RHEL 7.4 and (fingers > crossed !) up to now, it seems to work properly. > > Is there any official recommendation from IBM on this problem ? > > Regards, > PM > -- > HPC center > French space agency > > -----Message d'origine----- > De?: [email protected] > <[email protected]> De la part de > [email protected] > Envoy??: jeudi 14 juin 2018 13:00 > ??: [email protected] > Objet?: gpfsug-discuss Digest, Vol 77, Issue 19 > > Send gpfsug-discuss mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > or, via email, send a message with subject or body 'help' to > [email protected] > > You can reach the person managing the list at > [email protected] > > When replying, please edit your Subject line so it is more specific > than > "Re: Contents of gpfsug-discuss digest..." > > > Today's Topics: > > 1. Re: GPFS 4.2.3-9 and RHEL 7.5 (Tomer Perry) > 2. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 13 Jun 2018 17:45:44 +0300 > From: "Tomer Perry" <[email protected]> > To: gpfsug main discussion list <[email protected]> > Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 > Message-ID: > > <of826a0f69.c86bd2ab-onc22582ab.0050fe8e-c22582ab.00511...@notes.na.co > llabserv.com> > > > Content-Type: text/plain; charset="iso-8859-1" > > Please open a service ticket > > > Regards, > > Tomer Perry > Scalable I/O Development (Spectrum Scale) > email: [email protected] > 1 Azrieli Center, Tel Aviv 67021, Israel > Global Tel: +1 720 3422758 > Israel Tel: +972 3 9188625 > Mobile: +972 52 2554625 > > > > > From: Lukas Hejtmanek <[email protected]> > To: gpfsug main discussion list <[email protected]> > Date: 13/06/2018 13:14 > Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 > Sent by: [email protected] > > > > On Wed, Jun 13, 2018 at 12:48:14PM +0300, Tomer Perry wrote: > > knfs is supported - with or without the cNFS feature ( cNFS will > > add HA > > > to NFS on top of GPFS - > > > https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.1/com.ibm.sp > ectrum.scale.v5r01.doc/bl1adv_cnfs.htm > > > > ). > > > > knfs and cNFS can't coexist with CES in the same environment. > > well, I use knfs and no CNFS n RHEL 7.5 and getting mentioned issues. > > -- > Luk?? Hejtm?nek > > Linux Administrator only because > Full Time Multitasking Ninja > is not an official job title > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > > > > > -------------- next part -------------- An HTML attachment was > scrubbed... > URL: < > http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180613/3cf6fb > ce/attachment-0001.html > > > > ------------------------------ > > Message: 2 > Date: Wed, 13 Jun 2018 15:14:53 +0000 > From: "Wilson, Neil" <[email protected]> > To: gpfsug main discussion list <[email protected]> > Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 > Message-ID: > > <vi1pr01mb3869195da7652219d5e3c6fdc6...@vi1pr01mb3869.eurprd01.prod.ex > changelabs.com> > > > Content-Type: text/plain; charset="utf-8" > > We are running a cNFS on GPFS 4.2.3-9 on 7.4 and kernel version > 3.10.0-693.21.1.el7.x86_64 and are not having any errors. > So it's probably just GPFS not being ready for 7.5 yet. > > Neil. > > Neil Wilson? Senior IT Practitioner > Storage, Virtualisation and Mainframe Team?? IT Services Met Office > FitzRoy Road Exeter Devon EX1 3PB United Kingdom > > > -----Original Message----- > From: [email protected] > <[email protected]> On Behalf Of Jonathan > Buzzard > Sent: 13 June 2018 10:33 > To: gpfsug main discussion list <[email protected]> > Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 > > On Wed, 2018-06-13 at 11:10 +0200, Lukas Hejtmanek wrote: > > Hello, > > > > did anyone encountered an error with RHEL 7.5 kernel 3.10.0- > > 862.3.2.el7.x86_64 and the latest GPFS 4.2.3-9 with kernel NFS? > > > > I'm getting random errors: Unknown error 521. It means EBADHANDLE. > > Not sure whether it is due to kernel or GPFS. > > > > GPFS being not supported on 7.5 at this time would be the starting > point. I am also under the impression that kernel NFS was not > supported either it's Ganesha or nothing. > > The interim fix is probably to downgrade to a 7.4 kernel. Certainly in > the past that has worked for me. > > JAB. > > -- > Jonathan A. Buzzard?????????????????????????Tel: +44141-5483420 HPC > System Administrator, ARCHIE-WeSt. > University of Strathclyde, John Anderson Building, Glasgow. G4 0NG > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > ------------------------------ > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > End of gpfsug-discuss Digest, Vol 77, Issue 19 > ********************************************** > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- Luk?? Hejtm?nek Linux Administrator only because Full Time Multitasking Ninja is not an official job title ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 78, Issue 68 ********************************************** _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
