Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?
I had a problems between 2.9.0 servers and 2.10.1 clients. Actually from 2.10.1 clients I can list directories and files on my Lustre FS OSTs, but I am not able to access any file for reading or writing. I solved the problem decreasing the number of peer credits in ko2iblnd to 8 instead of 128, client side. This worked but I do not know exactly what is causing this problem. these are the errors I was getting. Nov 21 11:23:35 psana101 kernel: Lustre: 2287:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1511292215/real 1511292215] req@8801e8f08000 x1584330612541264/t0(0) o3->ffb11-OST000e-osc-8806320a3000@172.21.52.66@o2ib2:6/4 lens 608/432 e 0 to 1 dl 1511292227 ref 2 fl Rpc:eX/2/ rc 0/-1 Nov 21 11:23:35 psana101 kernel: Lustre: 2287:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 366 previous similar messages Nov 21 11:23:35 psana101 kernel: Lustre: ffb11-OST000e-osc-8806320a3000: Connection to ffb11-OST000e (at 172.21.52.66@o2ib2) was lost; in progress operations using this service will wait for recovery to complete On 11/9/17 3:13 PM, Dilger, Andreas wrote: > On Nov 9, 2017, at 05:27, Andrew Elwell wrote: >>> My Lustre server is running the version 2.5 and I want to use 2.10 client. >>> Is this combination supported ? Is there anything that I need to be aware of >> 2 of our storage appliances (sonnexion 1600 based) run 2.5.1, I've >> mounted this OK on infiniband clients fine with 2.10.0 and 2.10.1 OK, >> but a colleague has since had to downgrade some of our clients to >> 2.9.0 on OPA / KNL hosts as we were seeing strange issues (can't >> remember the ticket details) > If people are having problems like this, it would be useful to know the > details. If you are using a non-Intel release, you should go through your > support provider, since they know the most details about what patches are > in their release. > >> We do see the warnings at startup: >> Lustre: Server MGS version (2.5.1.0) is much older than client. >> Consider upgrading server (2.10.0) > This is a standard message if your client/server versions are more than 0.4 > releases apart. While Lustre clients and servers negotiate the supported > features between them at connection time, so there should be broad > interoperability between releases, we only test between the latest major > releases (e.g. 2.5.x and 2.7.y, or 2.7.y and 2.10.z), it isn't possible to > test interoperability between every release. > > Cheers, Andreas > -- > Andreas Dilger > Lustre Principal Architect > Intel Corporation > > > > > > > > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?
On Nov 9, 2017, at 05:27, Andrew Elwell wrote: > >> My Lustre server is running the version 2.5 and I want to use 2.10 client. >> Is this combination supported ? Is there anything that I need to be aware of > > 2 of our storage appliances (sonnexion 1600 based) run 2.5.1, I've > mounted this OK on infiniband clients fine with 2.10.0 and 2.10.1 OK, > but a colleague has since had to downgrade some of our clients to > 2.9.0 on OPA / KNL hosts as we were seeing strange issues (can't > remember the ticket details) If people are having problems like this, it would be useful to know the details. If you are using a non-Intel release, you should go through your support provider, since they know the most details about what patches are in their release. > We do see the warnings at startup: > Lustre: Server MGS version (2.5.1.0) is much older than client. > Consider upgrading server (2.10.0) This is a standard message if your client/server versions are more than 0.4 releases apart. While Lustre clients and servers negotiate the supported features between them at connection time, so there should be broad interoperability between releases, we only test between the latest major releases (e.g. 2.5.x and 2.7.y, or 2.7.y and 2.10.z), it isn't possible to test interoperability between every release. Cheers, Andreas -- Andreas Dilger Lustre Principal Architect Intel Corporation ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?
> My Lustre server is running the version 2.5 and I want to use 2.10 client. > Is this combination supported ? Is there anything that I need to be aware of 2 of our storage appliances (sonnexion 1600 based) run 2.5.1, I've mounted this OK on infiniband clients fine with 2.10.0 and 2.10.1 OK, but a colleague has since had to downgrade some of our clients to 2.9.0 on OPA / KNL hosts as we were seeing strange issues (can't remember the ticket details) We do see the warnings at startup: Lustre: Server MGS version (2.5.1.0) is much older than client. Consider upgrading server (2.10.0) Andrew ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?
Hi Eli, as I can tell, we are running the Lustre Client 2.10 with a 2.5 version in the backend without problems since 1 month so far. If you are running the Robinhood Policy Engine with that setup, you probably will get the conflict we had here during the changelog processing phase. We got an error regarding the Lustre changelog API, so we are running an older Lustre client version on the Robinhood client that works pretty well. Best regards Gabriele On 11/07/2017 04:30 PM, E.S. Rosenberg wrote: > Hi Biju, > The 2.10 client is multi-rail aware while the 2.5 server is not there have > been multiple reports on the list and several open bugs that this > combination doesn't work. > A 2.9 client may work but in general it is my understanding that > compatibility is only check 1 version back (so 2.9-2.8 etc.). > > HTH, > Eli > > On Tue, Nov 7, 2017 at 10:55 AM, Biju C P wrote: > >> Hi, >> >> My Lustre server is running the version 2.5 and I want to use 2.10 client. >> Is this combination supported ? Is there anything that I need to be aware >> of ? >> >> -- >> Biju C P >> >> ___ >> lustre-discuss mailing list >> lustre-discuss@lists.lustre.org >> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org >> >> > > > > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > -- Gabriele Iannetti Wissenschaftlicher Angestellter High Performance Computing (HPC) Phone / Telefon: +49 6159 71 3147 g.ianne...@gsi.de GSI Helmholtzzentrum für Schwerionenforschung GmbH Planckstraße 1, 64291 Darmstadt, Germany, www.gsi.de Commercial Register / Handelsregister: Amtsgericht Darmstadt, HRB 1528 Managing Directors / Geschäftsführung: Professor Dr. Paolo Giubellino, Ursula Weyrich, Jörg Blaurock Chairman of the Supervisory Board / Vorsitzender des GSI-Aufsichtsrats: State Secretary / Staatssekretär Dr. Georg Schütte ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?
Thanks a lot. This info is really useful for me. On Tue, Nov 7, 2017 at 9:06 PM, Carlson, Timothy S wrote: > FWIW, we have successfully been running 2.9 clients (RHEL 7.3) with 2.5.3 > servers (RHEL 6.6) at a small scale. About 40 OSSes and dozens of 2.9 > clients with hundreds of 2.5.3 clients mixed in. > > > > Tim > > > > *From:* lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] *On > Behalf Of *E.S. Rosenberg > *Sent:* Tuesday, November 07, 2017 7:30 AM > *To:* Biju C P > *Cc:* lustre-discuss@lists.lustre.org > *Subject:* Re: [lustre-discuss] Does lustre 2.10 client support 2.5 > server ? > > > > Hi Biju, > The 2.10 client is multi-rail aware while the 2.5 server is not there have > been multiple reports on the list and several open bugs that this > combination doesn't work. > > A 2.9 client may work but in general it is my understanding that > compatibility is only check 1 version back (so 2.9-2.8 etc.). > > HTH, > > Eli > > > > On Tue, Nov 7, 2017 at 10:55 AM, Biju C P wrote: > > Hi, > > > > My Lustre server is running the version 2.5 and I want to use 2.10 client. > Is this combination supported ? Is there anything that I need to be aware > of ? > > > > -- > > Biju C P > > > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > > > -- Biju C P ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?
FWIW, we have successfully been running 2.9 clients (RHEL 7.3) with 2.5.3 servers (RHEL 6.6) at a small scale. About 40 OSSes and dozens of 2.9 clients with hundreds of 2.5.3 clients mixed in. Tim From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf Of E.S. Rosenberg Sent: Tuesday, November 07, 2017 7:30 AM To: Biju C P Cc: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ? Hi Biju, The 2.10 client is multi-rail aware while the 2.5 server is not there have been multiple reports on the list and several open bugs that this combination doesn't work. A 2.9 client may work but in general it is my understanding that compatibility is only check 1 version back (so 2.9-2.8 etc.). HTH, Eli On Tue, Nov 7, 2017 at 10:55 AM, Biju C P mailto:cpb...@gmail.com>> wrote: Hi, My Lustre server is running the version 2.5 and I want to use 2.10 client. Is this combination supported ? Is there anything that I need to be aware of ? -- Biju C P ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org<mailto:lustre-discuss@lists.lustre.org> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?
Hi Biju, The 2.10 client is multi-rail aware while the 2.5 server is not there have been multiple reports on the list and several open bugs that this combination doesn't work. A 2.9 client may work but in general it is my understanding that compatibility is only check 1 version back (so 2.9-2.8 etc.). HTH, Eli On Tue, Nov 7, 2017 at 10:55 AM, Biju C P wrote: > Hi, > > My Lustre server is running the version 2.5 and I want to use 2.10 client. > Is this combination supported ? Is there anything that I need to be aware > of ? > > -- > Biju C P > > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > > ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Does lustre 2.10 client support 2.5 server ?
Hi, My Lustre server is running the version 2.5 and I want to use 2.10 client. Is this combination supported ? Is there anything that I need to be aware of ? -- Biju C P ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
