Re: [gpfsug-discuss] mmfsadddisk command interrupted

[IBM Spectrum Scale]

Hi Damir,

Since many GPFS management command got unresponsive and you are running
ESS, mail-list maybe not a good way to track this kinds of issue.
Could you please raise a ticket to ESS/SpectrumScale to get help from IBM
Service team?

Regards, The Spectrum Scale (GPFS) team

--

If you feel that your question can benefit other users of  Spectrum Scale
(GPFS), then please post it to the public IBM developerWroks Forum at
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479.


If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.

The forum is informally monitored as time permits and should not be used
for priority messages to the Spectrum Scale (GPFS) team.



From:   Damir Krstic 
To: gpfsug main discussion list 
Date:   06/23/2018 03:04 AM
Subject:[gpfsug-discuss] mmfsadddisk command interrupted
Sent by:gpfsug-discuss-boun...@spectrumscale.org



We were adding disks to one of our larger filesystems today. During the
"checking allocation map for storage pool system" we had to interrupt the
command since it was causing slow downs on our filesystem.

Now commands like mmrepquota, mmdf, etc. are timing out with tsaddisk
command is running message. Also during the run of the mmdf, mmrepquota,
etc. filesystem becomes completely unresponsive. This command was run on
ESS running version 5.2.0.

Any help is much appreciated.

Thank you.
Damir___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss



___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Mixing RDMA Client Fabrics for a single NSD Cluster

[Peinkofer, Stephan]

Dear Simon and List,


thanks. That was exactly I was looking for.


Best Regards,

Stephan Peinkofer



From: gpfsug-discuss-boun...@spectrumscale.org 
 on behalf of Simon Thompson 

Sent: Thursday, July 19, 2018 5:42 PM
To: gpfsug main discussion list
Subject: Re: [gpfsug-discuss] Mixing RDMA Client Fabrics for a single NSD 
Cluster

I think what you want is to use fabric numbers with verbsPorts, e.g. we have 
two IB fabrics and in the config we do thinks like:

[nodeclass1]
verbsPorts mlx4_0/1/1
[nodeclass2]
verbsPorts mlx5_0/1/3

GPFS recognises the /1 or /3 at the end as a fabric number and knows they are 
separate and will Ethernet between those nodes instead.

Simon

From:  on behalf of 
"stephan.peinko...@lrz.de" 
Reply-To: "gpfsug-discuss@spectrumscale.org" 
Date: Thursday, 19 July 2018 at 15:13
To: "gpfsug-discuss@spectrumscale.org" 
Subject: [gpfsug-discuss] Mixing RDMA Client Fabrics for a single NSD Cluster

Dear GPFS List,

does anyone of you know, if it is possible to have multiple file systems in a 
GPFS Cluster that all are served primary via Ethernet but for which different 
“booster” connections to various IB/OPA fabrics exist.

For example let’s say in my central Storage/NSD Cluster, I implement two file 
systems FS1 and FS2. FS1 is served by NSD-A and NSD-B and FS2 is served by 
NSD-C and NSD-D.
Now I have two client Clusters C1 and C2 which have different OPA fabrics. Both 
Clusters can mount the two file systems via Ethernet, but I now add OPA 
connections for NSD-A and NSD-B to C1’s fabric and OPA connections for NSD-C 
and NSD-D to  C2’s fabric and just switch on RDMA.
As far as I understood, GPFS will use RDMA if it is available between two nodes 
but switch to Ethernet if RDMA is not available between the two nodes. So given 
just this, the above scenario could work in principle. But will it work in 
reality and will it be supported by IBM?

Many thanks in advance.
Best Regards,
Stephan Peinkofer
--
Stephan Peinkofer
Leibniz Supercomputing Centre
Data and Storage Division
Boltzmannstraße 1, 85748 Garching b. München
URL: http://www.lrz.de
LRZ: Leibniz-Rechenzentrum der Bayerischen Akademie der 
Wissenschaften
www.lrz.de
Das LRZ ist das Rechenzentrum für die Münchner Universitäten, die Bayerische 
Akademie der Wissenschaften sowie nationales Zentrum für Hochleistungsrechnen.



___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss