date:20171114

Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server

2017-11-14 Thread Sobey, Richard A

To answer my own question:

https://www.ibm.com/support/knowledgecenter/en/SSFKCN_3.5.0/com.ibm.cluster.gpfs.v3r5.gpfs100.doc/bl1adm_uxtsdrb.htm

It’s built in.

From: gpfsug-discuss-boun...@spectrumscale.org 
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Sobey, Richard A
Sent: 14 November 2017 16:30
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server

Hi Scott

This looks like what I’m after (thank you Skylar and all others who responded 
too!)

For the uninitiated, what exactly is a User Exit in the context of the 
following line:

“One way to automate this collection of GPFS configuration data is to use a 
User Exit. “

Or to put it another way, what is calling the script to be run on the basis of 
running mmchconfig someparam=someval? I’d like to understand it more.

Thanks
Richard

From: gpfsug-discuss-boun...@spectrumscale.org 
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Scott Fadden
Sent: 16 October 2017 16:35
To: gpfsug-discuss@spectrumscale.org
Cc: gpfsug-discuss@spectrumscale.org
Subject: Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server

There are some comments on this in the wiki:

Backup Spectrum Scale 
configuration

Let me know if anything is missing.

Scott Fadden
Spectrum Scale - Technical Marketing
Phone: (503) 880-5833
sfad...@us.ibm.com
http://www.ibm.com/systems/storage/spectrum/scale


- Original message -
From: Skylar Thompson 
>
Sent by: 
gpfsug-discuss-boun...@spectrumscale.org
To: gpfsug-discuss@spectrumscale.org
Cc:
Subject: Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server
Date: Mon, Oct 16, 2017 6:29 AM

I'm not familiar with GSS, but we have a script that executes the following
before backing up a GPFS filesystem so that we have human-readable
configuration information:

mmlsconfig
mmlsnsd
mmlscluster
mmlsnode
mmlsdisk ${FS_NAME} -L
mmlsfileset ${FS_NAME} -L
mmlspool ${FS_NAME} all -L
mmlslicense -L
mmlspolicy ${FS_NAME} -L

And then executes this for the benefit of GPFS:

mmbackupconfig

Of course there's quite a bit of overlap for clusters that have more than
one filesystem, and even more for filesystems that we backup at the
fileset level, but disk is cheap and the hope is it'll make a DR scenario
a little bit less harrowing.

On Sun, Oct 15, 2017 at 12:44:42PM +, atmane khiredine wrote:
> Dear All,
>
> Is there a way to save the GPS configuration?
>
> OR how backup all GSS
>
> no backup of data or metadata only configuration for disaster recovery
>
> for example:
> stanza
> vdisk
> pdisk
> RAID code
> recovery group
> array
>
> Thank you
>
> Atmane Khiredine
> HPC System Administrator | Office National de la MÃ©tÃ©orologie
> TÃ©l : +213 21 50 73 93 # 303 | Fax : +213 21 50 79 40 | E-mail : 
> a.khired...@meteo.dz
> ___
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss=DwIFAw=jf_iaSHvJObTbx-siA1ZOg=WDtkF9zLTGGYqFnVnJ3rywZM6KHROA4FpMYi6cUkkKY=7Y7vgnMtYTCD5hcc83ShGW1VdOEzZyzil7mhxM0OUbY=yhw_G4t4P9iXSTmJvOyfI8EGWxmWKK74spKlLOpAxOA=

--
-- Skylar Thompson (skyl...@u.washington.edu)
-- Genome Sciences Department, System Administrator
-- Foege Building S046, (206)-685-7354
-- University of Washington School of Medicine
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss=DwIFAw=jf_iaSHvJObTbx-siA1ZOg=WDtkF9zLTGGYqFnVnJ3rywZM6KHROA4FpMYi6cUkkKY=7Y7vgnMtYTCD5hcc83ShGW1VdOEzZyzil7mhxM0OUbY=yhw_G4t4P9iXSTmJvOyfI8EGWxmWKK74spKlLOpAxOA=




Click 
here
 to report this email as spam.
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server

2017-11-14 Thread Sobey, Richard A

Hi Scott

This looks like what I’m after (thank you Skylar and all others who responded 
too!)

For the uninitiated, what exactly is a User Exit in the context of the 
following line:

“One way to automate this collection of GPFS configuration data is to use a 
User Exit. “

Or to put it another way, what is calling the script to be run on the basis of 
running mmchconfig someparam=someval? I’d like to understand it more.

Thanks
Richard

From: gpfsug-discuss-boun...@spectrumscale.org 
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Scott Fadden
Sent: 16 October 2017 16:35
To: gpfsug-discuss@spectrumscale.org
Cc: gpfsug-discuss@spectrumscale.org
Subject: Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server

There are some comments on this in the wiki:

Backup Spectrum Scale 
configuration

Let me know if anything is missing.

Scott Fadden
Spectrum Scale - Technical Marketing
Phone: (503) 880-5833
sfad...@us.ibm.com
http://www.ibm.com/systems/storage/spectrum/scale


- Original message -
From: Skylar Thompson 
>
Sent by: 
gpfsug-discuss-boun...@spectrumscale.org
To: gpfsug-discuss@spectrumscale.org
Cc:
Subject: Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server
Date: Mon, Oct 16, 2017 6:29 AM

I'm not familiar with GSS, but we have a script that executes the following
before backing up a GPFS filesystem so that we have human-readable
configuration information:

mmlsconfig
mmlsnsd
mmlscluster
mmlsnode
mmlsdisk ${FS_NAME} -L
mmlsfileset ${FS_NAME} -L
mmlspool ${FS_NAME} all -L
mmlslicense -L
mmlspolicy ${FS_NAME} -L

And then executes this for the benefit of GPFS:

mmbackupconfig

Of course there's quite a bit of overlap for clusters that have more than
one filesystem, and even more for filesystems that we backup at the
fileset level, but disk is cheap and the hope is it'll make a DR scenario
a little bit less harrowing.

On Sun, Oct 15, 2017 at 12:44:42PM +, atmane khiredine wrote:
> Dear All,
>
> Is there a way to save the GPS configuration?
>
> OR how backup all GSS
>
> no backup of data or metadata only configuration for disaster recovery
>
> for example:
> stanza
> vdisk
> pdisk
> RAID code
> recovery group
> array
>
> Thank you
>
> Atmane Khiredine
> HPC System Administrator | Office National de la MÃ©tÃ©orologie
> TÃ©l : +213 21 50 73 93 # 303 | Fax : +213 21 50 79 40 | E-mail : 
> a.khired...@meteo.dz
> ___
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss=DwIFAw=jf_iaSHvJObTbx-siA1ZOg=WDtkF9zLTGGYqFnVnJ3rywZM6KHROA4FpMYi6cUkkKY=7Y7vgnMtYTCD5hcc83ShGW1VdOEzZyzil7mhxM0OUbY=yhw_G4t4P9iXSTmJvOyfI8EGWxmWKK74spKlLOpAxOA=

--
-- Skylar Thompson (skyl...@u.washington.edu)
-- Genome Sciences Department, System Administrator
-- Foege Building S046, (206)-685-7354
-- University of Washington School of Medicine
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss=DwIFAw=jf_iaSHvJObTbx-siA1ZOg=WDtkF9zLTGGYqFnVnJ3rywZM6KHROA4FpMYi6cUkkKY=7Y7vgnMtYTCD5hcc83ShGW1VdOEzZyzil7mhxM0OUbY=yhw_G4t4P9iXSTmJvOyfI8EGWxmWKK74spKlLOpAxOA=





Click 
here
 to report this email as spam.
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

[gpfsug-discuss] Antwort: [Newsletter] Re: Combine different rules - tip: use mmfind & co; FOR FILESET; FILESET_NAME

2017-11-14 Thread Matthias . Knigge

mmfind or rather the convert-script is great!

Thanks, Matthias




Von:"Marc A Kaplan" 
An: gpfsug main discussion list 
Datum:  01.11.2017 15:43
Betreff:[Newsletter] Re: [gpfsug-discuss] Combine different rules 
- tip: use mmfind & co; FOR FILESET; FILESET_NAME
Gesendet von:   gpfsug-discuss-boun...@spectrumscale.org



Thanks Jonathan B for your comments and tips on experience using 
mmapplypolicy and policy rules.  Good to see that some of the features we 
put into the product are actually useful.  

For those not quite as familiar, and have come somewhat later to the game, 
like Matthias K - I have a few remarks and tips that may be helpful:

You can think of and use mmapplypolicy as a fast, parallelized version of 
the classic   `find ... | xargs ... `  pipeline.
In fact we've added some "sample" scripts with options that make this 
easy:

samples/ilm/mmfind  :  "understands" the classic find search arguments as 
well as all the mmapplypolicy options and the recent versions
  also support an -xargs option so you can write the classic pipepline as 
one command:   mmfind ... -xargs ...
 
There are debug/diagnostic options so you can see the underlying GPFS 
commands and policy rules that are generated, so if mmfind doesn't do 
exactly what you were hoping, you can capture the commands and rules that 
it does do and tweak/hack those.

Two of the most crucial and tricky parts of mmfind are available as 
separate scripts that can be used separately:

tr_findToPol.pl :  convert classic options to policy rules.
 
mmxargs :   100% correctly deal with the problem of whitespace and/or 
"special" characters in the pathnames output as file lists by
   mmapplypolicy.  This is somewhat tricky.  

EVEN IF you've already worked out your own policy rules and use policy 
RULE  ... EXTERNAL ...  EXEC 'myscript'
you may want to use mmxargs or "lift" some of the code there-in -- because 
it is very likely your 'myscript' is not handling the problem of special 
characters correctly.

FILESETs vs POOLs - yes these are "orthogonal" concepts in GPFS (Spectrum 
Scale!)  BUT some customer/admins may choose to direct GPFS to assign to 
POOL based on FILESET using policy rules clauses like:
FOR FILESET('a_fs', 'b_fs')   /* handy to restrict a rule to one or a 
few filesets */
WHERE ...   AND (FILESET_NAME LIKE 'xyz_%') AND ...  /*  restrict to 
filesets whose name matches a pattern */

-- marc of GPFS___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

[gpfsug-discuss] Antwort: [Newsletter] Re: Problem with the gpfsgui - separate networks for daemon and admin

2017-11-14 Thread Matthias . Knigge

Changing the hostname without FQDN does not help. When I change back that 
the admin-interface is in the same network as the daemon then it works 
again. Could it be that for the GUI a daemon-interface must set? If yes, 
where can I set this interface?

Thanks, Matthias




Von:"Andreas Koeninger" 
An: gpfsug-discuss@spectrumscale.org
Kopie:  gpfsug-discuss@spectrumscale.org
Datum:  10.11.2017 13:07
Betreff:[Newsletter] Re: [gpfsug-discuss] Problem with the gpfsgui 
- separate networks for daemon and admin
Gesendet von:   gpfsug-discuss-boun...@spectrumscale.org



Hi Matthias,
 
what's "hostname" returning on your nodes?
 
1.) If it is not the one that the GUI has in it's database you can force a 
refresh by executing the below command on the GUI node:
 
/usr/lpp/mmfs/gui/cli/runtask OS_DETECT --debug
 
2.) If it is not the one that's shown in the returned performance data you 
have to restart the pmsensor service on the nodes:
 
systemctl restart pmsensors
 

Mit freundlichen Grüßen / Kind regards

Andreas Koeninger
Scrum Master and Software Developer / Spectrum Scale GUI and REST API
IBM Systems  Group, Integrated Systems Development / M069
---
IBM Deutschland
Am Weiher 24
65451 Kelsterbach
Phone: +49-7034-643-0867
Mobile: +49-7034-643-0867
E-Mail: andreas.koenin...@de.ibm.com
---
IBM Deutschland Research & Development GmbH / Vorsitzende des 
Aufsichtsrats: Martina Koederitz
Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen / 
Registergericht: Amtsgericht Stuttgart, HRB 243294
 
 
- Original message -
From: "Wilson, Neil" 
Sent by: gpfsug-discuss-boun...@spectrumscale.org
To: gpfsug main discussion list 
Cc:
Subject: Re: [gpfsug-discuss] Problem with the gpfsgui - separate networks 
for daemon and admin
Date: Fri, Nov 10, 2017 12:20 PM
 
Hi Matthias,
 
Not sure if this will help but we had a very similar issue with the GUI 
not showing performance data, like you we have separate networks for the 
gpfs data traffic and management/admin traffic. 
 
For some reason when we put the full FQDN of the node into the “hostname” 
field (it’s blank by default) of the pmsensors cfg file on that node and 
restarted pmsensors – the gui started showing performance data for that 
node.
 
We ended up removing the auto config for pmsensors from all of our client 
nodes, then manually configured pmsensors with a custom cfg file on each 
node.
 
It’s probably not the same for you, but might be worth trying out.
 
Thanks
Neil
 
From: gpfsug-discuss-boun...@spectrumscale.org [
mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of 
matthias.kni...@rohde-schwarz.com
Sent: 10 November 2017 06:23
To: gpfsug-discuss@spectrumscale.org
Subject: [gpfsug-discuss] Problem with the gpfsgui - separate networks for 
daemon and admin
 
Hi at all,

when I install the gui without a separate network for the admin commands 
the gui works. But when I split the networks the gui tells me in the 
brower:

Performance collector did not return any data.

All the services like pmsensors, pmcollector, postgresql are running. The 
firewall is disabled.

Any idea for me or some information more needed?

Many thanks in advance!

Matthias 
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss=DwICAg=jf_iaSHvJObTbx-siA1ZOg=IbxtjdkPAM2Sbon4Lbbi4w=r2ldt2133nWuT-SD27LvI8nFqC4Kx7f47sYAeLaZH84=yDy0znk3CG9PZuuQ9yi81wOOwc48Aw8WbMvOjzW_uZI=
 
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss



___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Backing up GPFS config

2017-11-14 Thread Skylar Thompson

I can't remember if I replied to that post or a different one, but these
are the commands we capture output for before running mmbackup:

mmlsconfig
mmlsnsd
mmlscluster
mmlscluster --cnfs
mmlscluster --ces
mmlsnode
mmlsdisk ${FS_NAME} -L
mmlspool ${FS_NAME} all -L
mmlslicense -L
mmlspolicy ${FS_NAME} -L
mmbackupconfig ${FS_NAME} 

All the commands but mmbackupconfig produce human-readable output, while
mmbackupconfig produces machine-readable output suitable for recovering the
filesystem in a disaster.

On Tue, Nov 14, 2017 at 10:16:44AM +, Sobey, Richard A wrote:
> All,
> 
> A few months ago someone posted to the list all the commands they run to back 
> up their GPFS configuration. Including mmlsfileset -L, the output of 
> mmlsconfig etc, so that in the event of a proper "crap your pants" moment you 
> can not only restore your data, but also your whole configuration.
> 
> I cannot seem to find this post... does the OP remember and could kindly 
> forward it on to me, or the list again?
> 
> Thanks
> Richard

> ___
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss


-- 
-- Skylar Thompson (skyl...@u.washington.edu)
-- Genome Sciences Department, System Administrator
-- Foege Building S046, (206)-685-7354
-- University of Washington School of Medicine
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Backing up GPFS config

2017-11-14 Thread Jan-Frode Myklebust

Plese see
https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/General%20Parallel%20File%20System%20(GPFS)/page/Back%20Up%20GPFS%20Configuration

But also check «mmcesdr primary backup». I don't rememner if it included
all of mmbackupconfig/mmccr, but I think it did, and it also includes CES
config. You don't need to be using CES DR to use it.



-jf

tir. 14. nov. 2017 kl. 03:16 skrev Sobey, Richard A :

> All,
>
>
>
> A few months ago someone posted to the list all the commands they run to
> back up their GPFS configuration. Including mmlsfileset -L, the output of
> mmlsconfig etc, so that in the event of a proper “crap your pants” moment
> you can not only restore your data, but also your whole configuration.
>
>
>
> I cannot seem to find this post… does the OP remember and could kindly
> forward it on to me, or the list again?
>
>
>
> Thanks
>
> Richard
> ___
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

[gpfsug-discuss] Backing up GPFS config

2017-11-14 Thread Sobey, Richard A

All,

A few months ago someone posted to the list all the commands they run to back 
up their GPFS configuration. Including mmlsfileset -L, the output of mmlsconfig 
etc, so that in the event of a proper "crap your pants" moment you can not only 
restore your data, but also your whole configuration.

I cannot seem to find this post... does the OP remember and could kindly 
forward it on to me, or the list again?

Thanks
Richard
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server

Re: [gpfsug-discuss] Backup All Cluster GSS GPFS Storage Server

[gpfsug-discuss] Antwort: [Newsletter] Re: Combine different rules - tip: use mmfind & co; FOR FILESET; FILESET_NAME

[gpfsug-discuss] Antwort: [Newsletter] Re: Problem with the gpfsgui - separate networks for daemon and admin

Re: [gpfsug-discuss] Backing up GPFS config

Re: [gpfsug-discuss] Backing up GPFS config

[gpfsug-discuss] Backing up GPFS config

7 matches

Site Navigation

Mail list logo

Footer information