Re: [gpfsug-discuss] upgrading to spectrum scale 4.1 from gpfs 3.5.0-21

[Jonathan Buzzard]

On 11/03/16 21:10, Simon Thompson (Research Computing - IT Services) wrote:


That looks pretty much like the right process.


Yes and no. Assuming you are do this on either RHEL 6.x or 7.x (or their 
derivatives), then they will now complain constantly that you have 
modified the RPM database outside yum.


As such it is recommended by RedHat that you do "yum remove" and "yum 
install" rather than running rpm directly.


JAB.

--
Jonathan A. Buzzard Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] upgrading to spectrum scale 4.1 from gpfs 3.5.0-21

[Simon Thompson (Research Computing - IT Services)]

That looks pretty much like the right process.

Check that all the components upgraded ... rpm -qa | grep gpfs

You may need to do an rpm -e on the gpfs.gplbin package and then install the 
newly built one

Are you doing make rpm to build the rpm version of gpfs.gplbin and installing 
that?

Simon

From: gpfsug-discuss-boun...@spectrumscale.org 
[gpfsug-discuss-boun...@spectrumscale.org] on behalf of Damir Krstic 
[damir.krs...@gmail.com]
Sent: 11 March 2016 20:55
To: gpfsug main discussion list
Subject: [gpfsug-discuss] upgrading to spectrum scale 4.1 from gpfs 3.5.0-21

What is the correct procedure to upgrade from 3.5 to 4.1?

What I have tried is uninstalling existing 3.5 version (rpm -e) and installing 
4.1.0.0 using rpm -hiv *.rpm. After the install I've compiled kernel extensions:
cd /usr/lpp/mmfs/src && make Autoconfig && make World && make InstallImages

Rebooted the node and have been getting:
daemon and kernel extension do not match.

I've tried rebuilding extensions again and still could not get it to work. I've 
uninstalled 4.1 packages and reinstalled 3.5 and I am not getting daemon and 
kernel extension do not match error with 3.5 version on a single node. So, 
couple of questions:
What is the correct way of upgrading from 3.5 to 4.1.0.0?


Thanks,
Damir
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

[gpfsug-discuss] upgrading to spectrum scale 4.1 from gpfs 3.5.0-21

[Damir Krstic]

What is the correct procedure to upgrade from 3.5 to 4.1?

What I have tried is uninstalling existing 3.5 version (rpm -e) and
installing 4.1.0.0 using rpm -hiv *.rpm. After the install I've compiled
kernel extensions:
cd /usr/lpp/mmfs/src && make Autoconfig && make World && make InstallImages

Rebooted the node and have been getting:
daemon and kernel extension do not match.

I've tried rebuilding extensions again and still could not get it to work.
I've uninstalled 4.1 packages and reinstalled 3.5 and I am not getting
daemon and kernel extension do not match error with 3.5 version on a single
node. So, couple of questions:
What is the correct way of upgrading from 3.5 to 4.1.0.0?


Thanks,
Damir
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] GPFS+TSM+HSM: staging vs. migration priority

[Dominic Mueller-Wicke01]

Jaime,

found the RFE and will discuss it with product management.

Greetings, Dominic.

__

Dominic Mueller-Wicke | IBM Spectrum Protect Development | Technical Lead |
+49 7034 64 32794 | dominic.muel...@de.ibm.com

Vorsitzende des Aufsichtsrats: Martina Koederitz; Geschäftsführung: Dirk
Wittkopp
Sitz der Gesellschaft: Böblingen; Registergericht: Amtsgericht Stuttgart,
HRB 243294



From:   Jaime Pinto 
To: Dominic Mueller-Wicke01/Germany/IBM@IBMDE
Cc: gpfsug main discussion list ,
Marc A Kaplan 
Date:   11.03.2016 01:15
Subject:Re: [gpfsug-discuss] GPFS+TSM+HSM: staging vs. migration
priority



Hey Dominic

Just submitted a  new request:

Headline: GPFS+TSM+HSM: staging vs. migration priority

ID: 85292

Thank you
Jaime



Quoting Dominic Mueller-Wicke01 :

>
> Hi Jaime,
>
> I received the same request from other customers as well.
> could you please open a RFE for the theme and send me the RFE ID? I will
> discuss it with the product management then. RFE Link:
>
https://www.ibm.com/developerworks/rfe/execute?use_case=changeRequestLanding_ID=0_ID=360=11=12

>
> Greetings, Dominic.
>
>
__

>
> Dominic Mueller-Wicke | IBM Spectrum Protect Development | Technical Lead
|
> +49 7034 64 32794 | dominic.muel...@de.ibm.com
>
> Vorsitzende des Aufsichtsrats: Martina Koederitz; Geschäftsführung: Dirk
> Wittkopp
> Sitz der Gesellschaft: Böblingen; Registergericht: Amtsgericht Stuttgart,
> HRB 243294
>
>
>
> From:  Jaime Pinto 
> To:gpfsug main discussion list
,
> Marc A Kaplan 
> Cc:Dominic Mueller-Wicke01/Germany/IBM@IBMDE
> Date:  09.03.2016 16:22
> Subject:   Re: [gpfsug-discuss] GPFS+TSM+HSM: staging vs. 
> migration
> priority
>
>
>
> Interesting perspective Mark.
>
> I'm inclined to think EBUSY would be more appropriate.
>
> Jaime
>
> Quoting Marc A Kaplan :
>
>> For a write or create operation ENOSPC  would make some sense.
>> But if the file already exists and I'm just opening for read access I
>> would be very confused by ENOSPC.
>> How should the system respond:  "Sorry, I know about that file, I have
it
>> safely stored away in HSM, but it is not available right now. Try again
>> later!"
>>
>> EAGAIN or EBUSY might be the closest in ordinary language...
>> But EAGAIN is used when a system call is interrupted and can be retried
>> right away...
>> So EBUSY?
>>
>> The standard return codes in Linux are:
>>
>> #define EPERM1  /* Operation not permitted */
>> #define ENOENT   2  /* No such file or directory */
>> #define ESRCH3  /* No such process */
>> #define EINTR4  /* Interrupted system call */
>> #define EIO  5  /* I/O error */
>> #define ENXIO6  /* No such device or address */
>> #define E2BIG7  /* Argument list too long */
>> #define ENOEXEC  8  /* Exec format error */
>> #define EBADF9  /* Bad file number */
>> #define ECHILD  10  /* No child processes */
>> #define EAGAIN  11  /* Try again */
>> #define ENOMEM  12  /* Out of memory */
>> #define EACCES  13  /* Permission denied */
>> #define EFAULT  14  /* Bad address */
>> #define ENOTBLK 15  /* Block device required */
>> #define EBUSY   16  /* Device or resource busy */
>> #define EEXIST  17  /* File exists */
>> #define EXDEV   18  /* Cross-device link */
>> #define ENODEV  19  /* No such device */
>> #define ENOTDIR 20  /* Not a directory */
>> #define EISDIR  21  /* Is a directory */
>> #define EINVAL  22  /* Invalid argument */
>> #define ENFILE  23  /* File table overflow */
>> #define EMFILE  24  /* Too many open files */
>> #define ENOTTY  25  /* Not a typewriter */
>> #define ETXTBSY 26  /* Text file busy */
>> #define EFBIG   27  /* File too large */
>> #define ENOSPC  28  /* No space left on device */
>> #define ESPIPE  29  /* Illegal seek */
>> #define EROFS   30  /* Read-only file system */
>> #define EMLINK  31  /* Too many links */
>> #define EPIPE   32  /* Broken pipe */
>> #define EDOM33  /* Math argument out of domain of func
*/
>> #define ERANGE  34  /* Math result not representable */
>>
>>
>>
>>
>>
>>
>>
>
>
>
>
>
>
>   

Re: [gpfsug-discuss] SpectrumScale 4.2.0-2 is out and STILL NO pmsensors-4.2.0-2.el6

[Simon Thompson (Research Computing - IT Services)]

Hi Bob,

But on the plus side, I noticed in the release notes:
"If you are coming from 4.1.1-X, you must first upgrade to 4.2.0-0. You may use 
this 4.2.0-2 package to perform a First Time Install or to upgrade from an 
existing 4.2.0-X level."

So it looks like its no longer necessary to install 4.2.0 and then apply PTFs. 
I remember talking to someone a while ago and they were hoping this might 
happen, but it seems that it actually has!

Nice!

Simon

From: 
>
 on behalf of "Oesterlin, Robert" 
>
Reply-To: 
"gpfsug-discuss@spectrumscale.org" 
>
Date: Friday, 11 March 2016 at 14:30
To: "gpfsug-discuss@spectrumscale.org" 
>
Subject: [gpfsug-discuss] SpectrumScale 4.2.0-2 is out and STILL NO 
pmsensors-4.2.0-2.el6

I see this fix is out and IBM still is not providing the pmsensors package for 
RH6… can we PLEASE get this package posted as part of the normal distribution?

Bob Oesterlin
Sr Storage Engineer, Nuance HPC Grid
507-269-0413

___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Niggles in the 4.2.0 Install

[Jonathan Buzzard]

On Fri, 2016-03-11 at 13:19 +, Sean Killen wrote:
> Hi all,
> 
> So I have finally got my SpectrumScale system installed (well half of
> it).  But it wasn't without some niggles.
> 
> We have purchased DELL MD3860i disk trays with dual controllers (each
> with 2x 10Gbit NICs), to Linux this appears as 4 paths, I spent quite a
> while getting a nice multipath setup in place with 'friendly' names set
> 

Oh dear. I guess it might work with 10Gb Ethernet but based on my
personal experience iSCSI is spectacularly unsuited to GPFS. Either your
NSD nodes can overwhelm the storage arrays or the storage arrays can
overwhelm the NSD servers and performance falls through the floor. That
is unless you have Data Center Ethernet at which point you might as well
have gone Fibre Channel in the first place. Though unless you are going
to have large physical separation between the storage and NSD servers
12Gb SAS is a cheaper option and you can still have four NSD servers
hooked up to each MD3 based storage array.

I have in the past implement GPFS on Dell MD3200i's. I did eventually
get it working reliably but it was so suboptimal with so many
compromises that as soon as the MD3600f came out we purchased these to
replaced the MD3200i's.

Lets say you have three storage arrays with two paths to each controller
and four NSD servers. Basically what happens is that an NSD server
issues a bunch of requests for blocks to the storage arrays.

Then all 12 paths start answering to your two connections to the NSD
server. At this point the Ethernet adaptors on your NSD servers are
overwhelmed 802.1D PAUSE frames start being issued which just result in
head of line blocking and performance falls through the floor. You need
Data Center Ethernet to handle this properly, which is probably why FCoE
never took off as you can't just use the Ethernet switches and adaptors
you have. Both FC and SAS handle this sort of congestion gracefully
unlike ordinary Ethernet.

Now the caveat for all this is that it is much easier to overwhelm a
1Gbps link than a 10Gbps link. However with the combination of SSD and
larger cache's I can envisage that a 10Gbps link could be overwhelmed
and you would then see the same performance issues that I saw. Basically
the only way out is a one to one correspondence between ports on the
NSD's and the storage controllers.

JAB.

-- 
Jonathan A. Buzzard Email: jonathan (at) buzzard.me.uk
Fife, United Kingdom.


___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Niggles in the 4.2.0 Install

[Marc A Kaplan]

You may need/want to set up an nsddevices script to help GPFS find all 
your disks.  Google it! Or ...

http://www.ibm.com/support/knowledgecenter/STXKQY_4.1.1/com.ibm.spectrum.scale.v4r11.adm.doc/bl1adm_nsddevices.htm





___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Niggles in the 4.2.0 Install

[Sophie Carsten]

Hi,

In terms of the NSDs, you need to run the nsd devices script if they're 
not in /dev/dmX-, here's the link to the knowledge center:
http://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.ins.doc/bl1ins_nsdpro.htm?lang=en

The installer should work as normal after this script has been run.

We were hoping to get this solved in the upcoming version of the 
installer, so the user doesn't have to manually run the script. But the 
previous install team has been put on a new project in IBM, and I can't 
really comment any longer on when this could be expected to be delivered 
by the new team put in place.

Hope the link gets you further off the ground though.


 
Sophie Carsten
IBM Spectrum Virtualize Development Engineer
IBM Systems - Manchester Lab 

 44-161-9683886
sophie.cars...@uk.ibm.com 




From:   Sean Killen 
To: gpfsug main discussion list 
Date:   11/03/2016 13:20
Subject:[gpfsug-discuss] Niggles in the 4.2.0 Install
Sent by:gpfsug-discuss-boun...@spectrumscale.org



Hi all,

So I have finally got my SpectrumScale system installed (well half of
it).  But it wasn't without some niggles.

We have purchased DELL MD3860i disk trays with dual controllers (each
with 2x 10Gbit NICs), to Linux this appears as 4 paths, I spent quite a
while getting a nice multipath setup in place with 'friendly' names set

/dev/mapper/ssd1_1
/dev/mapper/t1d1_1
/dev/mapper/t2d1_1

etc, to represent the different tiers/disks/luns.

We used the install toolkit and added all the NSDs with the friendly
names and it all checked out and verified UNTIL we tried to
install/deploy!  At which point it said, no valid devices in
/proc/partitions (I need to use the unfriendly /dev/dm-X name instead) -
did I miss something in the toolkit, or is something that needs to be
resolved, surely it should have told me when I added the first of the 36
NSDs rather that at the install stage when I then need to correct 36 
errors.

Secondly, I have installed the GUI, it is constantly complaining of a
'Critical' event MS0297 - Connection failed to node. Wrong Credentials.
 But all nodes can connect to each other via SSH without passwords.
Anyone know how to clear and fix this error; I cannot find anything in
the docs!

Thanks

-- Sean
-- 
---
Dr Sean M Killen
UNIX Support Officer, IT
Faculty of Biological Sciences
University of Leeds
LEEDS
LS2 9JT
United Kingdom

Tel: +44 (0)113 3433148
Mob: +44 (0)776 8670907
Fax: +44 (0)113 3438465

GnuPG Key ID: ee0d36f0
---

[attachment "signature.asc" deleted by Sophie Carsten/UK/IBM] 
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss



Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 
741598. 
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] Niggles in the 4.2.0 Install

[Stefan Schmidt]

The message means following and is a warning without an direct affect to 
the function but an indicator that something is may wrong with the 
enclosure. Check the maintenance procedure which is shown for the event in 
the GUI event panel.

/** Ambient temperature of power supply "{0}" undercut the lower warning 
threshold at {1}. */
   MS0297("MS0297W",'W'),
   "Cause": "If the lower warning threshold is undercut a the 
device operation should not be affected. However this might indicate a 
hardware defect.",
 "User_action": "Follow the maintenance procedure for the 
enclosure.",
 "code": "MS0297",
 "description": "Ambient temperature of power supply \"{0}\" 
undercut the lower warning threshold at {1}.",


Mit freundlichen Grüßen / Kind regards

Stefan Schmidt

Scrum Master IBM Spectrum Scale GUI / Senior IT Architect /PMP - Dept. 
M069 / IBM Spectrum Scale Software Development
IBM Systems Group
IBM Deutschland



Phone:
+49-6131-84-3465
 IBM Deutschland

Mobile:
+49-170-6346601
 Hechtsheimer Str. 2
E-Mail:
stsch...@de.ibm.com
 55131 Mainz


 Germany


IBM Deutschland Research & Development GmbH / Vorsitzende des 
Aufsichtsrats: Martina Koederitz
Geschäftsführung: Dirk Wittkopp
Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, 
HRB 243294 




___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss