date:20220223

Re: [gpfsug-discuss] IO sizes

2022-02-23 Thread Uwe Falke


Hi,

the test bench is gpfsperf running on up to 12 clients with 1...64 
threads doing sequential reads and writes , file size per gpfsperf 
process is 12TB (with 6TB I saw caching effects in particular for large 
thread numbers ...)


As I wrote initially: GPFS is issuing nothing but 8MiB IOs to the data 
disks, as expected in that case.


Interesting thing though:

I have rebooted the suspicious node. Now, it does not issue smaller IOs 
than the others, but -- unbelievable -- larger ones (up to about 
4.7MiB). This is still harmful as also that size is incompatible with 
full stripe writes on the storage ( 8+2 disk groups, i.e. logically RAID6)


Currently, I draw this information from the storage boxes; I have not 
yet checked iostat data for that benchmark test after the reboot 
(before, when IO sizes were smaller, we saw that both in iostat and in 
the perf data retrieved from the storage controllers).



And: we have a separate data pool , hence dataOnly NSDs, I am just 
talking about these ...



As for "Are you sure that Linux OS is configured the same on all 4 NSD 
servers?." - of course there are not two boxes identical in the world. I 
have actually not installed those machines, and, yes, i also considered 
reinstalling them (or at least the disturbing one).


However, I do not have reason to assume or expect a difference, the 
supplier has just implemented these systems  recently from scratch.



In the current situation (i.e. with IOs bit larger than 4MiB) setting 
max_sectors_kB to 4096 might do the trick, but as I do not know the 
cause for that behaviour it might well start to issue IOs smaller than 
4MiB again at some point, so that is not a nice solution.



Thanks

Uwe


On 23.02.22 22:20, Andrew Beattie wrote:

Alex,

Metadata will be 4Kib

Depending on the filesystem version you will also have subblocks to 
consider V4 filesystems have 1/32 subblocks, V5 filesystems have 
1/1024 subblocks (assuming metadata and data block size is the same)


My first question would be is “ Are you sure that Linux OS is 
configured the same on all 4 NSD servers?.


My second question would be do you know what your average file size is 
if most of your files are smaller than your filesystem block size, 
then you are always going to be performing writes using groups of 
subblocks rather than a full block writes.


Regards,

Andrew



On 24 Feb 2022, at 04:39, Alex Chekholko  wrote:

 Hi, Metadata I/Os will always be smaller than the usual data block 
size, right? Which version of GPFS? Regards, Alex On Wed, Feb 23, 
2022 at 10:26 AM Uwe Falke  wrote: Dear all, sorry 
for asking a question which seems ZjQcmQRYFpfptBannerStart

This Message Is From an External Sender
This message came from outside your organization.
ZjQcmQRYFpfptBannerEnd
Hi,

Metadata I/Os will always be smaller than the usual data block size, 
right?

Which version of GPFS?

Regards,
Alex

On Wed, Feb 23, 2022 at 10:26 AM Uwe Falke  wrote:

Dear all,

sorry for asking a question which seems not directly GPFS related:

In a setup with 4 NSD servers (old-style, with storage
controllers in
the back end), 12 clients and 10 Seagate storage systems, I do
see in
benchmark tests that  just one of the NSD servers does send
smaller IO
requests to the storage  than the other 3 (that is, both reads and
writes are smaller).

The NSD servers form 2 pairs, each pair is connected to 5 seagate
boxes
( one server to the controllers A, the other one to controllers B
of the
Seagates, resp.).

All 4 NSD servers are set up similarly:

kernel: 3.10.0-1160.el7.x86_64 #1 SMP

HBA: Broadcom / LSI Fusion-MPT 12GSAS/PCIe Secure SAS38xx

driver : mpt3sas 31.100.01.00

max_sectors_kb=8192 (max_hw_sectors_kb=16383 , not 16384, as
limited by
mpt3sas) for all sd devices and all multipath (dm) devices built
on top.

scheduler: deadline

multipath (actually we do have 3 paths to each volume, so there
is some
asymmetry, but that should not affect the IOs, shouldn't it?, and
if it
did we would see the same effect in both pairs of NSD servers,
but we do
not).

All 4 storage systems are also configured the same way (2 disk
groups /
pools / declustered arrays, one managed by  ctrl A, one by ctrl
B,  and
8 volumes out of each; makes altogether 2 x 8 x 10 = 160 NSDs).


GPFS BS is 8MiB , according to iohistory (mmdiag) we do see clean IO
requests of 16384 disk blocks (i.e. 8192kiB) from GPFS.

The first question I have - but that is not my main one: I do
see, both
in iostat and on the storage systems, that the default IO
requests are
about 4MiB, not 8MiB as I'd expect from above settings
(max_sectors_kb
is really in terms of kiB, not sectors, cf.
https://www.kernel.org/doc/Documentation/block/queue-sysfs.txt).

But what puzzles me even more: one of the server compiles IOs even
smaller,

Re: [gpfsug-discuss] IO sizes

2022-02-23 Thread Andrew Beattie

Alex,

Metadata will be 4Kib 

Depending on the filesystem version you will also have subblocks to consider V4 
filesystems have 1/32 subblocks, V5 filesystems have 1/1024 subblocks (assuming 
metadata and data block size is the same)

My first question would be is “ Are you sure that Linux OS is configured the 
same on all 4 NSD servers?.

My second question would be do you know what your average file size is if most 
of your files are smaller than your filesystem block size, then you are always 
going to be performing writes using groups of subblocks rather than a full 
block writes.

Regards, 

Andrew


> On 24 Feb 2022, at 04:39, Alex Chekholko  wrote:
> 
> 
> This Message Is From an External Sender
> This message came from outside your organization.
> Hi,
> 
> Metadata I/Os will always be smaller than the usual data block size, right?
> Which version of GPFS?
> 
> Regards,
> Alex
> 
>> On Wed, Feb 23, 2022 at 10:26 AM Uwe Falke  wrote:
>> Dear all,
>> 
>> sorry for asking a question which seems not directly GPFS related:
>> 
>> In a setup with 4 NSD servers (old-style, with storage controllers in 
>> the back end), 12 clients and 10 Seagate storage systems, I do see in 
>> benchmark tests that  just one of the NSD servers does send smaller IO 
>> requests to the storage  than the other 3 (that is, both reads and 
>> writes are smaller).
>> 
>> The NSD servers form 2 pairs, each pair is connected to 5 seagate boxes 
>> ( one server to the controllers A, the other one to controllers B of the 
>> Seagates, resp.).
>> 
>> All 4 NSD servers are set up similarly:
>> 
>> kernel: 3.10.0-1160.el7.x86_64 #1 SMP
>> 
>> HBA: Broadcom / LSI Fusion-MPT 12GSAS/PCIe Secure SAS38xx
>> 
>> driver : mpt3sas 31.100.01.00
>> 
>> max_sectors_kb=8192 (max_hw_sectors_kb=16383 , not 16384, as limited by 
>> mpt3sas) for all sd devices and all multipath (dm) devices built on top.
>> 
>> scheduler: deadline
>> 
>> multipath (actually we do have 3 paths to each volume, so there is some 
>> asymmetry, but that should not affect the IOs, shouldn't it?, and if it 
>> did we would see the same effect in both pairs of NSD servers, but we do 
>> not).
>> 
>> All 4 storage systems are also configured the same way (2 disk groups / 
>> pools / declustered arrays, one managed by  ctrl A, one by ctrl B,  and 
>> 8 volumes out of each; makes altogether 2 x 8 x 10 = 160 NSDs).
>> 
>> 
>> GPFS BS is 8MiB , according to iohistory (mmdiag) we do see clean IO 
>> requests of 16384 disk blocks (i.e. 8192kiB) from GPFS.
>> 
>> The first question I have - but that is not my main one: I do see, both 
>> in iostat and on the storage systems, that the default IO requests are 
>> about 4MiB, not 8MiB as I'd expect from above settings (max_sectors_kb 
>> is really in terms of kiB, not sectors, cf. 
>> https://www.kernel.org/doc/Documentation/block/queue-sysfs.txt).
>> 
>> But what puzzles me even more: one of the server compiles IOs even 
>> smaller, varying between 3.2MiB and 3.6MiB mostly - both for reads and 
>> writes ... I just cannot see why.
>> 
>> I have to suspect that this will (in writing to the storage) cause 
>> incomplete stripe writes on our erasure-coded volumes (8+2p)(as long as 
>> the controller is not able to re-coalesce the data properly; and it 
>> seems it cannot do it completely at least)
>> 
>> 
>> If someone of you has seen that already and/or knows a potential 
>> explanation I'd be glad to learn about.
>> 
>> 
>> And if some of you wonder: yes, I (was) moved away from IBM and am now 
>> at KIT.
>> 
>> Many thanks in advance
>> 
>> Uwe
>> 
>> 
>> -- 
>> Karlsruhe Institute of Technology (KIT)
>> Steinbuch Centre for Computing (SCC)
>> Scientific Data Management (SDM)
>> 
>> Uwe Falke
>> 
>> Hermann-von-Helmholtz-Platz 1, Building 442, Room 187
>> D-76344 Eggenstein-Leopoldshafen
>> 
>> Tel: +49 721 608 28024
>> Email: uwe.fa...@kit.edu
>> www.scc.kit.edu
>> 
>> Registered office:
>> Kaiserstraße 12, 76131 Karlsruhe, Germany
>> 
>> KIT – The Research University in the Helmholtz Association
>> 
>> ___
>> gpfsug-discuss mailing list
>> gpfsug-discuss at spectrumscale.org
>> http://gpfsug.org/mailman/listinfo/gpfsug-discuss

___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

[gpfsug-discuss] IO sizes

2022-02-23 Thread Uwe Falke


Dear all,

sorry for asking a question which seems not directly GPFS related:

In a setup with 4 NSD servers (old-style, with storage controllers in 
the back end), 12 clients and 10 Seagate storage systems, I do see in 
benchmark tests that  just one of the NSD servers does send smaller IO 
requests to the storage  than the other 3 (that is, both reads and 
writes are smaller).


The NSD servers form 2 pairs, each pair is connected to 5 seagate boxes 
( one server to the controllers A, the other one to controllers B of the 
Seagates, resp.).


All 4 NSD servers are set up similarly:

kernel: 3.10.0-1160.el7.x86_64 #1 SMP

HBA: Broadcom / LSI Fusion-MPT 12GSAS/PCIe Secure SAS38xx

driver : mpt3sas 31.100.01.00

max_sectors_kb=8192 (max_hw_sectors_kb=16383 , not 16384, as limited by 
mpt3sas) for all sd devices and all multipath (dm) devices built on top.


scheduler: deadline

multipath (actually we do have 3 paths to each volume, so there is some 
asymmetry, but that should not affect the IOs, shouldn't it?, and if it 
did we would see the same effect in both pairs of NSD servers, but we do 
not).


All 4 storage systems are also configured the same way (2 disk groups / 
pools / declustered arrays, one managed by  ctrl A, one by ctrl B,  and 
8 volumes out of each; makes altogether 2 x 8 x 10 = 160 NSDs).



GPFS BS is 8MiB , according to iohistory (mmdiag) we do see clean IO 
requests of 16384 disk blocks (i.e. 8192kiB) from GPFS.


The first question I have - but that is not my main one: I do see, both 
in iostat and on the storage systems, that the default IO requests are 
about 4MiB, not 8MiB as I'd expect from above settings (max_sectors_kb 
is really in terms of kiB, not sectors, cf. 
https://www.kernel.org/doc/Documentation/block/queue-sysfs.txt).


But what puzzles me even more: one of the server compiles IOs even 
smaller, varying between 3.2MiB and 3.6MiB mostly - both for reads and 
writes ... I just cannot see why.


I have to suspect that this will (in writing to the storage) cause 
incomplete stripe writes on our erasure-coded volumes (8+2p)(as long as 
the controller is not able to re-coalesce the data properly; and it 
seems it cannot do it completely at least)



If someone of you has seen that already and/or knows a potential 
explanation I'd be glad to learn about.



And if some of you wonder: yes, I (was) moved away from IBM and am now 
at KIT.


Many thanks in advance

Uwe


--
Karlsruhe Institute of Technology (KIT)
Steinbuch Centre for Computing (SCC)
Scientific Data Management (SDM)

Uwe Falke

Hermann-von-Helmholtz-Platz 1, Building 442, Room 187
D-76344 Eggenstein-Leopoldshafen

Tel: +49 721 608 28024
Email: uwe.fa...@kit.edu
www.scc.kit.edu

Registered office:
Kaiserstraße 12, 76131 Karlsruhe, Germany

KIT – The Research University in the Helmholtz Association



smime.p7s
Description: S/MIME Cryptographic Signature
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] immutable folder

2022-02-23 Thread Paul Ward

Its not allowing me!


Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk
[A picture containing drawing  Description automatically generated]

From: gpfsug-discuss-boun...@spectrumscale.org 
 On Behalf Of IBM Spectrum Scale
Sent: 23 February 2022 14:57
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] immutable folder

Your directory is under a fileset with non-compliant iam mode. With fileset in 
that mode, it follows snapLock protocol - it disallows changing subdir to 
immutable, but allows changing subdir to mutable.

Regards, The Spectrum Scale (GPFS) team

--
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479.

If your query concerns a potential software error in Spectrum Scale (GPFS) and 
you have an IBM software maintenance contract please contact  1-800-237-5511 in 
the United States or your local IBM Service Center in other countries.

The forum is informally monitored as time permits and should not be used for 
priority messages to the Spectrum Scale (GPFS) team.



From:"Paul Ward" mailto:p.w...@nhm.ac.uk>>
To:"gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Date:02/23/2022 07:17 AM
Subject:[EXTERNAL] Re: [gpfsug-discuss] immutable folder
Sent by:
gpfsug-discuss-boun...@spectrumscale.org




Thanks, I couldn’t recreate that test: # mkdir "it/stu'pid name" mkdir: cannot 
create directory ‘it/stu'pid name’: No such file or directory [Removing the / ] 
# mkdir "itstu'pid name" ‍‍ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender

This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd

Thanks, I couldn’t recreate that test:



# mkdir "it/stu'pid name"

mkdir: cannot create directory ‘it/stu'pid name’: No such file or directory

[Removing the / ]



# mkdir "itstu'pid name"



# mmchattr -i yes itstu\'pid\ name/

itstu'pid name/: Change immutable flag failed: Invalid argument.

Can not set directory to be immutable or appendOnly under current fileset mode!



Which begs the question, how do I have an immutable folder!



Kindest regards,

Paul



Paul Ward

TS Infrastructure Architect

Natural History Museum

T: 02079426450

E: p.w...@nhm.ac.uk

[A picture containing drawingDescription automatically generated]



From:gpfsug-discuss-boun...@spectrumscale.org 
mailto:gpfsug-discuss-boun...@spectrumscale.org>>
 On Behalf Of Hannappel, Juergen
Sent: 23 February 2022 11:49
To: gpfsug main discussion list 
mailto:gpfsug-discuss@spectrumscale.org>>
Subject: Re: [gpfsug-discuss] immutable folder



While the apostrophe is evil it's not the problem:



root@it-gti-02 test1]# mkdir "it/stu'pid name"
[root@it-gti-02 test1]# mmchattr -i yes it/stu\'pid\ name
[root@it-gti-02 test1]# mmchattr -i no it/stu\'pid\ name



From: "Paul Ward" mailto:p.w...@nhm.ac.uk>>
To: "gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Sent: Wednesday, 23 February, 2022 12:03:37
Subject: Re: [gpfsug-discuss] immutable folder

Its not a fileset, its just a folder, well a subfolder…



[filesystem/[fileset]/share/data/iac/[user] 2004-2014/Laboratory Impact 
experiments/LGG shots/Kent LGG/Kent aerogel LGG shots/Lizardite in aerogel/Nick 
Foster's sample



It’s the “Nick Foster's sample” folder I want to delete, but it says it is 
immutable and I can’t disable that.



I suspect it’s the apostrophe confusing things.









Kindest regards,

Paul



Paul Ward

TS Infrastructure Architect

Natural History Museum

T: 02079426450

E: p.w...@nhm.ac.uk

[A picture containing drawingDescription automatically generated]



From:gpfsug-discuss-boun...@spectrumscale.orgmailto:gpfsug-discuss-boun...@spectrumscale.org>>
 On Behalf Of IBM Spectrum Scale
Sent: 22 February 2022 14:17
To: gpfsug main discussion list 
mailto:gpfsug-discuss@spectrumscale.org>>
Subject: Re: [gpfsug-discuss] immutable folder



Scale disallows deleting fileset junction

Re: [gpfsug-discuss] immutable folder

2022-02-23 Thread IBM Spectrum Scale

Your directory is under a fileset with non-compliant iam mode. With 
fileset in that mode, it follows snapLock protocol - it disallows changing 
subdir to immutable, but allows changing subdir to mutable. 

Regards, The Spectrum Scale (GPFS) team

--
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479
. 

If your query concerns a potential software error in Spectrum Scale (GPFS) 
and you have an IBM software maintenance contract please contact 
1-800-237-5511 in the United States or your local IBM Service Center in 
other countries. 

The forum is informally monitored as time permits and should not be used 
for priority messages to the Spectrum Scale (GPFS) team.



From:   "Paul Ward" 
To: "gpfsug main discussion list" 
Date:   02/23/2022 07:17 AM
Subject:[EXTERNAL] Re: [gpfsug-discuss] immutable folder
Sent by:gpfsug-discuss-boun...@spectrumscale.org



Thanks, I couldn’t recreate that test: # mkdir "it/stu'pid name" mkdir: 
cannot create directory ‘it/stu'pid name’: No such file or directory 
[Removing the / ] # mkdir "itstu'pid name" 
‍‍ZjQcmQRYFpfptBannerStart 
This Message Is From an External Sender 
This message came from outside your organization. 
ZjQcmQRYFpfptBannerEnd
Thanks, I couldn’t recreate that test:
 
# mkdir "it/stu'pid name"
mkdir: cannot create directory ‘it/stu'pid name’: No such file or 
directory
[Removing the / ]
 
# mkdir "itstu'pid name"
 
# mmchattr -i yes itstu\'pid\ name/
itstu'pid name/: Change immutable flag failed: Invalid argument.
Can not set directory to be immutable or appendOnly under current fileset 
mode!
 
Which begs the question, how do I have an immutable folder!
 
Kindest regards,
Paul
 
Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk

 
From: gpfsug-discuss-boun...@spectrumscale.org 
 On Behalf Of Hannappel, Juergen
Sent: 23 February 2022 11:49
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] immutable folder
 
While the apostrophe is evil it's not the problem:
 
root@it-gti-02 test1]# mkdir "it/stu'pid name"
[root@it-gti-02 test1]# mmchattr -i yes it/stu\'pid\ name
[root@it-gti-02 test1]# mmchattr -i no it/stu\'pid\ name

From: "Paul Ward" 
To: "gpfsug main discussion list" 
Sent: Wednesday, 23 February, 2022 12:03:37
Subject: Re: [gpfsug-discuss] immutable folder
Its not a fileset, its just a folder, well a subfolder…
 
[filesystem/[fileset]/share/data/iac/[user] 2004-2014/Laboratory Impact 
experiments/LGG shots/Kent LGG/Kent aerogel LGG shots/Lizardite in 
aerogel/Nick Foster's sample
 
It’s the “Nick Foster's sample” folder I want to delete, but it says it is 
immutable and I can’t disable that.
 
I suspect it’s the apostrophe confusing things.
 
 
 
 
Kindest regards,
Paul
 
Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk

 
From: gpfsug-discuss-boun...@spectrumscale.org <
gpfsug-discuss-boun...@spectrumscale.org> On Behalf Of IBM Spectrum Scale
Sent: 22 February 2022 14:17
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] immutable folder
 
Scale disallows deleting fileset junction using rmdir, so I suggested 
mmunlinkfileset.

Regards, The Spectrum Scale (GPFS) team

--
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479
. 

If your query concerns a potential software error in Spectrum Scale (GPFS) 
and you have an IBM software maintenance contract please contact 
1-800-237-5511 in the United States or your local IBM Service Center in 
other countries. 

The forum is informally monitored as time permits and should not be used 
for priority messages to the Spectrum Scale (GPFS) team.



From:"Paul Ward" 
To:"gpfsug main discussion list" 
Date:02/22/2022 05:31 AM
Subject:[EXTERNAL] Re: [gpfsug-discuss] immutable folder
Sent by:gpfsug-discuss-boun...@spectrumscale.org

___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss 





___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] How to do multiple mounts via GPFS

2022-02-23 Thread Jakobs, Julian

I've ran into the same problem some time ago.
What worked for me was this shell script I run as a @reboot cronjob:

#!/bin/bash
while [ ! -d /gpfs1/home ]
do
  sleep 5
done
mount --bind /gpfs1/home /home

-Ursprüngliche Nachricht-
Von: gpfsug-discuss-boun...@spectrumscale.org 
[mailto:gpfsug-discuss-boun...@spectrumscale.org] Im Auftrag von Justin Cantrell
Gesendet: Dienstag, 22. Februar 2022 20:24
An: gpfsug-discuss@spectrumscale.org
Betreff: Re: [gpfsug-discuss] How to do multiple mounts via GPFS

I tried a bind mount, but perhaps I'm doing it wrong. The system fails to boot 
because gpfs doesn't start until too late in the boot process.
In fact, the system boots and the gpfs1 partition isn't available for a good 
20-30 seconds.

/gfs1/home/homenone bind
I've tried adding mount options of x-systemd-requires=gpfs1, noauto.
The noauto lets it boot, but the mount is never mounted properly. Doing a 
manual mount -a mounts it.

On 2/22/22 12:37, Skylar Thompson wrote:
> Assuming this is on Linux, you ought to be able to use bind mounts for 
> that, something like this in fstab or equivalent:
>
> /home /gpfs1/home bind defaults 0 0
>
> On Tue, Feb 22, 2022 at 12:24:09PM -0500, Justin Cantrell wrote:
>> We're trying to mount multiple mounts at boot up via gpfs.
>> We can mount the main gpfs mount /gpfs1, but would like to mount 
>> things
>> like:
>> /home /gpfs1/home
>> /other /gpfs1/other
>> /stuff /gpfs1/stuff
>>
>> But adding that to fstab doesn't work, because from what I 
>> understand, that's not how gpfs works with mounts.
>> What's the standard way to accomplish something like this?
>> We've used systemd timers/mounts to accomplish it, but that's not ideal.
>> Is there a way to do this natively with gpfs or does this have to be 
>> done through symlinks or gpfs over nfs?
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


smime.p7s
Description: S/MIME cryptographic signature
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] immutable folder

2022-02-23 Thread Paul Ward

5.1.1-1


Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk
[A picture containing drawing  Description automatically generated]

From: gpfsug-discuss-boun...@spectrumscale.org 
 On Behalf Of Frederick Stock
Sent: 23 February 2022 12:51
To: gpfsug-discuss@spectrumscale.org
Cc: gpfsug-discuss@spectrumscale.org
Subject: Re: [gpfsug-discuss] immutable folder

Paul, what version of Spectrum Scale are you using?

Fred
___
Fred Stock | Spectrum Scale Development Advocacy | 720-430-8821
sto...@us.ibm.com


- Original message -
From: "Paul Ward" mailto:p.w...@nhm.ac.uk>>
Sent by: 
gpfsug-discuss-boun...@spectrumscale.org
To: "gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Cc:
Subject: [EXTERNAL] Re: [gpfsug-discuss] immutable folder
Date: Wed, Feb 23, 2022 7:17 AM


Thanks, I couldn't recreate that test:



# mkdir "it/stu'pid name"

mkdir: cannot create directory 'it/stu'pid name': No such file or directory

[Removing the / ]



# mkdir "itstu'pid name"



# mmchattr -i yes itstu\'pid\ name/

itstu'pid name/: Change immutable flag failed: Invalid argument.

Can not set directory to be immutable or appendOnly under current fileset mode!



Which begs the question, how do I have an immutable folder!



Kindest regards,

Paul



Paul Ward

TS Infrastructure Architect

Natural History Museum

T: 02079426450

E: p.w...@nhm.ac.uk

[A picture containing drawingDescription automatically generated]



From: 
gpfsug-discuss-boun...@spectrumscale.org
 
mailto:gpfsug-discuss-boun...@spectrumscale.org>>
 On Behalf Of Hannappel, Juergen
Sent: 23 February 2022 11:49
To: gpfsug main discussion list 
mailto:gpfsug-discuss@spectrumscale.org>>
Subject: Re: [gpfsug-discuss] immutable folder



While the apostrophe is evil it's not the problem:



root@it-gti-02 test1]# mkdir "it/stu'pid name"
[root@it-gti-02 test1]# mmchattr -i yes it/stu\'pid\ name
[root@it-gti-02 test1]# mmchattr -i no it/stu\'pid\ name



From: "Paul Ward" mailto:p.w...@nhm.ac.uk>>
To: "gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Sent: Wednesday, 23 February, 2022 12:03:37
Subject: Re: [gpfsug-discuss] immutable folder

Its not a fileset, its just a folder, well a subfolder...



[filesystem/[fileset]/share/data/iac/[user] 2004-2014/Laboratory Impact 
experiments/LGG shots/Kent LGG/Kent aerogel LGG shots/Lizardite in aerogel/Nick 
Foster's sample



It's the "Nick Foster's sample" folder I want to delete, but it says it is 
immutable and I can't disable that.



I suspect it's the apostrophe confusing things.









Kindest regards,

Paul



Paul Ward

TS Infrastructure Architect

Natural History Museum

T: 02079426450

E: p.w...@nhm.ac.uk

[A picture containing drawingDescription automatically generated]



From: 
gpfsug-discuss-boun...@spectrumscale.org
 
mailto:gpfsug-discuss-boun...@spectrumscale.org>>
 On Behalf Of IBM Spectrum Scale
Sent: 22 February 2022 14:17
To: gpfsug main discussion list 
mailto:gpfsug-discuss@spectrumscale.org>>
Subject: Re: [gpfsug-discuss] immutable folder



Scale disallows deleting fileset junction using rmdir, so I suggested 
mmunlinkfileset.

Regards, The Spectrum Scale (GPFS) team

--
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479.

If your query concerns a potential software error in Spectrum Scale (GPFS) and 
you have an IBM software maintenance contract please contact  1-800-237-5511 in 
the United States or your local IBM Service Center in other countries.

The forum is informally monitored as time permits and should not be used for 
priority messages to the Spectrum Scale (GPFS) team.



From:"Paul Ward" mailto:p.w...@nhm.ac.uk>>
To:"gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Date:02/22/2022 05:31 AM
Subject:[EXTERNAL] Re: [gpfsug-discuss] immutable folder

Re: [gpfsug-discuss] immutable folder

2022-02-23 Thread Frederick Stock

Paul, what version of Spectrum Scale are you using?
Fred___Fred Stock | Spectrum Scale Development Advocacy | 720-430-8821sto...@us.ibm.com
 
 
- Original message -From: "Paul Ward" Sent by: gpfsug-discuss-boun...@spectrumscale.orgTo: "gpfsug main discussion list" Cc:Subject: [EXTERNAL] Re: [gpfsug-discuss] immutable folderDate: Wed, Feb 23, 2022 7:17 AM  
Thanks, I couldn’t recreate that test:
 
# mkdir "it/stu'pid name"
mkdir: cannot create directory ‘it/stu'pid name’: No such file or directory
[Removing the / ]
 
# mkdir "itstu'pid name"
 
# mmchattr -i yes itstu\'pid\ name/
itstu'pid name/: Change immutable flag failed: Invalid argument.
Can not set directory to be immutable or appendOnly under current fileset mode!
 
Which begs the question, how do I have an immutable folder!
 
Kindest regards,
Paul
 
Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk

 
From: gpfsug-discuss-boun...@spectrumscale.org  On Behalf Of Hannappel, JuergenSent: 23 February 2022 11:49To: gpfsug main discussion list Subject: Re: [gpfsug-discuss] immutable folder
 
While the apostrophe is evil it's not the problem:
 
root@it-gti-02 test1]# mkdir "it/stu'pid name"[root@it-gti-02 test1]# mmchattr -i yes it/stu\'pid\ name[root@it-gti-02 test1]# mmchattr -i no it/stu\'pid\ name

From: "Paul Ward" To: "gpfsug main discussion list" Sent: Wednesday, 23 February, 2022 12:03:37Subject: Re: [gpfsug-discuss] immutable folder
Its not a fileset, its just a folder, well a subfolder…
 
[filesystem/[fileset]/share/data/iac/[user] 2004-2014/Laboratory Impact experiments/LGG shots/Kent LGG/Kent aerogel LGG shots/Lizardite in aerogel/Nick Foster's sample
 
It’s the “Nick Foster's sample” folder I want to delete, but it says it is immutable and I can’t disable that.
 
I suspect it’s the apostrophe confusing things.
 
 
 
 
Kindest regards,
Paul
 
Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk

 
From: gpfsug-discuss-boun...@spectrumscale.org  On Behalf Of IBM Spectrum ScaleSent: 22 February 2022 14:17To: gpfsug main discussion list Subject: Re: [gpfsug-discuss] immutable folder
 
Scale disallows deleting fileset junction using rmdir, so I suggested mmunlinkfileset.Regards, The Spectrum Scale (GPFS) team--If you feel that your question can benefit other users of  Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479.If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact  1-800-237-5511 in the United States or your local IBM Service Center in other countries.The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.From:        "Paul Ward" To:        "gpfsug main discussion list" Date:        02/22/2022 05:31 AMSubject:        [EXTERNAL] Re: [gpfsug-discuss] immutable folderSent by:        gpfsug-discuss-boun...@spectrumscale.org
___gpfsug-discuss mailing listgpfsug-discuss at spectrumscale.orghttp://gpfsug.org/mailman/listinfo/gpfsug-discuss
___gpfsug-discuss mailing listgpfsug-discuss at spectrumscale.orghttp://gpfsug.org/mailman/listinfo/gpfsug-discuss 
 


___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] immutable folder

2022-02-23 Thread Paul Ward

Thanks, I couldn't recreate that test:

# mkdir "it/stu'pid name"
mkdir: cannot create directory 'it/stu'pid name': No such file or directory
[Removing the / ]

# mkdir "itstu'pid name"

# mmchattr -i yes itstu\'pid\ name/
itstu'pid name/: Change immutable flag failed: Invalid argument.
Can not set directory to be immutable or appendOnly under current fileset mode!

Which begs the question, how do I have an immutable folder!

Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk
[A picture containing drawing  Description automatically generated]

From: gpfsug-discuss-boun...@spectrumscale.org 
 On Behalf Of Hannappel, Juergen
Sent: 23 February 2022 11:49
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] immutable folder

While the apostrophe is evil it's not the problem:

root@it-gti-02 test1]# mkdir "it/stu'pid name"
[root@it-gti-02 test1]# mmchattr -i yes it/stu\'pid\ name
[root@it-gti-02 test1]# mmchattr -i no it/stu\'pid\ name

From: "Paul Ward" mailto:p.w...@nhm.ac.uk>>
To: "gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Sent: Wednesday, 23 February, 2022 12:03:37
Subject: Re: [gpfsug-discuss] immutable folder
Its not a fileset, its just a folder, well a subfolder...

[filesystem/[fileset]/share/data/iac/[user] 2004-2014/Laboratory Impact 
experiments/LGG shots/Kent LGG/Kent aerogel LGG shots/Lizardite in aerogel/Nick 
Foster's sample

It's the "Nick Foster's sample" folder I want to delete, but it says it is 
immutable and I can't disable that.

I suspect it's the apostrophe confusing things.




Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk
[A picture containing drawingDescription automatically generated]

From: 
gpfsug-discuss-boun...@spectrumscale.org
 
mailto:gpfsug-discuss-boun...@spectrumscale.org>>
 On Behalf Of IBM Spectrum Scale
Sent: 22 February 2022 14:17
To: gpfsug main discussion list 
mailto:gpfsug-discuss@spectrumscale.org>>
Subject: Re: [gpfsug-discuss] immutable folder

Scale disallows deleting fileset junction using rmdir, so I suggested 
mmunlinkfileset.

Regards, The Spectrum Scale (GPFS) team

--
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479.

If your query concerns a potential software error in Spectrum Scale (GPFS) and 
you have an IBM software maintenance contract please contact  1-800-237-5511 in 
the United States or your local IBM Service Center in other countries.

The forum is informally monitored as time permits and should not be used for 
priority messages to the Spectrum Scale (GPFS) team.



From:"Paul Ward" mailto:p.w...@nhm.ac.uk>>
To:"gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Date:02/22/2022 05:31 AM
Subject:[EXTERNAL] Re: [gpfsug-discuss] immutable folder
Sent by:
gpfsug-discuss-boun...@spectrumscale.org

___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] immutable folder

2022-02-23 Thread Hannappel, Juergen

While the apostrophe is evil it's not the problem: 

root@it-gti-02 test1]# mkdir "it/stu'pid name" 
[root@it-gti-02 test1]# mmchattr -i yes it/stu\'pid\ name 
[root@it-gti-02 test1]# mmchattr -i no it/stu\'pid\ name 

> From: "Paul Ward" 
> To: "gpfsug main discussion list" 
> Sent: Wednesday, 23 February, 2022 12:03:37
> Subject: Re: [gpfsug-discuss] immutable folder

> Its not a fileset, its just a folder, well a subfolder…

> [filesystem/[fileset]/share/data/iac/[user] 2004-2014/Laboratory Impact
> experiments/LGG shots/Kent LGG/Kent aerogel LGG shots/Lizardite in 
> aerogel/Nick
> Foster's sample

> It’s the “Nick Foster's sample” folder I want to delete, but it says it is
> immutable and I can’t disable that.

> I suspect it’s the apostrophe confusing things.

> Kindest regards,

> Paul

> Paul Ward

> TS Infrastructure Architect

> Natural History Museum

> T: 02079426450

> E: [ mailto:p.w...@nhm.ac.uk | p.w...@nhm.ac.uk ]

> From: gpfsug-discuss-boun...@spectrumscale.org
>  On Behalf Of IBM Spectrum Scale
> Sent: 22 February 2022 14:17
> To: gpfsug main discussion list 
> Subject: Re: [gpfsug-discuss] immutable folder

> Scale disallows deleting fileset junction using rmdir, so I suggested
> mmunlinkfileset.

> Regards, The Spectrum Scale (GPFS) team

> --
> If you feel that your question can benefit other users of Spectrum Scale 
> (GPFS),
> then please post it to the public IBM developerWroks Forum at [
> https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fdeveloperworks%2Fcommunity%2Fforums%2Fhtml%2Fforum%3Fid%3D----0479=04%7C01%7Cp.ward%40nhm.ac.uk%7Cbd72c8c2ee3d49f619c908d9f60e0732%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637811363409593169%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000=XoY%2BAbA5%2FNBwuoJrY12MNurjJrp8KMsV1t63hdItfiM%3D=0
> |
> https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479
> ] .

> If your query concerns a potential software error in Spectrum Scale (GPFS) and
> you have an IBM software maintenance contract please contact 1-800-237-5511 in
> the United States or your local IBM Service Center in other countries.

> The forum is informally monitored as time permits and should not be used for
> priority messages to the Spectrum Scale (GPFS) team.

> From: "Paul Ward" < [ mailto:p.w...@nhm.ac.uk | p.w...@nhm.ac.uk ] >
> To: "gpfsug main discussion list" < [ mailto:gpfsug-discuss@spectrumscale.org 
> |
> gpfsug-discuss@spectrumscale.org ] >
> Date: 02/22/2022 05:31 AM
> Subject: [EXTERNAL] Re: [gpfsug-discuss] immutable folder
> Sent by: [ mailto:gpfsug-discuss-boun...@spectrumscale.org |
> gpfsug-discuss-boun...@spectrumscale.org ]

> ___
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] immutable folder

2022-02-23 Thread Paul Ward

Its not a fileset, its just a folder, well a subfolder…

[filesystem/[fileset]/share/data/iac/[user] 2004-2014/Laboratory Impact 
experiments/LGG shots/Kent LGG/Kent aerogel LGG shots/Lizardite in aerogel/Nick 
Foster's sample

It’s the “Nick Foster's sample” folder I want to delete, but it says it is 
immutable and I can’t disable that.

I suspect it’s the apostrophe confusing things.




Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.w...@nhm.ac.uk
[A picture containing drawing  Description automatically generated]

From: gpfsug-discuss-boun...@spectrumscale.org 
 On Behalf Of IBM Spectrum Scale
Sent: 22 February 2022 14:17
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] immutable folder

Scale disallows deleting fileset junction using rmdir, so I suggested 
mmunlinkfileset.

Regards, The Spectrum Scale (GPFS) team

--
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479.

If your query concerns a potential software error in Spectrum Scale (GPFS) and 
you have an IBM software maintenance contract please contact  1-800-237-5511 in 
the United States or your local IBM Service Center in other countries.

The forum is informally monitored as time permits and should not be used for 
priority messages to the Spectrum Scale (GPFS) team.



From:"Paul Ward" mailto:p.w...@nhm.ac.uk>>
To:"gpfsug main discussion list" 
mailto:gpfsug-discuss@spectrumscale.org>>
Date:02/22/2022 05:31 AM
Subject:[EXTERNAL] Re: [gpfsug-discuss] immutable folder
Sent by:
gpfsug-discuss-boun...@spectrumscale.org




Thank you for the suggestion… The fileset is in active use and is backed up 
using spectrum protect. This is therefore advised against. Was this option 
suggested to ‘close open files’ ? The issue is a directory not files. 
‍‍‍ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender

This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd

Thank you for the suggestion…



The fileset is in active use and is backed up using spectrum protect.

This is therefore advised against.



Was this option suggested to ‘close open files’ ?



The issue is a directory not files.





Kindest regards,

Paul



Paul Ward

TS Infrastructure Architect

Natural History Museum

T: 02079426450

E: p.w...@nhm.ac.uk

[A picture containing drawingDescription automatically generated]



From:gpfsug-discuss-boun...@spectrumscale.org 
mailto:gpfsug-discuss-boun...@spectrumscale.org>>
 On Behalf Of IBM Spectrum Scale
Sent: 21 February 2022 16:12
To: gpfsug main discussion list 
mailto:gpfsug-discuss@spectrumscale.org>>
Subject: Re: [gpfsug-discuss] immutable folder



Hi Paul,

Have you tried mmunlinkfileset first?

Regards, The Spectrum Scale (GPFS) team

--
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=----0479.

If your query concerns a potential software error in Spectrum Scale (GPFS) and 
you have an IBM software maintenance contract please contact  1-800-237-5511 in 
the United States or your local IBM Service Center in other countries.

The forum is informally monitored as time permits and should not be used for 
priority messages to the Spectrum Scale (GPFS) team.



From:"Paul Ward" mailto:p.w...@nhm.ac.uk>>
To:

Re: [gpfsug-discuss] IO sizes

Re: [gpfsug-discuss] IO sizes

[gpfsug-discuss] IO sizes

Re: [gpfsug-discuss] immutable folder

Re: [gpfsug-discuss] immutable folder

Re: [gpfsug-discuss] How to do multiple mounts via GPFS

Re: [gpfsug-discuss] immutable folder

Re: [gpfsug-discuss] immutable folder

Re: [gpfsug-discuss] immutable folder

Re: [gpfsug-discuss] immutable folder

Re: [gpfsug-discuss] immutable folder

11 matches

Site Navigation

Mail list logo

Footer information