Re: [gpfsug-discuss] preventing HSM tape recall storms

Mon, 09 Jul 2018 11:54:01 -0700

> we had left out "gpfs" from the
> vfs objects =
> line in smb.conf
>
> so setting
> vfs objects = gpfs (etc)
> gpfs:hsm = yes
> gpfs:recalls = yes  (not "no" as I had originally, and is implied by the manual)
 
Thank you for the update. gpfs:recalls=yes is the default, allowing
recalls of files. If you set that to 'no', Samba will deny access to
"OFFLINE" files in GPFS through SMB.
 
> and setting the offline flag on the file by migrating it, so that
> # mmlsattr -L  filename.jpg
> ...
> Misc attributes:      ARCHIVE OFFLINE
>
> now Explorer on Windows 7 and 10 do not recall the file while viewing the folder with "Large icons"
>
> and a standard icon with an X is displayed.
>
> But after the file is then opened and recalled, the icon displays the thumbnail image and the OFFLINE flag is lost.
 
Yes, that is working as intended. While the file is only in the
"external pool" (e.g. HSM tape), the OFFLINE flag is reported. Once
you read/write data, that triggers a recall to the disk pool and the
flag is cleared.
 
> Also as you observed, Finder on  MacOSX 10.13 ignores the file's offline flag,
>
> so we still risk a recall storm caused by them.
 
The question here would be how to handle the Mac clients. You could
configured two SMB shares on the same path: One with gpfs:recalls=yes
and tell the Windows users to access that share; the other one with
gpfs:recalls=no and tell the Mac users to use that share. That would
avoid the recall storms, but runs the risk of Mac users connecting to
the wrong share and avoiding this workaround...
 
Regards,

Christof Schmitt || IBM || Spectrum Scale Development || Tucson, AZ
[email protected]  ||  +1-520-799-2469    (T/L: 321-2469)
 
 
----- Original message -----
From: Cameron Dunn <[email protected]>
Sent by: [email protected]
To: "[email protected]" <[email protected]>
Cc:
Subject: Re: [gpfsug-discuss] preventing HSM tape recall storms
Date: Sat, Jul 7, 2018 2:30 PM
 

Thanks Christof,

 

we had left out "gpfs" from the

vfs objects = 
line in smb.conf
 
so setting
vfs objects = gpfs (etc)
gpfs:hsm = yes
gpfs:recalls = yes  (not "no" as I had originally, and is implied by the manual)
 
and setting the offline flag on the file by migrating it, so that
# mmlsattr -L  filename.jpg
...
 
Misc attributes:      ARCHIVE OFFLINE
 

now Explorer on Windows 7 and 10 do not recall the file while viewing the folder with "Large icons"

and a standard icon with an X is displayed.

But after the file is then opened and recalled, the icon displays the thumbnail image and the OFFLINE flag is lost.

 

Also as you observed, Finder on  MacOSX 10.13 ignores the file's offline flag,

so we still risk a recall storm caused by them.

 

All the best,

Cameron

 

From: [email protected] <[email protected]> on behalf of Christof Schmitt <[email protected]>
Sent: 03 July 2018 20:37:08
To: [email protected]
Cc: [email protected]
Subject: Re: [gpfsug-discuss] preventing HSM tape recall storms
 
> HSM over LTFS-EE runs the risk of a recall storm if files which have been migrated to tape
> are then shared by Samba to Macs and PCs.
> MacOS Finder and Windows Explorer will want to display all the thumbnail images of a
> folder's contents, which will recall lots of files from tape.
 
SMB clients can query file information, including the OFFLINE
flag. With Spectrum Scale and the "gpfs" module loaded in Samba that
is mapped from the the OFFLINE flag that is visible in "mmlsattr
-L". In those systems, the SMB client can determine that a file is
offline.
 
In our experience this is handled correctly in Windows Explorer; when
an "offline" file is encountered, no preview is generated from the
file data. The Finder on Mac clients does not seem to honor the
OFFLINE flag, thus the main problems are typically recall storms
caused by Mac clients.
 
> According to the Samba documentation this is preventable by setting the following
> ----------------------------------------------
> https://www.samba.org/samba/docs/current/man-html/vfs_gpfs.8.html
>
> gpfs:recalls = [ yes | no ]
> When this option is set to no, an attempt to open an offline file
> will be rejected with access denied.
> This helps preventing recall storms triggered by careless applications like Finder and Explorer.
>
> yes(default) - Open files that are offline. This will recall the files from HSM.
> no - Reject access to offline files with access denied. This will prevent recalls of files from HSM.
> Using this setting also requires gpfs:hsm to be set to yes.
>
> gpfs:hsm = [ yes | no ]
> Enable/Disable announcing if this FS has HSM enabled.
> no(default) - Do not announce HSM.
> yes - Announce HSM.
> --------------------------------------------------
>
> However we could not get this to work.
>
> On Centos7/Samba4.5, smb.conf contained
> gpfs:hsm = yes
> gpfs:recalls = no
> (also tried setting gpfs:offline = yes, though this is not documented)
 
These options apply to the "gpfs" module in Samba. The Samba version
you are using needs to be built with GPFS support and the "gpfs"
module needs to be loaded through the "vfs objects" configuration. As
Centos7/Samba4.5 is mentioned, would guess that the CentOS provided
Samba version is used, which is probably not compiled with GPFS
support.
 
From IBM we would recommend to use CES for protocol services, which
also provides Samba for SMB. The Samba provided through CES is
configured so that the gpfs:recalls option can be used:
 
 
gpfs:recalls
    If the value is set as yes files that have been migrated from disk
    will be recalled on access. By default, this is enabled. If
    recalls = no files will not be recalled on access and the client
    will receive ACCESS_DENIED message.
 
> We made a share containing image files that were then migrated to tape by LTFS-EE,
> to see if these flags were respected by OS X Finder or Windows Explorer.
>
> Neither Mac OS X (using SMB3) or Windows 7 (using SMB2) respected the settings,
> so that when browsing the stubs in the share, the files were recalled from tape
> and the thumbnails displayed.
>
> Has anyone seen these flags working as they are supposed to ?
 
Yes, they are working, as we use them in our Samba build. Debugging
this would require looking at the Samba configuration and possibly
collecting a trace. If my above assumption was wrong and this problem
occurs with the CES Samba (gpfs.smb), please open a PMR for debugging
this issue. If this is not the CES Samba, please contact the provider
of the Samba package for additional support.
 
Regards,
 
Christof

Christof Schmitt || IBM || Spectrum Scale Development || Tucson, AZ
[email protected]  ||  +1-520-799-2469    (T/L: 321-2469)
 
 
----- Original message -----
From: Cameron Dunn <[email protected]>
Sent by: [email protected]
To: "[email protected]" <[email protected]>
Cc:
Subject: [gpfsug-discuss] preventing HSM tape recall storms
Date: Tue, Jul 3, 2018 6:22 AM
 

 

HSM over LTFS-EE runs the risk of a recall storm if files which have been migrated to tape 
are then shared by Samba to Macs and PCs. 
MacOS Finder and Windows Explorer will want to display all the thumbnail images of a 
folder's contents, which will recall lots of files from tape.
 
According to the Samba documentation this is preventable by setting the following 
----------------------------------------------
https://www.samba.org/samba/docs/current/man-html/vfs_gpfs.8.html
 
gpfs:recalls = [ yes | no ]
When this option is set to no, an attempt to open an offline file 
will be rejected with access denied. 
This helps preventing recall storms triggered by careless applications like Finder and Explorer.
 
yes(default) - Open files that are offline. This will recall the files from HSM.
no - Reject access to offline files with access denied. This will prevent recalls of files from HSM. 
Using this setting also requires gpfs:hsm to be set to yes.
 
gpfs:hsm = [ yes | no ]
Enable/Disable announcing if this FS has HSM enabled.
no(default) - Do not announce HSM.
yes - Announce HSM.
--------------------------------------------------
 
However we could not get this to work.
 
On Centos7/Samba4.5, smb.conf contained
gpfs:hsm = yes
gpfs:recalls = no
(also tried setting gpfs:offline = yes, though this is not documented)
 
We made a share containing image files that were then migrated to tape by LTFS-EE, 
to see if these flags were respected by OS X Finder or Windows Explorer.
 
Neither Mac OS X (using SMB3) or Windows 7 (using SMB2) respected the settings,
so that when browsing the stubs in the share, the files were recalled from tape
and the thumbnails displayed.
 
Has anyone seen these flags working as they are supposed to ?

 

Many thanks for any ideas,

Cameron

 

Cameron Dunn
Advanced Computing Systems Administrator
Advanced Computing Research Centre
University of Bristol
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
 
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
 

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Reply via email to