Re: [gpfsug-discuss] Question about Policies

[Daniel Kidger]

The migration rule is only for modifying files without changing their filename or which directory they are in, so changing things like:

• compression
• replication (eg 1way to 2way)
• physical storage eg flash to disk
• stubbing a file to move content to external storage such as tape.

You would use a helper script with the policy engine to change the filename and directories themselves, eg.

• changing filename extensions from uppercase to lowercase
• tar-ing up directories
• gzip or other compression that changes filename itself.
• moving files to different directories.
• plus anything where you want to create lists of files that have certain properties.

Daniel

 

_________________________________________________________
Daniel Kidger

IBM Technical Sales Specialist

Spectrum Scale, Spectrum NAS and IBM Cloud Object Store

+44-(0)7818 522 266 
daniel.kid...@uk.ibm.com

 

 

 

----- Original message -----
From: Kevin Doyle <kevin.do...@manchester.ac.uk>
Sent by: gpfsug-discuss-boun...@spectrumscale.org
To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org>
Cc:
Subject: [EXTERNAL] Re: [gpfsug-discuss] Question about Policies
Date: Fri, Dec 27, 2019 13:57
 

Hi

 

Thanks for your reply, once I have a set of files that are older than 30 days would I then use the migration rule to move them ?

 

Looking at the migration Rule syntax implies a “From” pool and a “To” pool, I only have a single pool so would I use the same pool name for From and To ? if it is the same pool

How do I specify the folder to move it to which needs to be different from the current location.

 

Thanks

Kevin

 

RULE ['RuleName'] [WHEN TimeBooleanExpression]

  MIGRATE  [COMPRESS ({'yes' | 'no' | 'lz4' | 'z'})] 

    [FROM POOL 'FromPoolName']

    [THRESHOLD (HighPercentage[,LowPercentage[,PremigratePercentage]])]

    [WEIGHT (WeightExpression)]

  TO POOL 'ToPoolName'   

    [LIMIT (OccupancyPercentage)]

    [REPLICATE (DataReplication)]

    [FOR FILESET ('FilesetName'[,'FilesetName']...)]

    [SHOW (['String'] SqlExpression)]

    [SIZE (numeric-sql-_expression_)]

    [ACTION (SqlExpression)]

    [WHERE SqlExpression]

 

 

Kevin Doyle | Linux Administrator, Scientific Computing

Cancer Research UK, Manchester Institute

The University of Manchester

Room 13G40, Alderley Park, Macclesfield SK10 4TG

Mobile:  07554 223480

Email: kevin.do...@manchester.ac.uk

 

 

 

 

From: <gpfsug-discuss-boun...@spectrumscale.org> on behalf of Yaron Daniel <y...@il.ibm.com>
Reply-To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org>
Date: Friday, 27 December 2019 at 12:55
To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org>
Subject: Re: [gpfsug-discuss] Question about Policies

 

Hi

U can create list of diretories in output file which were not modify in the last 30 days, and than second script will move this directories to the new location that u want.


 
Regards
 

Yaron Daniel		94 Em Ha'Moshavot Rd
Storage Architect – IL Lab Services (Storage)		Petach Tiqva, 49527
IBM Global Markets, Systems HW Sales		Israel
Phone:	+972-3-916-5672
Fax:	+972-3-916-5672
Mobile:	+972-52-8395593
e-mail:	y...@il.ibm.com
Webex:            https://ibm.webex.com/meet/yard IBM Israel

  



From:        Kevin Doyle <kevin.do...@manchester.ac.uk>
To:        "gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org>
Date:        27/12/2019 13:45
Subject:        [EXTERNAL] [gpfsug-discuss] Question about Policies
Sent by:        gpfsug-discuss-boun...@spectrumscale.org

---

 

Hi

 

I work for Cancer Research UK MI in Manchester UK. I am new to GPFS and have been tasked with creating a policy that will

Move files older that 30 days to a new folder within the same pool. There are a lot of files so using a policy based move will be faster.

I have read about the migration Rule but it states a source and destination pool, we only have one pool. Will it work if I define the same source and destination pool ?

 

Many thanks

Kevin

 

 

Kevin Doyle | Linux Administrator, Scientific Computing

Cancer Research UK, Manchester Institute

The University of Manchester

Room 13G40, Alderley Park, Macclesfield SK10 4TG

Mobile:  07554 223480

Email: kevin.do...@manchester.ac.uk

 

 

 

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss 

 

Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 741598.
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss