Re: [gpfsug-discuss] mmfind -ls and so forth

2018-03-08 Thread Buterbaugh, Kevin L 
Hi Marc,

I test in production … just kidding.  But - not kidding - I did read the entire 
mmfind.README, compiled the binary as described therein, and read the output of 
“mmfind -h”.

But what I forgot was that when you run a bash shell script with “bash -x” it 
doesn’t show you the redirection you did to a file … and since the mmfind ran 
for ~5 days, including over a weekend, and including Monday which I took off 
from work to have our 16 1/2 year old Siberian Husky put to sleep, I simply 
forgot that in the script itself I had redirected the output to a file.  Stupid 
of me, I know, but unlike Delusional Donald, I’ll admit my stupid mistakes.

Thanks, and sorry.  I will try the mmfind as you suggested in your previous 
response the next time I need to run one to see if that significantly improves 
the performance…

Kevin

On Mar 7, 2018, at 1:15 PM, Marc A Kaplan 
mailto:makap...@us.ibm.com>> wrote:

As always when dealing with computers and potentially long running jobs, run a 
test on a handful of files first, so you can rapidly debug.
Did you read the mmfind.README ?

It mentions...that this sample utility "some user assembly required..."  ...

mmfindUtil_processOutputFile.c
  A utility to parse the "list file" produced by mmapplypolicy and to print
it in a find-compatible format
  mmfind invokes it once mmapplypolicy begins to populate the "list file"

mmfindUtil_processOutputFile.sampleMakefile
  copy to 'makefile', modify as needed, and run 'make' to compile 
mmfindUtil_processOutputFile.c
  This should produce a binary called mmfindUtil_processOutputFile
  mmfind will not be able to run until this utility has been compiled
  on the node from which you launch mmfind.

Works for me...
[root@n2 ilm]# ./mmfind /goo/zdbig -ls
2463649  256 drwxr-xr-x   2 root root   262144 Feb  9 11:41 /goo/zdbig
68044970 -rw-r--r--   1 root root0 Feb  9 11:41 
/goo/zdbig/xy

___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C7c170869f3294124be3608d5845fdecc%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636560469687764985&sdata=yNvpm34DY0AtEm2Y4OIMll5IW1v5kP3X3vHx3sQ%2B8Rs%3D&reserved=0

___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] mmfind -ls and so forth

2018-03-08 Thread Marc A Kaplan 
(John Hearns, et. al.)

Some minor script hacking would be the easiest way add test(s) for other 
MISC_ATTRIBUTES

Notice mmfind concentrates on providing the most popular classic(POSIX) 
and Linux predicates, BUT also adds a few gpfs specific predicates
(mmfind --help show you these)  -ea -eaWithValue -gpfsImmut -gpfsAppOnly

Look at the implementation of  -gpfsImmut in  tr_findToPol.pl ...

sub tr_gpfsImmut{
  return "( /* -gpfsImmut */ MISC_ATTRIBUTES LIKE '%X%')";
}


So easy to extend this for any or all the others  True it's perl, but 
you don't have to be a perl expert to cut-paste-hack another predicate 
into the script.

Let us know how you make out with this...
Perhaps we shall add  a general predicate -gpfsMiscAttrLike '...'   to the 
next version...

-- Marc K of GPFS



From:   John Hearns 
To: gpfsug main discussion list 
Date:   03/08/2018 04:59 AM
Subject:        Re: [gpfsug-discuss] mmfind -ls and so forth
Sent by:gpfsug-discuss-boun...@spectrumscale.org



On the subject of mmfind,
I would like to find files which have the misc attributes relevant to AFM.
For instance files which have the attribute ‘v’ The file is newly created, 
not yet copied to home
I can write a policy to do this, and I have a relevant policy written.
 
However I would like to do this using mmfind, which seems a nice general 
utility.
This syntax does not work:
 
mmfind /hpc -eaWithValue MISC_ATTRIBUTES===v
 
Before anyone says it, I am mixing up MISC_ATTRIBUTES and extended 
attributes!
My question really is – has anyone done this sort of serch using mmfind?
 
Thankyou
 
 
 
From: gpfsug-discuss-boun...@spectrumscale.org [
mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Marc A 
Kaplan
Sent: Wednesday, March 07, 2018 8:16 PM
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] mmfind -ls and so forth
 
As always when dealing with computers and potentially long running jobs, 
run a test on a handful of files first, so you can rapidly debug.
Did you read the mmfind.README ?

It mentions...that this sample utility "some user assembly required..." 
... 

mmfindUtil_processOutputFile.c
  A utility to parse the "list file" produced by mmapplypolicy and to 
print
it in a find-compatible format
  mmfind invokes it once mmapplypolicy begins to populate the "list file"

mmfindUtil_processOutputFile.sampleMakefile
  copy to 'makefile', modify as needed, and run 'make' to compile 
mmfindUtil_processOutputFile.c
  This should produce a binary called mmfindUtil_processOutputFile
  mmfind will not be able to run until this utility has been compiled
  on the node from which you launch mmfind.

Works for me...
[root@n2 ilm]# ./mmfind /goo/zdbig -ls
2463649  256 drwxr-xr-x   2 root root   262144 Feb  9 11:41 
/goo/zdbig
68044970 -rw-r--r--   1 root root0 Feb  9 11:41 
/goo/zdbig/xy
-- The information contained in this communication and any attachments is 
confidential and may be privileged, and is for the sole use of the 
intended recipient(s). Any unauthorized review, use, disclosure or 
distribution is prohibited. Unless explicitly stated otherwise in the body 
of this communication or the attachment thereto (if any), the information 
is provided on an AS-IS basis without any express or implied warranties or 
liabilities. To the extent you are relying on this information, you are 
doing so at your own risk. If you are not the intended recipient, please 
notify the sender immediately by replying to this message and destroy all 
copies of this message and any attachments. Neither the sender nor the 
company/group of companies he or she represents shall be liable for the 
proper and complete transmission of the information contained in this 
communication, or for any delay in its receipt. 
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=cvpnBBH0j41aQy0RPiG2xRL_M8mTc1izuQD3_PmtjZ8&m=LDC-t-w-jkuH2fJZ1lME_JUjzABDz3y90ptTlYWM3rc&s=xrFd1LD5dWq9GogfeOGs9ZCtqoptErjmGfJzD3eXhz4&e=





___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] mmfind -ls and so forth

2018-03-08 Thread John Hearns 
On the subject of mmfind,
I would like to find files which have the misc attributes relevant to AFM.
For instance files which have the attribute 'v' The file is newly created, not 
yet copied to home
I can write a policy to do this, and I have a relevant policy written.

However I would like to do this using mmfind, which seems a nice general 
utility.
This syntax does not work:

mmfind /hpc -eaWithValue MISC_ATTRIBUTES===v

Before anyone says it, I am mixing up MISC_ATTRIBUTES and extended attributes!
My question really is - has anyone done this sort of serch using mmfind?

Thankyou



From: gpfsug-discuss-boun...@spectrumscale.org 
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Marc A Kaplan
Sent: Wednesday, March 07, 2018 8:16 PM
To: gpfsug main discussion list 
Subject: Re: [gpfsug-discuss] mmfind -ls and so forth

As always when dealing with computers and potentially long running jobs, run a 
test on a handful of files first, so you can rapidly debug.
Did you read the mmfind.README ?

It mentions...that this sample utility "some user assembly required..."  ...

mmfindUtil_processOutputFile.c
  A utility to parse the "list file" produced by mmapplypolicy and to print
it in a find-compatible format
  mmfind invokes it once mmapplypolicy begins to populate the "list file"

mmfindUtil_processOutputFile.sampleMakefile
  copy to 'makefile', modify as needed, and run 'make' to compile 
mmfindUtil_processOutputFile.c
  This should produce a binary called mmfindUtil_processOutputFile
  mmfind will not be able to run until this utility has been compiled
  on the node from which you launch mmfind.

Works for me...
[root@n2 ilm]# ./mmfind /goo/zdbig -ls
2463649  256 drwxr-xr-x   2 root root   262144 Feb  9 11:41 /goo/zdbig
68044970 -rw-r--r--   1 root root0 Feb  9 11:41 
/goo/zdbig/xy
-- The information contained in this communication and any attachments is 
confidential and may be privileged, and is for the sole use of the intended 
recipient(s). Any unauthorized review, use, disclosure or distribution is 
prohibited. Unless explicitly stated otherwise in the body of this 
communication or the attachment thereto (if any), the information is provided 
on an AS-IS basis without any express or implied warranties or liabilities. To 
the extent you are relying on this information, you are doing so at your own 
risk. If you are not the intended recipient, please notify the sender 
immediately by replying to this message and destroy all copies of this message 
and any attachments. Neither the sender nor the company/group of companies he 
or she represents shall be liable for the proper and complete transmission of 
the information contained in this communication, or for any delay in its 
receipt.
___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

Re: [gpfsug-discuss] mmfind -ls and so forth

2018-03-07 Thread Marc A Kaplan 
As always when dealing with computers and potentially long running jobs, 
run a test on a handful of files first, so you can rapidly debug.
Did you read the mmfind.README ?

It mentions...that this sample utility "some user assembly required..." 
... 

mmfindUtil_processOutputFile.c
  A utility to parse the "list file" produced by mmapplypolicy and to 
print
it in a find-compatible format
  mmfind invokes it once mmapplypolicy begins to populate the "list file"

mmfindUtil_processOutputFile.sampleMakefile
  copy to 'makefile', modify as needed, and run 'make' to compile 
mmfindUtil_processOutputFile.c
  This should produce a binary called mmfindUtil_processOutputFile
  mmfind will not be able to run until this utility has been compiled
  on the node from which you launch mmfind.

Works for me...
[root@n2 ilm]# ./mmfind /goo/zdbig -ls
2463649  256 drwxr-xr-x   2 root root   262144 Feb  9 11:41 
/goo/zdbig
68044970 -rw-r--r--   1 root root0 Feb  9 11:41 
/goo/zdbig/xy


___
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss