Hi All,
I am on a site running Robinhood with samqfs filesystem used as the
intermediate disk cache between a lustre filesystem and Spectra Tape
Library .
There is a requirement to add specific user desired directory (200+
such entries) for HSM based Archival instead of the default "/home"
lustre filesystem.
Some Information:
=====================================
Product: robinhood
Version: 3.1.3-1
Build: 2018-03-14 09:19:00
Compilation switches:
Lustre filesystems
Lustre Version: 2.7
Address entries by FID
MDT Changelogs supported
Database binding: MySQL
=====================================
A sample fileclass definition looks like this:
FileClass prod_files {
definition { type == file and ( tree == "/home/gfsprod/data/gdasv14/gdas/prod"
or tree == "/home/umeps/PS40/cycle"
or tree == "/home/umeps/NEPS_PostProductions/long_fcst/post"
or tree == "/home/umeps/cylc-run/NEPS1024G/work"
or tree == "/home/umfcst/cylc-run/PS40_baseline/work"
or tree == "/home/umprod/cylc-run/PS40_Hybrid/work"
or tree == "/home/umprod/cylc-run/PS40_Hybrid/share/cycle"
or tree == "/home/umprod/gfsprod/data/gdas/prod" )
}
Curious to know if there is any limitation on the maximum no. of
entries in fileclass.inc or anything related which can cause issues in
Robinhood configuration and functioning.
Also, Is there a way in which without adding so many entries in a
fileclass, this can be handled?
I could think of these two options.
1. Creating a unique directory in each user area , eg
/home/<user_home>/<archive_only>
where users place only those files which they want to be
auto-archived using HSM ,
and using a regular expression in the fileclass definition
eg :
FileClass prod_files {
definition { type == file and ( tree ==
"/home/<user_home>/<archive_only>"
or tree == "/home/<group>/<user_home>/<archive_only>"
}
2. Creating a single flieclass with tree=/home/<archive_area> and
creating a symbolic link for
each user desired directory inside /home/<archive_area>/<user_dir_symlink> .
eg: /home/archive_area/user1 --->
/home/group1/user1/data/production/gfs_code_dir
Not sure if the archiver can traverse symbolic link and get inside
those user directories and
perform auto-archival. If it can, then I would like the archiver
to traverse the symbolic link
just once to get inside the user directory , ignoring any symbolic
links it encounters on the
way down.
Any suggestion/guidance will be really great.
Thanks and Regards,
Abhishek
_______________________________________________
robinhood-support mailing list
robinhood-support@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/robinhood-support
