Hi there.
I’ve performed an initial scan of my lustre filesystem and the lhsm deamon is
reading changelogs (—readlog option). I’m having trouble defining basic
fileclasses.
This rbh-lhsm-find command works OK and returns some matching files:
[root@dhcp-nebula-priv-52-38 pfs]# /opt/robinhood-2.5.4/bin/rbh-lhsm-find -f
/etc/robinhood.d/lhsm -atime +365d -size +5GB /lustre/ki/pfs/jmckinne
/lustre/ki/pfs/jmckinne/thickdisk7/dumps/gdump.bin
/lustre/ki/pfs/jmckinne/thickdisk7/idumps/fieldline5437.cart.bin.512.512.512
/lustre/ki/pfs/jmckinne/thickdisk7/idumps/fieldline5437.cart.bin.512.512.512.txt
/lustre/ki/pfs/jmckinne/thickdisk7/idumps/fieldline5437.cart.bin.nocurrent.512.512.512
/lustre/ki/pfs/jmckinne/thickdisk7/idumps/fieldline5437.cart.bin.nocurrent.512.512.512.txt
I’m now trying to define a migration policy based on this search:
#———lhsm cfg----------------
Filesets {
FileClass jonsbigfiles {
definition {
tree == "/lustre/ki/pfs/jmckinne"
and
size > 5GB
}
}
}
migration_policies {
policy archive_jons_files {
target_fileclass = jonsbigfiles;
condition {last_access > 365d}
archive_id = 1;
}
}
#————lhsm config ————————
rbh-lhsm-report does not give me any info for the FileClass “jonsbigfiles”:
[root@dhcp-nebula-priv-52-38 pfs]# /opt/robinhood-2.5.4/sbin/rbh-lhsm-report -f
/etc/robinhood.d/lhsm -i
status , type, count, volume, avg_size
n/a , symlink, 70014, 5.32 MB, 80
n/a , dir, 169450, 1002.53 MB, 6.06 KB
n/a , file, 746, 1.44 GB, 1.97 MB
new , file, 6841845, 267.74 TB, 41.03 MB
synchro , file, 3, 9.38 GB, 3.13 GB
released , file, 1, 11.18 GB, 11.18 GB
Total: 7082059 entries, 294405406090123 bytes (267.76 TB)
[root@dhcp-nebula-priv-52-38 pfs]# /opt/robinhood-2.5.4/sbin/rbh-lhsm-report -f
/etc/robinhood.d/lhsm --class-info=jonsbigfiles
filter class: jonsbigfiles
filter class: jonsbigfiles
Total: 0 entries, 0 bytes (0)
Any idea what’s missing?
———
Yemi
On Apr 9, 2015, at 1:28 AM, LEIBOVICI Thomas <[email protected]> wrote:
> Hi Adesanya,
>
> See my answers below.
>
> On 04/09/15 03:40, Adesanya, Adeyemi wrote:
>> Hi.
>>
>> I’ve successfully ran some tests with the Lustre HPSS copytool. Thank you,
>> CEA team!
> Great!
>> Can someone please point me to the latest version of the Robinhood Lustre
>> HSM admin guide?
>> It is not in the wiki:
>> https://github.com/cea-hpc/robinhood/wiki/Documentation
>>
>> I do see a doc in sourceforge from 2010:
>> http://robinhood.sourceforge.net/files/Lustre-HSM_PolicyEngine_v212_admin_guide.pdf
>> Is this doc up to date?
> I updated the robinhod doc for Lustre HSM and pushed it on the wiki:
> https://github.com/cea-hpc/robinhood/wiki/lhsm_tutorial
>
>> BTW, during my simple hsm_archive and hsm_release tests, I notice I cannot
>> remove an archive from HPSS if it has been released from Lustre. Ideally, I
>> would want to eventually remove a file completely after a certain period of
>> time. Does it have to be staged back into disk before being removed from
>> tape? See below….
>>
>> [root@bullet0019 yemi]# lfs hsm_state hsmfile1
>> hsmfile1: (0x0000000d) released exists archived, archive_id:1
>> [root@bullet0019 yemi]# lfs hsm_remove hsmfile1
>> Cannot send HSM request (use of hsmfile1): Operation not permitted
> It looks "lfs" doesn't correctly handles this. It has to be fixed.
>
> Anyhow, robinhood correctly handles it and you'll be able to implement this
> kind of delayed cleaning with robinhood
> (see hsm_remove_policy).
>
> Regards,
> Thomas.
>
>>
>>
>> -------
>> Yemi
>> ------------------------------------------------------------------------------
>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>> Develop your own process in accordance with the BPMN 2 standard
>> Learn Process modeling best practices with Bonita BPM through live exercises
>> http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
>> _______________________________________________
>> robinhood-support mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/robinhood-support
>
------------------------------------------------------------------------------
BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
Develop your own process in accordance with the BPMN 2 standard
Learn Process modeling best practices with Bonita BPM through live exercises
http://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual- event?utm_
source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
