Hi @all,
I configured a 'fileclass' for each our customer projects to get a
better overview about file size and numbers per project, e.g.:
...
FileClass bm0146
{
definition { tree == "/mnt/lustre02/work/bm0146*" }
}
FileClass bm0834
{
definition { tree == "/mnt/lustre02/work/bm0834*" }
}
FileClass bm0944
{
definition { tree == "/mnt/lustre02/work/bm0944*" }
}
...
With 'rbh-report' I get a mismatch on file counts with '--class-info'
and '--by-size-ratio 0..inf' / '--size-profile'. File 'max_size' is
displayed with 1.98 TB but no files greater then 1 TB are in the report:
[root@mrh2 robinhood]# rbh-report --class-info=bm0834 --by-size-ratio 0..inf
Using config file '/etc/robinhood.d/mrh2.conf'.
filter class: bm0834
fileclass, count, volume, spc_used,
min_size, max_size, avg_size, 0, 1~31, 32~1K-, 1K~31K,
32K~1M-, 1M~31M, 32M~1G-, 1G~31G, 32G~1T-, +1T, ratio(0..inf)
bm0834, 3437756, 2.54 PB, 2.52
PB, 0, 1.98 TB, 791.92 MB, 10725, 65487, 297586,
1247644, 902194, 762278, 84918, 56636, 10210, 0, 100.00%
Total: 3437756 entries, volume: 2854666858408847 bytes (2.54 PB), space
used: 2837172118641152 bytes (2.52 PB)
[root@mrh2 robinhood]#
[root@mrh2 robinhood]#
[root@mrh2 robinhood]# rbh-report --class-info=bm0834 --size-profile
Using config file '/etc/robinhood.d/mrh2.conf'.
filter class: bm0834
fileclass, count, volume, spc_used,
min_size, max_size, avg_size, 0, 1~31, 32~1K-, 1K~31K,
32K~1M-, 1M~31M, 32M~1G-, 1G~31G, 32G~1T-, +1T
bm0834, 3437763, 2.54 PB, 2.52
PB, 0, 1.98 TB, 791.92 MB, 10725, 65487, 297587,
1247644, 902194, 762279, 84920, 56640, 10209, 0
Total: 3437763 entries, volume: 2854680619380067 bytes (2.54 PB), space
used: 2837185871792640 bytes (2.52 PB)
[root@mrh2 robinhood]#
[root@mrh2 robinhood]# rbh-find -size +32G /mnt/lustre02/work/bm0834 | wc -l
Using config file '/etc/robinhood.d/mrh2.conf'.
10287
[root@mrh2 robinhood]# rbh-find -size +1T /mnt/lustre02/work/bm0834 | wc -l
Using config file '/etc/robinhood.d/mrh2.conf'.
78
[root@mrh2 robinhood]#
[root@mrh2 ~]# rbh-find -size +1T /mnt/lustre02/work/bm0834 -printf "%Rc
%p %s\n"
Using config file '/etc/robinhood.d/mrh2.conf'.
bm0834
/mnt/lustre02/work/bm0834/mxxxxxx/Mod/ICON_LEM-HDCP2_TA/icon-lem/icon-lem-dev/20170602/icon-lem/EXP/HDCP2TA_RegE_PR1250m-P01-20131211/L0_merge/HDCP2TA_RegE_PR1250m-P01_CLD_DOM01_ML_20131211T120000Z.nc
1152359610609
bm0834
/mnt/lustre02/work/bm0834/mxxxxxx/Mod/ICON_LEM-HDCP2_TA/icon-lem/icon-lem-dev/20170602/icon-lem/EXP/HDCP2TA_RegE_PR1250m-P01-20131220/L0_merge/HDCP2TA_RegE_PR1250m-P01_CLD_DOM01_ML_20131220T120000Z.nc
1152359610609
bm0834
/mnt/lustre02/work/bm0834/mxxxxxx/Mod/ICON_LEM-HDCP2_TA/icon-lem/icon-lem-dev/20170602/icon-lem/EXP/HDCP2TA_RegE_PR1250m-P01-20131212/L0_merge/HDCP2TA_RegE_PR1250m-P01_CLD_DOM01_ML_20131212T120000Z.nc
1152359610609
bm0834
/mnt/lustre02/work/bm0834/HDCP2_TA/20170829/20131220_RegE_PR1250m/data_icon/HDCP2TA_RegE_PR1250m-P01_CLD_DOM01_ML_20131220T120000Z.nc
1529600011427
bm0834
/mnt/lustre02/work/bm0834/HDCP2_TA/20170829/20131220_RegE_PR1250m/data_icon/HDCP2TA_RegE_PR1250m-P01_CLD_DOM04_ML_20131220T120000Z.nc
1147765459196
bm0834
/mnt/lustre02/work/bm0834/HDCP2_TA/20170829/20131220_RegE_PR1250m/data_icon/HDCP2TA_RegE_PR1250m-P01_CLD_DOM03_ML_20131220T120000Z.nc
1141295491580
bm0834
/mnt/lustre02/work/bm0834/kxxxxxx/icon-hdcp2-20150604/experiments/hdcp2_final/OLD_HIGHOPT_DATA/hdcp2_cosmodom_nest_R0156m_restart_atm_20130425T060000Z.nc
1299177317768
bm0834
/mnt/lustre02/work/bm0834/kxxxxxx/icon-hdcp2-20150604/experiments/hdcp2_final/OLD_HIGHOPT_DATA/hdcp2_cosmodom_nest_R0156m_restart_atm_20130425T020000Z.nc
1299177317768
bm0834
/mnt/lustre02/work/bm0834/kxxxxxx/icon-hdcp2-20150604/experiments/hdcp2_final/OLD_HIGHOPT_DATA/hdcp2_cosmodom_nest_R0156m_restart_atm_20130425T040000Z.nc
1299177317768
bm0834
/mnt/lustre02/work/bm0834/kxxxxxx/OUTPUT/20130424-default-two_moment_microphysics/2d_cloud_day_DOM03_ML_20130424T100000Z.nc
1281683590312
bm0834
/mnt/lustre02/work/bm0834/kxxxxxx/OUTPUT/20130424-default-two_moment_microphysics/sur_10.nc
2178868161600
bm0834
/mnt/lustre02/work/bm0834/kxxxxxx/icon-hdcp2-20150930/experiments/hdcp2_final_0511_06-24/3d_fine_day_DOM03_ML_20130511T080500Z.nc
1356730110654
...
Server information:
[root@mrh2 robinhood.d]# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 6.9 (Santiago)
[root@mrh2 robinhood.d]#
[root@mrh2 robinhood.d]# uname -a
Linux mrh2 2.6.32-696.6.3.el6.x86_64 #1 SMP Fri Jun 30 13:24:18 EDT 2017
x86_64 x86_64 x86_64 GNU/Linux
[root@mrh2 robinhood.d]#
[root@mrh2 robinhood.d]# rpm -qa | grep robinhood
robinhood-adm-3.1-3.noarch.x86_64
robinhood-lustre-3.1-3.lustre2.7.el6.x86_64
[root@mrh2 robinhood.d]#
[root@mrh2 robinhood.d]# rpm -qa | grep -i mariadb
MariaDB-devel-10.2.11-1.el6.x86_64
MariaDB-common-10.2.11-1.el6.x86_64
MariaDB-shared-10.2.11-1.el6.x86_64
MariaDB-client-10.2.11-1.el6.x86_64
MariaDB-server-10.2.11-1.el6.x86_64
MariaDB-compat-10.2.11-1.el6.x86_64
[root@mrh2 robinhood.d]#
[root@mrh2 robinhood]# rpm -qi robinhood-lustre-3.1-3.lustre2.7.el6.x86_64
Name : robinhood-lustre Relocations: /usr
Version : 3.1 Vendor: CEA, HPC
department <http://www-hpc.cea.fr>
Release : 3.lustre2.7.el6 Build Date: Thu 04 Jan 2018
01:38:54 PM CET
Install Date: Thu 04 Jan 2018 01:42:19 PM CET Build Host:
mrh2.hpc.dkrz.de
Group : Applications/System Source RPM:
robinhood-3.1-3.lustre2.7.el6.src.rpm
Size : 4513102 License: CeCILL-C
Signature : (none)
URL : http://robinhood.sourceforge.net
Summary : Robinhood Policy Engine for Lustre filesystems
Description :
Policy engine for Lustre filesystems.
[root@mrh2 robinhood]#
[root@mrh2 mysql]# rbh-report -a
Using config file '/etc/robinhood.d/mrh2.conf'.
Filesystem scan activity:
Last filesystem scan:
status: done
start: 2018/01/04 15:18:00
end: 2018/01/05 00:24:53
duration: 9h 06min 53s
Statistics:
entries scanned: 57498011
# threads: 12
average speed: 1754.39 entries/sec
Cheers, Carsten
--
Carsten Beyer
Abteilung Systeme
Deutsches Klimarechenzentrum GmbH (DKRZ)
Bundesstraße 45a * D-20146 Hamburg * Germany
Phone: +49 40 460094-221
Fax: +49 40 460094-270
Email: be...@dkrz.de
URL: http://www.dkrz.de
Geschäftsführer: Prof. Dr. Thomas Ludwig
Sitz der Gesellschaft: Hamburg
Amtsgericht Hamburg HRB 39784
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
robinhood-support mailing list
robinhood-support@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/robinhood-support
