Hi Thomas,
The two rbh-du reports are different as you said.
# rbh-du -f abc123
2670700880 /mnt/Data5
# rbh-du -f abc123 -b
2428653301706 /mnt/Data5
This is the PanFS report for the exact same volume
$ pan_df -hP /mnt/pan/Data5
Filesystem Size Used Avail Use% Mounted on
panfs://192.168.223.10/pan 2.9T 1.5T 1.5T 50% /mnt/Data5
Is it correct to use "panfs" in the configuration file?
fs_type = panfs;
On Thu, Apr 23, 2015 at 4:11 AM, LEIBOVICI Thomas <[email protected]>
wrote:
> It may be a difference between the logical size of entries and the
> physical blocksd they use.
> "rbh-report -i" displays sum(size)
> but the physical usage may be lower if files are sparse.
>
> To confirm or invalidate this guess, you can run and compare:
> "rbh-du" (based on physical blocks) and "rbh-du -b" (based on logical
> size).
>
> Regards,
> Thomas
>
>
>
> On 04/21/15 19:00, Hadrian Djohari wrote:
>
> Hi Thomas,
>
> I am talking about the comparison between the total in "rbh-report -i"
> or the summation of "rbh-report --top-users" and the actual physical space
> of the storage system. The rbh-report result is much higher than the actual
> physical storage size. In the case below, rbh-report would indicate 215tb
> being used, while the actual storage space is only about 75tb.
>
> This is an output:
> # rbh-report -i -f scratch
> Using config file
> '/usr/local/robinhood/2.5.2/etc/robinhood.d/tmpfs/scratch.conf'.
> type , count, volume, avg_size
> symlink , 4594, 50.30 KB, 11
> dir , 1412993, 13.22 GB, 9.81 KB
> file , 24305699, 214.46 TB, 9.25 MB
>
> Total: 25723286 entries, 235812918326035 bytes (214.47 TB)
>
> # rbh-report -i -f scratch -F
> Using config file
> '/usr/local/robinhood/2.5.2/etc/robinhood.d/tmpfs/scratch.conf'.
> type , count, volume, min_size, max_size, avg_size
> symlink , 4594, 50.30 KB, 4, 84, 11
> dir , 1412993, 13.22 GB, 4.00 KB, 89.12 MB, 9.81 KB
> file , 24305699, 214.46 TB, 0, 4.32 TB, 9.25 MB
>
> Total: 25723286 entries, 235812918326035 bytes (214.47 TB)
>
> The /scratch storage space only has ~75TB of space.
>
> It is almost like some old data still got retained in the database and
> be counted as "active".
>
> Best,
> Hadrian.
>
> On Tue, Apr 21, 2015 at 10:15 AM, LEIBOVICI Thomas <
> [email protected]> wrote:
>
>> Hi Hadrian,
>>
>> Do you talk about the output of "rbh-report -i"?
>>
>> Is the problem about the total number of entries or the volume ?
>>
>> Do you get the same result with: "rbh-report -i -F"?
>>
>> Regards,
>> Thomas
>>
>>
>> On 04/20/15 23:12, Hadrian Djohari wrote:
>>
>> Hi,
>>
>> We have installed Robinhood on a dedicated node that transverse 2
>> filesystems as tmpfs: a Panasas and a Nexsan (ZFS) storage.
>>
>> The total from the Nexsan appears to be correct, but the total from the
>> Panasas seems to be higher - as much as 2x the total amount.
>>
>> Is there a setting that needs to be tweaked for the Panasas?
>>
>> This is a typical conf file:
>>
>> General
>> {
>> fs_path = "/mnt/DataX";
>> fs_type = panfs;
>> check_mounted = TRUE;
>> }
>> Log
>> {
>> log_file = "/var/log/robinhood/abc123_fs.log";
>> report_file = "/var/log/robinhood/abc123_reports.log";
>> alert_file = "/var/log/robinhood/abc123_alerts.log";
>> }
>>
>> ListManager
>> {
>> MySQL
>> {
>> server = localhost;
>> db = robinhood_abc123;
>> user = robinhood;
>> password_file =
>> /usr/local/robinhood/2.5.2/etc/robinhood.d/.dbpassword;
>> }
>> }
>>
>> FS_Scan
>> {
>> scan_interval = 14d;
>> nb_threads_scan = 4;
>>
>> Ignore
>> {
>> # ignore ".snapshot" and ".snapdir" directories (don't scan them)
>> type == directory
>> and
>> ( name == ".snapdir" or name == ".snapshot" )
>> }
>> }
>>
>> Thank you,
>>
>> --
>> Hadrian Djohari
>> HPCC Manager
>> Case Western Reserve University
>> (W): 216-368-0395
>> (M): 216-798-7490
>>
>>
>>
>> ------------------------------------------------------------------------------
>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>> Develop your own process in accordance with the BPMN 2 standard
>> Learn Process modeling best practices with Bonita BPM through live
>> exerciseshttp://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
>> event?utm_
>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
>>
>>
>>
>> _______________________________________________
>> robinhood-support mailing
>> [email protected]https://lists.sourceforge.net/lists/listinfo/robinhood-support
>>
>>
>>
>
>
> --
> Hadrian Djohari
> HPCC Manager
> Case Western Reserve University
> (W): 216-368-0395
> (M): 216-798-7490
>
>
>
--
Hadrian Djohari
HPCC Manager
Case Western Reserve University
(W): 216-368-0395
(M): 216-798-7490
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
