Hi, any thoughts on the issue?
Has anyone run robinhood successfully on the Panasas?
Thanks,
Hadrian
On Fri, Apr 24, 2015 at 10:59 AM, Hadrian Djohari <[email protected]> wrote:
> Hi Thomas,
>
> The two rbh-du reports are different as you said.
> # rbh-du -f abc123
> 2670700880 /mnt/Data5
> # rbh-du -f abc123 -b
> 2428653301706 /mnt/Data5
>
>
> This is the PanFS report for the exact same volume
>
> $ pan_df -hP /mnt/pan/Data5
> Filesystem Size Used Avail Use% Mounted on
> panfs://192.168.223.10/pan 2.9T 1.5T 1.5T 50% /mnt/Data5
>
> Is it correct to use "panfs" in the configuration file?
> fs_type = panfs;
>
>
>
> On Thu, Apr 23, 2015 at 4:11 AM, LEIBOVICI Thomas <[email protected]
> > wrote:
>
>> It may be a difference between the logical size of entries and the
>> physical blocksd they use.
>> "rbh-report -i" displays sum(size)
>> but the physical usage may be lower if files are sparse.
>>
>> To confirm or invalidate this guess, you can run and compare:
>> "rbh-du" (based on physical blocks) and "rbh-du -b" (based on logical
>> size).
>>
>> Regards,
>> Thomas
>>
>>
>>
>> On 04/21/15 19:00, Hadrian Djohari wrote:
>>
>> Hi Thomas,
>>
>> I am talking about the comparison between the total in "rbh-report -i"
>> or the summation of "rbh-report --top-users" and the actual physical space
>> of the storage system. The rbh-report result is much higher than the actual
>> physical storage size. In the case below, rbh-report would indicate 215tb
>> being used, while the actual storage space is only about 75tb.
>>
>> This is an output:
>> # rbh-report -i -f scratch
>> Using config file
>> '/usr/local/robinhood/2.5.2/etc/robinhood.d/tmpfs/scratch.conf'.
>> type , count, volume, avg_size
>> symlink , 4594, 50.30 KB, 11
>> dir , 1412993, 13.22 GB, 9.81 KB
>> file , 24305699, 214.46 TB, 9.25 MB
>>
>> Total: 25723286 entries, 235812918326035 bytes (214.47 TB)
>>
>> # rbh-report -i -f scratch -F
>> Using config file
>> '/usr/local/robinhood/2.5.2/etc/robinhood.d/tmpfs/scratch.conf'.
>> type , count, volume, min_size, max_size, avg_size
>> symlink , 4594, 50.30 KB, 4, 84, 11
>> dir , 1412993, 13.22 GB, 4.00 KB, 89.12 MB, 9.81 KB
>> file , 24305699, 214.46 TB, 0, 4.32 TB, 9.25 MB
>>
>> Total: 25723286 entries, 235812918326035 bytes (214.47 TB)
>>
>> The /scratch storage space only has ~75TB of space.
>>
>> It is almost like some old data still got retained in the database and
>> be counted as "active".
>>
>> Best,
>> Hadrian.
>>
>> On Tue, Apr 21, 2015 at 10:15 AM, LEIBOVICI Thomas <
>> [email protected]> wrote:
>>
>>> Hi Hadrian,
>>>
>>> Do you talk about the output of "rbh-report -i"?
>>>
>>> Is the problem about the total number of entries or the volume ?
>>>
>>> Do you get the same result with: "rbh-report -i -F"?
>>>
>>> Regards,
>>> Thomas
>>>
>>>
>>> On 04/20/15 23:12, Hadrian Djohari wrote:
>>>
>>> Hi,
>>>
>>> We have installed Robinhood on a dedicated node that transverse 2
>>> filesystems as tmpfs: a Panasas and a Nexsan (ZFS) storage.
>>>
>>> The total from the Nexsan appears to be correct, but the total from
>>> the Panasas seems to be higher - as much as 2x the total amount.
>>>
>>> Is there a setting that needs to be tweaked for the Panasas?
>>>
>>> This is a typical conf file:
>>>
>>> General
>>> {
>>> fs_path = "/mnt/DataX";
>>> fs_type = panfs;
>>> check_mounted = TRUE;
>>> }
>>> Log
>>> {
>>> log_file = "/var/log/robinhood/abc123_fs.log";
>>> report_file = "/var/log/robinhood/abc123_reports.log";
>>> alert_file = "/var/log/robinhood/abc123_alerts.log";
>>> }
>>>
>>> ListManager
>>> {
>>> MySQL
>>> {
>>> server = localhost;
>>> db = robinhood_abc123;
>>> user = robinhood;
>>> password_file =
>>> /usr/local/robinhood/2.5.2/etc/robinhood.d/.dbpassword;
>>> }
>>> }
>>>
>>> FS_Scan
>>> {
>>> scan_interval = 14d;
>>> nb_threads_scan = 4;
>>>
>>> Ignore
>>> {
>>> # ignore ".snapshot" and ".snapdir" directories (don't scan them)
>>> type == directory
>>> and
>>> ( name == ".snapdir" or name == ".snapshot" )
>>> }
>>> }
>>>
>>> Thank you,
>>>
>>> --
>>> Hadrian Djohari
>>> HPCC Manager
>>> Case Western Reserve University
>>> (W): 216-368-0395
>>> (M): 216-798-7490
>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT
>>> Develop your own process in accordance with the BPMN 2 standard
>>> Learn Process modeling best practices with Bonita BPM through live
>>> exerciseshttp://www.bonitasoft.com/be-part-of-it/events/bpm-camp-virtual-
>>> event?utm_
>>> source=Sourceforge_BPM_Camp_5_6_15&utm_medium=email&utm_campaign=VA_SF
>>>
>>>
>>>
>>> _______________________________________________
>>> robinhood-support mailing
>>> [email protected]https://lists.sourceforge.net/lists/listinfo/robinhood-support
>>>
>>>
>>>
>>
>>
>> --
>> Hadrian Djohari
>> HPCC Manager
>> Case Western Reserve University
>> (W): 216-368-0395
>> (M): 216-798-7490
>>
>>
>>
>
>
> --
> Hadrian Djohari
> HPCC Manager
> Case Western Reserve University
> (W): 216-368-0395
> (M): 216-798-7490
>
--
Hadrian Djohari
HPCC Manager
Case Western Reserve University
(W): 216-368-0395
(M): 216-798-7490
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
