Matthew,
I'm not a Robinhood expert, but have worked with it a bit and noticed a
couple places you could investigate further...
On Thu, May 19, 2016 at 5:50 AM, Matthew BETTINGER <
[email protected]> wrote:
> Hope someone can show us the light here to get basic file purging working
> with robinhood 2.5.5 . I think before getting purging working we need to
> fix a problem with the databases not getting new files updated.
>
>
>
> We have changelog enabled on our lustre system. All we are wanting to do
> is purge files that are 14 days old from a directory /lustre2/scratch
>
First validate that changelogs are working on your system using basic
Lustre tools. On the MDS, look to see if the changelog ID that you have
configured in Robinhood is keeping up with the current index:
# cat /proc/fs/lustre/mdd/*MDT*/changelog_users
With robinhood stopped, you can also run a "lfs changelog" command on your
client to make sure that you can read the update as you create the new file
on the file system.
>
> I am having some confusion on when and what gets entered into the mysql
> database so things do not appear to be working as expected. For instance..
>
>
>
> We perform an initial robinhood scan
>
>
>
> robinhood –S –O and we can see the files with rbh-report –D –P
> /lustre2/robinhood/test
>
>
>
> [root@hous0162 ~]# rbh-report -D -P /lustre2/robinhood/test/
>
> Using config file '/etc/robinhood.d/tmpfs/lustre2.conf'.
>
> filter path: /lustre2/robinhood/test/
>
> type, size, user, group, purge
> class, path
>
> file, 0, 1378, 512,
> scratch, /lustre2/robinhood/test/bar
>
> dir, 4.00 KB, 1378, 512,
> [ignored], /lustre2/robinhood/test
>
>
>
> Total: 2 entries, 4096 bytes (4.00 KB)
>
>
>
>
>
> Now, if I make a new file it does not show up in rbh-report. What’s
> going on?
>
With just one file created, you might not see the update for a while.
There are batching features in Robinhood for DB update efficiency, as well
as builtin delays so that unnecesssary updates won't be performed if the
new file has attributes changed or it is deleted in short order.
>
>
> [root@hous0162 test]# head -c 2M < /dev/urandom > blah
>
> [root@hous0162 test]# ls -lart
>
> total 1036
>
> drwxrwxrwt 6 1378 512 4096 May 19 06:29 ..
>
> -rw-r--r-- 1 1378 512 0 May 19 06:35 bar
>
> -rw-r--r-- 1 1378 512 206 May 19 06:43 qbz
>
> -rw-r--r-- 1 root root 2097152 May 19 06:46 blah
>
> drwxr-xr-x 2 1378 512 4096 May 19 06:46 .
>
> [root@hous0162 test]# rbh-report -D -P /lustre2/robinhood/test/
>
> Using config file '/etc/robinhood.d/tmpfs/lustre2.conf'.
>
> filter path: /lustre2/robinhood/test/
>
> type, size, user, group, purge
> class, path
>
> file, 0, 1378, 512,
> scratch, /lustre2/robinhood/test/bar
>
> dir, 4.00 KB, 1378, 512,
> [ignored], /lustre2/robinhood/test
>
>
>
> Total: 2 entries, 4096 bytes (4.00 KB)
>
>
>
>
>
> We start robinhood after doing the initial scan with these parameters
>
>
>
> /usr/sbin/robinhood --purge -d -f /etc/robinhood.d/tmpfs/lustre2.conf -p
> /var/run/rbh.lustre2
>
If you share your config file, particularly the changelog section, that
might give someone a hint if something else is going wrong.
>
>
> If I stop the daemon and run the scan the file blah will show up but not
> as it is created.
>
If you just *stop* the daemon, I would guess that could flush any buffering
and batching, so see if the file shows up *before* you run a new scan.
Hope this helps,
Nathan
>
>
> Thanks.
>
>
>
>
>
>
> ------------------------------------------------------------------------------
> Mobile security can be enabling, not merely restricting. Employees who
> bring their own devices (BYOD) to work are irked by the imposition of MDM
> restrictions. Mobile Device Manager Plus allows you to control only the
> apps on BYO-devices by containerizing them, leaving personal data
> untouched!
> https://ad.doubleclick.net/ddm/clk/304595813;131938128;j
> _______________________________________________
> robinhood-support mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/robinhood-support
>
>
------------------------------------------------------------------------------
Mobile security can be enabling, not merely restricting. Employees who
bring their own devices (BYOD) to work are irked by the imposition of MDM
restrictions. Mobile Device Manager Plus allows you to control only the
apps on BYO-devices by containerizing them, leaving personal data untouched!
https://ad.doubleclick.net/ddm/clk/304595813;131938128;j
_______________________________________________
robinhood-support mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/robinhood-support
