Hi,

I am was trying to rescan a subtree of the Lustre file system, expecting 
a faster turnaround on that scan. But I found that it takes forever to 
finish that scan.

I have now run it with full logging to see what is going on and it looks 
like a specific database operation is causing the problem:

[root@tclin01 ~]# robinhood -l FULL -O 
--scan=/gdatat1/siteAB/root230/root/bin/

2017/04/27 16:04:05 [11885/15] FS_Scan | 23576148 entries in DB before 
starting the scan

The actual scan is finished quite quickly (there are not a lot of 
entries in that directory), but then it tries to delete all the entries 
it has not found:

2017/04/27 16:04:10 [11885/6] ListMgr | Direct deletion in NAMES table
2017/04/27 16:04:10 [11885/6] ListMgr | SQL query: DELETE FROM NAMES 
WHERE path_update<1493273035 AND this_path(parent_id,name) LIKE BINARY 
'0x200000007:0x1:0x0/siteAB/root230/root/bin/%'

And that database query takes forever. From what I can see, the runtime 
of that query seems to be connected to the number of entries in the 
database. Is there a way to speed that up?

Additionally that query can not be interrupted:

2017/04/27 16:33:55 [11885/16] STATS | --- Pipeline stage details ---
2017/04/27 16:33:55 [11885/16] STATS | RM_OLD_ENTRIES: (1 op): 
/gdatat1/siteAB/root230/root/bin, status=processing
q^C2017/04/27 16:39:27 [11885/2] SigHdlr | SIGINT received: performing 
clean daemon shutdown
2017/04/27 16:39:27 [11885/2] FS_Scan | Stop request has been sent to 
all scan threads
^C

There are no scan threads any more - that database query will not be 
interrupted. The only way is to kill -9 that PID.

I have seen the same behavior on Robinhood 2.5 and 3.0.

Many thanks,

Gerald











------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
robinhood-support mailing list
robinhood-support@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/robinhood-support

Reply via email to