Hi, I am was trying to rescan a subtree of the Lustre file system, expecting a faster turnaround on that scan. But I found that it takes forever to finish that scan.
I have now run it with full logging to see what is going on and it looks like a specific database operation is causing the problem: [root@tclin01 ~]# robinhood -l FULL -O --scan=/gdatat1/siteAB/root230/root/bin/ 2017/04/27 16:04:05 [11885/15] FS_Scan | 23576148 entries in DB before starting the scan The actual scan is finished quite quickly (there are not a lot of entries in that directory), but then it tries to delete all the entries it has not found: 2017/04/27 16:04:10 [11885/6] ListMgr | Direct deletion in NAMES table 2017/04/27 16:04:10 [11885/6] ListMgr | SQL query: DELETE FROM NAMES WHERE path_update<1493273035 AND this_path(parent_id,name) LIKE BINARY '0x200000007:0x1:0x0/siteAB/root230/root/bin/%' And that database query takes forever. From what I can see, the runtime of that query seems to be connected to the number of entries in the database. Is there a way to speed that up? Additionally that query can not be interrupted: 2017/04/27 16:33:55 [11885/16] STATS | --- Pipeline stage details --- 2017/04/27 16:33:55 [11885/16] STATS | RM_OLD_ENTRIES: (1 op): /gdatat1/siteAB/root230/root/bin, status=processing q^C2017/04/27 16:39:27 [11885/2] SigHdlr | SIGINT received: performing clean daemon shutdown 2017/04/27 16:39:27 [11885/2] FS_Scan | Stop request has been sent to all scan threads ^C There are no scan threads any more - that database query will not be interrupted. The only way is to kill -9 that PID. I have seen the same behavior on Robinhood 2.5 and 3.0. Many thanks, Gerald ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot _______________________________________________ robinhood-support mailing list robinhood-support@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/robinhood-support