Hi Amit, Thanks for this data point, that's interesting. Robinhood prints a scan summary in its logfile at the end of scan. It could be nice if you can copy/paste it, for further reference.
Aurélien Le 04/12/2020 23:39, « lustre-discuss au nom de Kumar, Amit » <lustre-discuss-boun...@lists.lustre.org au nom de ahku...@mail.smu.edu> a écrit : CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Dual Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz; 256GB RAM System x3650 M5 Storage for MDT is from NetApp EF560. Best regards, Amit -----Original Message----- From: Russell Dekema <deke...@umich.edu> Sent: Friday, December 4, 2020 4:27 PM To: Kumar, Amit <ahku...@mail.smu.edu> Cc: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Robinhood scan time Greetings, What kind of hardware are you running on your metadata array? Cheers, Rusty Dekema On Fri, Dec 4, 2020 at 5:12 PM Kumar, Amit <ahku...@mail.smu.edu> wrote: > > HI All, > > > > During LAD’20 Andreas mentioned if I could share the Robinhood scan time for the 369millions files we have. So here it is. It took ~23 days for me to complete initial scan of all 369 million files, on a dedicated robinhood server that has 384GB RAM. I had it setup with all tweaks for database and client that was mentioned in Robinhood document. I only used 2 threads for this scan. Hope this reference helps. > > > > Thank you, > > Amit > > > > _______________________________________________ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ----IF CLASSIFICATION START---- ----IF CLASSIFICATION END---- _______________________________________________ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org _______________________________________________ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org