The problem becomes that it is very time consuming to run stat on every file of the MDS. We have used a multi-threaded python program to walk the entire filesystem fairly effectively on our two large Lustre systems. I released one of them a while back to the mailing list, and it should be in the archives somewhere. If you cant locate it send me a mail, and I'll send it on to you. The released version was designed to expire files when they have been on the file system for a long time, but it doesn't have to, as it also collects usage data for files, and directories.
I've heard rumors that someone in CFS is working on and MDS scanning utility that should be more efficient, but until we see it I have no idea how well it works.. Evan > -----Original Message----- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Kaizaad Bilimorya > Sent: Thursday, January 11, 2007 7:31 AM > To: [email protected] > Subject: [Lustre-discuss] file stat in lustre > > Hello, > > We would like to build an informational page that will > provide users with stats (size, name, path, mod time,...) on > files they have in the lustre filesystem (and maybe store it > in a db). I can use "lfs" to get strip and OST info but not > "stat" info. We could build some perl tools (probably already > out there) which would traverse the filesystem and give us > this information, but I would like to know if there is a > better or efficient way to do this. > > Or maybe there is already a lustre utility that can give me > the stat info on a file just by querying the MDS server > instead of traversing the entire lustre filesystem? Or maybe > this is not a good approach? > Something better? > > thanks > -k > > _______________________________________________ > Lustre-discuss mailing list > [email protected] > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss > _______________________________________________ Lustre-discuss mailing list [email protected] https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
