Pre-make your list of files, split it into 5 or so parts, give each of 5 clients one piece, and let them migrate in parallel.

bob

On 9/26/2016 9:00 AM, Jérôme BECOT wrote:
Hello,

As we had a inode usage issue, we did as Andreas advised :

- add a new ost with much more inodes
- disable the first ost
- use lfs_migrate to move files to the new ost

We have about 16M files on this OST (7.5TB). Our OSS are connected via 10Gbps Ethernet, though the lfs_migrate command has been launched on a 1Gbps connected client.

It's running for 5 days and is at about 50% now. It's pretty slow.

Since the command has been launched on a client, does the data transit through it ? Is there any way to improve performances ? (we will have to move data from the 2nd ost back once the first one will get more inodes, then reformat it, then rebalance)

Thank you


_______________________________________________
lustre-discuss mailing list
[email protected]
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Reply via email to