On 10/25/2016 09:24 AM, Radhika A Parameswaran wrote: > > Loic, > We will add about removing .ptrash to the migration usecase documentation. > Can you please share some details about your dataset and performance for > migrating the 100M (time for listfile processing and actual transfer) ? > Hello, According to my logs, the files lists processing by "mmafmctl prefetch" with 2M files took between ~30 minutes and ~70 minutes. From what I can see, the longer processing times were for filesets with many directories (less files per directory).
For the actual data transfers, it varied widely from a few minutes (small files stored in the inode on a Flash-based storage unit) to a few hours (1 or 2 TB of files not large enough to trigger the parallel migration, while many batch jobs were accessing the "home" filesystem). Loïc. -- | Loïc Tortay <[email protected]> - IN2P3 Computing Centre | _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
