Jim, I'm forwarding this to lustre-discuss to get a broader community input.  
I'm sure somebody has some experience with this.

Begin forwarded message:
> 
> I am looking for information on how Lustre assigns and holds pages on client 
> nodes across jobs.  The motivation is that we want to make "huge" pages 
> available to users.  We have found that it is almost impossible to allocate 
> very many "huge" pages since Lustre holds scattered small pages across jobs.  
> In fact, typically about 1/3 of compute node memory can be allocated as huge 
> pages.
> 
> We have done quite a lot of performance studies which show that a substantial 
> percentage of jobs on Ranger have TLB misses as a major performance 
> bottleneck.  We estimate we might recover as much as an additional 5%-10% 
> throughput if users could use huge pages.
> 
> Therefore we would like to find a way to minimize the client memory which 
> Lustre holds across jobs.
> 
> Have you had anyone else mention this situation to you?
> 
> Regards,
> 
> Jim Browne
> 
> 

_______________________________________________
Lustre-discuss mailing list
[email protected]
http://lists.lustre.org/mailman/listinfo/lustre-discuss

Reply via email to