Re: [Lustre-discuss] Large directories optimization

2009-09-23 Thread Lukas Hejtmanek
On Tue, Sep 22, 2009 at 10:04:57AM -0400, Oleg Drokin wrote: I saw recommendation to limit ost_num_threads but it is deprecated. Should I limit oss_num_threads instead? Yes. (they are the same thing anyway) Thanks Oleg. One more question, this limit is per kernel module or per OST mount?

Re: [Lustre-discuss] Large directories optimization

2009-09-23 Thread Oleg Drokin
Hello! On Sep 23, 2009, at 7:47 AM, Lukas Hejtmanek wrote: I limit oss_num_threads instead? Yes. (they are the same thing anyway) Thanks Oleg. One more question, this limit is per kernel module or per OST mount? E.g., I have 1 physical server that hosts 2 OST servers - OST0, OST1. This

Re: [Lustre-discuss] Large directories optimization

2009-09-22 Thread Lukas Hejtmanek
On Thu, Sep 17, 2009 at 04:17:54PM -0400, Oleg Drokin wrote: If you bring down the load on the OSTs (read this list, recently there were several methods discussed like bringing down number of service threads) that should help. Thanks. I got a question regarding number of service threads.

Re: [Lustre-discuss] Large directories optimization

2009-09-22 Thread Oleg Drokin
Hello! On Sep 22, 2009, at 7:10 AM, Lukas Hejtmanek wrote: On Thu, Sep 17, 2009 at 04:17:54PM -0400, Oleg Drokin wrote: If you bring down the load on the OSTs (read this list, recently there were several methods discussed like bringing down number of service threads) that should help.

[Lustre-discuss] Large directories optimization

2009-09-17 Thread Lukas Hejtmanek
Hello, is it possible to optimize Lustre so that is supports really large directories (with 30k small files in it)? We have 8 physical clients which process jpeg files stored on Lustre volume and I get sooner or later client freezes - ls in Lustre directory waits forever. I there something I

Re: [Lustre-discuss] Large directories optimization

2009-09-17 Thread Peter Kjellstrom
On Thursday 17 September 2009, Lukas Hejtmanek wrote: Hello, is it possible to optimize Lustre so that is supports really large directories (with 30k small files in it)? We have 8 physical clients which process jpeg files stored on Lustre volume and I get sooner or later client freezes - ls

Re: [Lustre-discuss] Large directories optimization

2009-09-17 Thread Oleg Drokin
Hello! On Sep 17, 2009, at 7:28 AM, Lukas Hejtmanek wrote: LustreError: 11-0: an error occurred while communicating with x.x@tcp. The mds_connect operation failed with -16 Lustre: Request x112815827 sent from stable-OST0001-osc- 8802855b7800 to NID x.x@tcp 100s ago has timed