Re: Max. number of opened files, efficiency

2008-08-17 Thread Tait
How many files can I open under FreeBSD, at the same time? ... I tried to open 1000 temporary files and I could do so within one second. Another interesting (offtopic) question is that I could not open 10 000 files under Windows XP. Error was too many open file. How to overcome this? The

Max. number of opened files, efficiency

2008-08-13 Thread Laszlo Nagy
How many files can I open under FreeBSD, at the same time? Problem: I'm making a pivot table, and when I drill down the facts, I would like to create a new temporary file for each possible dimension value. In most cases, there will be less than 1000 dimension values. I tried to open 1000

Re: Max. number of opened files, efficiency

2008-08-13 Thread Bill Moran
In response to Laszlo Nagy [EMAIL PROTECTED]: How many files can I open under FreeBSD, at the same time? Problem: I'm making a pivot table, and when I drill down the facts, I would like to create a new temporary file for each possible dimension value. In most cases, there will be less

Re: Max. number of opened files, efficiency

2008-08-13 Thread Laszlo Nagy
Directories generally start to perform poorly when you put too many files in them (i.e. the time required to add a new directory entry or find an existing name in the entry goes up) If you're going to be making 10s of 1000s of files, I'd recommend making a tree of directories. I.e., make

RE: Max. number of opened files, efficiency

2008-08-13 Thread Bob McConnell
On Behalf Of Laszlo Nagy Another interesting (offtopic) question is that I could not open 10 000 files under Windows XP. Error was too many open file. How to overcome this? There are various limits on the numbers of handles of different types available in MS-Windows. Some can be adjusted by

Re: Max. number of opened files, efficiency

2008-08-13 Thread Oliver Fromme
Laszlo Nagy wrote: In fact I do not need any name associated with the file. I just need a temporary file object, I would like to access it in read write mode and then throw it. In that case, why do you use physical (i.e. on-disk) files at all? You could simply use memory objects. If you

Re: Max. number of opened files, efficiency

2008-08-13 Thread cpghost
On Wed, Aug 13, 2008 at 04:12:39PM +0200, Laszlo Nagy wrote: How many files can I open under FreeBSD, at the same time? % sysctl -a | grep maxfiles kern.maxfiles: 7880 kern.maxfilesperproc: 7092 But remember that you're already using a few hundred file descriptors, so usually, you won't have