Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-24 Thread Vallo Kallaste
On Tue, Apr 23, 2002 at 09:40:11PM -0700, David Schultz [EMAIL PROTECTED] wrote: Userspace processes will allocate memory from UVA space and can grow over 1GB of size if needed by swapping. You can certainly have more than one over-1GB process going on at the same time, but swapping

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-24 Thread Terry Lambert
David Schultz wrote: Thus spake Terry Lambert [EMAIL PROTECTED]: Writing a useful (non-fluff) technical book, optimistically, takes 2080 hours ... or 40 hours per week for 52 weeks... a man year. By the time you are done, the book is a year out of date, and even if you worked really

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-24 Thread Steve O'Hara-Smith
On Mon, 22 Apr 2002 06:04:34 -0700 Terry Lambert [EMAIL PROTECTED] wrote: TL FreeBSD doesn't currently support bank selection. Peter was TL working on it, last time I heard. Linux supports it, at an TL incredible performance penalty. This inspired an off the wall thought that may be

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-24 Thread Terry Lambert
Steve O'Hara-Smith wrote: On Mon, 22 Apr 2002 06:04:34 -0700 Terry Lambert [EMAIL PROTECTED] wrote: TL FreeBSD doesn't currently support bank selection. Peter was TL working on it, last time I heard. Linux supports it, at an TL incredible performance penalty. This inspired an

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-24 Thread Steve O'Hara-Smith
On Wed, 24 Apr 2002 16:38:08 -0700 Terry Lambert [EMAIL PROTECTED] wrote: TL Only if you reserved a window for it. Say 1G of KVA, though last I was thinking more like 1M, or even a few K, it sounds like that's not possible. TL I checked the bank selection granularity wasn't fine

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread David Schultz
Thus spake Terry Lambert [EMAIL PROTECTED]: I'm pretty sure Solaris also used 4K pages for swappable memory in the kernel, as well: 4M pages don't make much sense, since you could, for example, exhaust KVA space with 250 kernel modules (250 X (1 data + 1 code) * 4M = 2G). It doesn't use 4M

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread Marc G. Fournier
On Mon, 22 Apr 2002, Terry Lambert wrote: Marc G. Fournier wrote: First, alot of this stuff is slowly sinking in ... after repeatedly reading it and waiting for the headache to disapate:) But, one thing that I'm still not clear on ... If I have 4Gig of RAM in a server, does it make

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread Vallo Kallaste
On Tue, Apr 23, 2002 at 09:44:50AM -0300, Marc G. Fournier [EMAIL PROTECTED] wrote: Next, again, if I'm reading this right ... if I set my KVA to 3G, when the system boots, it will reserve 3G of *physical* RAM for the kernel itself, correct? So on a 4G machine, 1G of *physical* RAM will be

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread Vallo Kallaste
On Tue, Apr 23, 2002 at 12:25:31PM -0700, Terry Lambert [EMAIL PROTECTED] wrote: Vallo Kallaste wrote: You can have up to ~12GB of usable swap space, as I've heard. Don't remember why such arbitrary limit, unfortunately. Information about such topics is spread over several lists arhives,

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread Dave Hayes
Terry Lambert (who fits my arbitrary definition of a good cynic) writes: It's a hazard of Open Source projects, in general, that there are so many people hacking on whatever they think is cool that nothing ever really gets built to a long term design plan that's stable enough that a book

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread Chris BeHanna
On Tue, 23 Apr 2002, Dave Hayes wrote: Terry Lambert (who fits my arbitrary definition of a good cynic) writes: It's a hazard of Open Source projects, in general, that there are so many people hacking on whatever they think is cool that nothing ever really gets built to a long term

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread Terry Lambert
Dave Hayes wrote: So, it's time to question the assumption that the information you want available should be in a book. Many websites have annotation as a form of ad-hoc documentation (e.g. php.net). Why not have someone take a crack at documenting the FreeBSD kernel, and perhaps use some

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread David Schultz
Thus spake Vallo Kallaste [EMAIL PROTECTED]: Userspace processes will allocate memory from UVA space and can grow over 1GB of size if needed by swapping. You can certainly have more than one over-1GB process going on at the same time, but swapping will constrain your performance. It isn't a

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-23 Thread David Schultz
Thus spake Terry Lambert [EMAIL PROTECTED]: Writing a useful (non-fluff) technical book, optimistically, takes 2080 hours ... or 40 hours per week for 52 weeks... a man year. By the time you are done, the book is a year out of date, and even if you worked really hard and kept it up to date

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Jeroen Ruigrok/asmodai
Marc, -On [20020421 00:30], Marc G. Fournier ([EMAIL PROTECTED]) wrote: Over the past week, I've been trying to get information on how to fix a server that panics with: | panic: vm_map_entry_create: kernel resources exhausted | mp_lock = 0101; cpuid = 1; lapic.id = 0100 | boot() called

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Terry Lambert
Marc G. Fournier wrote: No, there's no stats collected on this stuff, because it's a pretty obvious and straight-forward thing: you have to have a KVA space large enough that, once you subtract out 4K for each 4M of physical memory and swap (max 4G total for both), you end up with

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Terry Lambert
Marc G. Fournier wrote: On Sun, 21 Apr 2002, Terry Lambert wrote: No, there's no stats collected on this stuff, because it's a pretty obvious and straight-forward thing: you have to have a KVA space large enough that, once you subtract out 4K for each 4M of physical memory and swap (max

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread David Schultz
Thus spake Terry Lambert [EMAIL PROTECTED]: If you want more, then you need to use a 64 bit processor (or use a processor that supports bank selection, and hack up FreeBSD to do bank swapping on 2G at a time, just like Linux has been hacked up, and expect that it won't be very useful). I'm

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Vizion Communication
Test - Please ignore - Original Message - From: David Schultz [EMAIL PROTECTED] To: Terry Lambert [EMAIL PROTECTED] Cc: [EMAIL PROTECTED]; [EMAIL PROTECTED] Sent: Monday, April 22, 2002 6:09 AM Subject: Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ? Thus spake Terry

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Marc G. Fournier
On Mon, 22 Apr 2002, Terry Lambert wrote: Marc G. Fournier wrote: On Sun, 21 Apr 2002, Terry Lambert wrote: No, there's no stats collected on this stuff, because it's a pretty obvious and straight-forward thing: you have to have a KVA space large enough that, once you subtract out 4K

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Terry Lambert
Marc G. Fournier wrote: You aren't going to be able to exceed 4G, no matter what you do, because that's the limit of your address space. If you want more, then you need to use a 64 bit processor (or use a processor that supports bank selection, and hack up FreeBSD to do bank swapping

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Marc G. Fournier
First, alot of this stuff is slowly sinking in ... after repeatedly reading it and waiting for the headache to disapate:) But, one thing that I'm still not clear on ... If I have 4Gig of RAM in a server, does it make any sense to have swap space on that server also? Again, from what I'm

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Terry Lambert
Jeroen Ruigrok/asmodai wrote: Take a look at this: http://www.freebsd.org/cgi/getmsg.cgi?fetch=245329+248644+/usr/local/www/db/text/2001/freebsd-hackers/20010624.freebsd-hackers This is actually no longer valid, since there have been changes to both the PDE caclcualtions and the kernel base

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Terry Lambert
David Schultz wrote: Thus spake Terry Lambert [EMAIL PROTECTED]: If you want more, then you need to use a 64 bit processor (or use a processor that supports bank selection, and hack up FreeBSD to do bank swapping on 2G at a time, just like Linux has been hacked up, and expect that it

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-22 Thread Terry Lambert
Marc G. Fournier wrote: First, alot of this stuff is slowly sinking in ... after repeatedly reading it and waiting for the headache to disapate:) But, one thing that I'm still not clear on ... If I have 4Gig of RAM in a server, does it make any sense to have swap space on that server

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-21 Thread Terry Lambert
Marc G. Fournier wrote: You have more memory than you can allocate kernel memory to provide page table entries for. The only solution is to increase your kernel virtual address space size to accomodate the page mappings. How to do this varies widely by the version of FreeBSD you are

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-21 Thread Marc G. Fournier
On Sun, 21 Apr 2002, Terry Lambert wrote: No, there's no stats collected on this stuff, because it's a pretty obvious and straight-forward thing: you have to have a KVA space large enough that, once you subtract out 4K for each 4M of physical memory and swap (max 4G total for both), you end

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-21 Thread Marc G. Fournier
On Sun, 21 Apr 2002, Terry Lambert wrote: Marc G. Fournier wrote: You have more memory than you can allocate kernel memory to provide page table entries for. The only solution is to increase your kernel virtual address space size to accomodate the page mappings. How to do

FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-20 Thread Marc G. Fournier
Over the past week, I've been trying to get information on how to fix a server that panics with: | panic: vm_map_entry_create: kernel resources exhausted | mp_lock = 0101; cpuid = 1; lapic.id = 0100 | boot() called on cpu#1 Great ... but, how do I determine what 'resources' I need to

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-20 Thread Marc G. Fournier
As a quick follow-up to this, doing more searching on the web, I came across a few suggested 'sysctl' settings, which I've added to what I had before, for a total of: kern.maxfiles=65534 jail.sysvipc_allowed=1 vm.swap_idle_enabled=1 vfs.vmiodirenable=1 kern.ipc.somaxconn=4096 I've also just

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-20 Thread Alfred Perlstein
* The Hermit Hacker [EMAIL PROTECTED] [020420 16:01] wrote: As a quick follow-up to this, doing more searching on the web, I came across a few suggested 'sysctl' settings, which I've added to what I had before, for a total of: kern.maxfiles=65534 jail.sysvipc_allowed=1

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-20 Thread Marc G. Fournier
On Sat, 20 Apr 2002, Alfred Perlstein wrote: * The Hermit Hacker [EMAIL PROTECTED] [020420 16:01] wrote: As a quick follow-up to this, doing more searching on the web, I came across a few suggested 'sysctl' settings, which I've added to what I had before, for a total of:

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-20 Thread Terry Lambert
Marc G. Fournier wrote: Over the past week, I've been trying to get information on how to fix a server that panics with: | panic: vm_map_entry_create: kernel resources exhausted | mp_lock = 0101; cpuid = 1; lapic.id = 0100 | boot() called on cpu#1 Great ... but, how do I

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-20 Thread Terry Lambert
Marc G. Fournier wrote: It'll only work if you set it before your processes setup. Some more information about what these 5000 processes are doing would help. Sorry ... the server is running ~210 jails ... so the '5k processes' would be when they all start up their periodic scripts

Re: FreeBSD 4.5-STABLE not easily scalable to large servers ... ?

2002-04-20 Thread Marc G. Fournier
On Sat, 20 Apr 2002, Terry Lambert wrote: Marc G. Fournier wrote: Over the past week, I've been trying to get information on how to fix a server that panics with: | panic: vm_map_entry_create: kernel resources exhausted | mp_lock = 0101; cpuid = 1; lapic.id = 0100 | boot()