Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-11 Thread Pavel Machek
Hi! > On 03 May 2001 09:13:00 +0200, > [EMAIL PROTECTED] (Kai Henningsen) wrote: > >[EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in ><[EMAIL PROTECTED]>: > > > >> PS: Hmm, how do you do timewarp for just one userland appliation with > >> this installed? > > > >1. What on earth for? > >

vsyscalls [was Re: X15 alpha release: as fast as TUX but in user space (fwd)]

2001-05-11 Thread Pavel Machek
Hi! > > > PS: Hmm, how do you do timewarp for just one userland appliation with > > > this installed? > > > > 1. What on earth for? > > Y2K testing was one previous example. > > > 2. How do you do it today, and why wouldn't that work? > > LD_PRELOAD and providing its still using a lib call

vsyscalls [was Re: X15 alpha release: as fast as TUX but in user space (fwd)]

2001-05-11 Thread Pavel Machek
Hi! PS: Hmm, how do you do timewarp for just one userland appliation with this installed? 1. What on earth for? Y2K testing was one previous example. 2. How do you do it today, and why wouldn't that work? LD_PRELOAD and providing its still using a lib call it would. I dont

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-11 Thread Pavel Machek
Hi! On 03 May 2001 09:13:00 +0200, [EMAIL PROTECTED] (Kai Henningsen) wrote: [EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in [EMAIL PROTECTED]: PS: Hmm, how do you do timewarp for just one userland appliation with this installed? 1. What on earth for? Y10K testing :)

Re: X15 alpha release: as fast as TUX but in user space

2001-05-09 Thread Fabio Riccardi
Hello, I have uploaded a new release of X15 that hopefully solves all the RFC bugs. I say hopefully because I haven't had the opportunity to fully test the request pipelining. Is there anything to automatize such tests? >From what I could measure X15 is still a good 5% faster than TUX. You can

Re: X15 alpha release: as fast as TUX but in user space

2001-05-09 Thread Fabio Riccardi
Hello, I have uploaded a new release of X15 that hopefully solves all the RFC bugs. I say hopefully because I haven't had the opportunity to fully test the request pipelining. Is there anything to automatize such tests? From what I could measure X15 is still a good 5% faster than TUX. You can

Re: X15 alpha release: as fast as TUX but in user space

2001-05-04 Thread Davide Libenzi
On 04-May-2001 Fabio Riccardi wrote: > ok, I'm totally ignorant here, what is a pipelined request? http://www.w3.org/Protocols/HTTP/Performance/Pipeline.html A pipelined application implementation buffers its output before writing it to the underlying TCP stack, roughly equivalent to what

Re: X15 alpha release: as fast as TUX but in user space

2001-05-04 Thread Fabio Riccardi
ok, I'm totally ignorant here, what is a pipelined request? btw: please be kind with my mistakes, X15 _is_ alpha code anyway... :) - Fabio Ingo Molnar wrote: > yet another anomaly i noticed. X15 does not appear to handle pipelined > HTTP/1.1 requests properly, it ignores the second request

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-04 Thread dean gaudet
um, presumably this new magic page won't eliminate the old syscall entry points. so just use those for UML. -dean On Fri, 4 May 2001, Pavel Machek wrote: > Hi! > > > > > That means that for fooling closed-source statically-linked binary, > > > > > > If they are using glibc then you have the

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-04 Thread bert hubert
On Thu, May 03, 2001 at 09:19:15PM +0100, Alan Cox wrote: > If they are using glibc then you have the right to the object to link > with the library and the library source under the LGPL. I dont know of any > app using its own C lib qmail is nearly there. -- http://www.PowerDNS.com

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-04 Thread Pavel Machek
Hi! > > > That means that for fooling closed-source statically-linked binary, > > > > If they are using glibc then you have the right to the object to link > > with the library and the library source under the LGPL. I dont know of any > > app using its own C lib > > Some don't use any libc at

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-04 Thread Pavel Machek
Hi! That means that for fooling closed-source statically-linked binary, If they are using glibc then you have the right to the object to link with the library and the library source under the LGPL. I dont know of any app using its own C lib Some don't use any libc at all, some

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-04 Thread bert hubert
On Thu, May 03, 2001 at 09:19:15PM +0100, Alan Cox wrote: If they are using glibc then you have the right to the object to link with the library and the library source under the LGPL. I dont know of any app using its own C lib qmail is nearly there. -- http://www.PowerDNS.com

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-04 Thread dean gaudet
um, presumably this new magic page won't eliminate the old syscall entry points. so just use those for UML. -dean On Fri, 4 May 2001, Pavel Machek wrote: Hi! That means that for fooling closed-source statically-linked binary, If they are using glibc then you have the right to the

Re: X15 alpha release: as fast as TUX but in user space

2001-05-04 Thread Fabio Riccardi
ok, I'm totally ignorant here, what is a pipelined request? btw: please be kind with my mistakes, X15 _is_ alpha code anyway... :) - Fabio Ingo Molnar wrote: yet another anomaly i noticed. X15 does not appear to handle pipelined HTTP/1.1 requests properly, it ignores the second request if

Re: X15 alpha release: as fast as TUX but in user space

2001-05-04 Thread Davide Libenzi
On 04-May-2001 Fabio Riccardi wrote: ok, I'm totally ignorant here, what is a pipelined request? http://www.w3.org/Protocols/HTTP/Performance/Pipeline.html QUOTE A pipelined application implementation buffers its output before writing it to the underlying TCP stack, roughly equivalent to

Re: X15 alpha release: as fast as TUX but in user space

2001-05-03 Thread Fabio Riccardi
I have fixed the stale header cache problem. Files are statted on every request, no "practical" tricks. Performance doesn't seem to have suffered :) I also have added a cache garbage collector to close "old" file descriptors and remove even older header cache entries. This should make sure that

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Gregory Maxwell
On Thu, May 03, 2001 at 09:19:15PM +0100, Alan Cox wrote: > > That means that for fooling closed-source statically-linked binary, > > If they are using glibc then you have the right to the object to link > with the library and the library source under the LGPL. I dont know of any > app using its

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Alan Cox
> That means that for fooling closed-source statically-linked binary, If they are using glibc then you have the right to the object to link with the library and the library source under the LGPL. I dont know of any app using its own C lib > - To unsubscribe from this list: send the line

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread agrawal
On Thu, 3 May 2001, Pavel Machek wrote: > That means that for fooling closed-source statically-linked binary, > you now need to patch kernel. That's regression; subterfugue.org could > do this with normal user rights in 2.4.0. This is particularly pretty, but something that might work: 1. a

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Pavel Machek
Hi! > > > > Whatever happened to that hack that was discussed a year or two ago? > > > > The one where (also on IA32) a magic page was set up by the kernel > > > > containing code for fast system calls, and the kernel would write > > > > calibation information to that magic page. The code

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Gregory Maxwell
On Thu, May 03, 2001 at 05:44:36PM +1000, Keith Owens wrote: > On 03 May 2001 09:13:00 +0200, > [EMAIL PROTECTED] (Kai Henningsen) wrote: > >[EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in ><[EMAIL PROTECTED]>: > > > >> PS: Hmm, how do you do timewarp for just one userland appliation

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Helge Hafting
Pavel Machek wrote: > > > > > > Whatever happened to that hack that was discussed a year or two ago? > > > The one where (also on IA32) a magic page was set up by the kernel > > > containing code for fast system calls, and the kernel would write > > > calibation information to that magic page.

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Ingo Oeser
On Thu, May 03, 2001 at 05:44:36PM +1000, Keith Owens wrote: > >2. How do you do it today, and why wouldn't that work? > > LD_PRELOAD on a library that overrides gettimeofday(). I can see no > reason why that would not continue to work. Static linkage? > What would stop working > are

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Alan Cox
> > PS: Hmm, how do you do timewarp for just one userland appliation with > > this installed? > > 1. What on earth for? Y2K testing was one previous example. > 2. How do you do it today, and why wouldn't that work? LD_PRELOAD and providing its still using a lib call it would. I dont see the

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Keith Owens
On 03 May 2001 09:13:00 +0200, [EMAIL PROTECTED] (Kai Henningsen) wrote: >[EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in <[EMAIL PROTECTED]>: > >> PS: Hmm, how do you do timewarp for just one userland appliation with >> this installed? > >1. What on earth for? Y10K testing :) >2. How

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Kai Henningsen
[EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in <[EMAIL PROTECTED]>: > PS: Hmm, how do you do timewarp for just one userland appliation with > this installed? 1. What on earth for? 2. How do you do it today, and why wouldn't that work? MfG Kai - To unsubscribe from this list: send the

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Kai Henningsen
[EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in [EMAIL PROTECTED]: PS: Hmm, how do you do timewarp for just one userland appliation with this installed? 1. What on earth for? 2. How do you do it today, and why wouldn't that work? MfG Kai - To unsubscribe from this list: send the

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Keith Owens
On 03 May 2001 09:13:00 +0200, [EMAIL PROTECTED] (Kai Henningsen) wrote: [EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in [EMAIL PROTECTED]: PS: Hmm, how do you do timewarp for just one userland appliation with this installed? 1. What on earth for? Y10K testing :) 2. How do you do it

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Alan Cox
PS: Hmm, how do you do timewarp for just one userland appliation with this installed? 1. What on earth for? Y2K testing was one previous example. 2. How do you do it today, and why wouldn't that work? LD_PRELOAD and providing its still using a lib call it would. I dont see the original

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Ingo Oeser
On Thu, May 03, 2001 at 05:44:36PM +1000, Keith Owens wrote: 2. How do you do it today, and why wouldn't that work? LD_PRELOAD on a library that overrides gettimeofday(). I can see no reason why that would not continue to work. Static linkage? What would stop working are timewarp

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Helge Hafting
Pavel Machek wrote: Whatever happened to that hack that was discussed a year or two ago? The one where (also on IA32) a magic page was set up by the kernel containing code for fast system calls, and the kernel would write calibation information to that magic page. The code written

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Gregory Maxwell
On Thu, May 03, 2001 at 05:44:36PM +1000, Keith Owens wrote: On 03 May 2001 09:13:00 +0200, [EMAIL PROTECTED] (Kai Henningsen) wrote: [EMAIL PROTECTED] (Pavel Machek) wrote on 30.04.01 in [EMAIL PROTECTED]: PS: Hmm, how do you do timewarp for just one userland appliation with this

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Pavel Machek
Hi! Whatever happened to that hack that was discussed a year or two ago? The one where (also on IA32) a magic page was set up by the kernel containing code for fast system calls, and the kernel would write calibation information to that magic page. The code written there

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread agrawal
On Thu, 3 May 2001, Pavel Machek wrote: That means that for fooling closed-source statically-linked binary, you now need to patch kernel. That's regression; subterfugue.org could do this with normal user rights in 2.4.0. This is particularly pretty, but something that might work: 1. a

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Alan Cox
That means that for fooling closed-source statically-linked binary, If they are using glibc then you have the right to the object to link with the library and the library source under the LGPL. I dont know of any app using its own C lib - To unsubscribe from this list: send the line

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-03 Thread Gregory Maxwell
On Thu, May 03, 2001 at 09:19:15PM +0100, Alan Cox wrote: That means that for fooling closed-source statically-linked binary, If they are using glibc then you have the right to the object to link with the library and the library source under the LGPL. I dont know of any app using its own C

Re: X15 alpha release: as fast as TUX but in user space

2001-05-03 Thread Fabio Riccardi
I have fixed the stale header cache problem. Files are statted on every request, no practical tricks. Performance doesn't seem to have suffered :) I also have added a cache garbage collector to close old file descriptors and remove even older header cache entries. This should make sure that you

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Fabio Riccardi
Our intention is to release X15 with an open source license. This will happen as soon as the codebase stabilizes a bit, that is when we go beta (in two - three weeks). At the moment we just don't have the time... The reason why I released the alpha binary version is that several people would

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Lincoln Dale
Hi, At 10:50 AM 2/05/2001 +0200, Ingo Molnar wrote: >i think Zach's phhttpd is an important milestone as well, it's the first >userspace webserver that shows how to use event-based, sigio-based async >networking IO and sendfile() under Linux. (I believe it had some >performance problems related

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Fabio Riccardi
>From my experience system calls are not an issue. What costs a lot is moving data around, since modern CPUs spend most of their time in memory/bus wait cycles... - Fabio Linus Torvalds wrote: > >I think that applies to all really high-performance servers. > > Note that it is definitely not

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Linus Torvalds
In article <[EMAIL PROTECTED]>, Matti Aarnio <[EMAIL PROTECTED]> wrote: >On Sun, Apr 29, 2001 at 02:16:43PM -0700, Jim Gettys wrote: >... >> "X is an exercise in avoiding system calls". I think I said this around >> 1984-1985. >> - Jim > >I think that applies to

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Matti Aarnio
On Sun, Apr 29, 2001 at 02:16:43PM -0700, Jim Gettys wrote: ... > "X is an exercise in avoiding system calls". I think I said this around > 1984-1985. > - Jim I think that applies to all really high-performance servers. Definitely it applies to ZMailer, which

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Zach Brown
> i think Zach's phhttpd is an important milestone as well, it's the first > userspace webserver that shows how to use event-based, sigio-based async > networking IO and sendfile() under Linux. (I believe it had some *blush* > performance problems related to sigio queue overflow, these issues

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Ingo Molnar
On Wed, 2 May 2001, Andi Kleen wrote: > > Whatever happened to that hack that was discussed a year or two ago? > > The one where (also on IA32) a magic page was set up by the kernel > > containing code for fast system calls, and the kernel would write > > calibation information to that magic

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Andi Kleen
[sorry for the late answer -- i was involuntarily offline for a few days] On Sat, Apr 28, 2001 at 04:56:27PM -0600, Richard Gooch wrote: > Whatever happened to that hack that was discussed a year or two ago? > The one where (also on IA32) a magic page was set up by the kernel > containing code

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Ingo Molnar
On Sun, 29 Apr 2001, Fabio Riccardi wrote: > TUX has definitively been my performance yardstick for the development > of X15, but I had many sources of inspiration for the X15 > architecture. Maybe the most relevant are the Flash Web Server (Pai, > Druschel, Zwaenepoel), several Linus

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Ingo Molnar
On Sun, 29 Apr 2001, Fabio Riccardi wrote: TUX has definitively been my performance yardstick for the development of X15, but I had many sources of inspiration for the X15 architecture. Maybe the most relevant are the Flash Web Server (Pai, Druschel, Zwaenepoel), several Linus observations

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Andi Kleen
[sorry for the late answer -- i was involuntarily offline for a few days] On Sat, Apr 28, 2001 at 04:56:27PM -0600, Richard Gooch wrote: Whatever happened to that hack that was discussed a year or two ago? The one where (also on IA32) a magic page was set up by the kernel containing code for

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Ingo Molnar
On Wed, 2 May 2001, Andi Kleen wrote: Whatever happened to that hack that was discussed a year or two ago? The one where (also on IA32) a magic page was set up by the kernel containing code for fast system calls, and the kernel would write calibation information to that magic page. The

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Zach Brown
i think Zach's phhttpd is an important milestone as well, it's the first userspace webserver that shows how to use event-based, sigio-based async networking IO and sendfile() under Linux. (I believe it had some *blush* performance problems related to sigio queue overflow, these issues might

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Matti Aarnio
On Sun, Apr 29, 2001 at 02:16:43PM -0700, Jim Gettys wrote: ... X is an exercise in avoiding system calls. I think I said this around 1984-1985. - Jim I think that applies to all really high-performance servers. Definitely it applies to ZMailer, which before

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Linus Torvalds
In article [EMAIL PROTECTED], Matti Aarnio [EMAIL PROTECTED] wrote: On Sun, Apr 29, 2001 at 02:16:43PM -0700, Jim Gettys wrote: ... X is an exercise in avoiding system calls. I think I said this around 1984-1985. - Jim I think that applies to all really

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-02 Thread Fabio Riccardi
From my experience system calls are not an issue. What costs a lot is moving data around, since modern CPUs spend most of their time in memory/bus wait cycles... - Fabio Linus Torvalds wrote: I think that applies to all really high-performance servers. Note that it is definitely not

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Lincoln Dale
Hi, At 10:50 AM 2/05/2001 +0200, Ingo Molnar wrote: i think Zach's phhttpd is an important milestone as well, it's the first userspace webserver that shows how to use event-based, sigio-based async networking IO and sendfile() under Linux. (I believe it had some performance problems related to

Re: X15 alpha release: as fast as TUX but in user space

2001-05-02 Thread Fabio Riccardi
Our intention is to release X15 with an open source license. This will happen as soon as the codebase stabilizes a bit, that is when we go beta (in two - three weeks). At the moment we just don't have the time... The reason why I released the alpha binary version is that several people would

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
On Tue, 1 May 2001, Fabio Riccardi wrote: > This is actually a bug in the current X15, I know how to fix it (with > negligible overhead) but I've been lazy :) yep, i think it's pretty straightforward: you have a cache of open file descriptors (like Squid i think), and you can start a

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Fabio Riccardi
This is actually a bug in the current X15, I know how to fix it (with negligible overhead) but I've been lazy :) give me a few days... - Fabio Ingo Molnar wrote: > hm, another X15 caching artifact i noticed: i've changed the index.html > file, and while X15 was still serving the old copy,

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-01 Thread Pavel Machek
Hi! > > > In x86-64 there are special vsyscalls btw to solve this problem that export > > > a lockless kernel gettimeofday() > > > > Whatever happened to that hack that was discussed a year or two ago? > > The one where (also on IA32) a magic page was set up by the kernel > > containing code

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
hm, another X15 caching artifact i noticed: i've changed the index.html file, and while X15 was still serving the old copy, TUX served the new file immediately. its cache is apparently not coherent with actual VFS contents. (ie. it's a read-once cache apparently?) TUX has some (occasionally

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
On Mon, 30 Apr 2001, Fabio Riccardi wrote: > Ok I fixed it, the header date timestamp is updated with every > request. > > Performance doesn't seem to have suffered significantly (less than > 1%). yep, expected that - doing a sendmsg()+sendfile() generates the same packet structure, the only

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
On Sun, 29 Apr 2001, Fabio Riccardi wrote: > I can disable header caching and see what happens, I'll add an option > for this in the next X15 release. what SPECweb99 performance do you get if you disable header caching? It might not make all that much of a difference. (but it will make the

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
On Sun, 29 Apr 2001, Fabio Riccardi wrote: I can disable header caching and see what happens, I'll add an option for this in the next X15 release. what SPECweb99 performance do you get if you disable header caching? It might not make all that much of a difference. (but it will make the

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
On Mon, 30 Apr 2001, Fabio Riccardi wrote: Ok I fixed it, the header date timestamp is updated with every request. Performance doesn't seem to have suffered significantly (less than 1%). yep, expected that - doing a sendmsg()+sendfile() generates the same packet structure, the only

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
hm, another X15 caching artifact i noticed: i've changed the index.html file, and while X15 was still serving the old copy, TUX served the new file immediately. its cache is apparently not coherent with actual VFS contents. (ie. it's a read-once cache apparently?) TUX has some (occasionally

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-05-01 Thread Pavel Machek
Hi! In x86-64 there are special vsyscalls btw to solve this problem that export a lockless kernel gettimeofday() Whatever happened to that hack that was discussed a year or two ago? The one where (also on IA32) a magic page was set up by the kernel containing code for fast system

Re: X15 alpha release: as fast as TUX but in user space

2001-05-01 Thread Ingo Molnar
On Tue, 1 May 2001, Fabio Riccardi wrote: This is actually a bug in the current X15, I know how to fix it (with negligible overhead) but I've been lazy :) yep, i think it's pretty straightforward: you have a cache of open file descriptors (like Squid i think), and you can start a background

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread David S. Miller
dean gaudet writes: > On Sun, 29 Apr 2001, David S. Miller wrote: > > > If you do the TCP_CORK thing, what you end up with is a scatter gather > > entry in the SKB for the header bits, then the page cache segments. > > so then the NIC would be sent a 3 entry gather list -- 1 entry for

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread dean gaudet
On Mon, 30 Apr 2001, Fabio Riccardi wrote: > Ok I fixed it, the header date timestamp is updated with every request. > > Performance doesn't seem to have suffered significantly (less than 1%). rad! > BTW: Don't call me slime, I wasn't trying to cheat, I just didn't know that > the date stamp

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread Fabio Riccardi
Ok I fixed it, the header date timestamp is updated with every request. Performance doesn't seem to have suffered significantly (less than 1%). You can find the new release at: http://www.chromium.com/X15-Alpha-2.tgz BTW: Don't call me slime, I wasn't trying to cheat, I just didn't know that

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread Alan Cox
> The point is: The code in that "magic page" that considers the > tradeoff is KERNEL code, which is designed to care about such > trade-offs for that machine. Glibc never knows this stuff and > shouldn't, because it is already bloated. glibc is bloated because it cares about such stuff and

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread Jonathan Lundell
At 12:29 AM -0700 2001-04-30, H. Peter Anvin wrote: >"David S. Miller" wrote: >> >> dean gaudet writes: >> > i was kind of solving a different problem with the code page >>though -- the >> > ability to use rdtsc on SMP boxes with processors of varying speeds and >> > synchronizations. >>

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread David S. Miller
H. Peter Anvin writes: > RDTSC in Crusoe processors does basically this. Hmmm, one of the advantages of using a seperate tick register for this constant clock is that you can still do cycle accurate asm code analysis even when the cpu is down clocked. The joys of compatability I suppose :-)

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread H. Peter Anvin
"David S. Miller" wrote: > > dean gaudet writes: > > i was kind of solving a different problem with the code page though -- the > > ability to use rdtsc on SMP boxes with processors of varying speeds and > > synchronizations. > > A better way to solve that problem is the way UltraSPARC-III

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread David S. Miller
dean gaudet writes: > i was kind of solving a different problem with the code page though -- the > ability to use rdtsc on SMP boxes with processors of varying speeds and > synchronizations. A better way to solve that problem is the way UltraSPARC-III do and future ia64 systems will, by way

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread David S. Miller
dean gaudet writes: > is this too slow for some reason? (does it play well with zero-copy?) His trick ends up with a minimal set of scatter gather entries. That's the whole gain behind the trick he's doing. If you do the TCP_CORK thing, what you end up with is a scatter gather entry in the

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread David S. Miller
dean gaudet writes: is this too slow for some reason? (does it play well with zero-copy?) His trick ends up with a minimal set of scatter gather entries. That's the whole gain behind the trick he's doing. If you do the TCP_CORK thing, what you end up with is a scatter gather entry in the

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread David S. Miller
dean gaudet writes: i was kind of solving a different problem with the code page though -- the ability to use rdtsc on SMP boxes with processors of varying speeds and synchronizations. A better way to solve that problem is the way UltraSPARC-III do and future ia64 systems will, by way of

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread H. Peter Anvin
David S. Miller wrote: dean gaudet writes: i was kind of solving a different problem with the code page though -- the ability to use rdtsc on SMP boxes with processors of varying speeds and synchronizations. A better way to solve that problem is the way UltraSPARC-III do and

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread David S. Miller
H. Peter Anvin writes: RDTSC in Crusoe processors does basically this. Hmmm, one of the advantages of using a seperate tick register for this constant clock is that you can still do cycle accurate asm code analysis even when the cpu is down clocked. The joys of compatability I suppose :-)

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread Jonathan Lundell
At 12:29 AM -0700 2001-04-30, H. Peter Anvin wrote: David S. Miller wrote: dean gaudet writes: i was kind of solving a different problem with the code page though -- the ability to use rdtsc on SMP boxes with processors of varying speeds and synchronizations. A better way to

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-30 Thread Alan Cox
The point is: The code in that magic page that considers the tradeoff is KERNEL code, which is designed to care about such trade-offs for that machine. Glibc never knows this stuff and shouldn't, because it is already bloated. glibc is bloated because it cares about such stuff and complex

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread Fabio Riccardi
Ok I fixed it, the header date timestamp is updated with every request. Performance doesn't seem to have suffered significantly (less than 1%). You can find the new release at: http://www.chromium.com/X15-Alpha-2.tgz BTW: Don't call me slime, I wasn't trying to cheat, I just didn't know that

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread dean gaudet
On Mon, 30 Apr 2001, Fabio Riccardi wrote: Ok I fixed it, the header date timestamp is updated with every request. Performance doesn't seem to have suffered significantly (less than 1%). rad! BTW: Don't call me slime, I wasn't trying to cheat, I just didn't know that the date stamp was

Re: X15 alpha release: as fast as TUX but in user space

2001-04-30 Thread David S. Miller
dean gaudet writes: On Sun, 29 Apr 2001, David S. Miller wrote: If you do the TCP_CORK thing, what you end up with is a scatter gather entry in the SKB for the header bits, then the page cache segments. so then the NIC would be sent a 3 entry gather list -- 1 entry for TCP/IP

Re: X15 alpha release: as fast as TUX but in user space

2001-04-29 Thread dean gaudet
On Sun, 29 Apr 2001, Fabio Riccardi wrote: > I can disable header caching and see what happens, I'll add an option > for this in the next X15 release. heh, well to be honest, i'd put the (permanent) caching of the Date header into the very slimy, benchmark-only trick category. (right up there

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Andrea Arcangeli
On Sun, Apr 29, 2001 at 04:18:27PM -0400, Gregory Maxwell wrote: > having both the code and a comprehensive jump-table might become tough in a In the x86-64 implementation there's no jump table. The original design had a jump table but Peter raised the issue that indirect jumps are very costly

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Andrea Arcangeli
On Sun, Apr 29, 2001 at 09:38:04PM +0200, Jamie Lokier wrote: > Fwiw, modern x86 has global TLB entries too. my x86-64 implementation is marking the tlb entry global of course (so it's not flushed during context switch): #define __PAGE_KERNEL_VSYSCALL \ (_PAGE_PRESENT | _PAGE_USER |

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Richard Gooch
H. Peter Anvin writes: > The thing that made me say we discussed this last month was > Richard's comment that it had already been implemented (which it > has, by Andrea, for x86-64.) The idea of doing it for i386 has been > kicked around for Correction: I didn't say it had been implemented. I

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Richard Gooch
Gregory Maxwell writes: > On Sun, Apr 29, 2001 at 10:11:59PM +0200, Ingo Oeser wrote: > [snip] > > The point is: The code in that "magic page" that considers the > > tradeoff is KERNEL code, which is designed to care about such > > trade-offs for that machine. Glibc never knows this stuff and > >

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Richard Gooch
Ingo Oeser writes: > On Sun, Apr 29, 2001 at 12:48:06PM -0600, Richard Gooch wrote: > > Ingo Oeser writes: > > > There we have 10x faster memmove/memcpy/bzero for 1K blocks > > > granularity (== alignment is 1K and size is multiple of 1K), that > > > is done by the memory controller. > > This

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Jim Gettys
> > Short summary: depending on how much you were talking general idea versus > specifics, you can go arbitrarily far back (I wouldn't be surprised if > shared memory techniques were used regularly before memory protection.) > > Fair? Very fair. > > Not to pick on you or anyone else, but it

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread H. Peter Anvin
Jim Gettys wrote: > > The "put the time into a magic location in shared memory" goes back... > Short summary: depending on how much you were talking general idea versus specifics, you can go arbitrarily far back (I wouldn't be surprised if shared memory techniques were used regularly before

Re: X15 alpha release: as fast as TUX but in user space

2001-04-29 Thread Fabio Riccardi
I can disable header caching and see what happens, I'll add an option for this in the next X15 release. Nevertheless I don't know how much this is interesting in real life, since on the internet most static pages are cached on proxies. I agree that the RFC asks for a date for the original

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Jim Gettys
The "put the time into a magic location in shared memory" goes back, as far as I know, to Bob Scheifler or myself for the X Window System, sometime around 1984 or 1985: we put it into a page of shared memory where we used a circular buffer scheme to put input events (keyboard/mice), so that we

Re: X15 alpha release: as fast as TUX but in user space

2001-04-29 Thread Fabio Riccardi
Linux 2.4 is surely one of the most advanced OSs ever happened, especially from the optimization point of view and for the admirable economy of concepts on which it lies. I definitively hope that X15 helps reinforcing the success to this amazing system. TUX has definitively been my performance

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Arjan van de Ven
In article <[EMAIL PROTECTED]> you wrote: > Yes, but we currently have more than 10K cycles for doing > memset of a page. make that 3800 or so. (700 Mhz AMD Duron) - To unsubscribe from this list: send the line "unsubscribe linux-kernel" in the body of a message to [EMAIL PROTECTED] More

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread H. Peter Anvin
Followup to: <[EMAIL PROTECTED]> By author:dean gaudet <[EMAIL PROTECTED]> In newsgroup: linux.dev.kernel > > On Sun, 29 Apr 2001, Jeff Garzik wrote: > > > "H. Peter Anvin" wrote: > > > We discussed this at the Summit, not a year or two ago. x86-64 has > > > it, and it wouldn't be too bad

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Gregory Maxwell
On Sun, Apr 29, 2001 at 10:11:59PM +0200, Ingo Oeser wrote: [snip] > The point is: The code in that "magic page" that considers the > tradeoff is KERNEL code, which is designed to care about such > trade-offs for that machine. Glibc never knows this stuff and > shouldn't, because it is already

Re: X15 alpha release: as fast as TUX but in user space (fwd)

2001-04-29 Thread Ingo Oeser
On Sun, Apr 29, 2001 at 12:48:06PM -0600, Richard Gooch wrote: > Ingo Oeser writes: > > There we have 10x faster memmove/memcpy/bzero for 1K blocks > > granularity (== alignment is 1K and size is multiple of 1K), that > > is done by the memory controller. > This sounds different to me. Using the

  1   2   >