Re: [Chicken-hackers] mmap

2014-07-11 Thread Christian Kellermann
Felix Winkelmann felix.winkelm...@bevuta.com writes: From: Andy Bennett andy...@ashurst.eu.org Subject: mmap (was: Re: [Chicken-hackers] library unit restructuring) Date: Wed, 09 Jul 2014 14:56:38 +0100 Hi, - memory-mapped-files Without wishing to hijack the entire thread, as an

Re: [Chicken-hackers] mmap

2014-07-11 Thread John Cowan
Felix Winkelmann scripsit: Since nobody replied to this - I wouldn't know how this is done. I guess there is some UNIX arcana that allows one to implement non-blocking behaviour. As memory access will cause the blocking, we can probably not check for this via poll/select. Do you have any

Re: [Chicken-hackers] mmap

2014-07-11 Thread Andy Bennett
Hi, There is no way to do this. By messing around with Linux-specific mmap() flags, you can get Linux to prepage the whole file, paying the entire cost at once, Yes. These methods don't strike me as a very good way forward. I was thinking more along the lines of executing FFI calls in a

Re: [Chicken-hackers] mmap

2014-07-11 Thread Felix Winkelmann
From: Andy Bennett andy...@ashurst.eu.org Subject: Re: [Chicken-hackers] mmap Date: Fri, 11 Jul 2014 14:16:27 +0100 Hi, There is no way to do this. By messing around with Linux-specific mmap() flags, you can get Linux to prepage the whole file, paying the entire cost at once, Yes

Re: [Chicken-hackers] mmap

2014-07-11 Thread Andy Bennett
Hi, Andy, can you elaborate on the blocking scenario you are seeing? My particular scenario is that I'm using SQLite with a pool of many database connections and I'm seeing those connections use a lot of memory that could be shared by using the SQLites mmap functionality rather than it's

[Chicken-hackers] mmap (was: Re: library unit restructuring)

2014-07-10 Thread Andy Bennett
I'm resending this as I don't appear to have received it back from the list?? Original Message Subject: mmap (was: Re: [Chicken-hackers] library unit restructuring) Date: Wed, 09 Jul 2014 14:56:38 +0100 From: Andy Bennett andy...@ashurst.eu.org To: Felix Winkelmann

[Chicken-hackers] mmap (was: Re: library unit restructuring)

2014-07-10 Thread Andy Bennett
Hi, - memory-mapped-files Without wishing to hijack the entire thread, as an aside, is there any way of making memory mapped files play nicely with the CHICKEN scheduler and threading model? It's possible for memory mapped files to cause a page fault which will then wait for I/O and, as I