Re: [Chicken-users] using mmap files as strings?

2010-11-03 Thread Peter Bex
On Wed, Nov 03, 2010 at 01:19:17PM +0100, Jörg F. Wittenberger wrote: > > That would be very annoying. > > sure in a way. > > mut not much worse that having unsafe libraries for the same purpose > (speed) We've done away with libuchicken, and I don't miss it :) Cheers, Peter -- http://sjamaan.

Re: [Chicken-users] using mmap files as strings?

2010-11-03 Thread F. Wittenberger
Am Mittwoch, den 03.11.2010, 12:53 +0100 schrieb Peter Bex: > On Wed, Nov 03, 2010 at 12:36:18PM +0100, Jörg F. Wittenberger wrote: > > I wonder if it would be feasible to to support 'heavy strings' by a > > compile time option. At worst this could imply that there would be > > 2 .so files per egg

Re: [Chicken-users] using mmap files as strings?

2010-11-03 Thread Peter Bex
On Wed, Nov 03, 2010 at 12:36:18PM +0100, Jörg F. Wittenberger wrote: > I wonder if it would be feasible to to support 'heavy strings' by a > compile time option. At worst this could imply that there would be > 2 .so files per egg, one for cheap strings and one for heavy strings. That would be ve

Re: [Chicken-users] using mmap files as strings?

2010-11-03 Thread F. Wittenberger
Am Dienstag, den 02.11.2010, 22:17 + schrieb Alaric Snell-Pym: > On 11/02/10 14:53, Felix wrote: > > From: Alaric Snell-Pym > > Subject: Re: [Chicken-users] using mmap files as strings? > > Date: Tue, 02 Nov 2010 13:22:01 + > > > >> Then have blobs, stri

Re: [Chicken-users] using mmap files as strings?

2010-11-02 Thread Alaric Snell-Pym
On 11/02/10 14:53, Felix wrote: From: Alaric Snell-Pym Subject: Re: [Chicken-users] using mmap files as strings? Date: Tue, 02 Nov 2010 13:22:01 + Then have blobs, strings, srfi-4 vectors, and friends all have the option of being a reference to one of the above with an offset and limit, so

Re: [Chicken-users] using mmap files as strings?

2010-11-02 Thread F. Wittenberger
Am Dienstag, den 02.11.2010, 13:22 + schrieb Alaric Snell-Pym: > On 10/27/10 13:02, Jörg F. Wittenberger wrote: > > Another application would be shared substrings. Or the combination of > > both. Example: feed a file content to a port, formatted as HTTP chunked > > encoding. A shared substri

Re: [Chicken-users] using mmap files as strings?

2010-11-02 Thread Felix
From: Alaric Snell-Pym Subject: Re: [Chicken-users] using mmap files as strings? Date: Tue, 02 Nov 2010 13:22:01 + > Then have blobs, strings, srfi-4 vectors, and friends all have the > option of being a reference to one of the above with an offset and > limit, so they can be v

Re: [Chicken-users] using mmap files as strings?

2010-11-02 Thread Alaric Snell-Pym
On 10/27/10 13:02, Jörg F. Wittenberger wrote: Another application would be shared substrings. Or the combination of both. Example: feed a file content to a port, formatted as HTTP chunked encoding. A shared substring pointing right into the mmaped file could save all copying. The expense wou

Re: [Chicken-users] using mmap files as strings?

2010-10-27 Thread F. Wittenberger
Am Mittwoch, den 27.10.2010, 09:53 -0700 schrieb Kon Lovett: > > I recently noticed that several of the ##sys# prefixes have been > > eliminated recently (elsewhere in the code). > > ?. Sorry, no traces left. Just noticed on my way. > At worst it might be a case of making sure the overwrite > >

Re: [Chicken-users] using mmap files as strings?

2010-10-27 Thread F. Wittenberger
Am Donnerstag, den 21.10.2010, 15:01 -0600 schrieb Alan Post: > So far so good, that is what I would expect. I'd like to work with > an mmap buffer like a string. Is it possible to create an object > that will treat the mmap area as a string that I can run regular > string operations on without c

Re: [Chicken-users] using mmap files as strings?

2010-10-24 Thread Felix
From: Alan Post Subject: Re: [Chicken-users] using mmap files as strings? Date: Sat, 23 Oct 2010 20:21:30 -0600 > I've summarized this information and created an mmap example on the > wiki: > > http://wiki.call-cc.org/manual/Unit%20posix#memory-mapped-io-example Examples a

Re: [Chicken-users] using mmap files as strings?

2010-10-23 Thread Alan Post
I've summarized this information and created an mmap example on the wiki: http://wiki.call-cc.org/manual/Unit%20posix#memory-mapped-io-example I'm afraid to ask, for being told to do it myself, but the ability to edit single docment sections rather than whole documents would be very nice. -Ala

Re: [Chicken-users] using mmap files as strings?

2010-10-23 Thread Jim Ursetto
On Sat, Oct 23, 2010 at 05:04, Peter Bex wrote: > On Fri, Oct 22, 2010 at 05:58:02PM -0600, Alan Post wrote: >> This is excellent, I've learned a lot more about how all of this >> works together now. >> >> What method would I use to convert a pointer and a length to a >> string?  Even though I'm c

Re: [Chicken-users] using mmap files as strings?

2010-10-23 Thread Peter Bex
On Fri, Oct 22, 2010 at 05:58:02PM -0600, Alan Post wrote: > This is excellent, I've learned a lot more about how all of this > works together now. > > What method would I use to convert a pointer and a length to a > string? Even though I'm copying the memory, how do I do it at > all? Something

Re: [Chicken-users] using mmap files as strings?

2010-10-22 Thread Alex Shinn
Peter Bex writes: > On Fri, Oct 22, 2010 at 06:20:01AM -0400, Felix wrote: >> >> > I'm specifically interested in running regular >> > expressions across the mmap space. >> >> irregex provides a "chunk" based API, perhaps it is possible to >> define chunks over the data represented by the mmap

Re: [Chicken-users] using mmap files as strings?

2010-10-22 Thread Alan Post
On Fri, Oct 22, 2010 at 06:20:01AM -0400, Felix wrote: > From: Alan Post > Subject: [Chicken-users] using mmap files as strings? > Date: Thu, 21 Oct 2010 15:01:10 -0600 > > > I have the following file: > > > > <++> mmap.scm > > (use posix) > &

Re: [Chicken-users] using mmap files as strings?

2010-10-22 Thread Peter Bex
On Fri, Oct 22, 2010 at 06:20:01AM -0400, Felix wrote: > I can't think of a way in the moment. Strings require a header-word, > and the data pointed to by a pointer doesn't have that header, so it > isn't possible to "sneak in" a pointer as a replacement of a string. > > > I'm > > specifically int

Re: [Chicken-users] using mmap files as strings?

2010-10-22 Thread Felix
From: Alan Post Subject: [Chicken-users] using mmap files as strings? Date: Thu, 21 Oct 2010 15:01:10 -0600 > I have the following file: > > <++> mmap.scm > (use posix) > (use lolevel) > > (let* ((fd (file-open "mmap.scm" (+ open/rdonly open/non

[Chicken-users] using mmap files as strings?

2010-10-21 Thread Alan Post
I have the following file: <++> mmap.scm (use posix) (use lolevel) (let* ((fd (file-open "mmap.scm" (+ open/rdonly open/nonblock))) (size (file-size fd)) (mmap (map-file-to-memory #f size prot/read (+ map/file map/shared) fd)) (buf (memory-mapped-file-pointer mmap))) (writ