Hi again.
In
http://book.realworldhaskell.org/read/concurrent-and-multicore-programming.html#id676390
there is a map reduce based log parser.
I have written an alternative version:
http://paste.pocoo.org/show/85699/
but, with a file of 315 MB, I have [1]:
1) map reduce implementation, non
manlio_perillo:
Hi again.
In
http://book.realworldhaskell.org/read/concurrent-and-multicore-programming.html#id676390
there is a map reduce based log parser.
I have written an alternative version:
http://paste.pocoo.org/show/85699/
but, with a file of 315 MB, I have [1]:
1) map
Hello Don,
Friday, September 19, 2008, 9:12:43 PM, you wrote:
It is possible to implement a map reduce version that can handle gzipped
log files?
Using the zlib binding on hackage.haskell.org, you can stream multiple
zlib decompression threads with lazy bytestrings, and combine the
Don Stewart ha scritto:
manlio_perillo:
[...]
It is possible to implement a map reduce version that can handle gzipped
log files?
Using the zlib binding on hackage.haskell.org, you can stream multiple
zlib decompression threads with lazy bytestrings, and combine the
results.
This is a bit
On Fri, Sep 19, 2008 at 2:31 PM, Manlio Perillo [EMAIL PROTECTED]wrote:
By the way, this phrase:
We allow multiple threads to read different chunks at once by supplying
each one with a distinct file handle, all reading the same file
here:
Bryan O'Sullivan ha scritto:
On Fri, Sep 19, 2008 at 2:31 PM, Manlio Perillo
[EMAIL PROTECTED] mailto:[EMAIL PROTECTED] wrote:
By the way, this phrase:
We allow multiple threads to read different chunks at once by
supplying each one with a distinct file handle, all reading the
