Re: [Haskell-cafe] Stream processing

2013-05-12 Thread Conrad Parker
On 11 May 2013 19:24, Ertugrul Söylemez wrote: > > However, my real question hasn't been answered so far. Is my > formulation of the stream processing problem accurate/complete? > Yes, you've summarized the commonly asked questions well. Perhaps you could make a wiki page which lists out these q

Re: [Haskell-cafe] Stream processing

2013-05-11 Thread Ertugrul Söylemez
Michael Snoyman wrote: > In conduit, this use case is addressed by connect-and-resume, which > essentially allows you to escape the inversion of control normally > introduced by the conduit pattern. Indeed, but this isn't even an extra feature in my case. It follows naturally from the automaton

Re: [Haskell-cafe] Stream processing

2013-05-11 Thread Gabriel Gonzalez
On 05/11/2013 11:04 AM, Michael Snoyman wrote: It's quite old at this point, but you may be interested in reading the initial motivations for creating conduit when the iteratee pattern (and enumerator library in particular) already existed: https://github.com/snoyberg/conduit/blob/master/READM

Re: [Haskell-cafe] Stream processing

2013-05-11 Thread Michael Snoyman
It's quite old at this point, but you may be interested in reading the initial motivations for creating conduit when the iteratee pattern (and enumerator library in particular) already existed: https://github.com/snoyberg/conduit/blob/master/README.md#general-goal I would say the only real compon

Re: [Haskell-cafe] Stream processing

2013-05-11 Thread Ertugrul Söylemez
o...@okmij.org wrote: > I'm a bit curious > > * be reliable in the presence of async exceptions (solved by > > conduit, pipes-safe), > > > > * hold on to resources only as long as necessary (solved by conduit > > and to some degree by pipes-safe), > > Are you aware of > http://okmij.org/ft

[Haskell-cafe] Stream processing

2013-05-10 Thread oleg
I'm a bit curious > * be reliable in the presence of async exceptions (solved by conduit, > pipes-safe), > > * hold on to resources only as long as necessary (solved by conduit > and to some degree by pipes-safe), Are you aware of http://okmij.org/ftp/Streams.html#regions wh

Re: [Haskell-cafe] Stream Processing

2013-05-10 Thread Gabriel Gonzalez
As far as I can tell, the only thing on that list not solved currently by `pipes` is leftovers, but I will be releasing that very soon. Hello everybody, I'm trying to formulate the stream processing problem, which doesn't seem to be solved fully by the currently existing patterns. I'm experimen

[Haskell-cafe] Stream processing

2013-05-10 Thread Ertugrul Söylemez
Hello everybody, I'm trying to formulate the stream processing problem, which doesn't seem to be solved fully by the currently existing patterns. I'm experimenting with a new idea, but I want to make sure that I don't miss any defining features of the problem, so here is my list. A stream proces