Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-12 Thread Christian Theune
Hi, Am Samstag, den 10.03.2007, 07:36 +0100 schrieb Dieter Maurer: Christian Theune wrote at 2007-3-7 22:05 +0100: ... If 5 seconds are spend in the application thread to untangle mime data which has nothing application-specific about it and then only 100ms or so in the application itself,

Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-09 Thread Dieter Maurer
Christian Theune wrote at 2007-3-7 22:05 +0100: ... If 5 seconds are spend in the application thread to untangle mime data which has nothing application-specific about it and then only 100ms or so in the application itself, I'd say there is a major overhead problem. But if the IO thread spends 5

Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-08 Thread Stefan H. Holek
This use-case is already covered by implementing ZPublisher.Iterators.IStreamIterator. You can return a stream iterator to Medusa and free the worker thread immediately. Stefan On 8. Mär 2007, at 05:40, Sidnei da Silva wrote: Hopefully something similar could be done for files being sent

Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-08 Thread Christian Theune
Hi, Am Donnerstag, den 08.03.2007, 01:40 -0300 schrieb Sidnei da Silva: On 3/7/07, Christian Theune [EMAIL PROTECTED] wrote: Right. This optimization is about leveraging the fact that in many situations the upstream bandwith is *much* lower than the IO bandwith to the disk. Another

Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-08 Thread Sidnei da Silva
On 3/8/07, Christian Theune [EMAIL PROTECTED] wrote: I really wonder whether that's necessary. Yeah, after re-reading Dieter's reply, I sort of wonder how big of a deal that is. Actually. I'll take a look around the other web frameworks and check how they do their REQUEST processing. Maybe I

[Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-07 Thread Christian Theune
I was looking through some publisher code and found that the `process_request` method which takes the request body as a file-like object and processes it as a FieldStorage happens within the application thread. This would be better if it happened beforehand because it can takes up time while a

Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-07 Thread Dieter Maurer
Christian Theune wrote at 2007-3-7 20:09 +0100: I was looking through some publisher code and found that the `process_request` method which takes the request body as a file-like object and processes it as a FieldStorage happens within the application thread. This would be better if it happened

Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-07 Thread Christian Theune
Hi, Am Mittwoch, den 07.03.2007, 21:48 +0100 schrieb Dieter Maurer: Christian Theune wrote at 2007-3-7 20:09 +0100: I was looking through some publisher code and found that the `process_request` method which takes the request body as a file-like object and processes it as a FieldStorage

Re: [Zope-dev] Early processing of request body (was: Proposal for optimized Blob handling)

2007-03-07 Thread Sidnei da Silva
On 3/7/07, Christian Theune [EMAIL PROTECTED] wrote: Right. This optimization is about leveraging the fact that in many situations the upstream bandwith is *much* lower than the IO bandwith to the disk. Another condition that I have (and I think this is the general pattern) is that application