[ 
https://issues.apache.org/jira/browse/COUCHDB-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603747#comment-14603747
 ] 

ASF GitHub Bot commented on COUCHDB-2724:
-----------------------------------------

GitHub user kocolosk opened a pull request:

    https://github.com/apache/couchdb-fabric/pull/22

    Execute a callback at end of each traversal

    We add this notification before entering a (potentially long) wait for new 
DB updates so that the client can choose to finalize any processing it might 
have been doing on earlier updates. The specific use case in
    apache/couchdb-chttpd#38 is to flush the client's internal buffer in a 
timely manner.
    
    COUCHDB-2724

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/couchdb-fabric 2724-chunked-buffering

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/couchdb-fabric/pull/22.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #22
    
----
commit cede5aa3a265f027b89b93f029b32543f044a86a
Author: Adam Kocoloski <[email protected]>
Date:   2015-06-24T18:05:20Z

    Execute a callback at end of each traversal
    
    We add this notification before entering a (potentially long) wait for
    new DB updates so that the client can choose to finalize any processing
    it might have been doing on earlier updates. The specific use case in
    chttpd is to flush the client's internal buffer in a timely manner.
    
    COUCHDB-2724

----


> Batch rows in streaming responses to improve throughput
> -------------------------------------------------------
>
>                 Key: COUCHDB-2724
>                 URL: https://issues.apache.org/jira/browse/COUCHDB-2724
>             Project: CouchDB
>          Issue Type: Improvement
>      Security Level: public(Regular issues) 
>          Components: Database Core, HTTP Interface
>            Reporter: Adam Kocoloski
>            Assignee: Adam Kocoloski
>
> [~tonysun83] showed me some profiling of the {{_changes}} feed which 
> indicated that the coordinator process was spending about 1/3 of its time 
> executing inside {{send_delayed_chunk}}. We can reduce the number of 
> invocations of this function by buffering individual rows until we reach a 
> (configurable) threshold for sending the data out the wire.
> We'll of course want to be careful about continuous feeds; if we're in the 
> "slow drip" portion of the feed we'll obviously want to emit right away 
> instead of adding latency unnecessarily.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to