Konstantin Orlov created IGNITE-18580:
-----------------------------------------

             Summary: Sql. Redesign the Exchange to use a pull-based approach
                 Key: IGNITE-18580
                 URL: https://issues.apache.org/jira/browse/IGNITE-18580
             Project: Ignite
          Issue Type: Improvement
          Components: sql
            Reporter: Konstantin Orlov


Currently, Exchange uses push-based strategy to exchange batches between 
different fragments. Such an approach works well for cases of scanning the 
whole table, but may cause an unnecessary overhead in cases, where the smaller 
amount of rows is expected. For example, for query "SELECT * FROM table LIMIT 
4", IO_BATCH_SIZE * IO_BATCH_COUNT * NODE_COUNT rows will be sent over network 
in push-based approach, whereas only 4 * NODE_COUNT will be sent in pull-based.

Let's redesign Exchange to gain more control over amount of data that is sent 
over the network. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to