songwdfu opened a new pull request, #16195:
URL: https://github.com/apache/pinot/pull/16195

   Previously, the `SelectionDataTableReducer` is blind to server's output 
sorting. It performs redundant sort when merging multiple dataTables.
   
   This PR introduces a metadata of block sorting. When a SelectionResultBlock 
is created, the `orderByExpressions` metadata is supplied if it is sorted. The 
value of this metadata is simply the string representation of the orderby 
expressions.
   
   Then in SelectionOperatorService 
[here](https://github.com/apache/pinot/compare/master...songwdfu:sort-merge-server-results?expand=1#:~:text=if%20(String,%2C%20dataTable)%3B),
 the broker checks for this metadata and perform mergeWithOrdering on sorted 
output. If the server output is not sorted, the broker sorts it as before.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to