X-Lemon-X opened a new pull request, #47424:
URL: https://github.com/apache/arrow/pull/47424
Rationale for this change
Lack of multi threading inputs support (batches were incoming not in
order if they were ordered) with nodes like ScalarAggregateNode and GroupByNode
previously resolved by disabling multi threading when using them.
Lack of ordering information on output of nodes ScalarAggregateNode and
GroupByNode when input was ordered.
What changes are included in this PR?
- added sequencer to input of ScalarAggregateNode and GroupByNode, (enables
only it self when input is ordered).
- added support for propagate ordering to ScalarAggregateNode and
GroupByNode.
- added BackPressure support when using Segmented keys.
Are these changes tested?
Yes
Are there any user-facing changes?
Yes. Users of those node must assert ordering on input where apropriate.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
