jacques-n commented on pull request #10934: URL: https://github.com/apache/arrow/pull/10934#issuecomment-906810077
Additional comments: given this interest in targeting physical engines, it is weird that we are missing common physical operations like HashJoin, MergeJoin, HashAggregate, StreamingAggregate, TopN (order + limit operator), as well as a bunch related to RedistributeSend, OrderedRedistribute, UnorderedReception, OrderedReception, etc. I also think we need to go to each operation and declare the following: - Properties each operation maintains. (e.g. if you have Read > Sort > Filter > Write, is the write expected to be sorted?) - The order of the output fields/columns. For example, Join (A, B), Project(a+b, c+d), etc. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
