yashmayya opened a new pull request, #17395: URL: https://github.com/apache/pinot/pull/17395
- Adds a new window option query hint `is_partitioned_by_window_keys` that can be used to force pre-partitioned exchanges for window functions in order to avoid data shuffle when we know that the input is already partitioned by the window's partition keys. - In most scenarios where the input is a table that is explicitly partitioned by the window's partition keys, we can use the `/*+ tableOptions(partition_key='...', partition_size='...') */` hint on the table scan so that the planner can automatically determine that the partitioning matches and the two stages should be colocated. However, in certain scenarios like implicit partitioning and also for debugging / iterating on queries, this new hint to force enable or disable the pre-partitioned exchanges can be useful. - Note that no tests are added here, because window hints are currently broken in Calcite (https://issues.apache.org/jira/browse/CALCITE-7338). So the functionality introduced in this PR depends on a fix for the linked Calcite issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
