houqp opened a new pull request, #10693:
URL: https://github.com/apache/datafusion/pull/10693

   ## Rationale for this change
   
   When applicable, table partition listing can be optimized by deriving a 
listing prefix based on literals provided in the filter predicates.
   
   For a selected large test table, this change reduces query time from minutes 
to 200ms.
   
   ## What changes are included in this PR?
   
   * stacked on top of https://github.com/apache/datafusion/pull/10691.
   * added a `evaluate_partition_prefix` function to derive a listing prefix 
based on filter predicates and table partitions.
   * `list_partitions` extended to take an optional prefix argument.
   
   ## Are these changes tested?
   
   Tested with unit tests.
   
   ## Are there any user-facing changes?
   
   No
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to