gene-bordegaray commented on PR #23854: URL: https://github.com/apache/datafusion/pull/23854#issuecomment-5253827208
> > Soemthing I have been thinking about. What would you guys think of creating a range partitioned or partitioned benchmarks similar to tpch or clickbench to be able to track progress on these more easily? > > Yes I think that would be a great idea. > > One thing you could perhaps do is use the TPCH queries but repartition the inputs by time (similar how it is done for tpch_sort) @alamb ok great. I was planning on creating a new wave of work for range partitioning like optimizations and benchmarks now that the base is in and this will definitely be on the list. I will create issues for these things and can start some discussions there 👍 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
