alamb commented on issue #94: URL: https://github.com/apache/arrow-datafusion/issues/94#issuecomment-1209286998
Hi @OscarTHZhang Thanks for commenting on this ticket. > I think we can divide the micro-bench into 2 types (as described above) I think the core goal for the ticket is to ensure the vast majority of the time is spent doing the operation rather than reading data. It might make sense to go through existing benchmarks and try to see what coverage we already have End to end benchmarks: https://github.com/apache/arrow-datafusion/tree/master/benchmarks more micro level benchmarks: https://github.com/apache/arrow-datafusion/tree/master/datafusion/core/benches There are already some benchmarks that appear to be *Targeted SQL* that you describe, for example https://github.com/apache/arrow-datafusion/blob/master/datafusion/core/benches/sql_planner.rs and https://github.com/apache/arrow-datafusion/blob/master/datafusion/core/benches/aggregate_query_sql.rs There are also some benchmarks for operators that are used as part of other operations, such as https://github.com/apache/arrow-datafusion/blob/master/datafusion/core/benches/merge.rs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
