rok commented on issue #52359: URL: https://github.com/apache/arrow/issues/52359#issuecomment-6086451067
To be honest I thought we did not have PyArrow benchmarks, however with some (🤖) searching: arctosalliance/arrow-benchmarks-ci: - Machine filters: https://github.com/arctosalliance/arrow-benchmarks-ci/blob/main/config.py#L85 - Benchmarkable repo pointer: https://github.com/arctosalliance/arrow-benchmarks-ci/blob/main/buildkite/benchmark/run.py#L32 Group list with commands: - https://github.com/arctosalliance/benchmarks/blob/main/benchmarks.json Benchmark implementations (arctosalliance/benchmarks): - csv-read: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/csv_benchmark.py - dataframe-to-table: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/dataframe_to_table_benchmark.py - dataset-filter: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/dataset_filter_benchmark.py - dataset-read: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/dataset_read_benchmark.py - dataset-select: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/dataset_select_benchmark.py - dataset-selectivity: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/dataset_selectivity_benchmark.py - dataset-serialize: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/dataset_serialize_benchmark.py - file-read and file-write: https://github.com/arctosalliance/benchmarks/blob/main/benchmarks/file_benchmark.py Results can be seen here: - csv-read: https://conbench.arrow-dev.org/c-benchmarks/csv-read - dataframe-to-table: https://conbench.arrow-dev.org/c-benchmarks/dataframe-to-table - dataset-filter: https://conbench.arrow-dev.org/c-benchmarks/dataset-filter - dataset-read: https://conbench.arrow-dev.org/c-benchmarks/dataset-read - dataset-select: https://conbench.arrow-dev.org/c-benchmarks/dataset-select - dataset-selectivity: https://conbench.arrow-dev.org/c-benchmarks/dataset-selectivity - dataset-serialize: https://conbench.arrow-dev.org/c-benchmarks/dataset-serialize - file-read: https://conbench.arrow-dev.org/c-benchmarks/file-read - file-write: https://conbench.arrow-dev.org/c-benchmarks/file-write - recursive-get-file-info: https://conbench.arrow-dev.org/c-benchmarks/recursive-get-file-info - wide-dataframe: https://conbench.arrow-dev.org/c-benchmarks/wide-dataframe -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
