pitrou commented on PR #41761:
URL: https://github.com/apache/arrow/pull/41761#issuecomment-2124632845
Besides changing the benchmark names, I've fixed a bug where the benchmark
was writing too many rows. Updated benchmark numbers:
```
------------------------------------------------------------------------------------------------------------------------
Benchmark Time
CPU Iterations UserCounters...
------------------------------------------------------------------------------------------------------------------------
WriteFileMetadataAndData/num_columns:1/num_row_groups:1 11753 ns
11751 ns 60000 data_size=54 file_size=290
items_per_second=85.0979k/s
WriteFileMetadataAndData/num_columns:1/num_row_groups:100 826599 ns
826369 ns 845 data_size=5.4k file_size=20.486k
items_per_second=1.21011k/s
WriteFileMetadataAndData/num_columns:1/num_row_groups:1000 8125279 ns
8123486 ns 86 data_size=54k file_size=207.687k
items_per_second=123.1/s
WriteFileMetadataAndData/num_columns:10/num_row_groups:1 100357 ns
100329 ns 6982 data_size=540 file_size=2.11k
items_per_second=9.96719k/s
WriteFileMetadataAndData/num_columns:10/num_row_groups:100 7913763 ns
7911870 ns 89 data_size=54k file_size=193.673k
items_per_second=126.392/s
WriteFileMetadataAndData/num_columns:10/num_row_groups:1000 80283750 ns
80259596 ns 8 data_size=540k file_size=1.94392M
items_per_second=12.4596/s
WriteFileMetadataAndData/num_columns:100/num_row_groups:1 937374 ns
937047 ns 745 data_size=5.4k file_size=20.694k
items_per_second=1.06718k/s
WriteFileMetadataAndData/num_columns:100/num_row_groups:100 78617577 ns
78590896 ns 9 data_size=540k file_size=1.94729M
items_per_second=12.7241/s
WriteFileMetadataAndData/num_columns:100/num_row_groups:1000 847927859 ns
847245720 ns 1 data_size=5.4M file_size=19.7673M
items_per_second=1.1803/s
WriteFileMetadataAndData/num_columns:1000/num_row_groups:1 9169263 ns
9167280 ns 76 data_size=54k file_size=211.499k
items_per_second=109.084/s
WriteFileMetadataAndData/num_columns:1000/num_row_groups:100 826783518 ns
826541970 ns 1 data_size=5.4M file_size=19.9623M
items_per_second=1.20986/s
WriteFileMetadataAndData/num_columns:10000/num_row_groups:1 97516452 ns
97475073 ns 7 data_size=540k file_size=2.15317M
items_per_second=10.259/s
WriteFileMetadataAndData/num_columns:10000/num_row_groups:100 8294650136 ns
8292024551 ns 1 data_size=54M file_size=201.916M
items_per_second=0.120598/s
ReadFileMetadata/num_columns:1/num_row_groups:1 3669 ns
3668 ns 190349 data_size=54 file_size=290
items_per_second=272.625k/s
ReadFileMetadata/num_columns:1/num_row_groups:100 84829 ns
84814 ns 8322 data_size=5.4k file_size=20.486k
items_per_second=11.7905k/s
ReadFileMetadata/num_columns:1/num_row_groups:1000 814708 ns
814559 ns 858 data_size=54k file_size=207.687k
items_per_second=1.22766k/s
ReadFileMetadata/num_columns:10/num_row_groups:1 19247 ns
19243 ns 36787 data_size=540 file_size=2.11k
items_per_second=51.9679k/s
ReadFileMetadata/num_columns:10/num_row_groups:100 690304 ns
690181 ns 1006 data_size=54k file_size=193.673k
items_per_second=1.4489k/s
ReadFileMetadata/num_columns:10/num_row_groups:1000 6723370 ns
6721934 ns 105 data_size=540k file_size=1.94392M
items_per_second=148.767/s
ReadFileMetadata/num_columns:100/num_row_groups:1 171196 ns
171161 ns 4077 data_size=5.4k file_size=20.694k
items_per_second=5.84244k/s
ReadFileMetadata/num_columns:100/num_row_groups:100 6585073 ns
6583501 ns 106 data_size=540k file_size=1.94729M
items_per_second=151.895/s
ReadFileMetadata/num_columns:100/num_row_groups:1000 75581479 ns
75544415 ns 9 data_size=5.4M file_size=19.7673M
items_per_second=13.2372/s
ReadFileMetadata/num_columns:1000/num_row_groups:1 1631872 ns
1631517 ns 435 data_size=54k file_size=211.499k
items_per_second=612.926/s
ReadFileMetadata/num_columns:1000/num_row_groups:100 75144953 ns
75104316 ns 9 data_size=5.4M file_size=19.9623M
items_per_second=13.3148/s
ReadFileMetadata/num_columns:10000/num_row_groups:1 16866177 ns
16857406 ns 41 data_size=540k file_size=2.15317M
items_per_second=59.3211/s
ReadFileMetadata/num_columns:10000/num_row_groups:100 780744719 ns
779370723 ns 1 data_size=54M file_size=201.916M
items_per_second=1.28309/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
