adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5337404259
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5336015224) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing 177bde8225b5ffa49c19f3b66109ae3091ef3114 (177bde8225b5ffa49c19f3b66109ae3091ef3114) to 177bde8225b5ffa49c19f3b66109ae3091ef3114 [diff](https://github.com/apache/arrow-rs/compare/177bde8225b5ffa49c19f3b66109ae3091ef3114..177bde8225b5ffa49c19f3b66109ae3091ef3114) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "177bde8225b5ffa49c19f3b66109ae3091ef3114" changed: ref: "177bde8225b5ffa49c19f3b66109ae3091ef3114" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.02 13.0±0.09ms 19.3 MB/sec 1.00 12.7±0.04ms 19.7 MB/sec bool/cdc 1.02 15.8±0.08ms 15.8 MB/sec 1.00 15.5±0.04ms 16.1 MB/sec bool/default 1.03 10.8±0.08ms 23.1 MB/sec 1.00 10.6±0.03ms 23.7 MB/sec bool/parquet_2 1.02 13.8±0.08ms 18.1 MB/sec 1.00 13.5±0.05ms 18.5 MB/sec bool/zstd 1.03 11.4±0.08ms 22.0 MB/sec 1.00 11.1±0.03ms 22.6 MB/sec bool/zstd_parquet_2 1.02 14.2±0.10ms 17.6 MB/sec 1.00 13.9±0.05ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.02ms 18.9 MB/sec 1.00 6.6±0.03ms 18.9 MB/sec bool_non_null/cdc 1.02 6.6±0.05ms 19.1 MB/sec 1.00 6.4±0.03ms 19.5 MB/sec bool_non_null/default 1.00 3.8±0.03ms 32.6 MB/sec 1.00 3.8±0.03ms 32.7 MB/sec bool_non_null/parquet_2 1.00 7.7±0.03ms 16.3 MB/sec 1.00 7.6±0.03ms 16.4 MB/sec bool_non_null/zstd 1.01 4.2±0.02ms 29.7 MB/sec 1.00 4.2±0.02ms 29.9 MB/sec bool_non_null/zstd_parquet_2 1.01 8.1±0.04ms 15.4 MB/sec 1.00 8.1±0.03ms 15.5 MB/sec bool_ree/bloom_filter 1.01 30.5±0.16ms 7.0 MB/sec 1.00 30.1±0.04ms 7.1 MB/sec bool_ree/cdc 1.01 31.7±0.14ms 6.7 MB/sec 1.00 31.5±0.11ms 6.8 MB/sec bool_ree/default 1.01 27.8±0.15ms 7.7 MB/sec 1.00 27.5±0.10ms 7.7 MB/sec bool_ree/parquet_2 1.01 29.2±0.16ms 7.3 MB/sec 1.00 28.8±0.07ms 7.4 MB/sec bool_ree/zstd 1.02 28.4±0.14ms 7.5 MB/sec 1.00 28.0±0.06ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.01 29.5±0.14ms 7.2 MB/sec 1.00 29.2±0.10ms 7.3 MB/sec decimal/bloom_filter 1.10 130.2±0.97ms 460.8 MB/sec 1.00 118.0±1.07ms 508.5 MB/sec decimal/cdc 1.00 102.0±0.59ms 588.0 MB/sec 1.00 101.7±1.49ms 589.7 MB/sec decimal/default 1.13 89.6±1.16ms 669.3 MB/sec 1.00 79.1±0.99ms 758.2 MB/sec decimal/parquet_2 1.05 187.5±2.01ms 320.1 MB/sec 1.00 177.9±1.24ms 337.3 MB/sec decimal/zstd 1.11 100.1±0.43ms 599.5 MB/sec 1.00 89.9±1.16ms 667.2 MB/sec decimal/zstd_parquet_2 1.05 206.8±1.60ms 290.1 MB/sec 1.00 197.8±2.06ms 303.3 MB/sec fixed_size_binary_ree/bloom_filter 1.02 60.2±0.37ms 16.7 MB/sec 1.00 59.1±0.27ms 17.0 MB/sec fixed_size_binary_ree/cdc 1.00 62.1±0.34ms 16.2 MB/sec 1.00 62.0±0.24ms 16.2 MB/sec fixed_size_binary_ree/default 1.02 52.7±0.21ms 19.1 MB/sec 1.00 51.7±0.24ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.02 68.3±0.36ms 14.7 MB/sec 1.00 67.2±0.31ms 15.0 MB/sec fixed_size_binary_ree/zstd 1.02 58.9±0.39ms 17.1 MB/sec 1.00 57.5±0.22ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.04 69.7±0.41ms 14.5 MB/sec 1.00 67.2±0.80ms 15.0 MB/sec float_with_nans/bloom_filter 1.00 83.4±0.49ms 167.8 MB/sec 1.00 83.3±0.55ms 168.1 MB/sec float_with_nans/cdc 1.02 72.3±0.34ms 193.6 MB/sec 1.00 70.8±0.19ms 197.7 MB/sec float_with_nans/default 1.00 64.4±0.24ms 217.3 MB/sec 1.00 64.6±0.27ms 216.9 MB/sec float_with_nans/parquet_2 1.01 82.0±0.30ms 170.8 MB/sec 1.00 80.9±1.00ms 173.1 MB/sec float_with_nans/zstd 1.01 102.8±0.34ms 136.2 MB/sec 1.00 101.9±0.99ms 137.4 MB/sec float_with_nans/zstd_parquet_2 1.01 119.2±0.33ms 117.4 MB/sec 1.00 117.7±0.22ms 118.9 MB/sec fsb/bloom_filter 1.02 8.9±0.10ms 1818.8 MB/sec 1.00 8.7±0.22ms 1846.9 MB/sec fsb/cdc 1.02 11.1±0.05ms 1457.1 MB/sec 1.00 10.8±0.07ms 1490.1 MB/sec fsb/default 1.00 7.4±0.07ms 2.1 GB/sec 1.00 7.4±0.11ms 2.1 GB/sec fsb/parquet_2 1.01 14.1±0.14ms 1146.5 MB/sec 1.00 13.9±0.23ms 1161.7 MB/sec fsb/zstd 1.00 9.9±0.07ms 1630.8 MB/sec 1.00 9.8±0.10ms 1638.6 MB/sec fsb/zstd_parquet_2 1.00 15.3±0.15ms 1052.8 MB/sec 1.00 15.4±0.29ms 1050.3 MB/sec int32_ree/bloom_filter 1.02 42.3±0.39ms 9.6 MB/sec 1.00 41.4±0.32ms 9.8 MB/sec int32_ree/cdc 1.01 41.0±0.15ms 9.9 MB/sec 1.00 40.8±0.10ms 10.0 MB/sec int32_ree/default 1.01 37.3±0.15ms 10.9 MB/sec 1.00 36.8±0.14ms 11.1 MB/sec int32_ree/parquet_2 1.01 37.3±0.14ms 10.9 MB/sec 1.00 36.9±0.11ms 11.0 MB/sec int32_ree/zstd 1.01 37.7±0.16ms 10.8 MB/sec 1.00 37.4±0.11ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.8±0.15ms 10.8 MB/sec 1.00 37.6±0.28ms 10.8 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.2±0.06ms 18.3 MB/sec 1.00 22.3±0.03ms 18.3 MB/sec int32_ree_95pct_null/cdc 1.00 24.1±0.06ms 16.9 MB/sec 1.00 24.1±0.07ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.7±0.02ms 18.7 MB/sec 1.00 21.8±0.10ms 18.7 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.7±0.04ms 18.7 MB/sec 1.00 21.7±0.04ms 18.7 MB/sec int32_ree_95pct_null/zstd 1.00 22.0±0.03ms 18.5 MB/sec 1.00 22.0±0.03ms 18.5 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.9±0.03ms 18.5 MB/sec 1.00 21.9±0.03ms 18.5 MB/sec large_string_distinct/delta_byte_array 1.01 82.6±1.69ms 3.0 GB/sec 1.00 81.9±3.30ms 3.1 GB/sec large_string_distinct/plain 1.00 65.5±1.29ms 3.8 GB/sec 1.02 66.8±2.89ms 3.7 GB/sec large_string_distinct_nullable/delta_byte_array 1.11 64.9±2.53ms 3.9 GB/sec 1.00 58.4±1.54ms 4.3 GB/sec large_string_non_null/bloom_filter 1.00 73.7±0.84ms 3.4 GB/sec 1.00 73.8±0.64ms 3.4 GB/sec large_string_non_null/cdc 1.01 246.0±1.64ms 1040.6 MB/sec 1.00 243.6±1.77ms 1051.1 MB/sec large_string_non_null/default 1.01 56.0±1.33ms 4.5 GB/sec 1.00 55.6±0.47ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 55.2±0.73ms 4.5 GB/sec 1.01 55.5±0.40ms 4.5 GB/sec large_string_non_null/zstd 1.00 54.9±0.46ms 4.6 GB/sec 1.01 55.5±0.52ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.2±0.58ms 4.5 GB/sec 1.01 55.7±1.93ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.00 123.5±2.75ms 2.0 GB/sec 1.14 141.3±12.60ms 1812.0 MB/sec large_string_shared_prefix/plain 1.00 102.8±2.51ms 2.4 GB/sec 1.29 132.2±8.74ms 1935.8 MB/sec large_string_shared_prefix_list/delta_byte_array 1.05 60.5±1.02ms 4.1 GB/sec 1.00 57.7±2.10ms 4.3 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 77.8±2.01ms 3.2 GB/sec 1.06 82.8±5.14ms 3.0 GB/sec large_string_shared_prefix_nullable/plain 1.00 72.4±1.38ms 3.5 GB/sec 1.02 73.8±3.80ms 3.4 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.01 61.5±1.62ms 2.0 GB/sec 1.00 61.1±3.64ms 2.0 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.06 78.9±1.83ms 3.2 GB/sec 1.00 74.5±3.57ms 3.4 GB/sec list_nested/bloom_filter 1.02 147.1±0.60ms 196.1 MB/sec 1.00 143.6±0.32ms 201.0 MB/sec list_nested/cdc 1.02 163.3±0.39ms 176.7 MB/sec 1.00 160.7±0.39ms 179.5 MB/sec list_nested/default 1.01 131.5±0.30ms 219.5 MB/sec 1.00 129.8±0.45ms 222.3 MB/sec list_nested/parquet_2 1.01 144.7±0.30ms 199.4 MB/sec 1.00 143.4±0.94ms 201.2 MB/sec list_nested/zstd 1.01 141.0±0.38ms 204.7 MB/sec 1.00 139.8±1.05ms 206.4 MB/sec list_nested/zstd_parquet_2 1.02 158.1±0.53ms 182.5 MB/sec 1.00 155.6±0.32ms 185.5 MB/sec list_primitive/bloom_filter 1.20 334.9±12.29ms 1628.3 MB/sec 1.00 280.1±1.91ms 1946.7 MB/sec list_primitive/cdc 1.07 338.7±13.68ms 1610.0 MB/sec 1.00 317.1±3.63ms 1719.6 MB/sec list_primitive/default 1.23 248.7±6.16ms 2.1 GB/sec 1.00 202.1±2.43ms 2.6 GB/sec list_primitive/parquet_2 1.16 257.3±5.52ms 2.1 GB/sec 1.00 222.0±0.67ms 2.4 GB/sec list_primitive/zstd 1.09 506.5±4.19ms 1076.8 MB/sec 1.00 465.4±4.36ms 1171.9 MB/sec list_primitive/zstd_parquet_2 1.07 479.0±8.38ms 1138.4 MB/sec 1.00 449.4±2.96ms 1213.6 MB/sec list_primitive_non_null/bloom_filter 1.23 474.8±33.41ms 1146.2 MB/sec 1.00 387.0±22.34ms 1406.3 MB/sec list_primitive_non_null/cdc 1.02 406.2±8.56ms 1339.8 MB/sec 1.00 397.6±12.03ms 1368.8 MB/sec list_primitive_non_null/default 1.22 301.7±21.19ms 1803.9 MB/sec 1.00 248.1±7.55ms 2.1 GB/sec list_primitive_non_null/parquet_2 1.00 274.4±19.18ms 1983.3 MB/sec 1.01 277.6±4.05ms 1960.9 MB/sec list_primitive_non_null/zstd 1.02 681.4±8.26ms 798.8 MB/sec 1.00 669.4±8.71ms 813.0 MB/sec list_primitive_non_null/zstd_parquet_2 1.05 693.8±23.84ms 784.5 MB/sec 1.00 662.8±6.49ms 821.1 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.03 13.3±0.07ms 2.7 GB/sec 1.00 12.9±0.31ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 25.1±0.10ms 1490.4 MB/sec 1.00 24.8±0.27ms 1505.4 MB/sec list_primitive_sparse_99pct_null/default 1.04 12.9±0.06ms 2.8 GB/sec 1.00 12.4±0.12ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.02 12.9±0.04ms 2.8 GB/sec 1.00 12.7±0.24ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.02 15.0±0.08ms 2.4 GB/sec 1.00 14.6±0.17ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.04 13.3±0.06ms 2.7 GB/sec 1.00 12.8±0.21ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.01 287.3±0.80ms 158.7 MB/sec 1.00 284.6±1.72ms 160.2 MB/sec list_struct_with_list/cdc 1.00 324.2±1.86ms 140.7 MB/sec 1.01 328.6±2.78ms 138.8 MB/sec list_struct_with_list/default 1.01 258.0±0.89ms 176.7 MB/sec 1.00 255.3±0.87ms 178.6 MB/sec list_struct_with_list/parquet_2 1.00 273.3±1.92ms 166.8 MB/sec 1.01 274.9±1.20ms 165.9 MB/sec list_struct_with_list/zstd 1.00 280.8±0.82ms 162.4 MB/sec 1.00 281.5±2.69ms 162.0 MB/sec list_struct_with_list/zstd_parquet_2 1.00 299.1±1.20ms 152.4 MB/sec 1.01 301.1±1.65ms 151.4 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 39.2±0.44ms 6.4 GB/sec 1.04 40.7±0.94ms 6.1 GB/sec primitive/bloom_filter 1.00 149.4±2.51ms 300.3 MB/sec 1.00 150.0±2.66ms 299.1 MB/sec primitive/cdc 1.01 158.1±1.49ms 283.8 MB/sec 1.00 156.1±0.65ms 287.6 MB/sec primitive/default 1.00 116.4±1.18ms 385.6 MB/sec 1.00 116.4±1.62ms 385.5 MB/sec primitive/parquet_2 1.00 131.0±1.15ms 342.6 MB/sec 1.00 130.8±0.47ms 343.1 MB/sec primitive/zstd 1.02 147.4±2.13ms 304.5 MB/sec 1.00 144.8±0.53ms 310.0 MB/sec primitive/zstd_parquet_2 1.02 166.5±1.44ms 269.5 MB/sec 1.00 163.4±0.49ms 274.7 MB/sec primitive_all_null/bloom_filter 1.00 913.1±8.18µs 48.0 GB/sec 1.00 915.2±23.26µs 47.9 GB/sec primitive_all_null/cdc 1.00 19.2±0.36ms 2.3 GB/sec 1.00 19.2±0.31ms 2.3 GB/sec primitive_all_null/default 1.00 274.0±1.39µs 159.9 GB/sec 1.01 275.5±1.86µs 159.1 GB/sec primitive_all_null/parquet_2 1.01 284.8±1.34µs 153.9 GB/sec 1.00 282.9±1.48µs 154.9 GB/sec primitive_all_null/zstd 1.00 425.8±1.72µs 102.9 GB/sec 1.00 424.7±2.43µs 103.2 GB/sec primitive_all_null/zstd_parquet_2 1.01 384.4±1.61µs 114.0 GB/sec 1.00 381.6±1.72µs 114.9 GB/sec primitive_non_null/bloom_filter 1.00 110.3±2.91ms 399.1 MB/sec 1.00 110.6±2.71ms 397.9 MB/sec primitive_non_null/cdc 1.01 88.0±1.58ms 500.0 MB/sec 1.00 86.8±0.46ms 506.7 MB/sec primitive_non_null/default 1.00 65.5±1.49ms 671.9 MB/sec 1.01 66.1±0.87ms 665.5 MB/sec primitive_non_null/parquet_2 1.00 86.7±1.40ms 507.7 MB/sec 1.00 86.5±1.09ms 508.6 MB/sec primitive_non_null/zstd 1.02 97.2±1.17ms 452.8 MB/sec 1.00 95.7±0.75ms 460.0 MB/sec primitive_non_null/zstd_parquet_2 1.02 120.6±1.58ms 364.8 MB/sec 1.00 118.7±0.22ms 370.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.03 13.9±0.14ms 3.2 GB/sec 1.00 13.5±0.33ms 3.3 GB/sec primitive_sparse_99pct_null/cdc 1.03 31.0±0.28ms 1448.0 MB/sec 1.00 30.2±0.28ms 1487.9 MB/sec primitive_sparse_99pct_null/default 1.02 11.5±0.07ms 3.8 GB/sec 1.00 11.3±0.10ms 3.9 GB/sec primitive_sparse_99pct_null/parquet_2 1.02 11.5±0.06ms 3.8 GB/sec 1.00 11.3±0.09ms 3.9 GB/sec primitive_sparse_99pct_null/zstd 1.01 14.9±0.06ms 2.9 GB/sec 1.00 14.8±0.18ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.02 13.4±0.06ms 3.3 GB/sec 1.00 13.1±0.18ms 3.3 GB/sec short_string_non_null/bloom_filter 1.03 28.3±0.46ms 423.8 MB/sec 1.00 27.5±0.10ms 436.4 MB/sec short_string_non_null/cdc 1.02 20.0±0.06ms 599.1 MB/sec 1.00 19.7±0.10ms 609.4 MB/sec short_string_non_null/default 1.00 15.8±0.08ms 758.1 MB/sec 1.00 15.8±0.05ms 760.6 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.05ms 462.4 MB/sec 1.00 25.9±0.06ms 462.6 MB/sec short_string_non_null/zstd 1.01 36.2±0.24ms 331.4 MB/sec 1.00 35.9±0.11ms 334.0 MB/sec short_string_non_null/zstd_parquet_2 1.01 29.0±0.14ms 414.5 MB/sec 1.00 28.8±0.05ms 416.8 MB/sec small_string_distinct/delta_byte_array 1.00 1038.7±18.39µs 7.6 GB/sec 1.47 1525.4±67.71µs 5.1 GB/sec small_string_distinct/plain 1.00 826.9±12.88µs 9.5 GB/sec 1.06 876.4±77.40µs 8.9 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1174.8±78.77µs 6.7 GB/sec 1.08 1274.3±94.56µs 6.2 GB/sec small_string_partial_prefix/plain 1.00 1167.0±23.98µs 6.7 GB/sec 1.12 1303.4±93.35µs 6.0 GB/sec small_string_shared_prefix/delta_byte_array 1.00 1028.8±5.44µs 7.6 GB/sec 1.04 1069.9±33.15µs 7.3 GB/sec small_string_shared_prefix/plain 1.00 1187.0±19.00µs 6.6 GB/sec 1.12 1327.5±117.70µs 5.9 GB/sec string/bloom_filter 1.09 238.1±24.30ms 2.2 GB/sec 1.00 218.5±25.18ms 2.3 GB/sec string/cdc 1.05 220.0±9.48ms 2.3 GB/sec 1.00 210.1±10.69ms 2.4 GB/sec string/default 1.06 133.3±23.11ms 3.8 GB/sec 1.00 125.3±21.52ms 4.1 GB/sec string/parquet_2 1.00 170.5±2.56ms 3.0 GB/sec 1.00 170.4±2.23ms 3.0 GB/sec string/zstd 1.02 489.3±16.14ms 1071.4 MB/sec 1.00 480.4±13.84ms 1091.2 MB/sec string/zstd_parquet_2 1.00 443.4±24.41ms 1182.3 MB/sec 1.03 455.3±13.49ms 1151.6 MB/sec string_and_binary_view/bloom_filter 1.05 67.5±1.74ms 477.5 MB/sec 1.00 64.3±0.47ms 501.7 MB/sec string_and_binary_view/cdc 1.00 59.6±0.87ms 540.7 MB/sec 1.06 63.0±0.99ms 511.7 MB/sec string_and_binary_view/default 1.01 50.2±0.90ms 642.9 MB/sec 1.00 49.5±0.81ms 652.0 MB/sec string_and_binary_view/parquet_2 1.01 60.4±0.72ms 534.0 MB/sec 1.00 59.5±0.38ms 541.7 MB/sec string_and_binary_view/zstd 1.01 86.3±1.22ms 373.5 MB/sec 1.00 85.8±0.45ms 376.0 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.9±0.99ms 436.1 MB/sec 1.03 76.1±1.01ms 423.9 MB/sec string_dictionary/bloom_filter 1.08 109.4±3.70ms 2.4 GB/sec 1.00 100.8±2.07ms 2.6 GB/sec string_dictionary/cdc 1.17 64.3±2.22ms 4.0 GB/sec 1.00 55.2±1.10ms 4.7 GB/sec string_dictionary/default 1.36 65.0±1.52ms 4.0 GB/sec 1.00 47.9±0.94ms 5.4 GB/sec string_dictionary/parquet_2 1.33 65.8±1.36ms 3.9 GB/sec 1.00 49.4±0.45ms 5.2 GB/sec string_dictionary/zstd 1.06 232.5±4.23ms 1136.0 MB/sec 1.00 219.9±4.19ms 1201.3 MB/sec string_dictionary/zstd_parquet_2 1.07 208.2±1.43ms 1268.8 MB/sec 1.00 194.8±1.65ms 1356.0 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.1±0.08ms 117.4 MB/sec 1.01 34.5±0.08ms 116.2 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.6±0.09ms 145.0 MB/sec 1.02 28.1±0.10ms 142.7 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.2±0.06ms 158.9 MB/sec 1.01 25.5±0.10ms 157.0 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.2±0.08ms 158.9 MB/sec 1.01 25.5±0.10ms 157.0 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.6±0.07ms 156.5 MB/sec 1.01 25.9±0.10ms 154.4 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.6±0.07ms 156.7 MB/sec 1.01 25.9±0.10ms 155.0 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.1±0.08ms 121.0 MB/sec 1.02 33.8±0.11ms 118.4 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.4±0.08ms 146.3 MB/sec 1.01 27.7±0.10ms 144.6 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.0±0.09ms 160.4 MB/sec 1.01 25.2±0.12ms 159.0 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 24.9±0.10ms 160.7 MB/sec 1.01 25.2±0.11ms 159.0 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.1±0.08ms 159.7 MB/sec 1.01 25.4±0.10ms 158.0 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.1±0.10ms 159.8 MB/sec 1.01 25.4±0.10ms 157.9 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.2±0.13ms 114.0 MB/sec 1.01 35.6±0.08ms 112.8 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.4±0.15ms 141.4 MB/sec 1.01 28.7±0.08ms 139.8 MB/sec string_dictionary_low_cardinality_400/default 1.00 26.0±0.09ms 154.5 MB/sec 1.02 26.5±0.09ms 151.6 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 26.0±0.07ms 154.4 MB/sec 1.01 26.3±0.10ms 152.4 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.5±0.07ms 151.2 MB/sec 1.01 26.7±0.15ms 150.1 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.5±0.10ms 151.4 MB/sec 1.01 26.7±0.09ms 150.1 MB/sec string_non_null/bloom_filter 1.01 253.1±13.21ms 2.0 GB/sec 1.00 250.7±12.48ms 2.0 GB/sec string_non_null/cdc 1.01 257.9±4.09ms 2031.7 MB/sec 1.00 255.5±5.24ms 2.0 GB/sec string_non_null/default 1.00 129.8±20.72ms 3.9 GB/sec 1.02 132.0±14.10ms 3.9 GB/sec string_non_null/parquet_2 1.15 137.2±15.02ms 3.7 GB/sec 1.00 119.1±12.26ms 4.3 GB/sec string_non_null/zstd 1.01 562.0±5.18ms 932.4 MB/sec 1.00 556.1±5.64ms 942.3 MB/sec string_non_null/zstd_parquet_2 1.00 509.6±6.06ms 1028.3 MB/sec 1.00 508.6±12.27ms 1030.3 MB/sec string_ree/bloom_filter 1.01 159.5±1.77ms 102.9 MB/sec 1.00 157.4±2.66ms 104.2 MB/sec string_ree/cdc 1.10 243.7±3.60ms 67.3 MB/sec 1.00 222.4±1.35ms 73.8 MB/sec string_ree/default 1.06 130.7±1.34ms 125.6 MB/sec 1.00 123.8±1.60ms 132.6 MB/sec string_ree/parquet_2 1.02 130.2±2.18ms 126.1 MB/sec 1.00 127.2±0.79ms 128.9 MB/sec string_ree/zstd 1.02 189.8±1.81ms 86.4 MB/sec 1.00 185.4±1.13ms 88.5 MB/sec string_ree/zstd_parquet_2 1.02 144.4±0.45ms 113.6 MB/sec 1.00 140.9±0.44ms 116.4 MB/sec string_ree_95pct_null/bloom_filter 1.01 27.0±0.07ms 52.1 MB/sec 1.00 26.8±0.06ms 52.5 MB/sec string_ree_95pct_null/cdc 1.02 33.3±0.12ms 42.3 MB/sec 1.00 32.6±0.28ms 43.2 MB/sec string_ree_95pct_null/default 1.01 25.4±0.07ms 55.4 MB/sec 1.00 25.2±0.21ms 55.8 MB/sec string_ree_95pct_null/parquet_2 1.00 25.3±0.07ms 55.7 MB/sec 1.00 25.1±0.06ms 56.0 MB/sec string_ree_95pct_null/zstd 1.02 26.3±0.16ms 53.5 MB/sec 1.00 25.8±0.17ms 54.6 MB/sec string_ree_95pct_null/zstd_parquet_2 1.03 26.3±0.12ms 53.4 MB/sec 1.00 25.6±0.12ms 55.0 MB/sec struct_all_null/bloom_filter 1.02 384.3±1.87µs 41.0 GB/sec 1.00 376.7±3.35µs 41.8 GB/sec struct_all_null/cdc 1.00 7.8±0.09ms 2.0 GB/sec 1.00 7.8±0.09ms 2.0 GB/sec struct_all_null/default 1.00 117.6±0.59µs 133.9 GB/sec 1.01 118.6±0.93µs 132.8 GB/sec struct_all_null/parquet_2 1.00 120.6±0.52µs 130.6 GB/sec 1.01 122.0±0.69µs 129.1 GB/sec struct_all_null/zstd 1.00 181.5±0.49µs 86.8 GB/sec 1.00 182.3±0.77µs 86.4 GB/sec struct_all_null/zstd_parquet_2 1.00 164.6±0.68µs 95.6 GB/sec 1.01 166.5±0.92µs 94.6 GB/sec struct_non_null/bloom_filter 1.07 48.0±1.10ms 333.0 MB/sec 1.00 44.8±1.68ms 357.5 MB/sec struct_non_null/cdc 1.04 45.1±0.40ms 354.8 MB/sec 1.00 43.5±0.99ms 367.6 MB/sec struct_non_null/default 1.00 31.1±0.38ms 513.9 MB/sec 1.05 32.6±0.75ms 490.5 MB/sec struct_non_null/parquet_2 1.00 39.3±0.28ms 407.5 MB/sec 1.00 39.1±0.77ms 408.9 MB/sec struct_non_null/zstd 1.03 39.6±0.35ms 403.7 MB/sec 1.00 38.6±0.53ms 414.6 MB/sec struct_non_null/zstd_parquet_2 1.04 54.4±0.50ms 293.9 MB/sec 1.00 52.5±0.35ms 305.0 MB/sec struct_sparse_99pct_null/bloom_filter 1.04 7.7±0.05ms 2.0 GB/sec 1.00 7.4±0.24ms 2.1 GB/sec struct_sparse_99pct_null/cdc 1.02 14.6±0.08ms 1103.7 MB/sec 1.00 14.3±0.28ms 1124.7 MB/sec struct_sparse_99pct_null/default 1.04 6.8±0.02ms 2.3 GB/sec 1.00 6.5±0.12ms 2.4 GB/sec struct_sparse_99pct_null/parquet_2 1.03 6.8±0.03ms 2.3 GB/sec 1.00 6.6±0.13ms 2.4 GB/sec struct_sparse_99pct_null/zstd 1.02 8.2±0.04ms 1969.5 MB/sec 1.00 8.1±0.11ms 2001.3 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.02 7.6±0.04ms 2.1 GB/sec 1.00 7.5±0.14ms 2.1 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3290.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3180.6s | | CPU sys | 108.1s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3350.8s | | Peak memory | 2.9 GiB | | Avg memory | 2.5 GiB | | CPU user | 3189.8s | | CPU sys | 157.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
