Dandandan commented on PR #8951:
URL: https://github.com/apache/arrow-rs/pull/8951#issuecomment-3627485469
> 🤖: Benchmark completed
>
> Details
>
> ```
> group
coalesce_batches_filter main
> -----
----------------------- ----
> filter: mixed_dict, 8192, nulls: 0, selectivity: 0.001
1.00 263.9±2.33ms ? ?/sec 1.00 263.2±2.58ms ?
?/sec
> filter: mixed_dict, 8192, nulls: 0, selectivity: 0.01
1.00 8.5±0.08ms ? ?/sec 1.00 8.5±0.11ms ?
?/sec
> filter: mixed_dict, 8192, nulls: 0, selectivity: 0.1
1.01 4.1±0.10ms ? ?/sec 1.00 4.0±0.05ms ?
?/sec
> filter: mixed_dict, 8192, nulls: 0, selectivity: 0.8
1.00 3.3±0.06ms ? ?/sec 1.07 3.5±0.05ms ?
?/sec
> filter: mixed_dict, 8192, nulls: 0.1, selectivity: 0.001
1.00 248.2±1.98ms ? ?/sec 1.28 318.8±4.18ms ?
?/sec
> filter: mixed_dict, 8192, nulls: 0.1, selectivity: 0.01
1.00 9.4±0.10ms ? ?/sec 1.00 9.4±0.10ms ?
?/sec
> filter: mixed_dict, 8192, nulls: 0.1, selectivity: 0.1
1.01 4.5±0.10ms ? ?/sec 1.00 4.5±0.06ms ?
?/sec
> filter: mixed_dict, 8192, nulls: 0.1, selectivity: 0.8
1.00 3.7±0.05ms ? ?/sec 1.26 4.6±0.06ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.001
1.00 59.1±0.55ms ? ?/sec 1.00 59.3±0.77ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.01
1.00 11.6±0.15ms ? ?/sec 1.00 11.6±0.11ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.1
1.01 9.4±0.14ms ? ?/sec 1.00 9.3±0.15ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0, selectivity: 0.8
1.00 8.1±0.17ms ? ?/sec 1.34 10.8±0.28ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0.1, selectivity: 0.001
1.00 69.6±0.48ms ? ?/sec 1.02 70.8±1.08ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0.1, selectivity: 0.01
1.00 12.7±0.10ms ? ?/sec 1.02 13.0±0.18ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0.1, selectivity: 0.1
1.00 9.8±0.20ms ? ?/sec 1.00 9.8±0.22ms ?
?/sec
> filter: mixed_utf8, 8192, nulls: 0.1, selectivity: 0.8
1.00 8.6±0.21ms ? ?/sec 1.18 10.1±0.28ms ?
?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0, selectivity:
0.001 1.00 48.6±0.43ms ? ?/sec 1.00 48.7±0.30ms ?
?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0, selectivity:
0.01 1.01 6.0±0.08ms ? ?/sec 1.00 6.0±0.04ms ?
?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0, selectivity:
0.1 1.02 4.6±0.12ms ? ?/sec 1.00 4.5±0.06ms ?
?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0, selectivity:
0.8 1.00 2.6±0.03ms ? ?/sec 1.17 3.1±0.05ms ?
?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0.1,
selectivity: 0.001 1.00 58.4±0.76ms ? ?/sec 1.00
58.5±0.46ms ? ?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0.1,
selectivity: 0.01 1.00 7.9±0.12ms ? ?/sec 1.02
8.1±0.10ms ? ?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0.1,
selectivity: 0.1 1.00 5.5±0.12ms ? ?/sec 1.02
5.7±0.16ms ? ?/sec
> filter: mixed_utf8view (max_string_len=128), 8192, nulls: 0.1,
selectivity: 0.8 1.00 2.2±0.01ms ? ?/sec 1.75
3.9±0.04ms ? ?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0, selectivity:
0.001 1.00 42.5±0.61ms ? ?/sec 1.00 42.7±0.65ms
? ?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0, selectivity:
0.01 1.00 4.7±0.10ms ? ?/sec 1.01 4.7±0.04ms
? ?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0, selectivity:
0.1 1.01 2.3±0.07ms ? ?/sec 1.00 2.3±0.04ms
? ?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0, selectivity:
0.8 1.00 1137.8±16.65µs ? ?/sec 1.32 1498.0±15.99µs
? ?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0.1, selectivity:
0.001 1.00 52.0±0.28ms ? ?/sec 1.00 52.2±1.36ms ?
?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0.1, selectivity:
0.01 1.00 7.0±0.11ms ? ?/sec 1.01 7.1±0.07ms ?
?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0.1, selectivity:
0.1 1.02 3.7±0.16ms ? ?/sec 1.00 3.6±0.05ms ?
?/sec
> filter: mixed_utf8view (max_string_len=20), 8192, nulls: 0.1, selectivity:
0.8 1.00 2.3±0.03ms ? ?/sec 1.68 3.9±0.03ms ?
?/sec
> filter: primitive, 8192, nulls: 0, selectivity: 0.001
1.00 54.2±1.34ms ? ?/sec 1.79 97.2±1.12ms ?
?/sec
> filter: primitive, 8192, nulls: 0, selectivity: 0.01
1.00 5.9±0.03ms ? ?/sec 1.58 9.3±0.06ms ?
?/sec
> filter: primitive, 8192, nulls: 0, selectivity: 0.1
1.00 3.3±0.22ms ? ?/sec 1.14 3.8±0.03ms ?
?/sec
> filter: primitive, 8192, nulls: 0, selectivity: 0.8
1.00 1689.2±38.67µs ? ?/sec 1.81 3.1±0.02ms ?
?/sec
> filter: primitive, 8192, nulls: 0.1, selectivity: 0.001
1.00 59.2±1.38ms ? ?/sec 2.14 126.3±1.98ms ?
?/sec
> filter: primitive, 8192, nulls: 0.1, selectivity: 0.01
1.00 8.1±0.08ms ? ?/sec 1.86 15.1±0.42ms ?
?/sec
> filter: primitive, 8192, nulls: 0.1, selectivity: 0.1
1.00 6.4±0.11ms ? ?/sec 1.12 7.1±0.27ms ?
?/sec
> filter: primitive, 8192, nulls: 0.1, selectivity: 0.8
1.00 4.9±0.07ms ? ?/sec 1.84 9.0±0.05ms ?
?/sec
> filter: single_utf8view, 8192, nulls: 0, selectivity: 0.001
1.00 64.7±0.37ms ? ?/sec 1.02 65.9±0.32ms ?
?/sec
> filter: single_utf8view, 8192, nulls: 0, selectivity: 0.01
1.01 7.4±0.08ms ? ?/sec 1.00 7.3±0.12ms ?
?/sec
> filter: single_utf8view, 8192, nulls: 0, selectivity: 0.1
1.02 4.0±0.28ms ? ?/sec 1.00 3.9±0.09ms ?
?/sec
> filter: single_utf8view, 8192, nulls: 0, selectivity: 0.8
1.00 1287.1±14.90µs ? ?/sec 1.11 1429.1±15.07µs ?
?/sec
> filter: single_utf8view, 8192, nulls: 0.1, selectivity: 0.001
1.07 89.7±0.95ms ? ?/sec 1.00 84.2±0.38ms ?
?/sec
> filter: single_utf8view, 8192, nulls: 0.1, selectivity: 0.01
1.02 11.5±0.11ms ? ?/sec 1.00 11.2±0.16ms ?
?/sec
> filter: single_utf8view, 8192, nulls: 0.1, selectivity: 0.1
1.04 5.3±0.14ms ? ?/sec 1.00 5.1±0.08ms ?
?/sec
> filter: single_utf8view, 8192, nulls: 0.1, selectivity: 0.8
1.00 2.7±0.02ms ? ?/sec 1.46 4.0±0.03ms ?
?/sec
> ```
Nice, so this confirms the higher threshold also is a speed up for filter
kernels.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
