rtpsw commented on PR #13880:
URL: https://github.com/apache/arrow/pull/13880#issuecomment-1234248082
Benchmark results comparing the baseline code of this PR with its latest
```
$ archery benchmark run --benchmark-filter=AsOfJoinOverhead
--output=baseline.json bc1a16cd0eceeffe67893a7e8000d2dd28dcf3f1
$ archery benchmark run --benchmark-filter=AsOfJoinOverhead
--output=ARROW-17412.json 8bee2346717c217d2f1e233a1273577d0df687eb
$ archery benchmark diff ARROW-17412.json baseline.json
```
are as follows:
```
INFO:numexpr.utils:NumExpr defaulting to 8 threads.
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Non-regressions: (1)
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark
baseline contender change %
counters
AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:32000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time
142.364 MiB/sec 159.425 MiB/sec 11.984 {'family_index': 0,
'per_family_instance_index': 14, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:32000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 7,
'input_rows_per_second': 867904.5056496062, 'maximum_peak_memory': 686301504.0}
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Regressions: (10)
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
benchmark
baseline contender change %
counters
AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:50/right_freq:400/right_cols:20/right_ids:500/real_time
323.553 MiB/sec 287.966 MiB/sec -10.999 {'family_index': 0,
'per_family_instance_index': 11, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:50/right_freq:400/right_cols:20/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 1,
'input_rows_per_second': 1972499.868090142, 'maximum_peak_memory': 686301504.0}
AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:10/right_freq:400/right_cols:20/right_ids:500/real_time
344.387 MiB/sec 306.150 MiB/sec -11.103 {'family_index': 0,
'per_family_instance_index': 10, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:10/right_freq:400/right_cols:20/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 3,
'input_rows_per_second': 2099512.4178041373, 'maximum_peak_memory': 148407104.0}
AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time
349.482 MiB/sec 303.890 MiB/sec -13.046 {'family_index': 0,
'per_family_instance_index': 9, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 19,
'input_rows_per_second': 2111813.458550057, 'maximum_peak_memory': 131071104.0}
AsOfJoinOverhead/left_freq:1000/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:1000/right_cols:20/right_ids:500/real_time
348.038 MiB/sec 301.696 MiB/sec -13.315 {'family_index': 0,
'per_family_instance_index': 2, 'run_name':
'AsOfJoinOverhead/left_freq:1000/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:1000/right_cols:20/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 44,
'input_rows_per_second': 2121769.8288677963, 'maximum_peak_memory': 54420864.0}
AsOfJoinOverhead/left_freq:200/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:200/right_cols:20/right_ids:500/real_time
355.718 MiB/sec 306.236 MiB/sec -13.911 {'family_index': 0,
'per_family_instance_index': 0, 'run_name':
'AsOfJoinOverhead/left_freq:200/left_cols:20/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:200/right_cols:20/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 8,
'input_rows_per_second': 2168591.3894433207, 'maximum_peak_memory': 54420864.0}
AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:1000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time
315.636 MiB/sec 270.699 MiB/sec -14.237 {'family_index': 0,
'per_family_instance_index': 12, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:500/left_batch_size:1000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 16,
'input_rows_per_second': 1924236.4216933611, 'maximum_peak_memory': 686301504.0}
AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:100/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:100/real_time
339.172 MiB/sec 288.468 MiB/sec -14.949 {'family_index': 0,
'per_family_instance_index': 6, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:100/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:100/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 84,
'input_rows_per_second': 2067719.28348546, 'maximum_peak_memory': 131071104.0}
AsOfJoinOverhead/left_freq:400/left_cols:10/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:10/right_ids:500/real_time
305.968 MiB/sec 256.047 MiB/sec -16.316 {'family_index': 0,
'per_family_instance_index': 3, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:10/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:10/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 29,
'input_rows_per_second': 3487291.181883503, 'maximum_peak_memory': 54420864.0}
AsOfJoinOverhead/left_freq:400/left_cols:100/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:100/right_ids:500/real_time
404.655 MiB/sec 337.929 MiB/sec -16.490 {'family_index': 0,
'per_family_instance_index': 5, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:100/left_ids:500/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:100/right_ids:500/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 4,
'input_rows_per_second': 522550.5184384509, 'maximum_peak_memory': 131071104.0}
AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:1000/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:1000/real_time
351.580 MiB/sec 289.530 MiB/sec -17.649 {'family_index': 0,
'per_family_instance_index': 8, 'run_name':
'AsOfJoinOverhead/left_freq:400/left_cols:20/left_ids:1000/left_batch_size:4000/num_right_tables:1/right_freq:400/right_cols:20/right_ids:1000/real_time',
'repetitions': 1, 'repetition_index': 0, 'threads': 1, 'iterations': 9,
'input_rows_per_second': 2143364.0434252876, 'maximum_peak_memory': 131071104.0}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
