Tan-JiaLiang commented on PR #6028:
URL: https://github.com/apache/paimon/pull/6028#issuecomment-3178022310
The following benchmarks are presented in tables with the following
characteristics:
- using Apache Parquet as the table format
- 16 columns
- 1,000,000 rows
- cardinality values of 300, 3,000, 30,000, 300,000 and 3,000,000
This is the Top1 benchmark base the range-bitmap file index.
```text
Running benchmark: topn
Running case: without-index-300-1
Stopped after 1 iterations, 481 ms
Running case: with-index-300-1
Stopped after 1 iterations, 16 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
topn:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_topn_without-index-300-1
482 / 482 2075.7 481.8
1.0X
OPERATORTEST_topn_with-index-300-1
17 / 17 59512.6 16.8
28.7X
Running benchmark: topn
Running case: without-index-3000-1
Stopped after 1 iterations, 478 ms
Running case: with-index-3000-1
Stopped after 1 iterations, 17 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
topn:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_topn_without-index-3000-1
479 / 479 2089.7 478.5
1.0X
OPERATORTEST_topn_with-index-3000-1
18 / 18 56874.2 17.6
27.2X
Running benchmark: topn
Running case: without-index-30000-1
Stopped after 1 iterations, 495 ms
Running case: with-index-30000-1
Stopped after 1 iterations, 255 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
topn:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_topn_without-index-30000-1
496 / 496 2016.7 495.9
1.0X
OPERATORTEST_topn_with-index-30000-1
255 / 255 3919.6 255.1
1.9X
Running benchmark: topn
Running case: without-index-300000-1
Stopped after 1 iterations, 511 ms
Running case: with-index-300000-1
Stopped after 1 iterations, 245 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
topn:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_topn_without-index-300000-1
512 / 512 1954.4 511.7
1.0X
OPERATORTEST_topn_with-index-300000-1
246 / 246 4072.5 245.5
2.1X
Running benchmark: topn
Running case: without-index-3000000-1
Stopped after 1 iterations, 522 ms
Running case: with-index-3000000-1
Stopped after 1 iterations, 244 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
topn:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_topn_without-index-3000000-1
522 / 522 1914.8 522.2
1.0X
OPERATORTEST_topn_with-index-3000000-1
245 / 245 4089.7 244.5
2.1X
```
This is the EQUALS benchmark base the range-bitmap file index.
```text
Running benchmark: equals
Running case: without-index-300
Stopped after 5 iterations, 2379 ms
Running case: with-index-300
Stopped after 5 iterations, 2516 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
equals:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_equals_without-index-300
466 / 476 2147.9 465.6
1.0X
OPERATORTEST_equals_with-index-300
485 / 503 2063.3 484.6
1.0X
Running benchmark: equals
Running case: without-index-3000
Stopped after 5 iterations, 2420 ms
Running case: with-index-3000
Stopped after 5 iterations, 2636 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
equals:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_equals_without-index-3000
472 / 484 2120.8 471.5
1.0X
OPERATORTEST_equals_with-index-3000
519 / 527 1925.8 519.3
0.9X
Running benchmark: equals
Running case: without-index-30000
Stopped after 5 iterations, 2513 ms
Running case: with-index-30000
Stopped after 5 iterations, 1347 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
equals:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_equals_without-index-30000
466 / 503 2144.8 466.2
1.0X
OPERATORTEST_equals_with-index-30000
243 / 269 4121.3 242.6
1.9X
Running benchmark: equals
Running case: without-index-300000
Stopped after 5 iterations, 2502 ms
Running case: with-index-300000
Stopped after 5 iterations, 60 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
equals:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_equals_without-index-300000
465 / 501 2149.0 465.3
1.0X
OPERATORTEST_equals_with-index-300000
12 / 12 85956.2 11.6
40.0X
Running benchmark: equals
Running case: without-index-3000000
Stopped after 5 iterations, 2526 ms
Running case: with-index-3000000
Stopped after 5 iterations, 168 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
equals:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_equals_without-index-3000000
470 / 505 2126.9 470.2
1.0X
OPERATORTEST_equals_with-index-3000000
30 / 34 33297.0 30.0
15.7X
```
This is the RANGE benchmark base the range-bitmap file index.
```text
Running benchmark: between
Running case: without-index-300-0-100
Stopped after 5 iterations, 2409 ms
Running case: with-index-300-0-100
Stopped after 5 iterations, 2464 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
between:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_between_without-index-300-0-100
469 / 482 2130.8 469.3
1.0X
OPERATORTEST_between_with-index-300-0-100
482 / 493 2074.2 482.1
1.0X
Running benchmark: between
Running case: without-index-3000-0-100
Stopped after 5 iterations, 2412 ms
Running case: with-index-3000-0-100
Stopped after 5 iterations, 2533 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
between:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_between_without-index-3000-0-100
475 / 483 2106.4 474.7
1.0X
OPERATORTEST_between_with-index-3000-0-100
489 / 507 2044.2 489.2
1.0X
Running benchmark: between
Running case: without-index-30000-0-100
Stopped after 5 iterations, 2458 ms
Running case: with-index-30000-0-100
Stopped after 5 iterations, 2598 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
between:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_between_without-index-30000-0-100
475 / 492 2103.6 475.4
1.0X
OPERATORTEST_between_with-index-30000-0-100
507 / 520 1974.2 506.5
0.9X
Running benchmark: between
Running case: without-index-300000-0-100
Stopped after 5 iterations, 2514 ms
Running case: with-index-300000-0-100
Stopped after 5 iterations, 2563 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
between:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_between_without-index-300000-0-100
467 / 503 2142.8 466.7
1.0X
OPERATORTEST_between_with-index-300000-0-100
502 / 513 1992.0 502.0
0.9X
Running benchmark: between
Running case: without-index-3000000-0-100
Stopped after 5 iterations, 1466 ms
Running case: with-index-3000000-0-100
Stopped after 5 iterations, 1421 ms
OpenJDK 64-Bit Server VM 1.8.0_442-b06 on Mac OS X 15.6
Apple M4 Pro
between:
Best/Avg Time(ms) Row Rate(K/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------
OPERATORTEST_between_without-index-3000000-0-100
269 / 293 3713.3 269.3
1.0X
OPERATORTEST_between_with-index-3000000-0-100
251 / 284 3990.3 250.6
1.1X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@paimon.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
