Hello,
I decided to compare v17 vs v16 performance (as I did the last year [1])
and discovered that v17 loses to v16 in the pg_tpcds (s64da_tpcds)
benchmark, query15 (and several others, but I focused on this one):
Best pg-src-master--.* worse than pg-src-16--.* by 52.2 percents (229.84 >
151.03): pg_tpcds.query15
Average pg-src-master--.* worse than pg-src-16--.* by 53.4 percents (234.20 >
152.64): pg_tpcds.query15
Please look at the full html report attached in case you're interested.
(I used my pg-mark tool to measure/analyze performance, but I believe the
same results can be seen without it.)
`git bisect` for this performance degradation pointed at b7b0f3f27...
[1]
https://www.postgresql.org/message-id/b32bed1b-0746-9b20-1472-4bdc9ca66d52%40gmail.com
Best regards,
Alexander
Title: Postgres benchmarking results
Benchmarking run started at 2024-05-14T12:04:26, ended at 2024-05-15T05:44:15
Benchmark version| Instance | version |
|---|
| pg-src-16--1 | PostgreSQL 16.3-REL_16_STABLE/c1664c8eef on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-master--1 | PostgreSQL 17devel-master/2e810bdb7f on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-16--2 | PostgreSQL 16.3-REL_16_STABLE/c1664c8eef on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-master--2 | PostgreSQL 17devel-master/2e810bdb7f on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-master--3 | PostgreSQL 17devel-master/2e810bdb7f on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
| pg-src-16--3 | PostgreSQL 16.3-REL_16_STABLE/c1664c8eef on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit |
Benchmark pgbench_native| Instance | tps |
|---|
| pg-src-16--1 | 10478.49 |
| pg-src-master--1 | 10662.36 |
| pg-src-16--2 | 10491.77 |
| pg-src-master--2 | 10700.65 |
| pg-src-master--3 | 10565.92 |
| pg-src-16--3 | 10555.88 |
Benchmark pgbench_reference| Instance | latency_avg | tps1 | tps2 |
|---|
| pg-src-16--1 | 8.59 | 7452.80 | 7452.84 |
| pg-src-master--1 | 8.42 | 7597.85 | 7597.88 |
| pg-src-16--2 | 8.52 | 7508.75 | 7508.79 |
| pg-src-master--2 | 8.48 | 7545.73 | 7545.77 |
| pg-src-master--3 | 8.37 | 7649.51 | 7649.55 |
| pg-src-16--3 | 8.54 | 7498.92 | 7498.95 |
Benchmark pg_tpch| Instance | query1 | query2 | query3 | query4 | query5 | query6 | query7 | query8 | query9 | query10 | query11 | query12 | query13 | query14 | query15 | query16 | query17 | query18 | query19 | query20 | query21 | query22 |
|---|
| pg-src-16--1 | 9.59 | 1.47 | 3.00 | 0.70 | 0.90 | 1.47 | 2.97 | 4.56 | 0.94 | 2.47 | 0.77 | 2.23 | 2.87 | 0.88 | 3.20 | 0.97 | 8.70 | 14.41 | 0.19 | 5.84 | 2.36 | 0.23 |
| pg-src-master--1 | 9.11 | 1.54 | 2.88 | 0.70 | 0.89 | 1.40 | 2.83 | 4.75 | 0.87 | 2.39 | 0.75 | 2.13 | 2.83 | 0.89 | 3.06 | 1.00 | 8.32 | 13.97 | 0.19 | 5.55 | 2.30 | 0.22 |
| pg-src-16--2 | 9.61 | 1.49 | 3.04 | 0.71 | 0.93 | 1.47 | 2.96 | 4.69 | 0.86 | 2.50 | 0.78 | 2.21 | 2.88 | 0.88 | 3.20 | 1.00 | 8.82 | 14.20 | 0.20 | 5.85 | 2.36 | 0.23 |
| pg-src-master--2 | 9.05 | 1.49 | 2.85 | 0.70 | 0.87 | 1.37 | 2.82 | 4.47 | 0.87 | 2.35 | 0.77 | 2.14 | 2.67 | 0.88 | 3.03 | 0.99 | 8.27 | 14.24 | 0.19 | 5.57 | 2.30 | 0.22 |
| pg-src-master--3 | 10.12 | 1.48 | 2.88 | 0.69 | 0.88 | 1.39 | 2.84 | 4.73 | 0.88 | 2.40 | 0.78 | 2.14 | 2.80 | 0.88 | 3.08 | 1.00 | 8.28 | 14.18 | 0.19 | 5.56 | 2.33 | 0.22 |
| pg-src-16--3 | 9.72 | 1.47 | 3.01 | 0.70 | 0.91 | 1.46 | 2.95 | 4.67 | 0.96 | 2.50 | 0.78 | 2.20 | 2.71 | 0.87 | 3.22 | 1.00 | 8.69 | 14.40 | 0.19 | 5.98 | 2.34 | 0.23 |
Benchmark pg_tpcds| Instance | load_size | indexes_size | vacuum_full_size | vacuum_freeze_size | load_time | indexes_time | vacuum_full_time | vacuum_freeze_time | analyze_time | query92 | query91 | query13 | query9 | query21 | query90 | query93 | query16 | query68 | query48 | query76 | query7 | query37 | query43 | query72 | query82 | query79 | query55 | query66 | query71 | query69 | query34 | query45 | query10 | query28 | query3 | query15 | query50 | query85 | query84 | query42 | query73 | query94 | query46 | query88 | query19 | query40 | query26 | query96 | query6 | query52 |
|---|
| pg-src-16--1 | 5069460.00 | 7250212.00 | 6939852.00 | 6942528.00 | 78.36 | 73.23 | 96.68 | 2.29 | 3.48 | 83.49 | 44.95 | 638.87 | 1466.98 | 157.23 | 149.80 | 4.96 | 105.36 | 278.76 | 774.01 | 380.49 | 1194.28 | 8.21 | 713.20 | 20492.58 | 10.40 | 346.13 | 297.64 | 302.20 | 241.78 | 115.87 | 246.68 | 133.86 | 31.62 | 667.38 | 30.43 | 153.41 | 78.77 | 182.25 | 15.65 | 294.41 | 205.36 | 77.62 | 498.71 | 1670.38 | 313.13 | 74.38 | 596.20 | 202.61 | 23918.69 | 311.14 |
| pg-src-master--1 | 5069628.00 | 7250072.00 | 6939856.00 | 6942528.00 | 79.87 | 71.63 | 92.83 | 2.16 | 3.46 | 82.14 | 45.80 | 612.61 | 1355.02 | 201.37 | 137.85 | 4.95 | 145.74 | 253.06 | 752.50 | 376.79 | 1203.26 | 8.36 | 692.81 | 25286.10 | 9.13 | 325.84 | 271.36 | 412.45 | 252.12 | 114.83 | 228.80 | 132.14 | 31.34 | 653.31 | 29.11 | 229.84 | 77.31 | 184.56 | 14.86 | 268.99 | 182.63 | 69.12 | 479.66 | 1515.73 | 297.10 | 96.46 | 955.47 | 185.35 | 17137.62 | 274.60 |
| pg-src-16--2 | 5069288.00 | 7249988.00 | 6939848.00 | 6942520.00 | 77.36 | 73.27 | 95.92 | 2.24 | 3.41 | 82.84 | 47.27 | 639.83 | 1450.85 | 158.35 | 154.49 | 4.76 | 101.82 | 277.17 | 779.26 | 387.13 | 1202.08 | 8.26 | 714.58 | 20769.88 | 10.32 | 348.23 | 288.74 | 304.59 | 243.07 | 114.51 | 249.44 | 137.42 | 32.46 | 662.65 | 29.54 | 153.47 | 80.16 | 119.14 | 16.45 | 295.05 | 207.38 | 77.66 | 506.87 | 1686.13 | 319.24 | 73.34 | 584.07 | 204.55 | 23798.14 | 291.23 |
| pg-src-master--2 | 5069476.00 | 7249892.00 | 6939860.00 | 6942500.00 | 79.95 | 70.72 | 92.64 | 3.10 | 3.41 | 78.34 | 44.75 | 610.52 | 1362.95 | 195.95 | 141.65 | 5.19 | 140.07 | 253.17 | 754.75 | 385.32 | 1209.35 | 7.56 | 686.49 | 25771.90 | 9.17 | 329.43 | 290.55 | 415.04 | 224.55 | 119.17 | 229.24 | 135.60 | 31.45 | 657.64 | 29.96 | 236.34 | 81.87 | 182.69 | 15.04 | 277.01 | 184.94 | 70.63 | 494.84 | 1523.35 | 306.65 | 103.54 | 975.26 | 185.29 | 17169.69 | 278.12 |
| pg-src-master--3 | 5069584.00 | 7249996.00 | 6939856.00 | 6942500.00 | 78.94 | 71.08 | 93.27 | 3.11 | 3.43 | 77.44 | 47.19 | 610.86 | 1386.95 | 193.86 | 140.13 | 4.83 | 154.89 | 257.04 | 756.67 | 378.82 | 1213.10 | 7.62 | 688.18 | 25978.55 | 9.44 | 328.20 | 278.73 | 417.64 | 226.57 | 119.25 | 231.79 | 135.54 | 31.99 | 654.80 | 30.82 | 236.43 | 56.91 | 117.99 | 14.63 | 281.26 | 183.65 | 71.78 | 479.82 | 1534.32 | 301.89 | 98.00 | 1002.00 | 184.58 | 17194.48 | 284.33 |
| pg-src-16--3 | 5069352.00 | 7250108.00 | 6939852.00 | 6942524.00 | 78.62 | 73.41 | 96.99 | 2.26 | 3.42 | 80.12 | 46.32 | 640.69 | 1455.49 | 160.60 | 149.99 | 4.21 | 101.03 | 273.02 | 775.44 | 377.31 | 1200.69 | 8.19 | 719.68 | 20943.10 | 10.56 | 350.66 | 286.82 | 316.33 | 247.52 | 114.07 | 246.41 | 136.98 | 32.20 | 662.66 | 31.10 | 151.03 | 58.40 | 118.75 | 15.56 | 288.93 | 204.55 | 75.92 | 496.13 | 1668.00 | 309.48 | 74.48 | 597.69 | 204.43 | 24008.34 | 284.83 |
Benchmark ycsb| Instance | load_a_size | load_b_size | load_c_size | load_d_size | load_f_size | load_a_time | load_b_time | load_c_time | load_d_time | load_f_time | load_a_10_runtime | load_a_25_runtime | load_a_50_runtime | load_b_10_runtime | load_b_25_runtime | load_b_50_runtime | load_c_10_runtime | load_c_25_runtime | load_c_50_runtime | load_d_10_runtime | load_d_25_runtime | load_d_50_runtime | load_f_10_runtime | load_f_25_runtime | load_f_50_runtime | load_a_10_ops | load_a_25_ops | load_a_50_ops | load_b_10_ops | load_b_25_ops | load_b_50_ops | load_c_10_ops | load_c_25_ops | load_c_50_ops | load_d_10_ops | load_d_25_ops | load_d_50_ops | load_f_10_ops | load_f_25_ops | load_f_50_ops |
|---|
| pg-src-16--1 | 2259520.00 | 2277336.00 | 2276716.00 | 2277160.00 | 2279244.00 | 41.94 | 40.17 | 43.10 | 41.86 | 41.26 | 7366.00 | 5305.00 | 5350.00 | 4996.00 | 3869.00 | 3402.00 | 4833.00 | 3063.00 | 2965.00 | 4495.00 | 3202.00 | 3172.00 | 9529.00 | 6783.00 | 7001.00 | 135758.89 | 188501.41 | 186915.89 | 200160.13 | 258464.72 | 293944.74 | 206910.82 | 326477.31 | 337268.13 | 222469.41 | 312304.81 | 315258.51 | 104942.81 | 147427.39 | 142836.74 |
| pg-src-master--1 | 2259484.00 | 2277312.00 | 2277100.00 | 2277144.00 | 2278592.00 | 40.38 | 40.02 | 40.88 | 40.06 | 40.26 | 7373.00 | 5476.00 | 5748.00 | 4875.00 | 3857.00 | 3546.00 | 4662.00 | 3057.00 | 3044.00 | 4540.00 | 3143.00 | 3124.00 | 11351.00 | 6673.00 | 7118.00 | 135630.00 | 182615.05 | 173973.56 | 205128.21 | 259268.86 | 282007.90 | 214500.21 | 327118.09 | 328515.11 | 220264.32 | 318167.36 | 320102.43 | 88097.96 | 149857.64 | 140488.90 |
| pg-src-16--2 | 2259516.00 | 2277596.00 | 2277496.00 | 2277160.00 | 2277960.00 | 42.14 | 41.74 | 41.35 | 42.36 | 40.76 | 7756.00 | 5401.00 | 5390.00 | 5677.00 | 3500.00 | 3375.00 | 4539.00 | 3140.00 | 3102.00 | 4616.00 | 3137.00 | 3118.00 | 9125.00 | 6741.00 | 6680.00 | 128932.44 | 185150.90 | 185528.76 | 176149.37 | 285714.29 | 296296.30 | 220312.84 | 318471.34 | 322372.66 | 216637.78 | 318775.90 | 320718.41 | 109589.04 | 148345.94 | 149700.60 |
| pg-src-master--2 | 2259488.00 | 2277572.00 | 2277480.00 | 2277148.00 | 2277948.00 | 42.25 | 41.53 | 42.64 | 41.02 | 42.85 | 7219.00 | 5504.00 | 5880.00 | 5672.00 | 3420.00 | 3310.00 | 4586.00 | 3081.00 | 3165.00 | 4484.00 | 3122.00 | 3082.00 | 9116.00 | 6910.00 | 7384.00 | 138523.34 | 181686.05 | 170068.03 | 176304.65 | 292397.66 | 302114.80 | 218054.95 | 324569.94 | 315955.77 | 223015.17 | 320307.50 | 324464.63 | 109697.24 | 144717.80 | 135427.95 |
| pg-src-master--3 | 2259492.00 | 2277568.00 | 2277216.00 | 2277140.00 | 2279476.00 | 41.86 | 40.83 | 42.67 | 41.41 | 40.76 | 7401.00 | 5446.00 | 5812.00 | 5541.00 | 3447.00 | 3393.00 | 4635.00 | 3059.00 | 3069.00 | 4609.00 | 3150.00 | 3056.00 | 9011.00 | 6827.00 | 7057.00 | 135116.88 | 183621.01 | 172057.81 | 180472.84 | 290107.34 | 294724.43 | 215749.73 | 326904.22 | 325839.04 | 216966.80 | 317460.32 | 327225.13 | 110975.47 | 146477.22 | 141703.27 |
| pg-src-16--3 | 2259512.00 | 2277344.00 | 2276732.00 | 2277164.00 | 2279500.00 | 40.10 | 41.73 | 42.44 | 42.34 | 40.73 | 7477.00 | 5357.00 | 5413.00 | 4903.00 | 3936.00 | 3453.00 | 4681.00 | 3085.00 | 3180.00 | 4521.00 | 3165.00 | 3097.00 | 9308.00 | 6835.00 | 6792.00 | 133743.48 | 186671.64 | 184740.44 | 203956.76 | 254065.04 | 289603.24 | 213629.57 | 324149.11 | 314465.41 | 221190.00 | 315955.77 | 322893.12 | 107434.46 | 146305.78 | 147232.04 |
Benchmark benchmarksql_tpcc| Instance | tpm_total | xacts | data_size |
|---|
| pg-src-16--1 | 205365.00 | 616142.00 | 2770484.00 |
| pg-src-master--1 | 180032.00 | 540147.00 | 2662452.00 |
| pg-src-16--2 | 193129.00 | 579412.00 | 2730544.00 |
| pg-src-master--2 | 212485.00 | 637487.00 | 2759256.00 |
| pg-src-master--3 | 198731.00 | 596240.00 | 2713388.00 |
| pg-src-16--3 | 215657.00 | 646981.00 | 2808516.00 |
Benchmark benchbase| Instance | auctionmark_rps | epinions_rps | hyadapt_rps | otmetrics_rps | resourcestresser_rps | seats_rps | sibench_rps | smallbank_rps | tatp_rps | tpcc_rps | tpch_rps | twitter_rps | voter_rps | ycsb_rps |
|---|
| pg-src-16--1 | 155.13 | 79317.56 | 13920.48 | 7118.98 | 1.26 | 10926.70 | 54185.90 | 36860.46 | 97460.04 | 6959.84 | 0.29 | 73358.83 | 44008.30 | 123319.57 |
| pg-src-master--1 | 142.97 | 85651.30 | 13785.14 | 7081.71 | 1.51 | 11051.04 | 54174.94 | 35307.73 | 99901.16 | 6405.83 | 0.29 | 75820.46 | 43766.91 | 127570.43 |
| pg-src-16--2 | 161.67 | 82043.68 | 15250.94 | 6943.96 | 1.15 | 9698.12 | 78324.62 | 35008.89 | 96210.59 | 6962.83 | 0.29 | 75629.01 | 45061.72 | 125973.72 |
| pg-src-master--2 | 145.55 | 86317.04 | 14594.67 | 7615.51 | 1.36 | 10106.41 | 62849.73 | 34462.66 | 99531.49 | 6221.76 | 0.30 | 74995.02 | 45214.80 | 127572.59 |
| pg-src-master--3 | 158.90 | 86684.36 | 13765.86 | 7844.34 | 1.03 | 10552.68 | 53621.81 | 35164.37 | 97183.46 | 6897.16 | 0.29 | 75698.36 | 44001.27 | 125992.97 |
| pg-src-16--3 | 170.17 | 81167.01 | 14691.79 | 7119.66 | 1.41 | 9676.44 | 65311.71 | 37311.84 | 100287.26 | 6853.22 | 0.29 | 73851.38 | 44620.00 | 124705.11 |
Benchmark gdprbench| Instance | load_controller_ops | run_controller_ops | load_customer_ops | run_customer_ops | load_processor_ops | run_processor_ops |
|---|
| pg-src-16--1 | 17094.02 | 1788.91 | 17123.29 | 2000.00 | 16977.93 | 1297.02 |
| pg-src-master--1 | 16835.02 | 1798.56 | 18691.59 | 2028.40 | 19841.27 | 1333.33 |
| pg-src-16--2 | 17605.63 | 1763.67 | 16835.02 | 1893.94 | 16949.15 | 1344.09 |
| pg-src-master--2 | 17035.78 | 1872.66 | 17301.04 | 2012.07 | 16863.41 | 1338.69 |
| pg-src-master--3 | 17182.13 | 1808.32 | 17182.13 | 2036.66 | 17391.30 | 1356.85 |
| pg-src-16--3 | 19230.77 | 1779.36 | 16077.17 | 1934.24 | 17391.30 | 1293.66 |
Benchmark s64da_tpch| Instance | total | query1 | query2 | query3 | query4 | query5 | query6 | query7 | query8 | query9 | query10 | query11 | query12 | query13 | query14 | query15 | query16 | query17 | query18 | query19 | query20 | query21 | query22 |
|---|
| pg-src-16--1 | 68.09 | 9.24 | 1.42 | 2.90 | 0.90 | 1.60 | 1.36 | 1.91 | 1.13 | 4.70 | 2.23 | 0.71 | 2.50 | 2.89 | 0.86 | 1.53 | 1.03 | 4.31 | 20.66 | 0.18 | 1.03 | 4.79 | 0.21 |
| pg-src-master--1 | 65.12 | 8.65 | 1.38 | 2.77 | 0.89 | 1.48 | 1.26 | 1.79 | 1.03 | 4.68 | 2.16 | 0.75 | 2.34 | 2.79 | 0.87 | 1.41 | 1.01 | 4.15 | 19.61 | 0.19 | 1.05 | 4.69 | 0.20 |
| pg-src-16--2 | 67.31 | 9.23 | 1.37 | 2.89 | 0.89 | 1.61 | 1.36 | 1.91 | 1.10 | 3.92 | 2.24 | 0.73 | 2.52 | 2.84 | 0.86 | 1.54 | 1.02 | 4.38 | 20.65 | 0.19 | 1.06 | 4.79 | 0.21 |
| pg-src-master--2 | 64.30 | 8.68 | 1.38 | 2.76 | 0.90 | 1.56 | 1.25 | 1.80 | 1.09 | 3.91 | 2.12 | 0.73 | 2.33 | 2.84 | 0.87 | 1.43 | 1.01 | 4.15 | 19.49 | 0.18 | 1.05 | 4.59 | 0.20 |
| pg-src-master--3 | 64.90 | 8.69 | 1.40 | 2.75 | 0.89 | 1.58 | 1.29 | 1.81 | 1.06 | 4.01 | 2.16 | 0.74 | 2.34 | 2.84 | 0.87 | 1.47 | 1.02 | 4.24 | 19.58 | 0.18 | 1.15 | 4.63 | 0.20 |
| pg-src-16--3 | 68.25 | 9.28 | 1.39 | 2.89 | 0.89 | 1.62 | 1.37 | 1.93 | 1.09 | 4.70 | 2.28 | 0.74 | 2.51 | 2.84 | 0.87 | 1.53 | 1.02 | 4.31 | 20.78 | 0.19 | 1.04 | 4.78 | 0.21 |
Benchmark s64da_tpcds| Instance | total | query1 | query2 | query3 | query5 | query6 | query7 | query8 | query9 | query12 | query13 | query14a | query14b | query15 | query16 | query17 | query18 | query19 | query20 | query21 | query22 | query23a | query23b | query24a | query24b | query25 | query26 | query27 | query28 | query29 | query30 | query31 | query32 | query33 | query34 | query35 | query36 | query37 | query38 | query39a | query39b | query40 | query41 | query42 | query43 | query44 | query45 | query46 | query47 | query48 | query49 | query50 | query51 | query52 | query53 | query54 | query55 | query56 | query57 | query58 | query59 | query60 | query61 | query62 | query63 | query64 | query65 | query66 | query67 | query68 | query69 | query70 | query71 | query72 | query73 | query75 | query76 | query78 | query79 | query80 | query81 | query82 | query83 | query84 | query85 | query86 | query87 | query88 | query89 | query90 | query91 | query92 | query93 | query94 | query95 | query96 | query97 | query98 | query99 |
|---|
| pg-src-16--1 | 2709.68 | 0.00 | 0.97 | 0.02 | 0.58 | 206.97 | 1.15 | 0.07 | 2.58 | 0.05 | 0.64 | 31.46 | 68.61 | 0.14 | 0.10 | 0.94 | 0.70 | 0.24 | 0.07 | 0.12 | 4.77 | 7.09 | 7.05 | 0.01 | 0.01 | 0.65 | 0.57 | 0.99 | 1.99 | 0.42 | 55.83 | 17.15 | 0.05 | 0.34 | 0.25 | 2.32 | 0.82 | 0.01 | 2.19 | 4.29 | 4.36 | 0.08 | 1.16 | 0.32 | 0.01 | 0.00 | 1.32 | 0.50 | 2.21 | 0.78 | 0.16 | 0.07 | 2.62 | 0.32 | 0.48 | 0.11 | 0.22 | 1.11 | 1.10 | 0.12 | 1.58 | 2.38 | 0.01 | 0.22 | 0.50 | 0.62 | 1.49 | 0.29 | 1.94 | 0.23 | 0.14 | 1.14 | 0.15 | 21.70 | 0.21 | 2.07 | 0.38 | 2.92 | 0.40 | 0.42 | 248.99 | 0.01 | 0.10 | 0.03 | 0.18 | 0.27 | 2.21 | 1.73 | 0.36 | 0.15 | 0.05 | 0.07 | 0.10 | 0.09 | 175.40 | 0.21 | 1.07 | 0.26 | 0.39 |
| pg-src-master--1 | 3652.11 | 930.75 | 0.94 | 0.01 | 0.58 | 202.32 | 1.13 | 0.06 | 2.41 | 0.05 | 0.62 | 31.57 | 68.06 | 0.23 | 0.12 | 0.91 | 1.02 | 0.30 | 0.07 | 0.20 | 4.46 | 6.85 | 6.85 | 0.01 | 0.01 | 0.64 | 0.84 | 0.98 | 1.86 | 0.42 | 54.56 | 16.92 | 0.06 | 0.25 | 0.23 | 2.35 | 0.80 | 0.01 | 2.20 | 3.93 | 3.94 | 0.11 | 1.14 | 0.28 | 0.01 | 0.00 | 1.33 | 0.48 | 2.31 | 0.75 | 0.16 | 0.06 | 2.44 | 0.28 | 0.50 | 0.11 | 0.28 | 1.11 | 1.47 | 0.12 | 1.35 | 2.35 | 0.01 | 0.21 | 0.48 | 0.56 | 1.37 | 0.40 | 1.86 | 0.21 | 0.14 | 1.08 | 0.24 | 25.95 | 0.19 | 1.85 | 0.38 | 3.23 | 0.37 | 0.56 | 243.61 | 0.01 | 0.10 | 0.02 | 0.17 | 0.27 | 2.23 | 1.56 | 0.34 | 0.14 | 0.05 | 0.06 | 0.09 | 0.08 | 195.95 | 0.19 | 1.07 | 0.24 | 0.69 |
| pg-src-16--2 | 2706.13 | 0.00 | 0.96 | 0.01 | 0.61 | 206.37 | 1.15 | 0.06 | 2.59 | 0.05 | 0.65 | 31.55 | 68.61 | 0.13 | 0.09 | 0.92 | 0.71 | 0.24 | 0.07 | 0.12 | 4.74 | 7.01 | 6.92 | 0.01 | 0.01 | 0.66 | 0.53 | 0.99 | 1.97 | 0.41 | 55.69 | 17.31 | 0.05 | 0.21 | 0.26 | 2.31 | 0.82 | 0.01 | 2.19 | 4.17 | 4.21 | 0.08 | 1.17 | 0.31 | 0.01 | 0.00 | 1.29 | 0.50 | 2.21 | 0.77 | 0.16 | 0.07 | 2.63 | 0.31 | 0.50 | 0.11 | 0.21 | 1.07 | 1.10 | 0.12 | 1.57 | 2.29 | 0.01 | 0.22 | 0.51 | 0.59 | 1.47 | 0.31 | 1.92 | 0.23 | 0.14 | 1.13 | 0.15 | 21.00 | 0.21 | 2.15 | 0.37 | 2.80 | 0.40 | 0.53 | 249.14 | 0.01 | 0.10 | 0.02 | 0.17 | 0.27 | 2.23 | 1.72 | 0.36 | 0.16 | 0.05 | 0.08 | 0.09 | 0.09 | 173.77 | 0.21 | 1.07 | 0.26 | 0.37 |
| pg-src-master--2 | 3818.81 | 928.40 | 0.94 | 0.01 | 0.57 | 202.53 | 1.15 | 0.05 | 2.42 | 0.05 | 0.62 | 31.82 | 67.36 | 0.23 | 0.12 | 0.93 | 1.02 | 0.30 | 0.07 | 0.20 | 4.47 | 6.84 | 6.82 | 0.01 | 0.01 | 0.66 | 0.86 | 0.99 | 1.86 | 0.42 | 55.64 | 16.91 | 0.06 | 0.25 | 0.23 | 2.31 | 0.80 | 0.01 | 2.21 | 4.04 | 4.06 | 0.08 | 1.14 | 0.29 | 0.01 | 0.00 | 1.29 | 0.49 | 2.34 | 0.75 | 0.16 | 0.10 | 2.47 | 0.28 | 0.51 | 0.11 | 0.28 | 1.13 | 1.49 | 0.12 | 1.35 | 2.37 | 0.01 | 0.21 | 0.51 | 0.56 | 1.37 | 0.40 | 1.86 | 0.21 | 0.14 | 1.08 | 0.23 | 25.82 | 0.19 | 1.86 | 0.38 | 3.25 | 0.38 | 0.56 | 246.66 | 0.01 | 0.10 | 0.02 | 0.17 | 0.27 | 2.25 | 1.55 | 0.34 | 0.14 | 0.05 | 0.06 | 0.09 | 0.08 | 360.86 | 0.18 | 1.07 | 0.24 | 0.66 |
| pg-src-master--3 | 3652.93 | 931.43 | 0.93 | 0.01 | 0.57 | 204.56 | 1.13 | 0.07 | 2.42 | 0.05 | 0.61 | 31.49 | 67.43 | 0.24 | 0.12 | 0.92 | 1.01 | 0.23 | 0.07 | 0.20 | 4.45 | 6.76 | 6.83 | 0.01 | 0.01 | 0.64 | 0.84 | 0.98 | 1.86 | 0.41 | 54.56 | 16.83 | 0.06 | 0.25 | 0.24 | 2.30 | 0.81 | 0.01 | 2.24 | 3.91 | 3.91 | 0.11 | 1.13 | 0.33 | 0.01 | 0.00 | 1.28 | 0.48 | 2.30 | 0.75 | 0.16 | 0.06 | 2.42 | 0.32 | 0.47 | 0.11 | 0.20 | 1.09 | 1.71 | 0.12 | 1.35 | 2.29 | 0.01 | 0.21 | 0.49 | 0.56 | 1.36 | 0.39 | 1.85 | 0.21 | 0.14 | 1.08 | 0.15 | 25.58 | 0.19 | 1.72 | 0.38 | 3.04 | 0.37 | 0.55 | 243.34 | 0.01 | 0.10 | 0.02 | 0.17 | 0.27 | 2.25 | 1.57 | 0.34 | 0.14 | 0.05 | 0.07 | 0.09 | 0.08 | 195.93 | 0.20 | 1.05 | 0.24 | 0.67 |
| pg-src-16--3 | 2706.19 | 0.00 | 0.97 | 0.02 | 0.59 | 207.02 | 1.13 | 0.06 | 2.57 | 0.05 | 0.64 | 30.90 | 68.12 | 0.14 | 0.09 | 0.90 | 0.70 | 0.30 | 0.07 | 0.12 | 4.71 | 6.95 | 6.93 | 0.01 | 0.01 | 0.63 | 0.57 | 0.98 | 1.97 | 0.41 | 55.79 | 17.18 | 0.05 | 0.21 | 0.25 | 2.29 | 0.82 | 0.01 | 2.18 | 4.27 | 4.28 | 0.08 | 1.15 | 0.29 | 0.01 | 0.00 | 1.29 | 0.50 | 2.19 | 0.76 | 0.16 | 0.06 | 2.63 | 0.29 | 0.48 | 0.11 | 0.29 | 1.06 | 1.09 | 0.12 | 1.58 | 2.26 | 0.01 | 0.22 | 0.50 | 0.60 | 1.47 | 0.30 | 1.91 | 0.23 | 0.14 | 1.13 | 0.25 | 20.70 | 0.21 | 2.06 | 0.39 | 2.84 | 0.40 | 0.55 | 249.23 | 0.01 | 0.10 | 0.03 | 0.17 | 0.27 | 2.20 | 1.70 | 0.36 | 0.15 | 0.05 | 0.07 | 0.09 | 0.09 | 174.60 | 0.21 | 1.07 | 0.25 | 0.38 |
Benchmark s64da_ssb| Instance | total | queryQ1.1 | queryQ1.2 | queryQ1.3 | queryQ2.1 | queryQ2.2 | queryQ2.3 | queryQ3.1 | queryQ3.2 | queryQ3.3 | queryQ3.4 | queryQ4.1 | queryQ4.2 | queryQ4.3 |
|---|
| pg-src-16--1 | 32.62 | 2.55 | 2.46 | 2.45 | 2.51 | 2.39 | 2.12 | 3.15 | 2.09 | 1.89 | 1.88 | 3.29 | 3.12 | 2.73 |
| pg-src-master--1 | 31.01 | 2.39 | 2.37 | 2.30 | 2.38 | 2.27 | 1.98 | 3.33 | 1.94 | 1.76 | 1.75 | 3.03 | 2.91 | 2.60 |
| pg-src-16--2 | 33.17 | 2.57 | 2.44 | 2.44 | 2.78 | 2.40 | 2.15 | 3.13 | 2.33 | 1.89 | 1.90 | 3.26 | 3.11 | 2.77 |
| pg-src-master--2 | 31.34 | 2.41 | 2.32 | 2.28 | 2.64 | 2.29 | 2.01 | 3.34 | 1.96 | 1.75 | 1.74 | 3.08 | 2.96 | 2.56 |
| pg-src-master--3 | 30.31 | 2.39 | 2.35 | 2.26 | 2.63 | 2.24 | 1.98 | 2.92 | 1.92 | 1.75 | 1.75 | 3.03 | 2.92 | 2.19 |
| pg-src-16--3 | 33.38 | 2.54 | 2.45 | 2.43 | 2.79 | 2.39 | 2.18 | 3.51 | 2.11 | 1.89 | 1.89 | 3.37 | 3.10 | 2.73 |
Benchmark job| Instance | query10a | query10b | query10c | query11a | query11b | query11c | query11d | query12a | query12b | query12c | query13a | query13b | query13c | query13d | query14a | query14b | query14c | query15a | query15b | query15c | query15d | query16a | query16b | query16c | query16d | query17a | query17b | query17c | query17d | query17e | query17f | query18a | query18b | query18c | query19a | query19b | query19c | query19d | query1a | query1b | query1c | query1d | query20a | query20b | query20c | query21a | query21b | query21c | query22a | query22b | query22c | query22d | query23a | query23b | query23c | query24a | query24b | query25a | query25b | query25c | query26a | query26b | query26c | query27a | query27b | query27c | query28a | query28b | query28c | query29a | query29b | query29c | query2a | query2b | query2c | query2d | query30a | query30b | query30c | query31a | query31b | query31c | query32a | query32b | query33a | query33b | query33c | query3a | query3b | query3c | query4a | query4b | query4c | query5a | query5b | query5c | query6a | query6b | query6c | query6d | query6e | query6f | query7a | query7b | query7c | query8a | query8b | query8c | query8d | query9a | query9b | query9c | query9d |
|---|
| pg-src-16--1 | 0.57 | 0.39 | 3.31 | 0.44 | 0.10 | 1.12 | 4.63 | 0.40 | 0.06 | 1.05 | 1.26 | 0.66 | 0.62 | 4.37 | 0.67 | 0.17 | 0.97 | 0.32 | 0.04 | 0.86 | 0.96 | 0.22 | 17.33 | 1.66 | 1.29 | 9.71 | 7.86 | 7.64 | 7.65 | 11.55 | 10.06 | 0.40 | 0.57 | 6.44 | 3.97 | 0.22 | 6.64 | 7.21 | 0.08 | 0.06 | 0.06 | 0.06 | 2.56 | 1.16 | 0.82 | 0.35 | 0.26 | 0.49 | 0.63 | 0.47 | 2.18 | 1.40 | 0.58 | 0.07 | 0.37 | 1.94 | 0.07 | 4.09 | 0.65 | 11.70 | 0.77 | 0.17 | 0.77 | 0.34 | 0.22 | 0.74 | 0.52 | 0.57 | 2.37 | 0.11 | 0.08 | 0.21 | 0.50 | 0.49 | 0.46 | 0.60 | 12.30 | 0.71 | 11.66 | 3.21 | 0.68 | 3.25 | 0.01 | 1.22 | 14.79 | 0.86 | 0.91 | 0.17 | 0.12 | 0.24 | 0.09 | 0.12 | 0.10 | 0.17 | 0.16 | 0.23 | 0.07 | 1.21 | 0.03 | 6.44 | 0.08 | 6.62 | 0.27 | 0.20 | 13.16 | 2.35 | 0.19 | 5.05 | 3.19 | 2.68 | 1.45 | 2.47 | 4.51 |
| pg-src-master--1 | 0.56 | 0.38 | 3.16 | 0.28 | 0.09 | 1.14 | 4.70 | 0.40 | 0.06 | 1.07 | 1.35 | 0.68 | 0.65 | 2.04 | 0.69 | 0.18 | 0.98 | 0.33 | 0.04 | 0.71 | 0.91 | 0.24 | 17.31 | 1.65 | 1.33 | 9.63 | 7.89 | 7.56 | 7.68 | 11.32 | 10.06 | 0.52 | 1.36 | 6.36 | 0.30 | 0.19 | 6.49 | 6.96 | 0.08 | 0.05 | 0.06 | 0.05 | 2.59 | 1.17 | 0.84 | 0.35 | 0.25 | 0.49 | 0.62 | 0.47 | 2.20 | 1.40 | 0.68 | 0.07 | 0.35 | 1.41 | 0.07 | 4.00 | 0.50 | 11.86 | 0.41 | 0.21 | 0.83 | 0.34 | 0.21 | 0.75 | 0.84 | 0.57 | 1.13 | 0.32 | 0.07 | 0.21 | 0.50 | 0.49 | 0.45 | 0.60 | 2.98 | 0.70 | 3.74 | 3.20 | 0.69 | 3.25 | 0.02 | 1.24 | 3.14 | 1.94 | 2.52 | 0.18 | 0.12 | 0.26 | 0.10 | 0.12 | 0.11 | 0.16 | 0.16 | 0.22 | 0.07 | 1.34 | 0.05 | 7.19 | 0.09 | 7.30 | 0.26 | 0.18 | 12.19 | 2.32 | 0.19 | 4.87 | 3.13 | 0.29 | 0.26 | 2.27 | 4.30 |
| pg-src-16--2 | 0.57 | 0.39 | 3.32 | 0.28 | 0.09 | 1.13 | 4.73 | 0.40 | 0.06 | 1.07 | 1.28 | 0.66 | 0.63 | 1.99 | 0.66 | 0.17 | 0.96 | 0.34 | 0.04 | 0.85 | 0.95 | 0.23 | 17.18 | 1.64 | 1.32 | 9.61 | 7.80 | 7.56 | 7.65 | 11.32 | 9.95 | 0.40 | 1.35 | 6.35 | 3.95 | 0.21 | 6.58 | 7.14 | 0.08 | 0.06 | 0.06 | 0.06 | 2.61 | 1.16 | 0.81 | 0.36 | 0.25 | 0.49 | 0.62 | 0.44 | 2.14 | 1.37 | 0.59 | 0.07 | 0.37 | 1.75 | 0.08 | 3.93 | 0.50 | 12.29 | 0.38 | 0.21 | 0.74 | 0.34 | 0.21 | 0.74 | 0.87 | 0.42 | 2.24 | 0.11 | 0.07 | 0.22 | 0.50 | 0.48 | 0.45 | 0.62 | 11.58 | 0.68 | 5.64 | 3.22 | 0.67 | 3.20 | 0.02 | 1.23 | 2.55 | 22.09 | 2.52 | 0.17 | 0.12 | 0.26 | 0.10 | 0.12 | 0.11 | 0.17 | 0.16 | 0.22 | 0.06 | 1.22 | 0.04 | 6.37 | 0.08 | 6.46 | 0.28 | 0.20 | 12.20 | 2.33 | 0.19 | 4.83 | 3.17 | 2.68 | 0.31 | 2.46 | 4.56 |
| pg-src-master--2 | 0.56 | 0.38 | 3.18 | 0.28 | 0.09 | 1.13 | 4.73 | 0.40 | 0.06 | 1.09 | 1.35 | 0.69 | 0.66 | 2.06 | 0.68 | 0.18 | 1.04 | 0.33 | 0.04 | 2.48 | 0.91 | 0.22 | 17.34 | 1.64 | 1.30 | 9.75 | 7.86 | 7.58 | 7.72 | 11.50 | 10.16 | 4.71 | 1.37 | 6.33 | 3.86 | 0.20 | 6.51 | 6.96 | 0.07 | 0.05 | 0.06 | 0.06 | 2.63 | 1.18 | 0.87 | 0.36 | 0.26 | 0.50 | 0.65 | 0.48 | 2.24 | 1.46 | 0.67 | 0.07 | 0.80 | 1.77 | 0.07 | 4.08 | 0.51 | 11.99 | 0.40 | 0.21 | 1.21 | 0.28 | 0.21 | 0.74 | 0.95 | 0.57 | 0.46 | 0.16 | 0.08 | 0.22 | 0.51 | 0.48 | 0.45 | 0.60 | 5.40 | 0.70 | 11.38 | 3.23 | 0.68 | 3.26 | 0.01 | 1.24 | 2.75 | 0.89 | 2.51 | 0.19 | 0.12 | 0.26 | 0.10 | 0.12 | 0.11 | 0.17 | 0.15 | 0.23 | 0.07 | 1.35 | 0.05 | 7.21 | 0.08 | 7.31 | 0.26 | 0.18 | 12.29 | 2.32 | 0.20 | 4.96 | 3.11 | 2.44 | 1.46 | 2.28 | 4.29 |
| pg-src-master--3 | 0.57 | 0.39 | 3.16 | 0.28 | 0.09 | 1.14 | 4.73 | 0.42 | 0.06 | 1.10 | 1.36 | 0.70 | 0.66 | 4.62 | 0.67 | 0.18 | 0.97 | 0.34 | 0.04 | 0.72 | 0.91 | 0.22 | 17.84 | 1.68 | 1.32 | 9.81 | 8.00 | 7.76 | 7.91 | 11.59 | 10.23 | 0.40 | 1.41 | 6.44 | 3.96 | 0.20 | 6.66 | 7.01 | 0.08 | 0.05 | 0.06 | 0.05 | 2.66 | 1.18 | 0.75 | 0.36 | 0.26 | 0.49 | 0.64 | 0.48 | 2.20 | 1.40 | 0.56 | 0.08 | 0.35 | 1.92 | 0.08 | 4.00 | 0.50 | 11.72 | 0.82 | 0.22 | 2.28 | 0.37 | 0.21 | 0.76 | 0.67 | 0.43 | 2.42 | 0.25 | 0.07 | 0.17 | 0.50 | 0.50 | 0.47 | 0.61 | 2.16 | 0.68 | 11.69 | 3.24 | 0.69 | 3.26 | 0.02 | 1.25 | 1.08 | 0.78 | 2.54 | 0.18 | 0.12 | 0.27 | 0.10 | 0.12 | 0.11 | 0.16 | 0.16 | 0.22 | 0.07 | 1.41 | 0.05 | 7.39 | 0.09 | 7.54 | 0.27 | 0.19 | 12.56 | 2.40 | 0.20 | 5.00 | 3.12 | 2.46 | 1.50 | 2.31 | 4.35 |
| pg-src-16--3 | 0.58 | 0.39 | 3.30 | 0.28 | 0.09 | 1.13 | 4.63 | 0.40 | 0.06 | 1.07 | 1.28 | 0.67 | 0.62 | 1.99 | 0.67 | 0.17 | 0.95 | 0.34 | 0.04 | 0.86 | 0.96 | 0.24 | 17.02 | 1.64 | 1.30 | 9.72 | 7.81 | 7.61 | 7.64 | 11.23 | 10.00 | 0.38 | 1.36 | 6.47 | 3.96 | 0.20 | 6.61 | 7.16 | 0.08 | 0.06 | 0.06 | 0.06 | 2.62 | 1.17 | 0.65 | 0.34 | 0.26 | 0.48 | 0.60 | 0.44 | 2.15 | 1.39 | 0.58 | 0.07 | 0.36 | 1.77 | 0.08 | 3.98 | 0.50 | 11.68 | 0.74 | 0.20 | 2.06 | 0.34 | 0.32 | 0.76 | 0.93 | 0.56 | 2.27 | 0.15 | 0.45 | 0.23 | 0.50 | 0.48 | 0.44 | 0.59 | 5.42 | 0.71 | 3.75 | 3.17 | 0.67 | 3.19 | 0.02 | 1.21 | 2.20 | 0.80 | 2.50 | 0.19 | 0.12 | 0.27 | 0.10 | 0.12 | 0.11 | 0.17 | 0.17 | 0.21 | 0.07 | 1.29 | 0.04 | 6.47 | 0.08 | 6.59 | 0.27 | 0.20 | 12.02 | 2.33 | 0.20 | 5.04 | 3.20 | 2.64 | 0.29 | 2.46 | 4.49 |
Benchmark sysbench| Instance | load_bulk_insert_tps | load_oltp_delete_tps | load_oltp_insert_tps | load_oltp_point_select_tps | load_oltp_read_only_tps | load_oltp_read_write_tps | load_oltp_update_index_tps | load_oltp_update_non_index_tps | load_oltp_write_only_tps | load_select_random_points_tps | load_select_random_ranges_tps | load_bulk_insert_ops | load_oltp_delete_ops | load_oltp_insert_ops | load_oltp_point_select_ops | load_oltp_read_only_ops | load_oltp_read_write_ops | load_oltp_update_index_ops | load_oltp_update_non_index_ops | load_oltp_write_only_ops | load_select_random_points_ops | load_select_random_ranges_ops |
|---|
| pg-src-16--1 | 2239310.80 | 357117.05 | 127288.29 | 346271.04 | 14671.85 | 8812.62 | 151218.93 | 176010.69 | 25207.98 | 214379.86 | 144092.43 | 78.54 | 357117.05 | 127288.29 | 346271.04 | 234749.59 | 176329.50 | 151218.93 | 176010.69 | 151504.88 | 214379.86 | 144092.43 |
| pg-src-master--1 | 2412944.91 | 366778.22 | 130358.55 | 353037.52 | 14972.68 | 9127.93 | 150506.38 | 180389.11 | 29556.30 | 259400.37 | 147098.78 | 85.12 | 366778.22 | 130358.55 | 353037.52 | 239562.80 | 182645.81 | 150506.38 | 180389.11 | 177648.26 | 259400.37 | 147098.78 |
| pg-src-16--2 | 2294793.78 | 368366.64 | 128020.20 | 353459.52 | 14812.03 | 8949.93 | 151231.72 | 179670.40 | 29632.32 | 218079.77 | 146280.25 | 80.66 | 368366.64 | 128020.20 | 353459.52 | 236992.56 | 179080.25 | 151231.72 | 179670.40 | 178106.37 | 218079.77 | 146280.25 |
| pg-src-master--2 | 2414900.66 | 362718.87 | 129802.73 | 349019.47 | 14932.07 | 9294.81 | 148078.97 | 175166.77 | 28153.47 | 255868.12 | 143556.88 | 85.22 | 362718.87 | 129802.73 | 349019.47 | 238913.13 | 185988.55 | 148078.97 | 175166.77 | 169203.11 | 255868.12 | 143556.88 |
| pg-src-master--3 | 2359194.37 | 367318.02 | 128577.22 | 354433.95 | 14759.47 | 8948.13 | 148556.96 | 178381.96 | 27852.43 | 259281.03 | 145294.32 | 83.09 | 367318.02 | 128577.22 | 354433.95 | 236151.49 | 179039.02 | 148556.96 | 178381.96 | 167395.10 | 259281.03 | 145294.32 |
| pg-src-16--3 | 2265793.45 | 353323.64 | 123067.01 | 343356.05 | 14549.85 | 8659.81 | 146659.80 | 170040.76 | 27223.09 | 213049.76 | 139908.73 | 79.55 | 353323.64 | 123067.01 | 343356.05 | 232797.57 | 173282.06 | 146659.80 | 170040.76 | 163622.61 | 213049.76 | 139908.73 |
Benchmark insert-1m| Instance | time |
|---|
| pg-src-16--1 | 36.99 |
| pg-src-master--1 | 37.75 |
| pg-src-16--2 | 37.79 |
| pg-src-master--2 | 35.41 |
| pg-src-master--3 | 35.72 |
| pg-src-16--3 | 36.48 |
