Tim Armstrong has posted comments on this change.
Change subject: Update LLVM to 3.7
......................................................................
Patch Set 2:
Updated single node perf results for targeted, tpch and tpcds. There are a few
queries where runtime performance, not just startup time, has regressed
significantly. I need to investigate hose.
Report Generated on 2016-03-09
Run Description: "Base: 158b9d88b795c4dc3d100d4895c6f858f17976fd vs
Ref: b39d44247b0ee1f5dc224b5d625df53e91539a64"
Cluster Name: UNKNOWN
Lab Run Info: UNKNOWN
Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
Baseline Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
+--------------------+-----------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) |
GeoMean(s) | Delta(GeoMean) |
+--------------------+-----------------------+---------+------------+------------+----------------+
| TARGETED-PERF(_20) | parquet / none / none | 10.20 | +1.29% |
3.81 | +3.66% |
+--------------------+-----------------------+---------+------------+------------+----------------+
+--------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+
| Workload | Query
| File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%)
| Base StdDev(%) | Num Clients | Iters |
+--------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+
| TARGETED-PERF(_20) | PERF_AGG-Q4
| parquet / none / none | 14.33 | 11.43 | R +25.31% | 2.36%
| 3.36% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_groupby_decimal_highndv
| parquet / none / none | 19.36 | 15.71 | R +23.20% | 6.99%
| 2.44% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_filter_bigint_selective
| parquet / none / none | 1.07 | 0.97 | +9.74% | 0.21%
| 1.98% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_STRING-Q2
| parquet / none / none | 1.91 | 1.75 | +9.24% | 1.22%
| 1.42% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_filter_decimal_selective
| parquet / none / none | 1.85 | 1.70 | +9.07% | 1.31%
| 2.25% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_STRING-Q4
| parquet / none / none | 2.09 | 1.94 | +7.90% | 1.12%
| 1.27% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_STRING-Q3
| parquet / none / none | 2.01 | 1.88 | +7.02% | 0.86%
| 2.94% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_STRING-Q1
| parquet / none / none | 1.79 | 1.67 | +6.70% | 1.18%
| 1.70% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_STRING-Q5
| parquet / none / none | 2.26 | 2.13 | +6.40% | 1.01%
| 1.17% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_broadcast_join_1
| parquet / none / none | 1.42 | 1.33 | +6.35% | 0.26%
| 2.36% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_AGG-Q5
| parquet / none / none | 3.09 | 2.92 | +5.70% | 1.29%
| 1.38% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_filter_decimal_non_selective
| parquet / none / none | 2.00 | 1.90 | +5.41% | 2.21%
| 3.48% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_AGG-Q7
| parquet / none / none | 1.53 | 1.45 | +5.29% | 1.41%
| 1.57% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_AGG-Q2
| parquet / none / none | 3.62 | 3.45 | +5.11% | 2.63%
| 1.25% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_AGG-Q6
| parquet / none / none | 1.52 | 1.45 | +4.50% | 1.45%
| 1.57% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_broadcast_join_3
| parquet / none / none | 4.10 | 3.94 | +4.05% | 1.08%
| 2.22% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_orderby_bigint
| parquet / none / none | 3.26 | 3.16 | +3.42% | 0.98%
| 0.69% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_STRING-Q6
| parquet / none / none | 4.86 | 4.71 | +3.15% | 2.25%
| 0.79% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_broadcast_join_2
| parquet / none / none | 2.53 | 2.45 | +3.08% | 1.28%
| 2.97% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_topn_bigint
| parquet / none / none | 6.93 | 6.73 | +3.02% | 4.90%
| 0.92% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_exchange_broadcast
| parquet / none / none | 21.15 | 20.54 | +2.98% | 2.00%
| 1.07% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_AGG-Q1
| parquet / none / none | 1.91 | 1.86 | +2.73% | 1.15%
| 0.13% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_filter_string_non_selective
| parquet / none / none | 1.68 | 1.64 | +2.43% | 5.18%
| 2.59% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_filter_bigint_non_selective
| parquet / none / none | 1.23 | 1.21 | +2.20% | 1.83%
| * 14.77% * | 1 | 5 |
| TARGETED-PERF(_20) | PERF_AGG-Q3
| parquet / none / none | 5.41 | 5.31 | +1.88% | 0.46%
| 0.82% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_filter_string_selective
| parquet / none / none | 1.55 | 1.54 | +0.83% | 6.20%
| 6.79% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_orderby_all
| parquet / none / none | 13.51 | 13.47 | +0.31% | 0.67%
| 0.37% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_filter_string_like
| parquet / none / none | 6.48 | 6.47 | +0.26% | 1.36%
| 0.55% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_STRING-Q7
| parquet / none / none | 3.83 | 3.83 | -0.07% | 1.02%
| 0.55% | 1 | 5 |
| TARGETED-PERF(_20) | PERF_LIMIT-Q1
| parquet / none / none | 0.01 | 0.01 | -0.58% | * 46.33% *
| * 44.73% * | 1 | 5 |
| TARGETED-PERF(_20) | primitive_groupby_bigint_pk
| parquet / none / none | 40.56 | 41.12 | -1.37% | 0.49%
| 0.77% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_shuffle_join_union_all_with_groupby
| parquet / none / none | 20.15 | 20.43 | -1.38% | 0.36%
| 0.96% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_top-n_all
| parquet / none / none | 40.41 | 41.11 | -1.70% | 1.07%
| 1.02% | 1 | 5 |
| TARGETED-PERF(_20) |
primitive_shuffle_join_one_to_many_string_with_groupby | parquet / none / none
| 97.32 | 99.16 | -1.86% | 0.77% | 0.64% | 1
| 5 |
| TARGETED-PERF(_20) | primitive_exchange_shuffle
| parquet / none / none | 35.98 | 36.90 | -2.49% | 1.16%
| 0.74% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_groupby_bigint_highndv
| parquet / none / none | 11.04 | 11.33 | -2.55% | 0.59%
| 1.44% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_groupby_decimal_lowndv.test
| parquet / none / none | 2.03 | 2.09 | -2.99% | 2.69%
| 2.08% | 1 | 5 |
| TARGETED-PERF(_20) | primitive_groupby_bigint_lowndv
| parquet / none / none | 2.00 | 2.15 | -6.99% | 1.09%
| 3.03% | 1 | 5 |
+--------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+
(R) Regression: TARGETED-PERF(_20) PERF_AGG-Q4 [parquet / none / none]
(11.43s -> 14.33s [+25.31%])
+--------------+------------+--------+----------+------------+-----------+--------+----------+------------+--------+---------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+--------+----------+------------+-----------+--------+----------+------------+--------+---------+-----------+
| 01:AGGREGATE | 97.24% | 13.83s | 10.98s | +25.95% | 2.46%
| 14.18s | 11.41s | +24.32% | 1 | 200.00K | 200.52K |
+--------------+------------+--------+----------+------------+-----------+--------+----------+------------+--------+---------+-----------+
(R) Regression: TARGETED-PERF(_20) primitive_groupby_decimal_highndv
[parquet / none / none] (15.71s -> 19.36s [+23.20%])
+--------------+------------+--------+----------+------------+-----------+--------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+--------+----------+------------+-----------+--------+----------+------------+--------+-------+-----------+
| 01:AGGREGATE | 97.05% | 18.69s | 15.10s | +23.76% | 7.34%
| 21.02s | 15.57s | +35.03% | 1 | 1.78M | 1.74M |
+--------------+------------+--------+----------+------------+-----------+--------+----------+------------+--------+-------+-----------+
(V) Significant Variability: TARGETED-PERF(_20) PERF_LIMIT-Q1 [parquet
/ none / none] (44.73% -> 46.33%)
No Nodes with significant StdDev %
Significant perf change detected
Report Generated on 2016-03-09
Run Description: "Base: 158b9d88b795c4dc3d100d4895c6f858f17976fd vs
Ref: b39d44247b0ee1f5dc224b5d625df53e91539a64"
Cluster Name: UNKNOWN
Lab Run Info: UNKNOWN
Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
Baseline Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
+-----------+-----------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s)
| Delta(GeoMean) |
+-----------+-----------------------+---------+------------+------------+----------------+
| TPCH(_20) | parquet / none / none | 12.73 | +2.86% | 8.80
| +2.24% |
+-----------+-----------------------+---------+------------+------------+----------------+
+-----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| Workload | Query | File Format | Avg(s) | Base Avg(s) |
Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters |
+-----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| TPCH(_20) | TPCH-Q3 | parquet / none / none | 8.17 | 7.24 |
+12.80% | 0.50% | 2.03% | 1 | 5 |
| TPCH(_20) | TPCH-Q1 | parquet / none / none | 19.78 | 18.16 |
+8.93% | 0.57% | 1.69% | 1 | 5 |
| TPCH(_20) | TPCH-Q18 | parquet / none / none | 16.83 | 15.56 |
+8.19% | 6.11% | 1.78% | 1 | 5 |
| TPCH(_20) | TPCH-Q14 | parquet / none / none | 4.40 | 4.11 |
+7.10% | 2.19% | 1.59% | 1 | 5 |
| TPCH(_20) | TPCH-Q8 | parquet / none / none | 7.00 | 6.73 |
+4.01% | 1.29% | 1.45% | 1 | 5 |
| TPCH(_20) | TPCH-Q21 | parquet / none / none | 35.94 | 34.74 |
+3.45% | 0.95% | 1.14% | 1 | 5 |
| TPCH(_20) | TPCH-Q19 | parquet / none / none | 56.94 | 55.11 |
+3.32% | 1.34% | 0.84% | 1 | 5 |
| TPCH(_20) | TPCH-Q4 | parquet / none / none | 13.48 | 13.06 |
+3.18% | 1.48% | 5.07% | 1 | 5 |
| TPCH(_20) | TPCH-Q22 | parquet / none / none | 3.43 | 3.34 |
+2.56% | 2.18% | 1.14% | 1 | 5 |
| TPCH(_20) | TPCH-Q11 | parquet / none / none | 2.54 | 2.48 |
+2.52% | 1.58% | 3.50% | 1 | 5 |
| TPCH(_20) | TPCH-Q17 | parquet / none / none | 21.84 | 21.32 |
+2.44% | 1.40% | 0.45% | 1 | 5 |
| TPCH(_20) | TPCH-Q15 | parquet / none / none | 6.87 | 6.72 |
+2.19% | 2.10% | 1.64% | 1 | 5 |
| TPCH(_20) | TPCH-Q9 | parquet / none / none | 15.23 | 14.93 |
+2.04% | 1.40% | 1.48% | 1 | 5 |
| TPCH(_20) | TPCH-Q10 | parquet / none / none | 6.59 | 6.54 |
+0.78% | 2.11% | 1.36% | 1 | 5 |
| TPCH(_20) | TPCH-Q6 | parquet / none / none | 3.59 | 3.58 |
+0.41% | 2.69% | 4.22% | 1 | 5 |
| TPCH(_20) | TPCH-Q16 | parquet / none / none | 2.30 | 2.30 |
+0.04% | 2.85% | 2.53% | 1 | 5 |
| TPCH(_20) | TPCH-Q13 | parquet / none / none | 10.80 | 10.81 |
-0.11% | 1.23% | 0.87% | 1 | 5 |
| TPCH(_20) | TPCH-Q20 | parquet / none / none | 7.37 | 7.41 |
-0.49% | 2.71% | 2.20% | 1 | 5 |
| TPCH(_20) | TPCH-Q2 | parquet / none / none | 3.32 | 3.41 |
-2.60% | 2.92% | 2.70% | 1 | 5 |
| TPCH(_20) | TPCH-Q7 | parquet / none / none | 17.85 | 18.36 |
-2.80% | 2.07% | 3.52% | 1 | 5 |
| TPCH(_20) | TPCH-Q5 | parquet / none / none | 11.13 | 11.52 |
-3.42% | 0.92% | 2.65% | 1 | 5 |
| TPCH(_20) | TPCH-Q12 | parquet / none / none | 4.60 | 4.78 |
-3.71% | 0.93% | 1.90% | 1 | 5 |
+-----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
Report Generated on 2016-03-09
Run Description: "Base: 158b9d88b795c4dc3d100d4895c6f858f17976fd vs
Ref: b39d44247b0ee1f5dc224b5d625df53e91539a64"
Cluster Name: UNKNOWN
Lab Run Info: UNKNOWN
Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
Baseline Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
+-------------+-----------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) |
GeoMean(s) | Delta(GeoMean) |
+-------------+-----------------------+---------+------------+------------+----------------+
| TPCDS(_100) | parquet / none / none | 6.33 | -1.60% | 1.69
| +11.95% |
+-------------+-----------------------+---------+------------+------------+----------------+
+-------------+------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| Workload | Query | File Format
| Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num
Clients | Iters |
+-------------+------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| TPCDS(_100) | TPCDS-COUNT-HOUSEHOLD_DEMOGRAPHICS | parquet / none /
none | 0.40 | 0.30 | R +34.77% | 5.46% | 0.80% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-CUSTOMER_DEMOGRAPHICS | parquet / none /
none | 0.40 | 0.30 | R +33.96% | 5.52% | 0.66% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-TIME_DIM | parquet / none /
none | 0.39 | 0.30 | R +30.97% | 6.30% | 0.17% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-DATE_DIM | parquet / none /
none | 0.39 | 0.30 | R +30.57% | 6.69% | 0.45% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-PROMOTION | parquet / none /
none | 0.38 | 0.30 | R +26.46% | 5.81% | 0.55% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-STORE | parquet / none /
none | 0.38 | 0.30 | R +26.36% | 5.19% | 1.63% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-CUSTOMER_ADDRESS | parquet / none /
none | 0.37 | 0.29 | R +25.92% | 5.91% | 0.48% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-ITEM | parquet / none /
none | 0.38 | 0.30 | R +25.29% | 5.60% | 0.72% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q52 | parquet / none /
none | 0.57 | 0.47 | R +22.07% | 0.22% | 0.17% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q55 | parquet / none /
none | 0.57 | 0.47 | R +21.56% | 0.16% | 0.18% | 1
| 5 |
| TPCDS(_100) | TPCDS-COUNT-CUSTOMER | parquet / none /
none | 0.36 | 0.29 | R +21.33% | 0.27% | 0.46% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q42 | parquet / none /
none | 0.58 | 0.49 | +18.03% | 3.82% | 8.97% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q98 | parquet / none /
none | 1.04 | 0.90 | +15.64% | 1.85% | 2.93% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q3 | parquet / none /
none | 1.14 | 0.99 | +15.26% | 3.14% | 0.44% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q19 | parquet / none /
none | 1.12 | 0.99 | +13.18% | 2.03% | 1.79% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q73 | parquet / none /
none | 0.84 | 0.75 | +11.48% | 2.93% | 3.16% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q34 | parquet / none /
none | 1.85 | 1.68 | +10.51% | 2.56% | 1.59% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q89 | parquet / none /
none | 2.26 | 2.07 | +9.15% | 2.85% | 3.64% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q68 | parquet / none /
none | 1.44 | 1.33 | +8.48% | 4.44% | 7.57% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q61 | parquet / none /
none | 1.80 | 1.67 | +8.26% | 1.14% | 2.22% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q63 | parquet / none /
none | 1.78 | 1.64 | +8.25% | 3.61% | 2.27% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q53 | parquet / none /
none | 1.76 | 1.64 | +7.59% | 1.48% | 2.19% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q27 | parquet / none /
none | 3.31 | 3.10 | +6.80% | 2.97% | 1.42% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q46 | parquet / none /
none | 3.07 | 2.96 | +3.67% | 1.74% | 1.75% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q7 | parquet / none /
none | 3.26 | 3.15 | +3.62% | 0.69% | 1.09% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q96 | parquet / none /
none | 5.38 | 5.20 | +3.46% | 1.19% | 0.31% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q79 | parquet / none /
none | 1.78 | 1.72 | +3.25% | 1.02% | 2.37% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q8 | parquet / none /
none | 1.30 | 1.27 | +2.40% | 3.05% | 4.43% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q88 | parquet / none /
none | 43.55 | 43.43 | +0.27% | 0.81% | 0.64% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q47 | parquet / none /
none | 33.01 | 33.70 | -2.04% | 1.19% | 1.61% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q43 | parquet / none /
none | 3.47 | 3.56 | -2.45% | 1.95% | 1.77% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q65 | parquet / none /
none | 23.48 | 24.14 | -2.75% | 1.20% | 1.29% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q59 | parquet / none /
none | 19.94 | 21.27 | -6.24% | 0.67% | 0.68% | 1
| 5 |
| TPCDS(_100) | TPCDS-Q6 | parquet / none /
none | 53.65 | 57.64 | -6.92% | 2.16% | 2.58% | 1
| 5 |
+-------------+------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-HOUSEHOLD_DEMOGRAPHICS [parquet
/ none / none] (0.30s -> 0.40s [+34.77%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 48.77% | 103.09ms | 87.78ms | +17.44% |
0.56% | 103.94ms | 91.34ms | +13.79% | 1 | 1 | 1 |
| 01:AGGREGATE | 50.32% | 106.36ms | 89.53ms | +18.80% |
0.61% | 107.08ms | 93.01ms | +15.13% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-CUSTOMER_DEMOGRAPHICS [parquet
/ none / none] (0.30s -> 0.40s [+33.96%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 47.18% | 100.85ms | 87.55ms | +15.18% |
0.47% | 101.58ms | 88.74ms | +14.47% | 1 | 1 | 1 |
| 01:AGGREGATE | 50.50% | 107.95ms | 91.00ms | +18.62% |
1.50% | 109.87ms | 94.03ms | +16.84% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-TIME_DIM [parquet / none /
none] (0.30s -> 0.39s [+30.97%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 49.68% | 106.97ms | 90.92ms | +17.66% |
0.86% | 107.88ms | 91.43ms | +17.99% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.38% | 106.32ms | 88.81ms | +19.71% |
1.55% | 108.01ms | 90.41ms | +19.48% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-DATE_DIM [parquet / none /
none] (0.30s -> 0.39s [+30.57%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 48.72% | 101.98ms | 86.47ms | +17.93% |
0.71% | 102.92ms | 87.77ms | +17.26% | 1 | 1 | 1 |
| 01:AGGREGATE | 50.23% | 105.13ms | 88.79ms | +18.39% |
1.81% | 106.66ms | 91.34ms | +16.76% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-PROMOTION [parquet / none /
none] (0.30s -> 0.38s [+26.46%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 49.71% | 105.21ms | 89.25ms | +17.88% |
1.02% | 106.13ms | 91.43ms | +16.08% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.43% | 104.62ms | 88.72ms | +17.91% |
1.37% | 106.71ms | 90.91ms | +17.39% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-STORE [parquet / none / none]
(0.30s -> 0.38s [+26.36%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 50.34% | 108.01ms | 90.76ms | +19.00% |
0.93% | 108.97ms | 91.33ms | +19.32% | 1 | 1 | 1 |
| 01:AGGREGATE | 48.82% | 104.75ms | 89.49ms | +17.05% |
1.75% | 107.91ms | 91.89ms | +17.44% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-CUSTOMER_ADDRESS [parquet /
none / none] (0.29s -> 0.37s [+25.92%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 48.13% | 98.96ms | 85.31ms | +16.00% |
1.19% | 100.68ms | 87.92ms | +14.51% | 1 | 1 | 1 |
| 01:AGGREGATE | 50.11% | 103.04ms | 89.45ms | +15.19% |
1.50% | 105.30ms | 89.97ms | +17.05% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-ITEM [parquet / none / none]
(0.30s -> 0.38s [+25.29%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 49.07% | 103.68ms | 90.18ms | +14.96% |
1.96% | 107.19ms | 94.11ms | +13.90% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.82% | 105.25ms | 90.30ms | +16.56% |
1.81% | 108.46ms | 92.52ms | +17.22% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q52 [parquet / none / none] (0.47s ->
0.57s [+22.07%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
| 10:AGGREGATE | 27.80% | 110.95ms | 96.43ms | +15.06% |
1.74% | 113.51ms | 103.90ms | +9.24% | 1 | 569 | 2.51K |
| 05:AGGREGATE | 33.76% | 134.77ms | 119.95ms | +12.36% |
5.22% | 141.50ms | 123.32ms | +14.74% | 1 | 569 | 2.51K |
| 01:SCAN HDFS | 25.11% | 100.24ms | 100.16ms | +0.07% |
6.38% | 105.83ms | 105.46ms | +0.35% | 1 | 168.56K | 9.32M |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q55 [parquet / none / none] (0.47s ->
0.57s [+21.56%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+
| 10:AGGREGATE | 27.37% | 110.54ms | 96.63ms | +14.39% |
2.94% | 115.86ms | 102.79ms | +12.71% | 1 | 539 | 2.51K |
| 05:AGGREGATE | 31.35% | 126.61ms | 106.56ms | +18.81% |
3.55% | 131.21ms | 115.49ms | +13.61% | 1 | 539 | 2.51K |
| 01:SCAN HDFS | 29.52% | 119.24ms | 120.16ms | -0.77% |
7.74% | 128.36ms | 126.80ms | +1.23% | 1 | 82.97K | 9.32M |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-CUSTOMER [parquet / none /
none] (0.29s -> 0.36s [+21.33%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 01:AGGREGATE | 50.18% | 101.16ms | 88.91ms | +13.78% |
1.11% | 102.46ms | 89.90ms | +13.97% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
Significant perf change detected
--
To view, visit http://gerrit.cloudera.org:8080/2486
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: I17d7afd05ad3b472a0bfe035bfc3daada5597b2d
Gerrit-PatchSet: 2
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Tim Armstrong <[email protected]>
Gerrit-Reviewer: Skye Wanderman-Milne <[email protected]>
Gerrit-Reviewer: Tim Armstrong <[email protected]>
Gerrit-HasComments: No
