Tim Armstrong has posted comments on this change.
Change subject: Upgrade LLVM to 3.8.0
......................................................................
Patch Set 3:
I reran local perf with 3.8.0, using the decimal constant injection patch as
the baseline. The results are (I think) good enough to move forward: we have
regressions due to increased codegen time of 100-200ms. There were some
regressions that looked larger than that, but I was unable to replicate the
results when rerunning the query manually, so it's reasonable to assume they
were noise. Aside from that a couple of decimal queries benefit significantly,
even on top of the previous decimal codegen patch:
Report Generated on 2016-03-15
Run Description: "Base: e5f009867baa336e4e4fad6b48494c39004bb84c vs
Ref: c3f09d2f58c6ea8f9f03982d4b0dac0341d2a00e"
Cluster Name: UNKNOWN
Lab Run Info: UNKNOWN
Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
Baseline Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
+--------------------+-----------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) |
GeoMean(s) | Delta(GeoMean) |
+--------------------+-----------------------+---------+------------+------------+----------------+
| TARGETED-PERF(_20) | parquet / none / none | 10.08 | -1.82% |
3.70 | +3.56% |
+--------------------+-----------------------+---------+------------+------------+----------------+
+--------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| Workload | Query
| File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) |
Base StdDev(%) | Num Clients | Iters |
+--------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| TARGETED-PERF(_20) | primitive_filter_bigint_non_selective
| parquet / none / none | 1.22 | 1.03 | +17.84% | 1.97% |
0.15% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_filter_bigint_selective
| parquet / none / none | 1.10 | 0.94 | +16.73% | 2.32% |
1.72% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_AGG-Q1
| parquet / none / none | 1.94 | 1.69 | +15.22% | 1.50% |
1.32% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_AGG-Q6
| parquet / none / none | 1.57 | 1.38 | +13.61% | 2.95% |
1.60% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_filter_decimal_non_selective
| parquet / none / none | 1.49 | 1.31 | +13.54% | 0.63% |
1.78% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_broadcast_join_1
| parquet / none / none | 1.46 | 1.30 | +12.54% | 2.25% |
2.48% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_filter_decimal_selective
| parquet / none / none | 1.32 | 1.18 | +12.47% | 1.29% |
1.97% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_filter_string_selective
| parquet / none / none | 1.64 | 1.46 | +12.09% | 6.04% |
5.46% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_filter_string_non_selective
| parquet / none / none | 1.78 | 1.59 | +11.90% | 4.04% |
5.34% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_AGG-Q7
| parquet / none / none | 1.55 | 1.39 | +11.26% | 1.28% |
0.12% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_STRING-Q2
| parquet / none / none | 1.84 | 1.69 | +8.53% | 1.03% |
1.76% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_STRING-Q1
| parquet / none / none | 1.75 | 1.62 | +8.08% | 1.29% |
2.15% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_STRING-Q5
| parquet / none / none | 2.23 | 2.10 | +6.59% | 1.39% |
1.30% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_STRING-Q3
| parquet / none / none | 1.99 | 1.87 | +6.18% | 1.65% |
1.78% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_broadcast_join_2
| parquet / none / none | 2.51 | 2.38 | +5.42% | 1.39% |
1.09% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_AGG-Q5
| parquet / none / none | 3.13 | 3.00 | +4.54% | 1.51% |
8.09% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_AGG-Q2
| parquet / none / none | 3.53 | 3.38 | +4.47% | 1.71% |
2.75% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_AGG-Q4
| parquet / none / none | 13.53 | 12.99 | +4.09% | 4.11% |
8.67% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_AGG-Q3
| parquet / none / none | 5.43 | 5.23 | +3.74% | 1.66% |
1.01% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_orderby_bigint
| parquet / none / none | 3.34 | 3.22 | +3.67% | 3.11% |
3.79% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_STRING-Q4
| parquet / none / none | 1.96 | 1.89 | +3.54% | 1.21% |
1.75% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_STRING-Q6
| parquet / none / none | 4.85 | 4.69 | +3.40% | 0.92% |
0.86% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_broadcast_join_3
| parquet / none / none | 4.07 | 3.95 | +3.10% | 1.19% |
2.34% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_filter_string_like
| parquet / none / none | 6.53 | 6.45 | +1.22% | 1.04% |
1.43% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_orderby_all
| parquet / none / none | 13.62 | 13.45 | +1.21% | 0.75% |
1.10% | 1 | 10 |
| TARGETED-PERF(_20) |
primitive_shuffle_join_one_to_many_string_with_groupby | parquet / none / none
| 99.13 | 98.30 | +0.85% | 0.63% | 0.92% | 1
| 10 |
| TARGETED-PERF(_20) | primitive_topn_bigint
| parquet / none / none | 6.88 | 6.86 | +0.22% | 3.87% |
5.80% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_LIMIT-Q1
| parquet / none / none | 0.01 | 0.01 | -0.04% | 3.78% |
9.20% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_shuffle_join_union_all_with_groupby
| parquet / none / none | 20.27 | 20.35 | -0.42% | 0.57% |
0.53% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_groupby_bigint_pk
| parquet / none / none | 41.40 | 41.65 | -0.60% | 0.62% |
0.51% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_exchange_broadcast
| parquet / none / none | 20.87 | 21.20 | -1.57% | 1.21% |
2.53% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_exchange_shuffle
| parquet / none / none | 35.82 | 36.60 | -2.12% | 1.36% |
1.24% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_groupby_decimal_lowndv.test
| parquet / none / none | 2.02 | 2.06 | -2.36% | 2.64% |
2.81% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_groupby_bigint_lowndv
| parquet / none / none | 1.98 | 2.05 | -3.53% | 1.69% |
1.91% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_groupby_bigint_highndv
| parquet / none / none | 11.04 | 11.46 | -3.66% | 0.80% |
0.77% | 1 | 10 |
| TARGETED-PERF(_20) | PERF_STRING-Q7
| parquet / none / none | 3.71 | 3.86 | -3.85% | 1.48% |
1.38% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_top-n_all
| parquet / none / none | 39.02 | 41.95 | -6.99% | 0.68% |
0.62% | 1 | 10 |
| TARGETED-PERF(_20) | primitive_groupby_decimal_highndv
| parquet / none / none | 15.36 | 22.41 | I -31.46% | 8.21% |
0.72% | 1 | 10 |
+--------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
(I) Improvement: TARGETED-PERF(_20) primitive_groupby_decimal_highndv
[parquet / none / none] (22.41s -> 15.36s [-31.46%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 2.00% | 305.37ms | 263.95ms | +15.69% |
5.29% | 350.04ms | 272.36ms | +28.52% | 1 | 0 | 174.13K |
| 01:AGGREGATE | 96.08% | 14.66s | 21.80s | -32.76% |
8.74% | 17.34s | 22.11s | -21.57% | 1 | 1.78M | 1.74M |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
Significant perf change detected
Report Generated on 2016-03-15
Run Description: "Base: e5f009867baa336e4e4fad6b48494c39004bb84c vs
Ref: c3f09d2f58c6ea8f9f03982d4b0dac0341d2a00e"
Cluster Name: UNKNOWN
Lab Run Info: UNKNOWN
Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
Baseline Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
+-----------+-----------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s)
| Delta(GeoMean) |
+-----------+-----------------------+---------+------------+------------+----------------+
| TPCH(_20) | parquet / none / none | 11.84 | +1.00% | 8.45
| +2.02% |
+-----------+-----------------------+---------+------------+------------+----------------+
+-----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| Workload | Query | File Format | Avg(s) | Base Avg(s) |
Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters |
+-----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| TPCH(_20) | TPCH-Q16 | parquet / none / none | 2.31 | 2.12 |
+8.95% | 2.44% | 1.72% | 1 | 10 |
| TPCH(_20) | TPCH-Q22 | parquet / none / none | 3.38 | 3.17 |
+6.72% | 1.32% | 1.81% | 1 | 10 |
| TPCH(_20) | TPCH-Q2 | parquet / none / none | 3.46 | 3.27 |
+5.94% | 1.93% | 2.72% | 1 | 10 |
| TPCH(_20) | TPCH-Q11 | parquet / none / none | 2.68 | 2.57 |
+4.30% | 4.67% | 2.62% | 1 | 10 |
| TPCH(_20) | TPCH-Q10 | parquet / none / none | 6.67 | 6.39 |
+4.27% | 1.63% | 1.47% | 1 | 10 |
| TPCH(_20) | TPCH-Q13 | parquet / none / none | 11.02 | 10.61 |
+3.93% | 1.63% | 2.22% | 1 | 10 |
| TPCH(_20) | TPCH-Q1 | parquet / none / none | 11.16 | 10.76 |
+3.68% | 2.12% | 2.17% | 1 | 10 |
| TPCH(_20) | TPCH-Q18 | parquet / none / none | 16.86 | 16.31 |
+3.39% | 4.96% | 4.58% | 1 | 10 |
| TPCH(_20) | TPCH-Q6 | parquet / none / none | 3.37 | 3.26 |
+3.34% | 3.01% | 2.20% | 1 | 10 |
| TPCH(_20) | TPCH-Q4 | parquet / none / none | 13.62 | 13.26 |
+2.72% | 3.85% | 2.41% | 1 | 10 |
| TPCH(_20) | TPCH-Q19 | parquet / none / none | 48.65 | 47.38 |
+2.69% | 1.26% | 2.19% | 1 | 10 |
| TPCH(_20) | TPCH-Q12 | parquet / none / none | 4.71 | 4.60 |
+2.31% | 1.79% | 1.74% | 1 | 10 |
| TPCH(_20) | TPCH-Q8 | parquet / none / none | 6.76 | 6.63 |
+2.03% | 2.33% | 2.44% | 1 | 10 |
| TPCH(_20) | TPCH-Q5 | parquet / none / none | 11.61 | 11.40 |
+1.83% | 1.80% | 2.55% | 1 | 10 |
| TPCH(_20) | TPCH-Q9 | parquet / none / none | 14.94 | 14.75 |
+1.30% | 0.85% | 1.10% | 1 | 10 |
| TPCH(_20) | TPCH-Q20 | parquet / none / none | 7.41 | 7.36 |
+0.59% | 1.83% | 2.10% | 1 | 10 |
| TPCH(_20) | TPCH-Q21 | parquet / none / none | 35.65 | 35.60 |
+0.14% | 1.09% | 1.31% | 1 | 10 |
| TPCH(_20) | TPCH-Q3 | parquet / none / none | 8.00 | 8.02 |
-0.24% | 1.90% | 1.49% | 1 | 10 |
| TPCH(_20) | TPCH-Q15 | parquet / none / none | 6.49 | 6.55 |
-0.97% | 2.84% | 2.04% | 1 | 10 |
| TPCH(_20) | TPCH-Q7 | parquet / none / none | 17.51 | 17.70 |
-1.08% | 0.83% | 1.31% | 1 | 10 |
| TPCH(_20) | TPCH-Q14 | parquet / none / none | 4.17 | 4.23 |
-1.27% | 2.26% | 2.53% | 1 | 10 |
| TPCH(_20) | TPCH-Q17 | parquet / none / none | 20.12 | 22.03 |
-8.70% | 4.81% | 1.45% | 1 | 10 |
+-----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
Report Generated on 2016-03-15
Run Description: "Base: e9f4f416217d8e5670d30cdf5ab47e7d6ed976aa vs
Ref: 87ab0b7fac40d49baeff1ce05d2dae1e6acf842c"
Cluster Name: UNKNOWN
Lab Run Info: UNKNOWN
Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
Baseline Impala Version: impalad version 2.5.0-cdh5.7.0 RELEASE
(2016-02-24)
+-------------+-----------------------+---------+------------+------------+----------------+
| Workload | File Format | Avg (s) | Delta(Avg) |
GeoMean(s) | Delta(GeoMean) |
+-------------+-----------------------+---------+------------+------------+----------------+
| TPCDS(_100) | parquet / none / none | 6.45 | +2.62% | 1.78
| +22.91% |
+-------------+-----------------------+---------+------------+------------+----------------+
+-------------+------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| Workload | Query | File Format
| Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num
Clients | Iters |
+-------------+------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
| TPCDS(_100) | TPCDS-COUNT-ITEM | parquet / none /
none | 0.43 | 0.28 | R +53.03% | 3.96% | 0.47% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-HOUSEHOLD_DEMOGRAPHICS | parquet / none /
none | 0.43 | 0.28 | R +51.12% | 0.18% | 0.22% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-CUSTOMER_ADDRESS | parquet / none /
none | 0.42 | 0.28 | R +51.04% | 0.50% | 0.43% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-DATE_DIM | parquet / none /
none | 0.43 | 0.28 | R +50.99% | 0.43% | 0.26% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-TIME_DIM | parquet / none /
none | 0.42 | 0.28 | R +50.99% | 0.28% | 0.24% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-CUSTOMER_DEMOGRAPHICS | parquet / none /
none | 0.42 | 0.28 | R +50.73% | 0.25% | 0.27% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-PROMOTION | parquet / none /
none | 0.42 | 0.28 | R +50.48% | 0.35% | 0.53% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-CUSTOMER | parquet / none /
none | 0.42 | 0.28 | R +50.21% | 0.57% | 0.43% | 1
| 10 |
| TPCDS(_100) | TPCDS-COUNT-STORE | parquet / none /
none | 0.42 | 0.28 | R +49.80% | 0.25% | 1.45% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q55 | parquet / none /
none | 0.62 | 0.43 | R +44.83% | 3.90% | 5.06% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q52 | parquet / none /
none | 0.62 | 0.43 | R +44.03% | 0.28% | 4.63% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q42 | parquet / none /
none | 0.62 | 0.44 | R +40.82% | 0.28% | 9.61% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q98 | parquet / none /
none | 1.11 | 0.83 | R +33.29% | 2.29% | 1.94% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q19 | parquet / none /
none | 1.25 | 0.95 | R +30.94% | 2.04% | 2.39% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q73 | parquet / none /
none | 0.92 | 0.73 | R +25.96% | 3.14% | 2.16% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q3 | parquet / none /
none | 1.17 | 0.95 | R +22.81% | 3.92% | 2.59% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q8 | parquet / none /
none | 1.38 | 1.17 | +18.41% | 3.90% | 3.06% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q68 | parquet / none /
none | 1.48 | 1.27 | +16.99% | 2.86% | 4.37% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q63 | parquet / none /
none | 1.79 | 1.60 | +11.69% | 2.34% | 2.07% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q53 | parquet / none /
none | 1.79 | 1.61 | +11.21% | 1.58% | 1.37% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q61 | parquet / none /
none | 1.90 | 1.71 | +11.14% | 1.42% | 7.42% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q34 | parquet / none /
none | 1.80 | 1.63 | +10.02% | 1.62% | 2.32% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q79 | parquet / none /
none | 1.79 | 1.65 | +8.52% | 1.98% | 2.17% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q96 | parquet / none /
none | 5.69 | 5.26 | +8.17% | 2.44% | 2.30% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q89 | parquet / none /
none | 2.28 | 2.12 | +7.38% | 1.78% | 4.36% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q46 | parquet / none /
none | 3.11 | 2.90 | +7.25% | 1.42% | 1.33% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q7 | parquet / none /
none | 3.31 | 3.11 | +6.59% | 1.55% | 0.93% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q27 | parquet / none /
none | 3.17 | 3.00 | +5.51% | 2.75% | 3.62% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q43 | parquet / none /
none | 3.38 | 3.21 | +5.36% | 2.25% | 1.96% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q88 | parquet / none /
none | 44.45 | 42.95 | +3.50% | 1.60% | 1.46% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q47 | parquet / none /
none | 34.84 | 33.81 | +3.06% | 1.12% | 2.01% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q59 | parquet / none /
none | 19.20 | 19.10 | +0.50% | 1.43% | 1.18% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q65 | parquet / none /
none | 23.77 | 24.17 | -1.64% | 1.27% | 1.55% | 1
| 10 |
| TPCDS(_100) | TPCDS-Q6 | parquet / none /
none | 54.13 | 56.22 | -3.71% | 0.72% | 0.74% | 1
| 10 |
+-------------+------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-ITEM [parquet / none / none]
(0.28s -> 0.43s [+53.03%])
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 48.02% | 116.49ms | 73.80ms | +57.83% |
1.15% | 119.23ms | 76.12ms | +56.63% | 1 | 1 | 1 |
| 01:AGGREGATE | 51.03% | 123.78ms | 73.65ms | +68.07% | *
15.31% * | 177.26ms | 74.14ms | +139.09% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-HOUSEHOLD_DEMOGRAPHICS [parquet
/ none / none] (0.28s -> 0.43s [+51.12%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 49.53% | 116.05ms | 73.12ms | +58.71% |
0.60% | 117.59ms | 74.45ms | +57.94% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.73% | 116.53ms | 73.44ms | +58.67% |
2.11% | 120.78ms | 74.30ms | +62.56% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-CUSTOMER_ADDRESS [parquet /
none / none] (0.28s -> 0.42s [+51.04%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 48.49% | 111.44ms | 69.91ms | +59.40% |
1.79% | 116.54ms | 71.95ms | +61.99% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.95% | 114.79ms | 73.05ms | +57.13% |
1.38% | 117.58ms | 73.67ms | +59.60% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-DATE_DIM [parquet / none /
none] (0.28s -> 0.43s [+50.99%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 49.58% | 116.10ms | 73.13ms | +58.75% |
1.39% | 118.24ms | 74.60ms | +58.50% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.51% | 115.94ms | 73.25ms | +58.29% |
1.64% | 121.16ms | 73.78ms | +64.21% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-TIME_DIM [parquet / none /
none] (0.28s -> 0.42s [+50.99%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 49.13% | 113.01ms | 71.53ms | +57.98% |
0.93% | 115.30ms | 73.11ms | +57.70% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.96% | 114.91ms | 72.87ms | +57.70% |
1.79% | 119.05ms | 73.32ms | +62.37% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-CUSTOMER_DEMOGRAPHICS [parquet
/ none / none] (0.28s -> 0.42s [+50.73%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 47.73% | 112.20ms | 70.74ms | +58.61% |
0.97% | 114.48ms | 71.17ms | +60.86% | 1 | 1 | 1 |
| 01:AGGREGATE | 50.29% | 118.22ms | 76.22ms | +55.10% |
1.38% | 121.39ms | 77.51ms | +56.61% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-PROMOTION [parquet / none /
none] (0.28s -> 0.42s [+50.48%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 49.47% | 114.80ms | 73.48ms | +56.23% |
1.17% | 117.48ms | 75.76ms | +55.07% | 1 | 1 | 1 |
| 01:AGGREGATE | 49.78% | 115.52ms | 73.16ms | +57.89% |
1.51% | 120.34ms | 74.27ms | +62.03% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-CUSTOMER [parquet / none /
none] (0.28s -> 0.42s [+50.21%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 47.08% | 106.03ms | 67.64ms | +56.75% |
2.28% | 109.71ms | 70.68ms | +55.22% | 1 | 1 | 1 |
| 01:AGGREGATE | 50.67% | 114.12ms | 73.04ms | +56.24% |
2.26% | 118.57ms | 73.75ms | +60.77% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-COUNT-STORE [parquet / none / none]
(0.28s -> 0.42s [+49.80%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
| 03:AGGREGATE | 48.92% | 113.20ms | 73.56ms | +53.89% |
0.70% | 114.64ms | 83.56ms | +37.19% | 1 | 1 | 1 |
| 01:AGGREGATE | 50.31% | 116.41ms | 73.24ms | +58.96% |
1.76% | 119.85ms | 73.89ms | +62.21% | 1 | 1 | 1 |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q55 [parquet / none / none] (0.43s ->
0.62s [+44.83%])
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
| 10:AGGREGATE | 29.35% | 127.69ms | 86.17ms | +48.18% | *
10.08% * | 162.91ms | 116.08ms | +40.34% | 1 | 539 | 2.51K |
| 05:AGGREGATE | 31.71% | 137.97ms | 94.42ms | +46.12% | *
11.68% * | 183.19ms | 128.62ms | +42.42% | 1 | 539 | 2.51K |
| 01:SCAN HDFS | 27.42% | 119.31ms | 121.00ms | -1.40% |
5.25% | 130.42ms | 130.90ms | -0.36% | 1 | 82.97K | 9.32M |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q52 [parquet / none / none] (0.43s ->
0.62s [+44.03%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
| 10:AGGREGATE | 28.84% | 121.33ms | 80.19ms | +51.30% |
1.21% | 125.14ms | 104.55ms | +19.69% | 1 | 569 | 2.51K |
| 05:AGGREGATE | 34.53% | 145.30ms | 104.69ms | +38.80% |
3.52% | 155.74ms | 129.00ms | +20.73% | 1 | 569 | 2.51K |
| 01:SCAN HDFS | 23.88% | 100.48ms | 103.31ms | -2.75% |
7.13% | 112.10ms | 133.18ms | -15.83% | 1 | 168.56K | 9.32M |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q42 [parquet / none / none] (0.44s ->
0.62s [+40.82%])
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+
| 10:AGGREGATE | 30.13% | 131.40ms | 90.10ms | +45.84% | *
16.52% * | 179.55ms | 122.21ms | +46.92% | 1 | 11 | 2.51K |
| 05:AGGREGATE | 32.11% | 140.05ms | 104.25ms | +34.34% |
8.47% | 172.43ms | 129.98ms | +32.66% | 1 | 11 | 2.51K |
| 01:SCAN HDFS | 25.53% | 111.35ms | 103.86ms | +7.22% |
8.90% | 128.41ms | 116.95ms | +9.80% | 1 | 168.56K | 9.32M |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q98 [parquet / none / none] (0.83s ->
1.11s [+33.29%])
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+
| 12:AGGREGATE | 17.26% | 147.74ms | 91.64ms | +61.22% | *
10.44% * | 173.58ms | 110.27ms | +57.42% | 1 | 30.57K | 791.08K |
| 05:AGGREGATE | 59.80% | 511.93ms | 420.56ms | +21.73% |
3.51% | 546.09ms | 441.02ms | +23.82% | 1 | 30.57K | 791.08K |
| 03:HASH JOIN | 12.77% | 109.36ms | 102.56ms | +6.63% |
2.85% | 114.15ms | 107.67ms | +6.02% | 1 | 873.82K | 791.08K |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q19 [parquet / none / none] (0.95s ->
1.25s [+30.94%])
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
| 19:AGGREGATE | 13.56% | 134.70ms | 93.26ms | +44.43% |
5.93% | 146.01ms | 107.88ms | +35.35% | 1 | 1.85K | 2.37K |
| 11:AGGREGATE | 17.14% | 170.31ms | 119.12ms | +42.96% |
5.66% | 188.63ms | 136.27ms | +38.43% | 1 | 1.85K | 2.37K |
| 01:SCAN HDFS | 39.77% | 395.14ms | 369.09ms | +7.06% |
3.54% | 408.97ms | 386.79ms | +5.73% | 1 | 161.05K | 8.81M |
+--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+---------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q73 [parquet / none / none] (0.73s ->
0.92s [+25.96%])
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
| 09:HASH JOIN | 15.74% | 133.61ms | 84.56ms | +58.01% |
9.65% | 169.83ms | 118.44ms | +43.39% | 1 | 7 | 2.00M |
| 15:AGGREGATE | 16.17% | 137.20ms | 83.44ms | +64.43% | *
11.81% * | 170.87ms | 106.69ms | +60.16% | 1 | 243 | 367.16K |
| 07:AGGREGATE | 15.87% | 134.65ms | 87.01ms | +54.74% | *
10.31% * | 173.58ms | 119.32ms | +45.47% | 1 | 3.95K | 367.16K |
| 00:SCAN HDFS | 25.38% | 215.43ms | 210.41ms | +2.39% |
7.32% | 242.08ms | 224.60ms | +7.78% | 1 | 41.30K | 8.27M |
| 08:SCAN HDFS | 23.48% | 199.31ms | 195.37ms | +2.02% |
0.99% | 203.36ms | 215.96ms | -5.83% | 1 | 7 | 2.00M |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
(R) Regression: TPCDS(_100) TPCDS-Q3 [parquet / none / none] (0.95s ->
1.17s [+22.81%])
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
| Operator | % of Query | Avg | Base Avg | Delta(Avg) |
StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
| 10:AGGREGATE | 9.97% | 122.88ms | 95.11ms | +29.20% |
0.92% | 124.48ms | 121.12ms | +2.78% | 1 | 437 | 48.39K |
| 05:AGGREGATE | 11.83% | 145.78ms | 100.16ms | +45.54% | *
14.40% * | 184.15ms | 126.82ms | +45.21% | 1 | 437 | 48.39K |
| 00:SCAN HDFS | 22.06% | 271.92ms | 174.95ms | +55.43% | *
14.81% * | 365.32ms | 244.89ms | +49.18% | 1 | 155 | 1.93K |
| 01:SCAN HDFS | 52.76% | 650.27ms | 631.87ms | +2.91% |
2.21% | 675.67ms | 659.81ms | +2.40% | 1 | 52.24K | 46.55M |
+--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+--------+-----------+
Significant perf change detected
--
To view, visit http://gerrit.cloudera.org:8080/2486
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: comment
Gerrit-Change-Id: I17d7afd05ad3b472a0bfe035bfc3daada5597b2d
Gerrit-PatchSet: 3
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Tim Armstrong <[email protected]>
Gerrit-Reviewer: Dan Hecht <[email protected]>
Gerrit-Reviewer: Skye Wanderman-Milne <[email protected]>
Gerrit-Reviewer: Tim Armstrong <[email protected]>
Gerrit-HasComments: No
