[
https://issues.apache.org/jira/browse/HIVE-18079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483520#comment-16483520
]
Hive QA commented on HIVE-18079:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12924388/HIVE-18079.18.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/11128/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11128/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11128/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
error:
a/ql/src/test/results/clientpositive/encrypted/encryption_move_tbl.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/hll.q.out: does not exist in index
error: a/ql/src/test/results/clientpositive/llap/acid_no_buckets.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/autoColumnStats_2.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/auto_join1.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/auto_join21.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/auto_join29.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/auto_join30.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/auto_sortmerge_join_6.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/bucket_groupby.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/bucket_map_join_tez2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/check_constraint.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/correlationoptimizer1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/correlationoptimizer2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/correlationoptimizer3.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/correlationoptimizer6.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/cross_join.q.out: does not
exist in index
error:
a/ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction_sw.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/dynamic_semijoin_user_level.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/explainanalyze_2.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/explainuser_1.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/explainuser_2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/explainuser_4.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/groupby1.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/llap/groupby2.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/llap/groupby_resolution.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/hybridgrace_hashjoin_1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/hybridgrace_hashjoin_2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/join1.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/llap/join32_lessSize.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/join_max_hashtable.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/limit_join_transpose.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/limit_pushdown.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/limit_pushdown3.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/llap/llap_vector_nohybridgrace.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/llapdecider.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/mapjoin_decimal.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/mapjoin_mapjoin.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/mrr.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/llap/multiMapJoin2.q.out: does not
exist in index
error:
a/ql/src/test/results/clientpositive/llap/offset_limit_ppd_optimizer.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/partialdhj.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/quotedid_smb.q.out: does not
exist in index
error:
a/ql/src/test/results/clientpositive/llap/reduce_deduplicate_extended.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/results_cache_1.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/results_cache_lifetime.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/semijoin.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/llap/semijoin_hint.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/sharedworkext.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/skewjoin.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/llap/smb_mapjoin_15.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/smb_mapjoin_6.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_corr.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_exists.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_in.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_in_having.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_multi.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_notin.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_scalar.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_select.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_views.q.out: does not
exist in index
error:
a/ql/src/test/results/clientpositive/llap/tez_bmj_schema_evolution.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_join_hash.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_join_tests.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_joins_explain.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_smb_main.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_union.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_union2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_union_multiinsert.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/tez_vector_dynpart_hashjoin_2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/unionDistinct_3.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/union_fast_stats.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/union_top_level.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_cast_constant.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_count_distinct.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_groupby_mapjoin.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_left_outer_join.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_llap_text_1.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_limit.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/vectorization_short_regress.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorized_context.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorized_distinct_gby.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorized_mapjoin.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/llap/vectorized_nested_mapjoin.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorized_shufflejoin.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/mapjoin_mapjoin.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/bucket_map_join_tez2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/join32_lessSize.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/mapjoin_mapjoin.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_1.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_3.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_4.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainuser_3.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/tez/hybridgrace_hashjoin_1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/tez/hybridgrace_hashjoin_2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/tez/tez-tag.q.out: does not exist
in index
error:
a/standalone-metastore/src/main/java/org/apache/hadoop/hive/common/ndv/NumDistinctValueEstimatorFactory.java:
does not exist in index
error:
a/standalone-metastore/src/main/java/org/apache/hadoop/hive/common/ndv/hll/HLLDenseRegister.java:
does not exist in index
error:
a/standalone-metastore/src/main/java/org/apache/hadoop/hive/common/ndv/hll/HLLSparseRegister.java:
does not exist in index
error:
a/standalone-metastore/src/main/java/org/apache/hadoop/hive/common/ndv/hll/HyperLogLog.java:
does not exist in index
error:
a/standalone-metastore/src/main/java/org/apache/hadoop/hive/common/ndv/hll/HyperLogLogUtils.java:
does not exist in index
error:
a/standalone-metastore/src/test/java/org/apache/hadoop/hive/common/ndv/hll/TestHyperLogLog.java:
does not exist in index
error: patch failed:
ql/src/test/queries/clientpositive/bucket_map_join_tez2.q:37
Falling back to three-way merge...
Applied patch to 'ql/src/test/queries/clientpositive/bucket_map_join_tez2.q'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/encrypted/encryption_move_tbl.q.out:117
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/encrypted/encryption_move_tbl.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/auto_sortmerge_join_6.q.out:808
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/auto_sortmerge_join_6.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction.q.out:452
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/dynamic_semijoin_user_level.q.out:256
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/dynamic_semijoin_user_level.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/explainanalyze_2.q.out:229
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/explainanalyze_2.q.out' with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/explainuser_1.q.out:5329
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/explainuser_1.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/explainuser_2.q.out:1292
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/explainuser_2.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out:651
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out' with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out:5241
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out:114
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out' with conflicts.
Going to apply patch with: git apply -p1
/data/hiveptest/working/scratch/build.patch:26: trailing whitespace.
distinct_count 316
/data/hiveptest/working/scratch/build.patch:35: trailing whitespace.
distinct_count 316
/data/hiveptest/working/scratch/build.patch:44: trailing whitespace.
distinct_count 316
/data/hiveptest/working/scratch/build.patch:53: trailing whitespace.
distinct_count 307
/data/hiveptest/working/scratch/build.patch:62: trailing whitespace.
distinct_count 316
error: patch failed:
ql/src/test/queries/clientpositive/bucket_map_join_tez2.q:37
Falling back to three-way merge...
Applied patch to 'ql/src/test/queries/clientpositive/bucket_map_join_tez2.q'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/encrypted/encryption_move_tbl.q.out:117
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/encrypted/encryption_move_tbl.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/auto_sortmerge_join_6.q.out:808
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/auto_sortmerge_join_6.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction.q.out:452
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/dynamic_semijoin_reduction.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/dynamic_semijoin_user_level.q.out:256
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/dynamic_semijoin_user_level.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/explainanalyze_2.q.out:229
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/explainanalyze_2.q.out' with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/explainuser_1.q.out:5329
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/explainuser_1.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/explainuser_2.q.out:1292
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/explainuser_2.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out:651
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out' with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out:5241
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out:114
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out' with conflicts.
U ql/src/test/queries/clientpositive/bucket_map_join_tez2.q
U ql/src/test/results/clientpositive/encrypted/encryption_move_tbl.q.out
U ql/src/test/results/clientpositive/llap/auto_sortmerge_join_6.q.out
U ql/src/test/results/clientpositive/llap/dynamic_semijoin_user_level.q.out
U ql/src/test/results/clientpositive/llap/explainanalyze_2.q.out
U ql/src/test/results/clientpositive/llap/explainuser_1.q.out
U ql/src/test/results/clientpositive/llap/explainuser_2.q.out
U ql/src/test/results/clientpositive/llap/unionDistinct_1.q.out
U ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out
U ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out
warning: squelched 67 whitespace errors
warning: 72 lines add whitespace errors.
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12924388 - PreCommit-HIVE-Build
> Statistics: Allow HyperLogLog to be merged to the lowest-common-denominator
> bit-size
> ------------------------------------------------------------------------------------
>
> Key: HIVE-18079
> URL: https://issues.apache.org/jira/browse/HIVE-18079
> Project: Hive
> Issue Type: Improvement
> Components: Standalone Metastore, Statistics
> Affects Versions: 3.0.0
> Reporter: Gopal V
> Assignee: Prasanth Jayachandran
> Priority: Major
> Attachments: HIVE-18079-branch-3.patch, HIVE-18079-branch-3.patch,
> HIVE-18079-branch-3.patch, HIVE-18079.1.patch, HIVE-18079.10.patch,
> HIVE-18079.11.patch, HIVE-18079.12.patch, HIVE-18079.13.patch,
> HIVE-18079.14.patch, HIVE-18079.15.patch, HIVE-18079.15.patch,
> HIVE-18079.15.patch, HIVE-18079.16.patch, HIVE-18079.17.patch,
> HIVE-18079.17.patch, HIVE-18079.18.patch, HIVE-18079.2.patch,
> HIVE-18079.4.patch, HIVE-18079.5.patch, HIVE-18079.6.patch,
> HIVE-18079.7.patch, HIVE-18079.8.patch, HIVE-18079.9.patch
>
>
> HyperLogLog can merge a 14 bit HLL into a 10 bit HLL bitset, because of its
> mathematical hash distribution & construction.
> Allow the squashing of a 14 bit HLL -> 10 bit HLL without needing a second
> scan over the data-set.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
