[
https://issues.apache.org/jira/browse/HIVE-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457114#comment-16457114
]
Hive QA commented on HIVE-18910:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12920912/HIVE-18910.44.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/10537/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/10537/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-10537/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
error: a/ql/src/test/results/clientpositive/spark/union_remove_7.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/union_remove_8.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/union_remove_9.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/spark/vectorization_0.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/stats0.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/stats1.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/stats10.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/stats16.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/stats3.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/stats5.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/stats_empty_partition2.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/stats_invalidation.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/stats_list_bucket.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/stats_noscan_2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/statsfs.q.out: does not exist in
index
error:
a/ql/src/test/results/clientpositive/temp_table_display_colstats_tbllvl.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/tez/acid_vectorization_original_tez.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_4.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_5.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/transform_ppr1.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/transform_ppr2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/truncate_column.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/truncate_column_buckets.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/udf_explode.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/udtf_explode.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/unicode_comments.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/unicode_notation.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union22.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/union24.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/union_pos_alias.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_ppr.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/union_remove_1.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_10.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_11.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_12.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_13.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_14.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_15.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_16.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_17.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_18.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_19.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_20.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_21.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_22.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_23.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_24.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_3.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_4.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_5.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_7.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_8.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_remove_9.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/union_stats.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/unset_table_view_property.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/view_alias.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/view_cbo.q.out: does not exist in
index
error:
a/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorUtils.java:
does not exist in index
error:
a/serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestObjectInspectorUtils.java:
does not exist in index
error:
a/standalone-metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/hive_metastoreConstants.java:
does not exist in index
error: a/storage-api/src/java/org/apache/hive/common/util/Murmur3.java: does
not exist in index
error: a/storage-api/src/test/org/apache/hive/common/util/TestMurmur3.java:
does not exist in index
error: a/streaming/src/test/org/apache/hive/streaming/TestStreaming.java: does
not exist in index
error: patch failed:
ql/src/test/results/clientpositive/acid_table_stats.q.out:93
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/acid_table_stats.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/autoColumnStats_4.q.out:194
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/autoColumnStats_4.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/acid_bucket_pruning.q.out:44
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/acid_bucket_pruning.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/acid_vectorization_original.q.out:665
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/acid_vectorization_original.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out:235
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/default_constraint.q.out:1148
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/default_constraint.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/dynpart_sort_optimization_acid.q.out:94
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/dynpart_sort_optimization_acid.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/enforce_constraint_notnull.q.out:3233
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/enforce_constraint_notnull.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/insert_into_default_keyword.q.out:2368
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/insert_into_default_keyword.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/insert_values_orig_table_use_metadata.q.out:167
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/insert_values_orig_table_use_metadata.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite_4.q.out:933
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite_4.q.out'
cleanly.
error: patch failed: ql/src/test/results/clientpositive/llap/sample10.q.out:288
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/sample10.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_3.q.out:148
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_3.q.out' cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/union_stats.q.out:299
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/union_stats.q.out'
cleanly.
error: patch failed: ql/src/test/results/clientpositive/row__id.q.out:62
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/row__id.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out:4245
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out' with
conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/sample10.q.out:285
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/sample10.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/tez/acid_vectorization_original_tez.q.out:680
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/tez/acid_vectorization_original_tez.q.out'
with conflicts.
Going to apply patch with: git apply -p1
/data/hiveptest/working/scratch/build.patch:9: trailing whitespace.
bucketing_version 2
/data/hiveptest/working/scratch/build.patch:21: trailing whitespace.
bucketing_version 2
/data/hiveptest/working/scratch/build.patch:29: trailing whitespace.
bucketing_version 2
/data/hiveptest/working/scratch/build.patch:41: trailing whitespace.
bucketing_version 2
/data/hiveptest/working/scratch/build.patch:49: trailing whitespace.
bucketing_version 2
error: patch failed:
ql/src/test/results/clientpositive/acid_table_stats.q.out:93
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/acid_table_stats.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/autoColumnStats_4.q.out:194
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/autoColumnStats_4.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/acid_bucket_pruning.q.out:44
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/acid_bucket_pruning.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/acid_vectorization_original.q.out:665
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/acid_vectorization_original.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out:235
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/default_constraint.q.out:1148
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/default_constraint.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/dynpart_sort_optimization_acid.q.out:94
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/dynpart_sort_optimization_acid.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/enforce_constraint_notnull.q.out:3233
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/enforce_constraint_notnull.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/insert_into_default_keyword.q.out:2368
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/insert_into_default_keyword.q.out'
with conflicts.
error: patch failed:
ql/src/test/results/clientpositive/llap/insert_values_orig_table_use_metadata.q.out:167
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/insert_values_orig_table_use_metadata.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite_4.q.out:933
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite_4.q.out'
cleanly.
error: patch failed: ql/src/test/results/clientpositive/llap/sample10.q.out:288
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/sample10.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_3.q.out:148
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_3.q.out' cleanly.
error: patch failed:
ql/src/test/results/clientpositive/llap/union_stats.q.out:299
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/llap/union_stats.q.out'
cleanly.
error: patch failed: ql/src/test/results/clientpositive/row__id.q.out:62
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/row__id.q.out' with
conflicts.
error: patch failed:
ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out:4245
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out' with
conflicts.
error: patch failed: ql/src/test/results/clientpositive/spark/sample10.q.out:285
Falling back to three-way merge...
Applied patch to 'ql/src/test/results/clientpositive/spark/sample10.q.out'
cleanly.
error: patch failed:
ql/src/test/results/clientpositive/tez/acid_vectorization_original_tez.q.out:680
Falling back to three-way merge...
Applied patch to
'ql/src/test/results/clientpositive/tez/acid_vectorization_original_tez.q.out'
with conflicts.
U ql/src/test/results/clientpositive/acid_table_stats.q.out
U ql/src/test/results/clientpositive/autoColumnStats_4.q.out
U ql/src/test/results/clientpositive/llap/acid_bucket_pruning.q.out
U ql/src/test/results/clientpositive/llap/acid_vectorization_original.q.out
U ql/src/test/results/clientpositive/llap/bucket_map_join_tez1.q.out
U ql/src/test/results/clientpositive/llap/default_constraint.q.out
U ql/src/test/results/clientpositive/llap/dynpart_sort_optimization_acid.q.out
U ql/src/test/results/clientpositive/llap/enforce_constraint_notnull.q.out
U ql/src/test/results/clientpositive/llap/insert_into_default_keyword.q.out
U ql/src/test/results/clientpositive/row__id.q.out
U ql/src/test/results/clientpositive/spark/bucket_map_join_tez1.q.out
U ql/src/test/results/clientpositive/tez/acid_vectorization_original_tez.q.out
warning: squelched 633 whitespace errors
warning: 638 lines add whitespace errors.
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12920912 - PreCommit-HIVE-Build
> Migrate to Murmur hash for shuffle and bucketing
> ------------------------------------------------
>
> Key: HIVE-18910
> URL: https://issues.apache.org/jira/browse/HIVE-18910
> Project: Hive
> Issue Type: Task
> Reporter: Deepak Jaiswal
> Assignee: Deepak Jaiswal
> Priority: Major
> Attachments: HIVE-18910.1.patch, HIVE-18910.10.patch,
> HIVE-18910.11.patch, HIVE-18910.12.patch, HIVE-18910.13.patch,
> HIVE-18910.14.patch, HIVE-18910.15.patch, HIVE-18910.16.patch,
> HIVE-18910.17.patch, HIVE-18910.18.patch, HIVE-18910.19.patch,
> HIVE-18910.2.patch, HIVE-18910.20.patch, HIVE-18910.21.patch,
> HIVE-18910.22.patch, HIVE-18910.23.patch, HIVE-18910.24.patch,
> HIVE-18910.25.patch, HIVE-18910.26.patch, HIVE-18910.27.patch,
> HIVE-18910.28.patch, HIVE-18910.29.patch, HIVE-18910.3.patch,
> HIVE-18910.30.patch, HIVE-18910.31.patch, HIVE-18910.32.patch,
> HIVE-18910.33.patch, HIVE-18910.34.patch, HIVE-18910.35.patch,
> HIVE-18910.36.patch, HIVE-18910.36.patch, HIVE-18910.37.patch,
> HIVE-18910.38.patch, HIVE-18910.39.patch, HIVE-18910.4.patch,
> HIVE-18910.40.patch, HIVE-18910.41.patch, HIVE-18910.42.patch,
> HIVE-18910.43.patch, HIVE-18910.44.patch, HIVE-18910.5.patch,
> HIVE-18910.6.patch, HIVE-18910.7.patch, HIVE-18910.8.patch, HIVE-18910.9.patch
>
>
> Hive uses JAVA hash which is not as good as murmur for better distribution
> and efficiency in bucketing a table.
> Migrate to murmur hash but still keep backward compatibility for existing
> users so that they dont have to reload the existing tables.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
