[
https://issues.apache.org/jira/browse/HIVE-22239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947959#comment-16947959
]
Hive QA commented on HIVE-22239:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12982599/HIVE-22239.03.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/18925/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/18925/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-18925/
Messages:
{noformat}
**** This message was trimmed, see log for full details ****
error:
a/ql/src/test/results/clientpositive/llap/materialized_view_create_rewrite_2.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/materialized_view_rewrite_1.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/materialized_view_rewrite_no_join_opt_2.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/materialized_view_rewrite_part_1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/orc_llap.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/llap/orc_llap_nonvector.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/orc_merge5.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/orc_merge6.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/orc_merge7.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/orc_merge_incompat1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/orc_merge_incompat2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/orc_predicate_pushdown.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/parquet_predicate_pushdown.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/results_cache_with_masking.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/retry_failure_reorder.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/runtime_stats_hs2.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part_all_primitive.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_orc_nonvec_part_all_primitive_llap_io.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part_all_primitive.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_orc_vec_part_all_primitive_llap_io.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part_all_primitive.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_text_nonvec_part_all_primitive_llap_io.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part_all_primitive.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_text_vec_part_all_primitive_llap_io.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part_all_primitive.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/schema_evol_text_vecrow_part_all_primitive_llap_io.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/semijoin.q.out: does not exist
in index
error: a/ql/src/test/results/clientpositive/llap/smb_mapjoin_14.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_in.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/subquery_select.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_1.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/tez_dynpart_hashjoin_3.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/tez_vector_dynpart_hashjoin_1.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/tez_vector_dynpart_hashjoin_2.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_aggregate_9.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_between_in.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_coalesce.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_complex_join.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_decimal_cast.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/vector_decimal_expressions.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_elt.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_inner_join.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_interval_mapjoin.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_leftsemi_mapjoin.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vector_outer_join1.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/llap/vector_reuse_scratchcols.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_0.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_10.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_11.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_12.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_13.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_14.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_15.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_16.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_17.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_2.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_3.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_5.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_7.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_8.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_9.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_div0.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorization_limit.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/vectorization_short_regress.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/llap/vectorized_casts.q.out: does
not exist in index
error:
a/ql/src/test/results/clientpositive/llap/vectorized_timestamp_funcs.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/llap/vectorized_timestamp_ints_casts.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/masking_1.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/masking_12.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/masking_13.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/masking_1_newdb.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/masking_5.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/masking_8.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/masking_disablecbo_1.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/masking_mv.q.out: does not exist in
index
error:
a/ql/src/test/results/clientpositive/nullability_transitive_inference.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/orc_merge5.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/orc_merge6.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/orc_merge_incompat1.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/orc_merge_incompat2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_0.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_10.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_11.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_12.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_13.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_14.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_15.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_16.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_17.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_2.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_3.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_5.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_7.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_8.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_9.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_div0.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/parquet_vectorization_limit.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/parquet_vectorization_offset_limit.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/pcr.q.out: does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query34.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query35.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query37.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query66.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query73.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query79.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query82.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query84.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query88.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query90.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/constraints/query96.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query34.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query35.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query37.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query66.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query73.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query79.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query82.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query84.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query88.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query90.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/perf/tez/query96.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/remove_exprs_stats.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/sample7.q.out: does not exist in
index
error:
a/ql/src/test/results/clientpositive/spark/dynpart_sort_optimization.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/spark/spark_explainuser_1.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/tez/acid_vectorization_original_tez.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_3.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainanalyze_4.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/tez/explainuser_3.q.out: does not
exist in index
error:
a/ql/src/test/results/clientpositive/tez/vector_non_string_partition.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/timestamp_ints_casts.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/union_pos_alias.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_aggregate_9.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_coalesce.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_decimal_cast.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_decimal_expressions.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/vector_elt.q.out: does not exist in
index
error: a/ql/src/test/results/clientpositive/vector_empty_where.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_interval_mapjoin.q.out: does
not exist in index
error: a/ql/src/test/results/clientpositive/vector_non_constant_in_expr.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/vector_non_string_partition.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/vector_outer_join1.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_outer_join3.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_outer_join4.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vector_udf_trunc.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_10.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_11.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_12.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_13.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_14.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_15.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_16.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_17.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_2.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_3.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_5.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_7.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_8.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_9.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_limit.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorization_offset_limit.q.out:
does not exist in index
error: a/ql/src/test/results/clientpositive/vectorized_casts.q.out: does not
exist in index
error: a/ql/src/test/results/clientpositive/vectorized_timestamp_funcs.q.out:
does not exist in index
error:
a/ql/src/test/results/clientpositive/vectorized_timestamp_ints_casts.q.out:
does not exist in index
Going to apply patch with: git apply -p1
/data/hiveptest/working/scratch/build.patch:475: trailing whitespace.
min 2012-01-01 01:02:03
/data/hiveptest/working/scratch/build.patch:476: trailing whitespace.
max 2012-01-01 01:02:03
/data/hiveptest/working/scratch/build.patch:486: trailing whitespace.
min 2012-01-01 01:02:03
/data/hiveptest/working/scratch/build.patch:487: trailing whitespace.
max 2012-01-01 01:02:03
/data/hiveptest/working/scratch/build.patch:497: trailing whitespace.
min 2013-01-01 09:02:04
warning: squelched 9 whitespace errors
warning: 14 lines add whitespace errors.
+ [[ maven == \m\a\v\e\n ]]
+ rm -rf /data/hiveptest/working/maven/org/apache/hive
+ mvn -B clean install -DskipTests -T 4 -q
-Dmaven.repo.local=/data/hiveptest/working/maven
protoc-jar: executing: [/tmp/protoc6307922080038298989.exe, --version]
libprotoc 2.5.0
protoc-jar: executing: [/tmp/protoc6307922080038298989.exe,
-I/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/src/main/protobuf/org/apache/hadoop/hive/metastore,
--java_out=/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/target/generated-sources,
/data/hiveptest/working/apache-github-source-source/standalone-metastore/metastore-common/src/main/protobuf/org/apache/hadoop/hive/metastore/metastore.proto]
ANTLR Parser Generator Version 3.5.2
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process
(process-resource-bundles) on project hive-pre-upgrade: Execution
process-resource-bundles of goal
org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process failed.
ConcurrentModificationException -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hive-pre-upgrade
+ result=1
+ '[' 1 -ne 0 ']'
+ rm -rf yetus_PreCommit-HIVE-Build-18925
+ exit 1
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12982599 - PreCommit-HIVE-Build
> Scale data size using column value ranges
> -----------------------------------------
>
> Key: HIVE-22239
> URL: https://issues.apache.org/jira/browse/HIVE-22239
> Project: Hive
> Issue Type: Improvement
> Components: Physical Optimizer
> Reporter: Jesus Camacho Rodriguez
> Assignee: Jesus Camacho Rodriguez
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22239.01.patch, HIVE-22239.02.patch,
> HIVE-22239.03.patch, HIVE-22239.patch
>
> Time Spent: 4h 20m
> Remaining Estimate: 0h
>
> Currently, min/max values for columns are only used to determine whether a
> certain range filter falls out of range and thus filters all rows or none at
> all. If it does not, we just use a heuristic that the condition will filter
> 1/3 of the input rows. Instead of using that heuristic, we can use another
> one that assumes that data will be uniformly distributed across that range,
> and calculate the selectivity for the condition accordingly.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
