[ 
https://issues.apache.org/jira/browse/IMPALA-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16901540#comment-16901540
 ] 

Tim Armstrong commented on IMPALA-8816:
---------------------------------------

I'll leave this open still since the runtime is still pretty bad. Here's the 
table of test durations.

 
|[Package|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[Duration|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[Fail|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[(diff)|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[Skip|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[(diff)|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[Pass|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[(diff)|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[Total|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|[(diff)|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/]|
|[authorization.test_authorization|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_authorization/]|2
 min 32 sec|0| |0| |8|+8|8|+8|
|[authorization.test_authorized_proxy|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_authorized_proxy/]|1
 min 29 sec|0| |0| |6|+6|6|+6|
|[authorization.test_grant_revoke|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_grant_revoke/]|5
 min 13 sec|0| |0| |9|+9|9|+9|
|[authorization.test_owner_privileges|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_owner_privileges/]|2
 min 5 sec|0| |0| |4|+4|4|+4|
|[authorization.test_provider|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_provider/]|23
 sec|0| |0| |1|+1|1|+1|
|[authorization.test_ranger|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_ranger/]|2
 min 37 sec|0| |0| |8|+8|8|+8|
|[authorization.test_sentry|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_sentry/]|45
 sec|0| |0| |3|+3|3|+3|
|[authorization.test_show_grant|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/authorization.test_show_grant/]|1
 min 2 sec|0| |0| |2|+2|2|+2|
|[catalog_service.test_catalog_service_client|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/catalog_service.test_catalog_service_client/]|2.3
 sec|0| |0| |1|+1|1|+1|
|[catalog_service.test_hms_failure|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/catalog_service.test_hms_failure/]|1
 min 3 sec|0| |0| |1|+1|1|+1|
|[catalog_service.test_large_num_partitions|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/catalog_service.test_large_num_partitions/]|10
 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_admission_controller|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_admission_controller/]|8
 min 41 sec|0| |3|+3|21|+21|24|+24|
|[custom_cluster.test_alloc_fail|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_alloc_fail/]|50
 sec|0| |1|+1|1|+1|2|+2|
|[custom_cluster.test_always_false_filter|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_always_false_filter/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_auto_scaling|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_auto_scaling/]|0
 ms|0| |3|+3|0| |3|+3|
|[custom_cluster.test_automatic_invalidation|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_automatic_invalidation/]|1
 min 31 sec|0| |0| |4|+4|4|+4|
|[custom_cluster.test_blacklist|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_blacklist/]|0
 ms|0| |2|+2|0| |2|+2|
|[custom_cluster.test_breakpad|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_breakpad/]|7.3
 sec|0| |10|+10|1|+1|11|+11|
|[custom_cluster.test_catalog_wait|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_catalog_wait/]|18
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_client_ssl|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_client_ssl/]|2
 min 53 sec|0| |6|+6|10|+10|16|+16|
|[custom_cluster.test_compact_catalog_updates|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_compact_catalog_updates/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_coordinators|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_coordinators/]|3
 min 1 sec|0| |0| |5|+5|5|+5|
|[custom_cluster.test_custom_statestore|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_custom_statestore/]|9
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_data_cache|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_data_cache/]|2
 min 56 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_delegation|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_delegation/]|27
 sec|0| |0| |3|+3|3|+3|
|[custom_cluster.test_disable_catalog_data_ops|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_disable_catalog_data_ops/]|10
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_disable_features|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_disable_features/]|9.9
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_disk_spill_configurations|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_disk_spill_configurations/]|15
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_event_processing|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_event_processing/]|1
 min 21 sec|0| |1|+1|1|+1|2|+2|
|[custom_cluster.test_exchange_deferred_batches|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_exchange_deferred_batches/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_exchange_delays|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_exchange_delays/]|59
 sec|0| |0| |3|+3|3|+3|
|[custom_cluster.test_executor_groups|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_executor_groups/]|3
 min 31 sec|0| |0| |11|+11|11|+11|
|[custom_cluster.test_frontend_connection_limit|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_frontend_connection_limit/]|27
 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_hdfs_fd_caching|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_hdfs_fd_caching/]|1
 min 18 sec|0| |0| |3|+3|3|+3|
|[custom_cluster.test_hdfs_timeout|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_hdfs_timeout/]|20
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_hedged_reads|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_hedged_reads/]|10
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_hive_parquet_codec_interop|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_hive_parquet_codec_interop/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_hive_parquet_timestamp_conversion|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_hive_parquet_timestamp_conversion/]|49
 sec|0| |0| |3|+3|3|+3|
|[custom_cluster.test_hs2|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_hs2/]|0
 ms|0| |2|+2|0| |2|+2|
|[custom_cluster.test_insert_behaviour|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_insert_behaviour/]|23
 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_jvm_mem_tracking|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_jvm_mem_tracking/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_krpc_mem_usage|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_krpc_mem_usage/]|0
 ms|0| |3|+3|0| |3|+3|
|[custom_cluster.test_krpc_metrics|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_krpc_metrics/]|0
 ms|0| |3|+3|0| |3|+3|
|[custom_cluster.test_krpc_options|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_krpc_options/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_kudu|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_kudu/]|3
 min 48 sec|0| |0| |12|+12|12|+12|
|[custom_cluster.test_kudu_not_available|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_kudu_not_available/]|9
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_lineage|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_lineage/]|29
 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_local_catalog|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_local_catalog/]|5
 min 22 sec|0| |0| |9|+9|9|+9|
|[custom_cluster.test_local_tz_conversion|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_local_tz_conversion/]|39
 sec|0| |0| |4|+4|4|+4|
|[custom_cluster.test_mem_reservations|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_mem_reservations/]|25
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_metadata_replicas|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_metadata_replicas/]|0
 ms|0| |2|+2|0| |2|+2|
|[custom_cluster.test_mt_dop|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_mt_dop/]|1
 min 56 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_parquet_max_page_header|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_parquet_max_page_header/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_pause_monitor|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_pause_monitor/]|16
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_permanent_udfs|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_permanent_udfs/]|1
 ms|0| |6|+6|0| |6|+6|
|[custom_cluster.test_query_concurrency|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_query_concurrency/]|0
 ms|0| |1|+1|0| |1|+1|
|[custom_cluster.test_query_event_hooks|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_query_event_hooks/]|9.8
 sec|0| |2|+2|1|+1|3|+3|
|[custom_cluster.test_query_expiration|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_query_expiration/]|46
 sec|0| |0| |3|+3|3|+3|
|[custom_cluster.test_redaction|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_redaction/]|20
 sec|0| |3|+3|1|+1|4|+4|
|[custom_cluster.test_reserved_words_version|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_reserved_words_version/]|18
 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_restart_services|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_restart_services/]|5
 min 16 sec|0| |1|+1|9|+9|10|+10|
|[custom_cluster.test_rpc_exception|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_rpc_exception/]|1
 ms|0| |8|+8|0| |8|+8|
|[custom_cluster.test_rpc_timeout|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_rpc_timeout/]|2
 ms|0| |11|+11|0| |11|+11|
|[custom_cluster.test_s3a_access|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_s3a_access/]|1
 ms|0| |2|+2|0| |2|+2|
|[custom_cluster.test_scanner_plugin|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_scanner_plugin/]|10
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_scratch_disk|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_scratch_disk/]|1
 ms|0| |5|+5|0| |5|+5|
|[custom_cluster.test_seq_file_filtering|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_seq_file_filtering/]|11
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_session_expiration|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_session_expiration/]|1
 min 47 sec|0| |0| |5|+5|5|+5|
|[custom_cluster.test_set_and_unset|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_set_and_unset/]|18
 sec|0| |0| |2|+2|2|+2|
|[custom_cluster.test_shared_tzdb|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_shared_tzdb/]|35
 sec|0| |0| |3|+3|3|+3|
|[custom_cluster.test_shell_interactive|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_shell_interactive/]|18
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_shell_interactive_reconnect|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_shell_interactive_reconnect/]|1
 min 19 sec|0| |0| |3|+3|3|+3|
|[custom_cluster.test_stats_extrapolation|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_stats_extrapolation/]|13
 sec|0| |0| |1|+1|1|+1|
|[custom_cluster.test_udf_concurrency|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_udf_concurrency/]|0
 ms|0| |2|+2|0| |2|+2|
|[custom_cluster.test_web_pages|https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/6995/testReport/custom_cluster.test_web_pages/]|0
 ms|0| |2|+2|0| |2|+2|

> custom cluster tests in precommit are taking close to 2 hours
> -------------------------------------------------------------
>
>                 Key: IMPALA-8816
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8816
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Infrastructure
>    Affects Versions: Impala 3.3.0
>            Reporter: Tim Armstrong
>            Assignee: Tim Armstrong
>            Priority: Major
>
> This is affecting precommit times substantially. We should either speed up 
> the tests or, more likely, move some to exhaustive.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to