[jira] [Created] (IMPALA-8906) TestObservability.test_query_profile_contains_query_compilation_metadata_load_events is flaky
Sahil Takiar created IMPALA-8906:
Summary:
TestObservability.test_query_profile_contains_query_compilation_metadata_load_events
is flaky
Key: IMPALA-8906
URL: https://issues.apache.org/jira/browse/IMPALA-8906
Project: IMPALA
Issue Type: Bug
Components: Backend
Reporter: Sahil Takiar
Assignee: Tamas Mate
This test failed in a recent run of ubuntu-16.04-dockerised-tests:
[https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/1100/testReport/junit/query_test.test_observability/TestObservability/test_query_profile_contains_query_compilation_metadata_load_events/]
Error Message:
{code:java}
query_test/test_observability.py:340: in
test_query_profile_contains_query_compilation_metadata_load_events
self.__verify_profile_event_sequence(load_event_regexes, runtime_profile)
query_test/test_observability.py:432: in __verify_profile_event_sequence
assert event_regex_index == 0, \ E AssertionError:
CatalogFetch.PartitionLists.Misses not in-
CatalogFetch.PartitionLists.Hits: 1 E Query
(id=56480a470616cf3c:7cfadfbe): E DEBUG MODE WARNING: Query
profile created while running a DEBUG build of Impala. Use RELEASE builds to
measure query performance. E Summary: E Session ID:
854d1d6ab3cb65b7:9ba11e621c088385 E Session Type: BEESWAX E
Start Time: 2019-08-28 20:01:05.725329000 E End Time: 2019-08-28
20:01:07.305869000 E Query Type: QUERY E Query State: FINISHED
E Query Status: OK E Impala Version: impalad version
3.4.0-SNAPSHOT DEBUG (build 207b1443ff1b116d2d031dc5325ce971af80c4a6) E
User: ubuntu E Connected User: ubuntu E Delegated User: E
Network Address: 172.18.0.1:44044 E Default Db: default E
Sql Statement: select * from functional.alltypes E Coordinator:
f6d78aab23cf:22000 E Query Options (set by configuration):
DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
E Query Options (set by configuration and planner):
DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,MT_DOP=0,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
E Plan: E E Max Per-Host Resource
Reservation: Memory=32.00KB Threads=3 E Per-Host Resource Estimates:
Memory=160MB E Codegen disabled by planner E Analyzed query: SELECT *
FROM functional.alltypes E E F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1
instances=1 E | Per-Host Resources: mem-estimate=490.49KB
mem-reservation=0B thread-reservation=1 E PLAN-ROOT SINK E |
mem-estimate=0B mem-reservation=0B thread-reservation=0 E | E
01:EXCHANGE [UNPARTITIONED] E | mem-estimate=490.49KB mem-reservation=0B
thread-reservation=0 E | tuple-ids=0 row-size=89B cardinality=7.30K E
| in pipelines: 00(GETNEXT) E | E F00:PLAN FRAGMENT [RANDOM] hosts=3
instances=3 E Per-Host Resources: mem-estimate=160.00MB
mem-reservation=32.00KB thread-reservation=2 E 00:SCAN HDFS
[functional.alltypes, RANDOM] EHDFS partitions=24/24 files=24
size=478.45KB Estored statistics: E table: rows=7.30K
size=478.45KB E partitions: 24/24 rows=7.30K E columns: all E
extrapolated-rows=disabled max-scan-range-rows=310 E
mem-estimate=160.00MB mem-reservation=32.00KB thread-reservation=1 E
tuple-ids=0 row-size=89B cardinality=7.30K Ein pipelines: 00(GETNEXT) E
E Estimated Per-Host Mem: 168274422 E
Request Pool: default-pool E Per Host Min Memory Reservation:
6db176633e3a:22000(32.00 KB) bf5c6b4d70c3:22000(32.00 KB)
f6d78aab23cf:22000(32.00 KB) E Per Host Number of Fragment Instances:
6db176633e3a:22000(1) bf5c6b4d70c3:22000(1) f6d78aab23cf:22000(2) E
Admission result: Admitted immediately E Cluster Memory Admitted:
481.44 MB E Executor Group: default E ExecSummary: E
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak
Mem Est. Peak Mem Detail E
-
E F01:ROOT 1 323.998ms 323.998ms
0 0 E 01:EXCHANGE1
3.999ms3.999ms 7.30K 7.30K 776.00 KB 490.49 KB
UNPARTITIONEDE F00:EXCHANGE SENDER37.999ms 19.999ms
1.55 KB 0 E 00:SCAN
HDFS 3 66.666ms
[jira] [Created] (IMPALA-8906) TestObservability.test_query_profile_contains_query_compilation_metadata_load_events is flaky
Sahil Takiar created IMPALA-8906:
Summary:
TestObservability.test_query_profile_contains_query_compilation_metadata_load_events
is flaky
Key: IMPALA-8906
URL: https://issues.apache.org/jira/browse/IMPALA-8906
Project: IMPALA
Issue Type: Bug
Components: Backend
Reporter: Sahil Takiar
Assignee: Tamas Mate
This test failed in a recent run of ubuntu-16.04-dockerised-tests:
[https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests/1100/testReport/junit/query_test.test_observability/TestObservability/test_query_profile_contains_query_compilation_metadata_load_events/]
Error Message:
{code:java}
query_test/test_observability.py:340: in
test_query_profile_contains_query_compilation_metadata_load_events
self.__verify_profile_event_sequence(load_event_regexes, runtime_profile)
query_test/test_observability.py:432: in __verify_profile_event_sequence
assert event_regex_index == 0, \ E AssertionError:
CatalogFetch.PartitionLists.Misses not in-
CatalogFetch.PartitionLists.Hits: 1 E Query
(id=56480a470616cf3c:7cfadfbe): E DEBUG MODE WARNING: Query
profile created while running a DEBUG build of Impala. Use RELEASE builds to
measure query performance. E Summary: E Session ID:
854d1d6ab3cb65b7:9ba11e621c088385 E Session Type: BEESWAX E
Start Time: 2019-08-28 20:01:05.725329000 E End Time: 2019-08-28
20:01:07.305869000 E Query Type: QUERY E Query State: FINISHED
E Query Status: OK E Impala Version: impalad version
3.4.0-SNAPSHOT DEBUG (build 207b1443ff1b116d2d031dc5325ce971af80c4a6) E
User: ubuntu E Connected User: ubuntu E Delegated User: E
Network Address: 172.18.0.1:44044 E Default Db: default E
Sql Statement: select * from functional.alltypes E Coordinator:
f6d78aab23cf:22000 E Query Options (set by configuration):
DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
E Query Options (set by configuration and planner):
DEBUG_ACTION=CRS_BEFORE_ADMISSION:SLEEP@1000,MT_DOP=0,TIMEZONE=Zulu,CLIENT_IDENTIFIER=query_test/test_observability.py::TestObservability::()::test_exec_summary_in_runtime_profile
E Plan: E E Max Per-Host Resource
Reservation: Memory=32.00KB Threads=3 E Per-Host Resource Estimates:
Memory=160MB E Codegen disabled by planner E Analyzed query: SELECT *
FROM functional.alltypes E E F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1
instances=1 E | Per-Host Resources: mem-estimate=490.49KB
mem-reservation=0B thread-reservation=1 E PLAN-ROOT SINK E |
mem-estimate=0B mem-reservation=0B thread-reservation=0 E | E
01:EXCHANGE [UNPARTITIONED] E | mem-estimate=490.49KB mem-reservation=0B
thread-reservation=0 E | tuple-ids=0 row-size=89B cardinality=7.30K E
| in pipelines: 00(GETNEXT) E | E F00:PLAN FRAGMENT [RANDOM] hosts=3
instances=3 E Per-Host Resources: mem-estimate=160.00MB
mem-reservation=32.00KB thread-reservation=2 E 00:SCAN HDFS
[functional.alltypes, RANDOM] EHDFS partitions=24/24 files=24
size=478.45KB Estored statistics: E table: rows=7.30K
size=478.45KB E partitions: 24/24 rows=7.30K E columns: all E
extrapolated-rows=disabled max-scan-range-rows=310 E
mem-estimate=160.00MB mem-reservation=32.00KB thread-reservation=1 E
tuple-ids=0 row-size=89B cardinality=7.30K Ein pipelines: 00(GETNEXT) E
E Estimated Per-Host Mem: 168274422 E
Request Pool: default-pool E Per Host Min Memory Reservation:
6db176633e3a:22000(32.00 KB) bf5c6b4d70c3:22000(32.00 KB)
f6d78aab23cf:22000(32.00 KB) E Per Host Number of Fragment Instances:
6db176633e3a:22000(1) bf5c6b4d70c3:22000(1) f6d78aab23cf:22000(2) E
Admission result: Admitted immediately E Cluster Memory Admitted:
481.44 MB E Executor Group: default E ExecSummary: E
Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak
Mem Est. Peak Mem Detail E
-
E F01:ROOT 1 323.998ms 323.998ms
0 0 E 01:EXCHANGE1
3.999ms3.999ms 7.30K 7.30K 776.00 KB 490.49 KB
UNPARTITIONEDE F00:EXCHANGE SENDER37.999ms 19.999ms
1.55 KB 0 E 00:SCAN
HDFS 3 66.666ms
