Pranav Yogi Lodha created IMPALA-13760:
------------------------------------------
Summary: AssertionError in TestRuntimeFilters.test_basic_filters
Key: IMPALA-13760
URL: https://issues.apache.org/jira/browse/IMPALA-13760
Project: IMPALA
Issue Type: Bug
Reporter: Pranav Yogi Lodha
h3. Error Message
{noformat}
AssertionError: Did not find matches for lines in runtime profile: EXPECTED
LINES: row_regex: .*REMOTE.*ms.*ms.*true ACTUAL PROFILE: Query
(id=c240144e50156fdf:4a5d42ea00000000): Summary: Session ID:
01416e6b603bb5cc:0218894cee8302ab Session Type: BEESWAX Start Time: 2025-02-13
22:12:29.699446000 End Time: 2025-02-13 22:12:29.754395000 Duration: 54.949ms
(54949 us) Query Type: QUERY Query State: FINISHED Impala Query State: FINISHED
Query Status: OK Impala Version: impalad version 4.3.0-SNAPSHOT RELEASE (build
438cff1063dc1ce98f3a35224954a3194cf6c748) User: jenkins Connected User: jenkins
Delegated User: Network Address: 127.0.0.1:48608 Default Db:
functional_text_gzip Sql Statement: select STRAIGHT_JOIN count(*) from alltypes
a join [SHUFFLE] alltypestiny b on a.month = b.month + 10000 Coordinator:
impala-ec2-rhel88-m7g-4xlarge-ondemand-1ba5.vpc.cloudera.com:27000 Query
Options (set by configuration):
ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=60000,MT_DOP=1,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestRuntimeFilters::()::test_basic_filters[mt_dop:1|protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_no,MINMAX_FILTER_PARTITION_COLUMNS=0,TEST_REPLAN=1
Query Options (set by configuration and planner):
Stacktrace
query_test/test_runtime_filters.py:79: in test_basic_filters
test_file_vars={'$RUNTIME_FILTER_WAIT_TIME_MS' : str(WAIT_TIME_MS)})
/data/jenkins/workspace/impala-cdh_main-exhaustive-release-arm/repos/Impala/tests/common/impala_test_suite.py:845:
in run_test_case update_section=pytest.config.option.update_results)
/data/jenkins/workspace/impala-cdh_main-exhaustive-release-arm/repos/Impala/tests/common/test_result_verifier.py:685:
in verify_runtime_profile actual)) E AssertionError: Did not find matches for
lines in runtime profile: E EXPECTED LINES: E row_regex: .*REMOTE.*ms.*ms.*true
E E ACTUAL PROFILE: E Query (id=c240144e50156fdf:4a5d42ea00000000): E Summary:
E Session ID: 01416e6b603bb5cc:0218894cee8302ab E Session Type: BEESWAX E Start
Time: 2025-02-13 22:12:29.699446000 E End Time: 2025-02-13 22:12:29.754395000 E
Duration: 54.949ms (54949 us) E Query Type: QUERY E Query State: FINISHED E
Impala Query State: FINISHED E Query Status: OK E Impala Version: impalad
version 4.3.0-SNAPSHOT RELEASE (build 438cff1063dc1ce98f3a35224954a3194cf6c748)
E User: jenkins E Connected User: jenkins E Delegated User: E Network Address:
127.0.0.1:48608 E Default Db: functional_text_gzip E Sql Statement: select
STRAIGHT_JOIN count(*) from alltypes a E join [SHUFFLE] alltypestiny b E on
a.month = b.month + 10000 E Coordinator:
impala-ec2-rhel88-m7g-4xlarge-ondemand-1ba5.vpc.cloudera.com:27000 E Query
Options (set by configuration):
ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=60000,MT_DOP=1,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestRuntimeFilters::()::test_basic_filters[mt_dop:1|protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_no,MINMAX_FILTER_PARTITION_COLUMNS=0,TEST_REPLAN=1
E Query Options (set by configuration and planner):
ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,RUNTIME_FILTER_WAIT_TIME_MS=60000,MT_DOP=1,DISABLE_CODEGEN_ROWS_THRESHOLD=0,TIMEZONE=America/Los_Angeles,CLIENT_IDENTIFIER=query_test/test_runtime_filters.py::TestRuntimeFilters::()::test_basic_filters[mt_dop:1|protocol:beeswax|exec_option:{'test_replan':1;'batch_size':0;'num_nodes':0;'disable_codegen_rows_threshold':0;'disable_codegen':True;'abort_on_error':1;'exec_single_no,SPOOL_QUERY_RESULTS=0,MINMAX_FILTER_THRESHOLD=0.5,MINMAX_FILTERING_LEVEL=PAGE,MINMAX_FILTER_PARTITION_COLUMNS=0,TEST_REPLAN=1
E Plan: E ---------------- E Max Per-Host Resource Reservation: Memory=3.95MB
Threads=5 E Per-Host Resource Estimates: Memory=36MB E WARNING: The following
tables are missing relevant table and/or column statistics. E
functional_text_gzip.alltypestiny E Analyzed query: SELECT /* +straight_join */
count(*) FROM E functional_text_gzip.alltypes a INNER JOIN /* +SHUFFLE */ E
functional_text_gzip.alltypestiny b ON CAST(a.`month` AS BIGINT) = E
CAST(b.`month` AS BIGINT) + CAST(10000 AS BIGINT) E E F03:PLAN FRAGMENT
[UNPARTITIONED] hosts=1 instances=1 E | Per-Instance Resources:
mem-estimate=32.00KB mem-reservation=0B thread-reservation=1 E PLAN-ROOT SINK E
| output exprs: count(*) E | mem-estimate=0B mem-reservation=0B
thread-reservation=0 E | E 07:AGGREGATE [FINALIZE] E | output: count:merge(*) E
| mem-estimate=16.00KB mem-reservation=0B spill-buffer=2.00MB
thread-reservation=0 E | tuple-ids=2 row-size=8B cardinality=1 E | in
pipelines: 07(GETNEXT), 03(OPEN) E | E 06:EXCHANGE [UNPARTITIONED] E |
mem-estimate=16.00KB mem-reservation=0B thread-reservation=0 E | tuple-ids=2
row-size=8B cardinality=1 E | in pipelines: 03(GETNEXT) E | E F02:PLAN FRAGMENT
[HASH(a.`month`)] hosts=3 instances=3 E Per-Instance Resources:
mem-estimate=64.00KB mem-reservation=0B thread-reservation=1 E 03:AGGREGATE E |
output: count(*) E | mem-estimate=16.00KB mem-reservation=0B
spill-buffer=2.00MB thread-reservation=0 E | tuple-ids=2 row-size=8B
cardinality=1 E | in pipelines: 03(GETNEXT), 00(OPEN) E | E 02:HASH JOIN [INNER
JOIN, PARTITIONED] E | hash-table-id=00 E | hash predicates: a.`month` =
b.`month` + 10000 E | fk/pk conjuncts: assumed fk/pk E | mem-estimate=0B
mem-reservation=0B spill-buffer=64.00KB thread-reservation=0 E | tuple-ids=0,1
row-size=8B cardinality=3.57K E | in pipelines: 00(GETNEXT), 01(OPEN) E | E
|--F04:PLAN FRAGMENT [HASH(a.`month`)] hosts=3 instances=3 E | | Per-Instance
Resources: mem-estimate=2.95MB mem-reservation=2.94MB thread-reservation=1
runtime-filters-memory=1.00MB E | JOIN BUILD E | | join-table-id=00 plan-id=01
cohort-id=01 E | | build expressions: b.`month` + 10000 E | | runtime filters:
RF000[bloom] <- b.`month` + 10000 E | | mem-estimate=1.94MB
mem-reservation=1.94MB spill-buffer=64.00KB thread-reservation=0 E | | E |
05:EXCHANGE [HASH(b.`month` + 10000)] E | | mem-estimate=16.00KB
mem-reservation=0B thread-reservation=0 E | | tuple-ids=1 row-size=4B
cardinality=15 E | | in pipelines: 01(GETNEXT) E | | E | F01:PLAN FRAGMENT
[RANDOM] hosts=3 instances=3 E | Per-Instance Resources: mem-estimate=16.09MB
mem-reservation=8.00KB thread-reservation=1 E | 01:SCAN HDFS
[functional_text_gzip.alltypestiny b, RANDOM] E | HDFS partitions=4/4 files=4
size=328B E | stored statistics: E | table: rows=unavailable size=unavailable E
| partitions: 0/4 rows=15 E | columns: all E | extrapolated-rows=disabled
max-scan-range-rows=unavailable E | mem-estimate=16.00MB mem-reservation=8.00KB
thread-reservation=0 E | tuple-ids=1 row-size=4B cardinality=15 E | in
pipelines: 01(GETNEXT) E | E 04:EXCHANGE [HASH(a.`month`)] E |
mem-estimate=28.65KB mem-reservation=0B thread-reservation=0 E | tuple-ids=0
row-size=4B cardinality=3.57K E | in pipelines: 00(GETNEXT) E | E F00:PLAN
FRAGMENT [RANDOM] hosts=3 instances=3 E Per-Host Shared Resources:
mem-estimate=1.00MB mem-reservation=1.00MB thread-reservation=0
runtime-filters-memory=1.00MB E Per-Instance Resources: mem-estimate=16.09MB
mem-reservation=8.00KB thread-reservation=1 E 00:SCAN HDFS
[functional_text_gzip.alltypes a, RANDOM] E HDFS partitions=24/24 files=24
size=77.88KB E runtime filters: RF000[bloom] -> a.`month` E stored statistics:
E table: rows=unavailable size=unavailable E partitions: 0/24 rows=3.57K E
columns: all E extrapolated-rows=disabled max-scan-range-rows=unavailable E
mem-estimate=16.00MB mem-reservation=8.00KB thread-reservation=0 E tuple-ids=0
row-size=4B cardinality=3.57K E in pipelines: 00(GETNEXT) E ---------------- E
Estimated Per-Host Mem: 37994496 E Tables Missing Stats: fntime_filters.test
-- executing against localhost:21000
SET RUNTIME_FILTER_MODE=OFF;
-- 2025-02-13 22:12:23,624 INFO MainThread: Started query
0b45130cb197cee2:37d6007200000000
-- executing against localhost:21000
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
