[jira] [Resolved] (IMPALA-10897) TestEventProcessing.test_event_based_replication is flaky
[
https://issues.apache.org/jira/browse/IMPALA-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vihang Karajgaonkar resolved IMPALA-10897.
--
Fix Version/s: Impala 4.0.1
Resolution: Fixed
This test has been disabled as part of IMPALA-9857
> TestEventProcessing.test_event_based_replication is flaky
> -
>
> Key: IMPALA-10897
> URL: https://issues.apache.org/jira/browse/IMPALA-10897
> Project: IMPALA
> Issue Type: Bug
>Reporter: Quanlong Huang
>Assignee: Vihang Karajgaonkar
>Priority: Critical
> Fix For: Impala 4.0.1
>
>
> Saw this in an ASAN build:
> {code:python}
> metadata/test_event_processing.py:185: in test_event_based_replication
> self.__run_event_based_replication_tests()
> metadata/test_event_processing.py:326: in __run_event_based_replication_tests
> EventProcessorUtils.wait_for_event_processing(self)
> util/event_processor_utils.py:61: in wait_for_event_processing
> within {1} seconds".format(current_event_id, timeout))
> E Exception: Event processor did not sync till last known event id 34722
>within 10 seconds {code}
> Standard Error
> {code}
> SET
> client_identifier=metadata/test_event_processing.py::TestEventProcessing::()::test_event_based_replication;
> -- connecting to: localhost:21000
> -- connecting to localhost:21050 with impyla
> -- 2021-08-28 23:43:40,300 INFO MainThread: Closing active operation
> -- connecting to localhost:28000 with impyla
> -- 2021-08-28 23:43:40,323 INFO MainThread: Closing active operation
> -- connecting to localhost:11050 with impyla
> -- 2021-08-28 23:43:48,026 INFO MainThread: Waiting until events
> processor syncs to event id:31451
> -- 2021-08-28 23:43:48,759 DEBUGMainThread: Metric last-synced-event-id
> has reached the desired value:31455
> -- 2021-08-28 23:43:48,790 DEBUGMainThread: Found 3 impalad/1
> statestored/1 catalogd process(es)
> -- 2021-08-28 23:43:48,820 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:48,824 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:49,825 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:49,829 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:50,830 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:50,835 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:51,836 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:51,840 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:52,841 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:52,846 INFO MainThread: Metric 'catalog.curr-version'
> has reached desired value: 2364
> -- 2021-08-28 23:43:52,846 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25001
> -- 2021-08-28 23:43:52,851 INFO MainThread: Metric 'catalog.curr-version'
> has reached desired value: 2364
> -- 2021-08-28 23:43:52,851 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25002
> -- 2021-08-28 23:43:52,855 INFO MainThread: Metric 'catalog.curr-version'
> has reached desired value: 2364
> -- executing against localhost:21000
> create table repl_source_ugchr.unpart_tbl (a string, b string) stored as
> parquet tblproperties
> ('transactional'='true','transactional_properties'='insert_only');
> -- 2021-08-28 23:43:52,878 INFO MainThread: Started query
> 394339b6db812c59:a5e5039a
> -- executing against localhost:21000
> create table repl_source_ugchr.part_tbl (id int, bool_col boolean,
> tinyint_col tinyint, smallint_col smallint, int_col int, bigint_col bigint,
> float_col float, double_col double, date_string string, string_col string,
> timestamp_col timestamp) partitioned by (year int, month int) stored as
> parquet tblproperties
> ('transactional'='true','transactional_properties'='insert_only');
> -- 2021-08-28 23:43:52,900 INFO MainThread: Started query
> b74f5e32e4c1790a:46410750
> -- executing against localhost:21000
> insert into repl_source_ugchr.unpart_tbl select * from functional.tinytable;
> -- 2021-08-28 23:43:56,132 INFO MainThread: Started query
>
[jira] [Resolved] (IMPALA-10897) TestEventProcessing.test_event_based_replication is flaky
[
https://issues.apache.org/jira/browse/IMPALA-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vihang Karajgaonkar resolved IMPALA-10897.
--
Fix Version/s: Impala 4.0.1
Resolution: Fixed
This test has been disabled as part of IMPALA-9857
> TestEventProcessing.test_event_based_replication is flaky
> -
>
> Key: IMPALA-10897
> URL: https://issues.apache.org/jira/browse/IMPALA-10897
> Project: IMPALA
> Issue Type: Bug
>Reporter: Quanlong Huang
>Assignee: Vihang Karajgaonkar
>Priority: Critical
> Fix For: Impala 4.0.1
>
>
> Saw this in an ASAN build:
> {code:python}
> metadata/test_event_processing.py:185: in test_event_based_replication
> self.__run_event_based_replication_tests()
> metadata/test_event_processing.py:326: in __run_event_based_replication_tests
> EventProcessorUtils.wait_for_event_processing(self)
> util/event_processor_utils.py:61: in wait_for_event_processing
> within {1} seconds".format(current_event_id, timeout))
> E Exception: Event processor did not sync till last known event id 34722
>within 10 seconds {code}
> Standard Error
> {code}
> SET
> client_identifier=metadata/test_event_processing.py::TestEventProcessing::()::test_event_based_replication;
> -- connecting to: localhost:21000
> -- connecting to localhost:21050 with impyla
> -- 2021-08-28 23:43:40,300 INFO MainThread: Closing active operation
> -- connecting to localhost:28000 with impyla
> -- 2021-08-28 23:43:40,323 INFO MainThread: Closing active operation
> -- connecting to localhost:11050 with impyla
> -- 2021-08-28 23:43:48,026 INFO MainThread: Waiting until events
> processor syncs to event id:31451
> -- 2021-08-28 23:43:48,759 DEBUGMainThread: Metric last-synced-event-id
> has reached the desired value:31455
> -- 2021-08-28 23:43:48,790 DEBUGMainThread: Found 3 impalad/1
> statestored/1 catalogd process(es)
> -- 2021-08-28 23:43:48,820 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:48,824 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:49,825 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:49,829 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:50,830 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:50,835 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:51,836 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:51,840 INFO MainThread: Sleeping 1s before next retry.
> -- 2021-08-28 23:43:52,841 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25000
> -- 2021-08-28 23:43:52,846 INFO MainThread: Metric 'catalog.curr-version'
> has reached desired value: 2364
> -- 2021-08-28 23:43:52,846 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25001
> -- 2021-08-28 23:43:52,851 INFO MainThread: Metric 'catalog.curr-version'
> has reached desired value: 2364
> -- 2021-08-28 23:43:52,851 INFO MainThread: Getting metric:
> catalog.curr-version from
> impala-ec2-centos74-m5-4xlarge-ondemand-1787.vpc.cloudera.com:25002
> -- 2021-08-28 23:43:52,855 INFO MainThread: Metric 'catalog.curr-version'
> has reached desired value: 2364
> -- executing against localhost:21000
> create table repl_source_ugchr.unpart_tbl (a string, b string) stored as
> parquet tblproperties
> ('transactional'='true','transactional_properties'='insert_only');
> -- 2021-08-28 23:43:52,878 INFO MainThread: Started query
> 394339b6db812c59:a5e5039a
> -- executing against localhost:21000
> create table repl_source_ugchr.part_tbl (id int, bool_col boolean,
> tinyint_col tinyint, smallint_col smallint, int_col int, bigint_col bigint,
> float_col float, double_col double, date_string string, string_col string,
> timestamp_col timestamp) partitioned by (year int, month int) stored as
> parquet tblproperties
> ('transactional'='true','transactional_properties'='insert_only');
> -- 2021-08-28 23:43:52,900 INFO MainThread: Started query
> b74f5e32e4c1790a:46410750
> -- executing against localhost:21000
> insert into repl_source_ugchr.unpart_tbl select * from functional.tinytable;
> -- 2021-08-28 23:43:56,132 INFO MainThread: Started query
>
