Flaky test issue report (37)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (created 2019-08-16) https://issues.apache.org/jira/browse/BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (created 2019-07-26) https://issues.apache.org/jira/browse/BEAM-7752: Java Validates DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky (created 2019-
Flaky test issue report (37)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (created 2019-08-16) https://issues.apache.org/jira/browse/BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (created 2019-07-26) https://issues.apache.org/jira/browse/BEAM-7752: Java Validates DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky (created 2019-
Flaky test issue report (37)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (created 2019-08-16) https://issues.apache.org/jira/browse/BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (created 2019-07-26) https://issues.apache.org/jira/browse/BEAM-7752: Java Validates DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky (created 2019-
Flaky test issue report (37)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (created 2019-08-16) https://issues.apache.org/jira/browse/BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (created 2019-07-26) https://issues.apache.org/jira/browse/BEAM-7752: Java Validates DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky (created 2019-
Flaky test issue report (37)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (created 2019-08-16) https://issues.apache.org/jira/browse/BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (created 2019-07-26) https://issues.apache.org/jira/browse/BEAM-7752: Java Validates DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky (created 2019-
Flaky test issue report (37)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (created 2019-08-16) https://issues.apache.org/jira/browse/BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (created 2019-07-26) https://issues.apache.org/jira/browse/BEAM-7752: Java Validates DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky (created 2019-
Flaky test issue report (37)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types (created 2019-08-16) https://issues.apache.org/jira/browse/BEAM-7827: MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on DirectRunner (created 2019-07-26) https://issues.apache.org/jira/browse/BEAM-7752: Java Validates DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky (created 2019-