Once in a while I try to repro some of these. Is anyone else looking at them? My impression is that mostly they are stale. When I look at actual recent flakes there are just 2-4 culprits. What would it take to get this email to 0?
Kenn On Mon, Aug 23, 2021 at 11:45 AM Beam Jira Bot <[email protected]> wrote: > This is your daily summary of Beam's current flaky tests ( > https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake > ) > > These are P1 issues because they have a major negative impact on the > community and make it hard to determine the quality of the software. > > https://issues.apache.org/jira/browse/BEAM-12515: Python PreCommit > flaking in PipelineOptionsTest.test_display_data (created 2021-06-18) > https://issues.apache.org/jira/browse/BEAM-12387: > beam_PostCommit_Python* timing out (created 2021-05-21) > https://issues.apache.org/jira/browse/BEAM-12386: > beam_PostCommit_Py_VR_Dataflow(_V2) failing metrics tests (created > 2021-05-21) > https://issues.apache.org/jira/browse/BEAM-12322: > FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created > 2021-05-10) > https://issues.apache.org/jira/browse/BEAM-12320: > PubsubTableProviderIT.testSQLSelectsArrayAttributes[0] failing in SQL > PostCommit (created 2021-05-10) > https://issues.apache.org/jira/browse/BEAM-12309: > PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) > https://issues.apache.org/jira/browse/BEAM-12307: > PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) > https://issues.apache.org/jira/browse/BEAM-12303: Flake in > PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) > https://issues.apache.org/jira/browse/BEAM-12291: > org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: > false] is flaky (created 2021-05-05) > https://issues.apache.org/jira/browse/BEAM-12200: > SamzaStoreStateInternalsTest is flaky (created 2021-04-20) > https://issues.apache.org/jira/browse/BEAM-12163: Python GHA > PreCommits flake with grpc.FutureTimeoutError on SDK harness startup > (created 2021-04-13) > https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL > failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) > https://issues.apache.org/jira/browse/BEAM-11837: Java build flakes: > "Memory constraints are impeding performance" (created 2021-02-18) > https://issues.apache.org/jira/browse/BEAM-11792: Python precommit > failed (flaked?) installing package (created 2021-02-10) > https://issues.apache.org/jira/browse/BEAM-11666: > apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution > is flaky (created 2021-01-20) > https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest > flake: network not found (py38 postcommit) (created 2021-01-19) > https://issues.apache.org/jira/browse/BEAM-11645: > beam_PostCommit_XVR_Flink failing (created 2021-01-15) > https://issues.apache.org/jira/browse/BEAM-11641: Bigquery Read tests > are flaky on Flink runner in Python PostCommit suites (created 2021-01-15) > https://issues.apache.org/jira/browse/BEAM-11541: > testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. > (created 2020-12-30) > https://issues.apache.org/jira/browse/BEAM-10866: > PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on > macOS (created 2020-09-09) > https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: > ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) > https://issues.apache.org/jira/browse/BEAM-9649: > beam_python_mongoio_load_test started failing due to mismatched results > (created 2020-03-31) > https://issues.apache.org/jira/browse/BEAM-9232: > BigQueryWriteIntegrationTests is flaky coercing to Unicode (created > 2020-01-31) > https://issues.apache.org/jira/browse/BEAM-8101: Flakes in > ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful > for Direct, Spark, Flink (created 2019-08-27) > https://issues.apache.org/jira/browse/BEAM-8035: > WatchTest.testMultiplePollsWithManyResults flake: Outputs must be in > timestamp order (sickbayed) (created 2019-08-22) > https://issues.apache.org/jira/browse/BEAM-7992: Unhandled > type_constraint in > apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types > (created 2019-08-16) > https://issues.apache.org/jira/browse/BEAM-7827: > MetricsTest$AttemptedMetricTests.testAllAttemptedMetrics is flaky on > DirectRunner (created 2019-07-26) > https://issues.apache.org/jira/browse/BEAM-7752: Java Validates > DirectRunner: testTeardownCalledAfterExceptionInFinishBundleStateful flaky > (created 2019-07-16) > https://issues.apache.org/jira/browse/BEAM-6804: > [beam_PostCommit_Java] [PubsubReadIT.testReadPublicData] Timeout waiting on > Sub (created 2019-03-11) > https://issues.apache.org/jira/browse/BEAM-5286: > [beam_PostCommit_Java_GradleBuild][org.apache.beam.examples.subprocess.ExampleEchoPipelineTest.testExampleEchoPipeline][Flake] > .sh script: text file busy. (created 2018-09-01) > https://issues.apache.org/jira/browse/BEAM-5172: > org.apache.beam.sdk.io.elasticsearch/ElasticsearchIOTest is flaky > (created 2018-08-20) >
