[jira] [Commented] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.
[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17122064#comment-17122064 ] Kenneth Knowles commented on BEAM-7063: --- This issue is assigned but has not received an update in 30 days so it has been labeled "stale-assigned". If you are still working on the issue, please give an update and remove the label. If you are no longer working on the issue, please unassign so someone else may work on it. In 7 days the issue will be automatically unassigned. > Stage Dataflow runner harness in Dataflow FnApi Python test suites that run > using an unreleased SDK. > > > Key: BEAM-7063 > URL: https://issues.apache.org/jira/browse/BEAM-7063 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, test-failures >Reporter: Chamikara Madhusanka Jayalath >Assignee: Valentyn Tymofieiev >Priority: P2 > Labels: stale-assigned > Time Spent: 5h 40m > Remaining Estimate: 0h > > Seems like this was the first post-commit failure: > [https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Python_Verify/7855/] > (the one before this also failed but that looks like a flake) > > > Looking at failed tests I noticed that some of the were due to failed > Dataflow jobs. I noticed three issues. > (1) Error in Dataflow jobs "This handler is only capable of dealing with > urn:beam:sideinput:materialization:multimap:0.1 materializations but was > asked to handle beam:side_input:multimap:v1 for PCollectionView with tag > side0-FilterOutSpammers." > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_17_57_01-16397932959358575026?project=apache-beam-testing] > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_07_11-1342017143600540529?project=apache-beam-testing] > > (2) BigQuery job failures (possibly this is transient) > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_25_22-16437560120793921616?project=apache-beam-testing] > > (3) Some batch Dataflow jobs timed out and were cancelled (possibly also > transient). > > (1) is probably due to > [https://github.com/apache/beam/commit/684f8130284a7c7979773300d04e5473ca0ac8f3] > > > cc: [~altay] [~lostluck] [~alanmyrvold] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.
[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837708#comment-16837708 ] Valentyn Tymofieiev commented on BEAM-7063: --- I removed "fix version" as after conversations with few folks we believe the risk for the release is low. > Stage Dataflow runner harness in Dataflow FnApi Python test suites that run > using an unreleased SDK. > > > Key: BEAM-7063 > URL: https://issues.apache.org/jira/browse/BEAM-7063 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, test-failures >Reporter: Chamikara Jayalath >Assignee: Valentyn Tymofieiev >Priority: Major > Time Spent: 5h > Remaining Estimate: 0h > > Seems like this was the first post-commit failure: > [https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Python_Verify/7855/] > (the one before this also failed but that looks like a flake) > > > Looking at failed tests I noticed that some of the were due to failed > Dataflow jobs. I noticed three issues. > (1) Error in Dataflow jobs "This handler is only capable of dealing with > urn:beam:sideinput:materialization:multimap:0.1 materializations but was > asked to handle beam:side_input:multimap:v1 for PCollectionView with tag > side0-FilterOutSpammers." > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_17_57_01-16397932959358575026?project=apache-beam-testing] > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_07_11-1342017143600540529?project=apache-beam-testing] > > (2) BigQuery job failures (possibly this is transient) > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_25_22-16437560120793921616?project=apache-beam-testing] > > (3) Some batch Dataflow jobs timed out and were cancelled (possibly also > transient). > > (1) is probably due to > [https://github.com/apache/beam/commit/684f8130284a7c7979773300d04e5473ca0ac8f3] > > > cc: [~altay] [~lostluck] [~alanmyrvold] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.
[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16837707#comment-16837707 ] Ankur Goenka commented on BEAM-7063: Can we move this to 2.14 > Stage Dataflow runner harness in Dataflow FnApi Python test suites that run > using an unreleased SDK. > > > Key: BEAM-7063 > URL: https://issues.apache.org/jira/browse/BEAM-7063 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, test-failures >Reporter: Chamikara Jayalath >Assignee: Valentyn Tymofieiev >Priority: Major > Fix For: 2.13.0 > > Time Spent: 5h > Remaining Estimate: 0h > > Seems like this was the first post-commit failure: > [https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Python_Verify/7855/] > (the one before this also failed but that looks like a flake) > > > Looking at failed tests I noticed that some of the were due to failed > Dataflow jobs. I noticed three issues. > (1) Error in Dataflow jobs "This handler is only capable of dealing with > urn:beam:sideinput:materialization:multimap:0.1 materializations but was > asked to handle beam:side_input:multimap:v1 for PCollectionView with tag > side0-FilterOutSpammers." > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_17_57_01-16397932959358575026?project=apache-beam-testing] > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_07_11-1342017143600540529?project=apache-beam-testing] > > (2) BigQuery job failures (possibly this is transient) > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_25_22-16437560120793921616?project=apache-beam-testing] > > (3) Some batch Dataflow jobs timed out and were cancelled (possibly also > transient). > > (1) is probably due to > [https://github.com/apache/beam/commit/684f8130284a7c7979773300d04e5473ca0ac8f3] > > > cc: [~altay] [~lostluck] [~alanmyrvold] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-7063) Stage Dataflow runner harness in Dataflow FnApi Python test suites that run using an unreleased SDK.
[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823559#comment-16823559 ] Chamikara Jayalath commented on BEAM-7063: -- Ah OK. Thanks. This bug was opened for post-commit failure but I see now that the title has changed. > Stage Dataflow runner harness in Dataflow FnApi Python test suites that run > using an unreleased SDK. > > > Key: BEAM-7063 > URL: https://issues.apache.org/jira/browse/BEAM-7063 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, test-failures >Reporter: Chamikara Jayalath >Assignee: Luke Cwik >Priority: Critical > Fix For: 2.13.0 > > Time Spent: 5h > Remaining Estimate: 0h > > Seems like this was the first post-commit failure: > [https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Python_Verify/7855/] > (the one before this also failed but that looks like a flake) > > > Looking at failed tests I noticed that some of the were due to failed > Dataflow jobs. I noticed three issues. > (1) Error in Dataflow jobs "This handler is only capable of dealing with > urn:beam:sideinput:materialization:multimap:0.1 materializations but was > asked to handle beam:side_input:multimap:v1 for PCollectionView with tag > side0-FilterOutSpammers." > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_17_57_01-16397932959358575026?project=apache-beam-testing] > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_07_11-1342017143600540529?project=apache-beam-testing] > > (2) BigQuery job failures (possibly this is transient) > [https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-04-08_18_25_22-16437560120793921616?project=apache-beam-testing] > > (3) Some batch Dataflow jobs timed out and were cancelled (possibly also > transient). > > (1) is probably due to > [https://github.com/apache/beam/commit/684f8130284a7c7979773300d04e5473ca0ac8f3] > > > cc: [~altay] [~lostluck] [~alanmyrvold] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
