[ 
https://issues.apache.org/jira/browse/BEAM-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-11999:
-----------------------------------
    Status: Open  (was: Triage Needed)

> Enable Dataflow in ValidatesRunner test framework.
> --------------------------------------------------
>
>                 Key: BEAM-11999
>                 URL: https://issues.apache.org/jira/browse/BEAM-11999
>             Project: Beam
>          Issue Type: Sub-task
>          Components: sdk-go
>            Reporter: Daniel Oliveira
>            Assignee: Daniel Oliveira
>            Priority: P2
>
> _This is an ex-post-facto bug documenting work that should have had it's own 
> JIRA but didn't. The purpose of this bug is to add a more detailed summary of 
> work that is already finished._
> Dataflow needed to be enabled in the Go SDK's new test framework. Before this 
> work was done the test framework was only initially supporting direct, Python 
> ULR, Spark, and Flink. This is because a decent amount of additional setup 
> was necessary to enable Dataflow, mostly adjusting the script running the 
> tests so that it could handle GCP related tasks.
> The work involved was mostly straightforward as there was an existing 
> reference to use, in the existing test framework. Most of the delay getting 
> this change in was focused on attempting to get the cross-language tests 
> working, which turned out to be very difficult, and involved a slow 
> development cycle (each attempted fix would take about 5+ minutes to test, as 
> it involved running a Dataflow job). That effort was put on pause and 
> documented on BEAM-11574 and the final PR only included Dataflow support for 
> non-cross-language tests. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to