[
https://issues.apache.org/jira/browse/BEAM-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Oliveira updated BEAM-11999:
-----------------------------------
Fix Version/s: Not applicable
Resolution: Fixed
Status: Resolved (was: Open)
> Enable Dataflow in ValidatesRunner test framework.
> --------------------------------------------------
>
> Key: BEAM-11999
> URL: https://issues.apache.org/jira/browse/BEAM-11999
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-go
> Reporter: Daniel Oliveira
> Assignee: Daniel Oliveira
> Priority: P2
> Fix For: Not applicable
>
>
> _This is an ex-post-facto bug documenting work that should have had it's own
> JIRA but didn't. The purpose of this bug is to add a more detailed summary of
> work that is already finished._
> Dataflow needed to be enabled in the Go SDK's new test framework. Before this
> work was done the test framework was only initially supporting direct, Python
> ULR, Spark, and Flink. This is because a decent amount of additional setup
> was necessary to enable Dataflow, mostly adjusting the script running the
> tests so that it could handle GCP related tasks.
> The work involved was mostly straightforward as there was an existing
> reference to use, in the existing test framework. Most of the delay getting
> this change in was focused on attempting to get the cross-language tests
> working, which turned out to be very difficult, and involved a slow
> development cycle (each attempted fix would take about 5+ minutes to test, as
> it involved running a Dataflow job). That effort was put on pause and
> documented on BEAM-11574 and the final PR only included Dataflow support for
> non-cross-language tests.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
