Daniel Oliveira created BEAM-11999:
--------------------------------------
Summary: Enable Dataflow in ValidatesRunner test framework.
Key: BEAM-11999
URL: https://issues.apache.org/jira/browse/BEAM-11999
Project: Beam
Issue Type: Sub-task
Components: sdk-go
Reporter: Daniel Oliveira
Assignee: Daniel Oliveira
_This is an ex-post-facto bug documenting work that should have had it's own
JIRA but didn't. The purpose of this bug is to add a more detailed summary of
work that is already finished._
Dataflow needed to be enabled in the Go SDK's new test framework. Before this
work was done the test framework was only initially supporting direct, Python
ULR, Spark, and Flink. This is because a decent amount of additional setup was
necessary to enable Dataflow, mostly adjusting the script running the tests so
that it could handle GCP related tasks.
The work involved was mostly straightforward as there was an existing reference
to use, in the existing test framework. Most of the delay getting this change
in was focused on attempting to get the cross-language tests working, which
turned out to be very difficult, and involved a slow development cycle (each
attempted fix would take about 5+ minutes to test, as it involved running a
Dataflow job). That effort was put on pause and documented on BEAM-11574 and
the final PR only included Dataflow support for non-cross-language tests.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
