Are we talking about integration testing or general pipeline execution metrics?
For integration testing, I would see that they users on PAssert and a test runner to do testing similar to Apache Beam's @ValidatesRunner or IO integration tests. For production pipeline monitoring, the common metric I have been told was tracking the watermark. But I'm sure others have different opinions. On Tue, Nov 21, 2017 at 3:35 PM, Holden Karau <[email protected]> wrote: > Hi Wonderful BEAM users, > > I'm wondering if folks would be willing to share what kind of metrics they > look at when validating their BEAM jobs? > > Cheers, > > Holden :) > > -- > Twitter: https://twitter.com/holdenkarau >
