Re: Accessing attempted metrics from within a DoFn

2018-08-30 Thread Etienne Chauchot
Robin, I asked myself the same thing, and indeed there is no way of accessing the metrics from within the pipeline itself. The only access you can have is directly to the MetricCell like that (1) but it is runner facing, it is not user facing, so not helping for your test.So I agree with you:

Re: Accessing attempted metrics from within a DoFn

2018-08-29 Thread Pablo Estrada
Adding Andrea as she may have thoughts on this. On Wed, Aug 29, 2018 at 10:43 AM Robin Qiu wrote: > Hi everyone, > > I am writing a test [1] for the support of @RequiresStableInput annotation > in Java SDK [2]. In the test I need to have a ParDo make some side effects > and then fail.

Accessing attempted metrics from within a DoFn

2018-08-29 Thread Robin Qiu
Hi everyone, I am writing a test [1] for the support of @RequiresStableInput annotation in Java SDK [2]. In the test I need to have a ParDo make some side effects and then fail. Currently, the only way to persist the side effect during retries without depending on external states is using