Re: Output after Pipeline replaceAll

2022-07-29 Thread Moritz Mack
Thanks so much, Kenn! Exactly what I was looking for 😊 On 28.07.22, 19:32, "Kenneth Knowles" wrote: Yes, this is expected.⁠​ The goal of replaceAll is to replace a transform with a different subgraph that implements precisely the same semantics.⁠​ And since the rest of the graph depends on the

Re: Output after Pipeline replaceAll

2022-07-28 Thread Kenneth Knowles
Yes, this is expected. The goal of replaceAll is to replace a transform with a different subgraph that implements precisely the same semantics. And since the rest of the graph depends on the PCollections, the new expanded transform is wired directly to the old outputs. First point: Certainly the s

Output after Pipeline replaceAll

2022-07-28 Thread Moritz Mack
Hi all, Wondering if somebody could help and shed some lights on the behavior of Pipeline.replaceAll, particularly the outputs to expect after the replacement. I’m currently looking into supporting VR tests for SparkRunner in streaming mode [1]. Unfortunately, I didn’t succeed replacing (wrappin