Hi,
We love Crunch for the great Unit-Testing capabilities, which gives us a
good confidence when running the pipeline on the real data.
However, we did find one place in which the Unit-Tests failed us - when we
need to add *getDettachedValue* call on *iterable*, unit-tests did behave
differently and did not reuse the same objects, as happened in the
production pipeline on the whole data.
Is there any way to incorporate this validation in unit-tests?
We have tests that run a set of *DoFn*s setting the input *MemCollection*s and
check the *MemCollection*s out using *MemPipeline*, and other tests for a
single *DoFn*'s *process* using *InMemoryEmitter*.
Thanks,
Ron Hashimshony

Reply via email to