Hi,

I'm working on putting together a basic runner for Apache Apex.

Hitting a couple of serialization related issues with running tests. Apex
is using Kryo for serialization by default (and Kryo can delegate to other
serialization frameworks).

The inner classes of WindowedValue are private and have no default
constructor, which the Kryo field serializer does not like. Also these
classes are not Java serializable, so that's not a fallback option (not
that it would be efficient anyways).

What's the recommended technique to move the WindowedValues over the wire?

Also, PipelineOptions aren't serializable, while most other classes are.
They are needed for example with DoFnRunnerBase, so what's the recommended
way to distribute them? Disassemble/reassemble? :)

Thanks,
Thomas

Reply via email to