This is more of a Dataflow question I guess but asking here in hopes someone has faced a similar problem and can help. I am trying to use "--update" option to update a running Dataflow job. I am noticing that compatibility checks fail any time I add a new field to my data model. Error says
The Coder or type for step XYZ has changed I am using a Java Pojo for data. Avro coder to serialize the model. I read somewhere that adding new optional fields to the data should work when updating the pipeline. I am fine with updating the coder or implementation of the model to something which allows me to update the pipeline in cases when I add new optional fields to existing model. Any suggestions?
