reuvenlax commented on PR #30279: URL: https://github.com/apache/beam/pull/30279#issuecomment-2083171737
Dataflow keeps track of the old and new schema, and will match up fields to ensure that the encoding position remains the same even if the field orders are different. This is the reason why schemas have an encoding position in addition to a field number. Sorting the fields is not needed for update, and in fact is not a solution since Dataflow supports adding new fields to a schema via update (if we relied on sorting the new field would end up in the middle of the list, and would break update). On Mon, Apr 29, 2024 at 7:53 AM Kenn Knowles ***@***.***> wrote: > How does it work for update compatibility if I add a new field to my POJO? > I added Reuven because he knows the most about this. > > — > Reply to this email directly, view it on GitHub > <https://github.com/apache/beam/pull/30279#issuecomment-2082958359>, or > unsubscribe > <https://github.com/notifications/unsubscribe-auth/AFAYJVOTCZO2RRBFYYXKJZLY7ZNHNAVCNFSM6AAAAABDBXMF4GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBSHE2TQMZVHE> > . > You are receiving this because your review was requested.Message ID: > ***@***.***> > -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
