Re: [QUESTION] Why no auto labels?

2023-10-01 Thread Joey Tran
Hmm, I'm not sure what you mean by "updating pipelines in place". Can you elaborate? I forgot to mention my question is posed from the context of a python SDK user, and afaict, there doesn't seem to be an obvious way to autogenerate names/labels. Hearing that the java SDK supports it makes me

Re: [QUESTION] Why no auto labels?

2023-10-01 Thread Reuven Lax via user
Are you talking about transform names? The main reason was because for runners that support updating pipelines in place, the only way to do so safely is if the runner can perfectly identify which transforms in the new graph match the ones in the old graph. There's no good way to auto generate

Re: EFO KinesisIO watermarking doubt

2023-10-01 Thread Pavel Solomin
Hello, sorry for the late reply. EFOKinesisReader implemented the same logic of timestamps non-EFO KinesisReader had. At the time of EFO implementation more careful evaluation of the records' timestamps was out of context. Can you please create an issue at https://github.com/apache/beam/issues ?