Re: Do I need to set assignTimestampsAndWatermarks if I set my time characteristic to IngestionTime?

Watermarks are a tool for handling out-of-orderness when working with event time timestamps. They provide a mechanism for managing the tradeoff between latency and completeness, allowing you to manage how long to wait for any out-of-orderness to resolve itself. Note the way that Flink uses these

Re: Do I need to set assignTimestampsAndWatermarks if I set my time characteristic to IngestionTime?

On 10.03.20 10:13, kant kodali wrote: If ingestion time programs cannot handle late data then why would it generate watermarks? Isn't the whole point of watermarks is to handle the late data? Watermarks are not only used for handling late data. Watermarks are the mechanism that is used to

Re: Do I need to set assignTimestampsAndWatermarks if I set my time characteristic to IngestionTime?

Hi Arvid, If ingestion time programs cannot handle late data then why would it generate watermarks? Isn't the whole point of watermarks is to handle the late data? My last question was more about this library I run several algorithms using

Re: Do I need to set assignTimestampsAndWatermarks if I set my time characteristic to IngestionTime?

Hi Kant, I just saw that asked the same question on SO [1]. Could you, in the future, please cross-reference these posts, so that we don't waste resources on answering? [1]

Re: Do I need to set assignTimestampsAndWatermarks if I set my time characteristic to IngestionTime?

Hi Kant, according to the documentation [1], you don't need to set a watermark assigner: > Compared to *event time*, *ingestion time* programs cannot handle any > out-of-order events or late data, but the programs don’t have to specify > how to generate *watermarks*. > > Internally, *ingestion

Do I need to set assignTimestampsAndWatermarks if I set my time characteristic to IngestionTime?

Hi All, Do I need to set assignTimestampsAndWatermarks if I set my time characteristic to IngestionTime? say I set my time characteristic of stream execution environment to Ingestion time as follows streamExecutionEnvironment.setStreamTimeCharacteristic(TimeCharacteristic.IngestionTime); do I