Re: Flink SQL ANTI JOIN results with windowing in DataStream

2024-01-16 Thread Péter Váry
Turns out the issue was that the windows were not triggered for the joins. For one of the tasks the watermark was advanced, so the fdFiles and the tableFiles windows were triggered, but the global watermark was not advanced (parallelism was 4). Since the global watermark was not advanced, the join

Flink SQL ANTI JOIN results with windowing in DataStream

2024-01-16 Thread Péter Váry
Hi Team, I am working on Iceberg in process compaction, and trying to use SQL window join to compare 2 streams like this: *Table fsFiles = tEnv.sqlQuery("SELECT runId, location, window_start, window_end " +"FROM TABLE(" +"* *TUMBLE(" +"TABLE " + fileSystemFilesTable +