Thanks Timo.
The whole idea is also based on the side output and output tag. Let me
explain it in detail:
1. Introduce a VirtualTableScan(or SideOutputTableScan), which can be
optimized as Physical RelNode. Then we can create a source catalog table
which will be converted to a VirtualTableScan, a
Hi,
your explanation makes sense but I'm wondering how the implementation
would look like. This would mean bigger changes in a Flink fork, right?
Late data handling in SQL is a frequently asked question. Currently, we
don't have a good way of supporting it. Usually, we recommend to use
DataS
We can get a stream from a DataStream api by SideOutput. But it's hard to do
the same thing with Flink SQL.
I have an idea about how to get the late records while using Flink SQL.
Assuming we have a source table for the late records, then we can query late
records on it. Obviously, it's not a rea