Hi team, I've recently started work on our Flink platform, since Flink DataSets are deprecated we should also slowly move away from Flink DataSets.
I've just created a PR for bounded Flink streams, these look very much like our old ones, but now comes the question of how we are going to integrate these, such that our optimizer can use them. I suggest we have a transitionary period where we support both DataSets & bounded streams, perhaps you would choose either by config, or we allow the optimizer to chose. Lastly comes the question of whether and how we are going to support continuous Flink DataStreams, these monitor and continuously perform operations on new data, which is a break from the current model of Wayang.
