Hi, I think your first proposal to use bounded streams and get rid of DataSets (thus making DataStream the default) would be a good way. As we don't really have the capabilities to run Wayang with continuous workloads, I wouldn't consider any of these operations for now.
Best, Juri ________________________________ From: Mads Sejer Pedersen <[email protected]> Sent: 19 January 2026 09:56 To: Zoi Kaoudi via dev <[email protected]> Subject: Flink DataStream Integration Hi team, I've recently started work on our Flink platform, since Flink DataSets are deprecated we should also slowly move away from Flink DataSets. I've just created a PR for bounded Flink streams, these look very much like our old ones, but now comes the question of how we are going to integrate these, such that our optimizer can use them. I suggest we have a transitionary period where we support both DataSets & bounded streams, perhaps you would choose either by config, or we allow the optimizer to chose. Lastly comes the question of whether and how we are going to support continuous Flink DataStreams, these monitor and continuously perform operations on new data, which is a break from the current model of Wayang.
