ozankabak commented on issue #11366: URL: https://github.com/apache/datafusion/issues/11366#issuecomment-2225204324
To help as best as I can, let me first reiterate my understanding of your use case: You have a streaming source, which has some columns like `speed` and `altitude`, but your `ts` column may be out-of-order and is not monotonic. Or, maybe you don't have such a column at all. Still, you want to do streaming computations based on processing time on such data. In such a case, what you can do is to use a projection to add an order defining column based on processing time, and use `BoundedWindowAggExec` to do streaming/incremental windowing based on that. So basically two built-in operators compose together to give you what you want (or I should say, what I think you want 🙂 ). Let me know if this helps. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
