alamb commented on issue #24265: URL: https://github.com/apache/datafusion/issues/24265#issuecomment-5401035526
Given @2010YOUY01 's comments on https://github.com/apache/datafusion/issues/24265#issuecomment-5383969323 and @jayzhan211 's comments > I agree on separating into its own Stream type. If we find significant similarity between the implementations once the streaming feature is in place, we can revisit and refactor at that point. Where do we want to put this code? It feels to me like we should try and put it into its own crate (where we can document it, and allow downstream systems to opt in) -- BTW the symmetric hash join code is another example of something that I think is mostly for the streaming usecase and would be good to consolidate How about a new crate - `datafusion-streaming` ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
