metesynnada commented on PR #8021: URL: https://github.com/apache/arrow-datafusion/pull/8021#issuecomment-1805245293
The problem is that this PR becomes "ready to merge" instead of a POC PR. I got the idea and iterated on this to come up with a design, as promised. I will publish it today. Indeed, there is enough functionality for FIFO or more use cases without the object store. I agree with separating batch and stream sources to ease the feature development on both sides. However, pushing this PR means deleting the gatekeepers of the unbounded functionality without an alternative. I do not understand the rush to disable these tests from the rest of the code base. What is the gain here, can you explain if I do not fully understand? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
