mustafasrepo commented on issue #8230: URL: https://github.com/apache/datafusion/issues/8230#issuecomment-2208185444
I think, the reason for these bugs is that. Source doesn't emit any data (Or doesn't expect to be called.). I think, we might need to update sources to support generating data. For doing so we need to update `csv_exec_sorted` and `stream_exec_ordered` implementations to generate sources that can emit data. One possible approach would be updating `csv_exec_sorted` such that it generates a `MemoryExec` with single row (Method could be renamed to `memory_exec_sorted`. The reason I propose `MemoryExec` is that it is easier to give data during initialization for this operator). However, corresponding change might be a bit tricky for `StreamingTableExec` since its stream is mock and doesn't support any data generation. Hence I propose to execute tests with actual data for just bounded cases (e.g. cases where source is constructed with `csv_exec_sorted` call.) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
