nrc commented on issue #12010: URL: https://github.com/apache/datafusion/issues/12010#issuecomment-2295638391
I'm not familiar enough with DataFusion internals to comment on your suggestion, sorry. > Not sure how do you union with the created ParquetExec, If you have the table_schema from FileScanConfig::projection in ParquetOpener, does this help? We make the union by colllecting the `ParquetExec`s into a `Vec` and then calling `UnionExec::new`. The trick is that union requires each component exec to have matching schemas, so we have to ensure that is true. We can't let the exec choose its own schema because as far as I know there is no easy way to have an adjusting step before putting it into the union. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
