samarthjain opened a new issue #645: Add support to fallback to non-vectorized read path URL: https://github.com/apache/incubator-iceberg/issues/645 We need to add support to fallback to the non-vectorized read path for the following reasons: 1) Provide operators an option to turn on/off vectorized read path for iceberg. This would be a config driven decision. 2) Since spark doesn't support vectorized read path for complex data types, and till iceberg adds support for the same(https://github.com/apache/incubator-iceberg/issues/521), we would need to make sure that the older/non-vectorized code path is used for such types.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
