alamb opened a new issue, #14097: URL: https://github.com/apache/datafusion/issues/14097
### Is your feature request related to a problem or challenge? Currently DataFusion has its own avro --> arrow implementation in: https://github.com/apache/datafusion/blob/54a5d3fd3f98997f048c2e3e7ba67d7bfe2f124d/datafusion/core/src/datasource/avro_to_arrow/mod.rs This was added way back in the day by @Igosuki and @jorgecarleitao in - https://github.com/apache/datafusion/pull/910 Recently there is work upstream in arrow-rs to add additional avro support: - https://github.com/apache/arrow-rs/issues/4886 For example, the recent PR from @jecsand838 - https://github.com/apache/arrow-rs/pull/6965 ### Describe the solution you'd like One arrow-avro is more mature, it would be great to consider removing the DataFusion specific implementation and using the upstream arrow-avro one This would allow DataFusion to take advantage of the upstream work and keep our codebase a bit simpler ### Describe alternatives you've considered _No response_ ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
