dhruve opened a new pull request #23735: [SPARK-26801][SQL] Read avro types other than record URL: https://github.com/apache/spark/pull/23735 ## What changes were proposed in this pull request? Currently spark reads avro files of type records only as this is internally mapped to the SQL StructType. Any other avro type is currently not supported reading at the top level. Primitive and Non-record types are supported within a record but not on their own. This change fixes the issue by wrapping the incompatible types under a record so these can be successfully read. Note, the issue is while reading only, as during writing, spark writes these types wrapped in a record itself. ## How was this patch tested? Manually loaded avro primitive types and added unit tests.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
