dhruve commented on issue #23735: [SPARK-26801][SQL] Read avro types other than record URL: https://github.com/apache/spark/pull/23735#issuecomment-462930054 - I can't say for certain how the spark community would like to handle the issue. If there is an incompatibility between avro serde's, I believe most of the consumers of avro module would be affected. We could either support reading the old and new format or we could just let the users deal with writing converters. But then I believe the issue will be more broader as its not just spark that will be affected but every open source project providing utilities to deal with avro files. - I thought about generating the files dynamically, but this was more of a convenience as we would have to add one more dependency for just generating the avro files and specify schemas for all of them. I am not too picky about this.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
