giamo commented on issue #24405: [SPARK-27506][SQL] Allow deserialization of Avro data using compatible schemas URL: https://github.com/apache/spark/pull/24405#issuecomment-529094020 @HyukjinKwon I've updated the PR description, maybe the use case will be more clear now. 1. I can't speak for other users, but in our case we need this feature in a real project and for the moment we had to do a custom workaround in our code to make it work 2. It's possible to pass the writer schema inside the `options` map, if you guys think it would be more clear. Should I implement the change? 3. In the case of Avro DataSource the situation is a bit more tricky, because you can read multiple Avro files and each one was potentially written with a different schema and you would have to specify the writer schema for each one of them
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
