jonvex opened a new pull request, #13289: URL: https://github.com/apache/hudi/pull/13289
### Change Logs The precision is incorrect for evolution from float to double and has been fixed for most of spark by https://github.com/apache/hudi/pull/13188. However, there are some edge cases that still need to be fixed. This pr fixes: 1. avro log blocks the evolution is fixed by adding the float -> double conversion into the method that determines if we need to manually convert the record (and the manual conversion already has the float->double conversion correct) 2. For vectorized reader, we only use the typechangeinfos with vectorized reader if there is an internal schema. This requirement is too strict and if typechangeinfos is nonempty we should use it. ### Impact Fix float -> double precision issue for 2 edge cases ### Risk level (write none, low medium or high below) low ### Documentation Update N/A ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
