ahmedabu98 opened a new pull request, #41316: URL: https://github.com/apache/beam/pull/41316
`SerializableDataFile` and `SerializableDeleteFile` store a file's partition as JSON written by Iceberg's `SingleValueParser`. That parser writes NaN and infinite `float` and `double` values as quoted strings and then can't read them back. Beam used to fall back to parsing the partition path instead, which silently changed the tuple's other values: a `year` of 54 came back as `2024`, and a null string as "null". Beam now turns those strings back into numbers before parsing, so the fallback is gone. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
