andygrove commented on issue #4764: URL: https://github.com/apache/datafusion-comet/issues/4764#issuecomment-5860286081
Status as of `31b38196d`: Gap B is done. #5310 decodes invalid UTF-8 at every JVM-to-native import site: `ScanExec::import_column`, native columnar-to-row and the JVM UDF result. So the "passes bytes through unchecked" row of the current-state table no longer holds, and the policy question has in practice been settled as decode-at-the-boundary. The benchmark item is covered by `CometStringFfiImportBenchmark` and `benches/utf8_decode.rs`. What remains is Gap A (#4121). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
