paleolimbot opened a new issue, #250: URL: https://github.com/apache/sedona-db/issues/250
In https://github.com/apache/sedona-db/pull/237 we updated to DataFusion 50, which includes some new features for caching metadata. In our GeoParquet reader we do one or two extra metadata fetches that would benefit greatly from using this! Some of the code we had to copy over doesn't pipe through the global cache. Upstream: ```rust DFParquetMetadata::new(store.as_ref(), object) .with_metadata_size_hint(self.metadata_size_hint()) .with_decryption_properties(file_decryption_properties.as_ref()) .with_file_metadata_cache(Some(Arc::clone(&file_metadata_cache))) .with_coerce_int96(coerce_int96) .fetch_schema_with_location() .await?; ``` Our code: https://github.com/apache/sedona-db/blob/c67484c88d9b839b96bd7e81219db696c8f64de1/rust/sedona-geoparquet/src/format.rs#L187-L190 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
