waynr commented on issue #7135: URL: https://github.com/apache/arrow-rs/issues/7135#issuecomment-2660552902
@tustvold I considered something like that, but the problem is that we pass the `MemCachedObjectStore` as `Arc<dyn ObjectStore>` to a [`iox_query::exec::Executor`](https://github.com/influxdata/influxdb3_core/blob/a5f6076c966f4940a67998e0b85d12c3e8596715/iox_query/src/exec.rs#L79) as well as being [registered as an iox object store with the datafusion runtime](https://github.com/influxdata/influxdb/blob/8daccb7ee8f82ffae99b25236af9645fd60e448b/influxdb3/src/commands/serve.rs#L515). While it's not totally clear to me if the parquet file accesses that we care are about are happening in those core crates using this `Arc<dyn ObjectStore>`, it does seem likely given the limited number of ways that it's used in the InfluxDB3 server setup. It's also not clear to me whether we could get a session-scoped span threaded in to an objectstore through the datafusion engine. But I have observed something similar happening for the [`TableProvider.scan`](https://docs.rs/datafusion/latest/datafusion/catalog/trait.TableProvider.html#tymethod.scan) method in a private git repo. So anywhere in datafusion where a method has access to a [SessionConfig](https://docs.rs/datafusion/latest/datafusion/prelude/struct.SessionConfig.html) and makes calls to a `Arc<dyn ObjectStore>.*_with_session` we could convert that to a session config recognized by the `ObjectStore` trait. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
