mixermt opened a new issue, #3509: URL: https://github.com/apache/iceberg-rust/issues/3509
Catalogs take an `iceberg::runtime::Runtime` through `with_runtime`, but `StorageFactory::build` and the storages it creates never see it, so a backend that spawns long-lived tasks has to pick a runtime itself. The HDFS backend (#3111) is one: an hdfs-native client spawns its NameNode connections on the runtime current when it is built and panics once that runtime is gone, so the backend builds clients inside a crate-owned runtime. With the catalog's runtime available to the factory, it could build them on `runtime.io()` and drop its own. Since `Runtime` holds only handles, a dropped catalog runtime would bring the panic back; the fallback when no runtime is configured also needs deciding. Related: #1945, #2602. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
