vishnuprakaz opened a new pull request, #17437:
URL: https://github.com/apache/iceberg/pull/17437
The dynamic sink's `TableSerializerCache` loads a catalog with
`CatalogLoader.loadCatalog()` on every cache miss (an unknown schema or spec
id, or an LRU eviction) but never closes it. Each call builds a fresh catalog
whose resources, such as a REST HTTP client and thread pool or a Hive metastore
client pool, are released only on close, so a long-running job that keeps
missing the cache leaks connections and threads.
The cache lives inside a Flink `TypeSerializer` that has no teardown hook,
so it now closes the catalog right after reading the table's schemas and specs.
This matches how `TableLoader` closes the catalogs it opens.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
