springle commented on issue #1502: URL: https://github.com/apache/iceberg/issues/1502#issuecomment-803592326
Hi @rdblue - this is with Iceberg 11 and Spark 2.4, and I think the catalog in the link above ends up getting loaded from [here](https://github.com/apache/iceberg/blob/629f7ad7c5fbc16da1e0752f5d170889d4e761b4/spark2/src/main/java/org/apache/iceberg/spark/source/CustomCatalogs.java#L89). I see what you're saying about the catalog cache being tied to a Spark session, but maybe using `softValues` lets it get cleaned up prematurely? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
