Jungtaek Lim created SPARK-36667: ------------------------------------ Summary: Close resources properly in StateStoreSuite/RocksDBStateStoreSuite Key: SPARK-36667 URL: https://issues.apache.org/jira/browse/SPARK-36667 Project: Spark Issue Type: Bug Components: Structured Streaming Affects Versions: 3.2.0 Reporter: Jungtaek Lim
The StateStoreProvider instances created from "newStoreProvider" are NOT automatically closed. While this is trivial for HDFSBackedStateStoreProvider, for RocksDBStateStoreProvider we leak RocksDB instance as well which should have closed. Most tests in the RocksDBStateStoreSuite initialize RocksDBStateStoreProvider, meaning that 60+ RocksDB instances are not closed in the suite. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org