kete1987 commented on PR #56281: URL: https://github.com/apache/spark/pull/56281#issuecomment-4607431939
> > @anishshri-db this is a backport of #56234 to branch-4.2. Please merge whenever convenient. > > Do we need the backport for 4.2 ? Usually we only merge critical fixes to cut branches Yes, I think it's worth including in 4.2.0 — the release is still in preview (preview5, no final RC yet), and this is a resource leak in the default configuration (`boundedMemoryUsage=false`). Any long-running streaming job that creates many RocksDB instances under low GC pressure will accumulate native memory non-deterministically. The fix is minimal (3 lines) and has no behavior or API changes. SPARK-56523 (Statistics native memory leak, same component, same scope) was also merged to branch-4.2 as a reference. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
