anishshri-db opened a new pull request, #40455: URL: https://github.com/apache/spark/pull/40455
### What changes were proposed in this pull request? Add support for setting max_write_buffer_number and write_buffer_size for RocksDB used in streaming ### Why are the changes needed? We need these settings in order to control memory tuning for RocksDB. We already expose settings for blockCache size. However, these 2 settings are missing. This change proposes to add them. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Added unit tests and docs in the guide doc ``` [info] Run completed in 59 seconds, 336 milliseconds. [info] Total number of tests run: 27 [info] Suites: completed 1, aborted 0 [info] Tests: succeeded 27, failed 0, canceled 0, ignored 0, pending 0 [info] All tests passed. [success] Total time: 165 s (02:45), completed Mar 15, 2023, 11:24:17 PM ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
