Anish Shrigondekar created SPARK-42819:
------------------------------------------
Summary: Add support for setting max_write_buffer_number and
write_buffer_size for RocksDB used in streaming
Key: SPARK-42819
URL: https://issues.apache.org/jira/browse/SPARK-42819
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 3.4.0
Reporter: Anish Shrigondekar
Add support for setting max_write_buffer_number and write_buffer_size for
RocksDB used in streaming
We need these settings in order to control memory tuning for RocksDB. We
already expose settings for blockCache size. However, these 2 settings are
missing. This change proposes to add them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
