Gurpreet Nanda created SPARK-55728:
--------------------------------------
Summary: Introduce RocksDB conf for file checksum threadpool size
Key: SPARK-55728
URL: https://issues.apache.org/jira/browse/SPARK-55728
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.1.0
Reporter: Gurpreet Nanda
fileChecksumThreadPoolSize is currently hardcoded to 4:
[https://github.com/apache/spark/blob/3b343b4d5c5294e145d4d8d936fba2b49bb76b36/sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/RocksDB.scala#L159]
make this a conf
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]