Jungtaek Lim created SPARK-55148:
------------------------------------
Summary: Improving performance in state format in stream-stream
join via RocksDB batch operations (WriteBatch, MGET, etc)
Key: SPARK-55148
URL: https://issues.apache.org/jira/browse/SPARK-55148
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Jungtaek Lim
There are opportunities in state manager in stream-stream join to gain
performance, via applying batch operations. For example, WriteBatch and MGET.
This ticket tracks the effort of revisiting the code and apply the
optimization. We could have more tickets derived from this ticket if we want to
break the effort down.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
