Boyang Jerry Peng created SPARK-40957:
-----------------------------------------
Summary: Add in memory cache in HDFSMetadataLog
Key: SPARK-40957
URL: https://issues.apache.org/jira/browse/SPARK-40957
Project: Spark
Issue Type: New Feature
Components: Structured Streaming
Affects Versions: 3.4.0
Reporter: Boyang Jerry Peng
Every time entries in offset log or commit log needs to be access, we read from
disk which is slow. Can a cache of recent entries to speed up reads.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
