Viraj Jasani created HDFS-16967:
-----------------------------------
Summary: RBF: File based state stores should allow concurrent
access to the records
Key: HDFS-16967
URL: https://issues.apache.org/jira/browse/HDFS-16967
Project: Hadoop HDFS
Issue Type: Improvement
Reporter: Viraj Jasani
Assignee: Viraj Jasani
File based state store implementations (StateStoreFileImpl and
StateStoreFileSystemImpl) should allow updating as well as reading of the state
store records concurrently rather than serially. Concurrent access to the
record files on the hdfs based store seems to be improving the state store
cache loading performance by more than 10x.
For instance, in order to maintain data integrity, when any mount table
record(s) is updated, the cache is reloaded. This reload operation seems to be
able to gain significant performance improvement by the concurrent access of
the mount table records.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
