Viraj Jasani created HADOOP-18740:
-------------------------------------

             Summary: s3a prefetch cache blocks should be accessed by RW locks
                 Key: HADOOP-18740
                 URL: https://issues.apache.org/jira/browse/HADOOP-18740
             Project: Hadoop Common
          Issue Type: Sub-task
            Reporter: Viraj Jasani
            Assignee: Viraj Jasani


In order to implement LRU or LFU based cache removal policies for s3a 
prefetched cache blocks, it is important for all cache reader threads to 
acquire read lock and similarly cache file removal mechanism (fs close or cache 
eviction) to acquire write lock before accessing the files.

As we maintain the block entries in an in-memory map, we should be able to 
introduce read-write lock per cache file entry, we don't need coarse-grained 
lock shared by all entries.

 

This is a prerequisite to HADOOP-18291.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org

Reply via email to