[ 
https://issues.apache.org/jira/browse/HBASE-26786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ankit Singhal resolved HBASE-26786.
-----------------------------------
    Fix Version/s: hbase-filesystem-1.0.0-alpha2
       Resolution: Fixed

Thanks [~elserj]  for the review.

> [hboss] Limit synchronization from hot path of HBoss APIs
> ---------------------------------------------------------
>
>                 Key: HBASE-26786
>                 URL: https://issues.apache.org/jira/browse/HBASE-26786
>             Project: HBase
>          Issue Type: Bug
>          Components: hboss
>    Affects Versions: hbase-filesystem-1.0.0-alpha2
>            Reporter: Ankit Singhal
>            Assignee: Ankit Singhal
>            Priority: Major
>              Labels: HBOSS
>             Fix For: hbase-filesystem-1.0.0-alpha2
>
>
> Problem:-
> While using HBase with S3, timeouts were observed while restoring a snapshot 
> of a table having many regions and HFiles, and the problem regressed as we 
> added more restores or snapshots in parallel.
>  
> Root cause:-
> HBoss has some of the APIs interacting with the cache as synchronized, but as 
> these are in the hot path of the interaction with the filesystem, threads are 
> blocked until one is done, causing all threads working on the filesystem to 
> run serially. In the case of restore_snapshot, which includes getting a list 
> of completed snapshots, validating each store file, creating an HFile link in 
> the target table, archiving files, etc. Therefore the problem is highlighted 
> more with restore snapshot.
>  
> Solution:-
> Remove the synchronization as those seem unnecessary, change cache data 
> structure to a thread-safe which provides the required level concurrency.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to