[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17714409#comment-17714409
 ] 

Adam Yi commented on ZOOKEEPER-3306:
------------------------------------

I think there's an issue with this patch and created ZOOKEEPER-4689

> Node may not accessible due the the inconsistent ACL reference map after SNAP 
> sync 
> -----------------------------------------------------------------------------------
>
>                 Key: ZOOKEEPER-3306
>                 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3306
>             Project: ZooKeeper
>          Issue Type: Bug
>          Components: server
>    Affects Versions: 3.5.4, 3.6.0, 3.4.13
>            Reporter: Fangmin Lv
>            Assignee: Fangmin Lv
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 3.6.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> This is a new bug we found on production.
> ZooKeeper uses ACL reference id and count to save the space in snapshot. 
> During fuzzy snapshot sync, the reference count may not be updated correctly 
> in case like the znode is already exist.
> When ACL reference count reaches 0, it will be deleted from the system, but 
> actually there might be other nodes still using it. And when visiting a node 
> with the deleted ACL id, it will be rejected because it doesn't exist anymore.
> Here is the detailed flow for one of the scenario here:
>  # Server A starts to have snap sync with leader
>  # After serializing the ACL map to Server A, there is a txn T1 to create a 
> node N1 with new ACL_1 which was not exist in ACL map
>  # On leader, after this txn, the ACL map will be ID1 -> (ACL_1, COUNT: 1), 
> and data tree N1 -> ID1
>  # On server A, it will be empty ACL map, and N1 -> ID1 in fuzzy snapshot
>  # When replaying the txn T1, it will skip at the beginning since the node is 
> already exist, which leaves an empty ACL map, and N1 is referencing to a 
> non-exist ACL ID1
>  # Node N1 will be not accessible because the ACL not exist, and if it became 
> leader later then all the write requests will be rejected as well with 
> marshalling error.
> We're still working on the fix, suggestions are welcome.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to