[
https://issues.apache.org/jira/browse/ZOOKEEPER-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072843#comment-17072843
]
Weichu Liu commented on ZOOKEEPER-3781:
---------------------------------------
According to the document, {{snapshot.trust.empty}} should only be used during
upgrade. I interpret it as if all zookeepers are on newer version, they should
all generate snapshot.
But our instances are not behaving like that, so zk cannot boot without
{{snapshot.trust.empty=true}}. This looks like a bug to me.
I used the vanilla zookeeper 3.5.7 and the issue can be reproduced by the
commands
{code}
terminal-1 $ ./apache-zookeeper-3.5.7-bin/bin/zkServer.sh start-foreground
/path/to/zk1.cfg
terminal-2 $ ./apache-zookeeper-3.5.7-bin/bin/zkServer.sh start-foreground
/path/to/zk2.cfg
terminal-3 $ ./apache-zookeeper-3.5.7-bin/bin/zkServer.sh start-foreground
/path/to/zk2.cfg
{code}
> Zookeeper 3.5.7 not creating snapshot
> -------------------------------------
>
> Key: ZOOKEEPER-3781
> URL: https://issues.apache.org/jira/browse/ZOOKEEPER-3781
> Project: ZooKeeper
> Issue Type: Bug
> Reporter: Weichu Liu
> Priority: Major
> Attachments: zk_no_snapshot.zip
>
>
> Hi,
> In our deployment, we are using zookeepers as Kafka quorum.
> Recently we upgraded Zookeeper from 3.4.14 to 3.5.7.
> During the upgrade, we enabled snapshot.trust.empty and removed it after.
> However, about 25% of zookeepers (all on 3.5.7) are not creating snapshot
> files, so they keep crashing on reboot with ERROR.
> {noformat}
> ERROR [main:QuorumPeer@937] - Unable to load database on disk
> <http://java.io|java.io>.IOException: No snapshot found, but there are log
> entries. Something is broken!
> {noformat}
> Nothing suspecious did I find from the zookeeper log.
> I managed to reproduce the issue with the data from our servers, I put them
> in the attachment.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
