Re: CAS operation result is unknown - proposal accepted by 1 but not a quorum

2023-04-12 Thread Ralph Boehme
On 4/12/23 15:30, Jeff Jirsa wrote: Are you always inserting into the same partition (with contention) or different ? I'm actually updating the very same row. :) Which version are you using ? # nodetool version ReleaseVersion: 4.1.1 The short tldr is that the failure modes of the

Re: CAS operation result is unknown - proposal accepted by 1 but not a quorum

2023-04-12 Thread Jeff Jirsa
Are you always inserting into the same partition (with contention) or different ? Which version are you using ? The short tldr is that the failure modes of the existing paxos implementation (under contention, under latency, under cluster strain) can cause undefined states. I believe that a

Re: CAS operation result is unknown - proposal accepted by 1 but not a quorum

2023-04-12 Thread Ralph Boehme
On 4/11/23 21:14, Ralph Boehme wrote: On 4/11/23 19:53, Bowen Song via user wrote: That error message sounds like one of the nodes timed out in the paxos propose stage.  You can check the system.log and gc.log and see if you can find anything unusual in them, such as network errors, out of

Re: CAS operation result is unknown - proposal accepted by 1 but not a quorum

2023-04-11 Thread Ralph Boehme
On 4/11/23 19:53, Bowen Song via user wrote: That error message sounds like one of the nodes timed out in the paxos propose stage.  You can check the system.log and gc.log and see if you can find anything unusual in them, such as network errors, out of sync clocks or long stop-the-world GC

Re: CAS operation result is unknown - proposal accepted by 1 but not a quorum

2023-04-11 Thread Bowen Song via user
That error message sounds like one of the nodes timed out in the paxos propose stage.  You can check the system.log and gc.log and see if you can find anything unusual in them, such as network errors, out of sync clocks or long stop-the-world GC pauses. BTW, since you said you want it to be

CAS operation result is unknown - proposal accepted by 1 but not a quorum

2023-04-11 Thread Ralph Boehme
Hi folks! Ralph here from the Samba team. I'm currently doing research into Opensource distributed NoSQL key/value stores to be used by Samba as an more scalable alternative to Samba's own homegrown distributed key/value store called "ctdb" [1]. As an Opensource implementation of the SMB