Re: [ovs-discuss] [External] : 01775|raft|INFO|current entry eid 1da31769-d05e-4d07-ad03-6eb680bdb67f does not match prerequisite eb3b4396-c15f-4fc9-911e-1ce8a4795ec8 in execute_command_request
On 3/15/24 20:10, Brendan Doyle via discuss wrote: > > > On 15/03/2024 19:07, Brendan Doyle wrote: >> I found this old email thread: >>> On Tue, Oct 20, 2020 at 11:55 AM Tony Liu >>> wrote: > > Hi, > > From ovnsb log, I see many of the following messages. > >>> What does it mean? Is that a concern? > > >>> 2020-10-20T18:52:50.483Z|00093|raft|INFO|current entry eid >>> 2ab3eff8-87e1-4e19-9a1f-d359ad56a9ad does not match prerequisite >>> c6ffd854-6f6e-4533-a6d8-b297acb542e0 in execute_command_request > > > >>> Thanks! > Tony This is expected in cluster mode when there are concurrent >>> transactions initiated from different cluster nodes. It is recommended to >>> connect to the leader for write-heavy clients. Occasional conflict is ok >>> and the transaction will be resubmitted. Thanks, Han >> >> But we are seeing 10's of 100's of these messages! > > 10's of 1000's !! Han's old reply still stands. You're likely sending a lot of write transactions from multiple clients connected to different followers. They'll all be re-tried, but it's better to connect to the leader instead for write-heavy operations. In the past ovn-kubernetes used a version of libovsdb that wouldn't re-connect to a new leader and would keep sending transactions through the follower causing a lot of such logs. But it was Northbound, not Southbound. You need to find which processes are sending many transactions to Sb followers. Best regards, Ilya Maximets. >> >> On 15/03/2024 18:41, Brendan Doyle via discuss wrote: >>> Hi, >>> >>> >>> We run OVN central as a RAFT cluster of 3 in a k8 DaemonSet. We recently >>> upgraded to the latest >>> LTS, and started see loads of these >>> >>> 2024-03-14T20:17:44.677Z|01779|raft|INFO|current entry eid >>> e857968d-5da5-4b8a-9a17-f06075e67703 does not match prerequisite >>> 025d7ea8-2c1d-4177-986f-1b6617ff5bed in execute_command_request >>> 2024-03-14T20:17:47.315Z|01780|raft|INFO|Dropped 171 log messages in last 3 >>> seconds (most recently, 3 seconds ago) due to excessive rate >>> >>> In ovsdb-server-sb.log >>> >>> Has anybody got an idea what they mean? >>> >>> >>> Thanks >>> >>> Brendan >>> ___ >>> discuss mailing list >>> disc...@openvswitch.org >>> https://urldefense.com/v3/__https://mail.openvswitch.org/mailman/listinfo/ovs-discuss__;!!ACWV5N9M2RV99hQ!J2ZmXngj-e7hJHejBcN5FYYihte0Ng8x9wRXbbuVIUH1DEGVoxAmCB_KM9gYpMLhbDuQhQBlec-ZI8SiuUGkeAvUpfDdMg$ >>> >> > > > ___ > discuss mailing list > disc...@openvswitch.org > https://mail.openvswitch.org/mailman/listinfo/ovs-discuss ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] [External] : 01775|raft|INFO|current entry eid 1da31769-d05e-4d07-ad03-6eb680bdb67f does not match prerequisite eb3b4396-c15f-4fc9-911e-1ce8a4795ec8 in execute_command_request
On 15/03/2024 19:07, Brendan Doyle wrote: I found this old email thread: On Tue, Oct 20, 2020 at 11:55 AM Tony Liu hotmail.com> wrote: > > Hi, > > From ovnsb log, I see many of the following messages. > What does it mean? Is that a concern? > > 2020-10-20T18:52:50.483Z|00093|raft|INFO|current entry eid 2ab3eff8-87e1-4e19-9a1f-d359ad56a9ad does not match prerequisite c6ffd854-6f6e-4533-a6d8-b297acb542e0 in execute_command_request > > > Thanks! > Tony This is expected in cluster mode when there are concurrent transactions initiated from different cluster nodes. It is recommended to connect to the leader for write-heavy clients. Occasional conflict is ok and the transaction will be resubmitted. Thanks, Han But we are seeing 10's of 100's of these messages! 10's of 1000's !! On 15/03/2024 18:41, Brendan Doyle via discuss wrote: Hi, We run OVN central as a RAFT cluster of 3 in a k8 DaemonSet. We recently upgraded to the latest LTS, and started see loads of these 2024-03-14T20:17:44.677Z|01779|raft|INFO|current entry eid e857968d-5da5-4b8a-9a17-f06075e67703 does not match prerequisite 025d7ea8-2c1d-4177-986f-1b6617ff5bed in execute_command_request 2024-03-14T20:17:47.315Z|01780|raft|INFO|Dropped 171 log messages in last 3 seconds (most recently, 3 seconds ago) due to excessive rate In ovsdb-server-sb.log Has anybody got an idea what they mean? Thanks Brendan ___ discuss mailing list disc...@openvswitch.org https://urldefense.com/v3/__https://mail.openvswitch.org/mailman/listinfo/ovs-discuss__;!!ACWV5N9M2RV99hQ!J2ZmXngj-e7hJHejBcN5FYYihte0Ng8x9wRXbbuVIUH1DEGVoxAmCB_KM9gYpMLhbDuQhQBlec-ZI8SiuUGkeAvUpfDdMg$ ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
Re: [ovs-discuss] [External] : 01775|raft|INFO|current entry eid 1da31769-d05e-4d07-ad03-6eb680bdb67f does not match prerequisite eb3b4396-c15f-4fc9-911e-1ce8a4795ec8 in execute_command_request
I found this old email thread: On Tue, Oct 20, 2020 at 11:55 AM Tony Liu wrote: > > Hi, > > From ovnsb log, I see many of the following messages. > What does it mean? Is that a concern? > > 2020-10-20T18:52:50.483Z|00093|raft|INFO|current entry eid 2ab3eff8-87e1-4e19-9a1f-d359ad56a9ad does not match prerequisite c6ffd854-6f6e-4533-a6d8-b297acb542e0 in execute_command_request > > > Thanks! > Tony This is expected in cluster mode when there are concurrent transactions initiated from different cluster nodes. It is recommended to connect to the leader for write-heavy clients. Occasional conflict is ok and the transaction will be resubmitted. Thanks, Han But we are seeing 10's of 100's of these messages! On 15/03/2024 18:41, Brendan Doyle via discuss wrote: Hi, We run OVN central as a RAFT cluster of 3 in a k8 DaemonSet. We recently upgraded to the latest LTS, and started see loads of these 2024-03-14T20:17:44.677Z|01779|raft|INFO|current entry eid e857968d-5da5-4b8a-9a17-f06075e67703 does not match prerequisite 025d7ea8-2c1d-4177-986f-1b6617ff5bed in execute_command_request 2024-03-14T20:17:47.315Z|01780|raft|INFO|Dropped 171 log messages in last 3 seconds (most recently, 3 seconds ago) due to excessive rate In ovsdb-server-sb.log Has anybody got an idea what they mean? Thanks Brendan ___ discuss mailing list disc...@openvswitch.org https://urldefense.com/v3/__https://mail.openvswitch.org/mailman/listinfo/ovs-discuss__;!!ACWV5N9M2RV99hQ!J2ZmXngj-e7hJHejBcN5FYYihte0Ng8x9wRXbbuVIUH1DEGVoxAmCB_KM9gYpMLhbDuQhQBlec-ZI8SiuUGkeAvUpfDdMg$ ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
[ovs-discuss] 01775|raft|INFO|current entry eid 1da31769-d05e-4d07-ad03-6eb680bdb67f does not match prerequisite eb3b4396-c15f-4fc9-911e-1ce8a4795ec8 in execute_command_request
Hi, We run OVN central as a RAFT cluster of 3 in a k8 DaemonSet. We recently upgraded to the latest LTS, and started see loads of these 2024-03-14T20:17:44.677Z|01779|raft|INFO|current entry eid e857968d-5da5-4b8a-9a17-f06075e67703 does not match prerequisite 025d7ea8-2c1d-4177-986f-1b6617ff5bed in execute_command_request 2024-03-14T20:17:47.315Z|01780|raft|INFO|Dropped 171 log messages in last 3 seconds (most recently, 3 seconds ago) due to excessive rate In ovsdb-server-sb.log Has anybody got an idea what they mean? Thanks Brendan ___ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
