Hi there, Since months ago, we noticed our Kafka producer is seeing from time to time request latency when trying to produce, and specific consumers (not sure if all of them since we have too many) seeing clearly fetch latency, which ending into Kafka lag, even sometimes producer and consumers are pretty aligned in latency peaks, and very often is clearly connected to high producing rate for certain topics at the same time, but even seeing when not so maybe something else happening.
Historically (exactly from version 2.2.1) we have enabled idempotence following your official recommendation to not missing data or out of order, so could be root cause of bottleneck under pressure and explaining those latencies? If not, what else could explain such thing? Maybe topic throughput is going down for some reason? Do you have any recommendation what to verify? Thanks [image.png] Confidentiality notice: This email and its attachments are for the sole use of the intended recipient(s) and may not be shared with any other party. They may be privileged or otherwise protected from disclosure and/or contain confidential information of ‘evoke plc’ (formally 888 Holdings plc) or its direct and indirect subsidiaries or affiliated companies (together, the “evoke Group”). Any review, use, disclosure or distribution by persons or entities other than the intended recipient(s) is prohibited. Nothing in this email or its attachments is capable of or intended to create any legally binding obligation. The evoke Group will only ever assume a legally binding obligation where recorded in a written agreement duly executed by the authorised signatory/ies of the relevant evoke Group company. If you are not the intended recipient, please contact the sender by return and destroy all copies of the original email and its attachments. Unless specifically indicated otherwise, the contents of this email and its attachments are subject to contract, and they are not an official statement and do not necessarily represent the views of the evoke Group. The evoke Group accepts no liability for any personal statements or views expressed in this email or its attachments. Please note that, whilst the evoke Group has taken reasonable precautions to ensure no viruses are present in this email or its attachments, the evoke Group cannot accept responsibility for any loss or damage sustained as a result of any viruses contained within this email or its attachments, and it is your responsibility to scan any emails and their attachments to ensure that they are virus free. The evoke Group may monitor email traffic data and the content of emails for effective operation of the email system and/or for general security purposes. For information about how we process data and monitor communications, please see our Privacy Policy and for terms of use, please see our Website Terms and Conditions. ‘evoke plc’ is a publicly limited company registered in Gibraltar, with company number 90099 and whose registered office address is at Suite 601/701 Europort, Europort Road, Gibraltar, GX11 1AA. evoke plc is listed on the London Stock Exchange. This email is sent by an evoke Group company. The evoke Group of companies include, among others, ‘888 Atlantic Limited’ (company number 109382), ‘888 US Services, Inc.’ (company number 5436078), ‘William Hill Limited’ (company number 04212563), ‘William Hill Organization Limited’ (company number 0278208), ‘WHG (International) Limited’ (company number 99191) and ‘Mr Green Limited’ (company number C43260). 888 Atlantic Limited is registered in Gibraltar and has its registered office at Suite 601/701, Europort, Europort Road, Gibraltar, GX11 1AA. 888 US Services, Inc. is registered in Delaware, USA, and has its registered office at 850 New Burton Road, Suite 201, Dover 19904, Delaware, USA. Each of William Hill Limited and William Hill Organization Limited is registered in England and Wales, and has its registered office at 1 Bedford Avenue, London, United Kingdom, WC1B 3AU. WHG (International) Limited is registered in Gibraltar and has its registered office at Suite 601/701, Europort, Europort Road, Gibraltar, GX11 1AA. Mr Green Limited is registered in Malta and has its registered office at Tagliaferro Business Centre, Level 7, 14 High Street, Sliema SLM 1549, Malta. A full list of the evoke Group companies and affiliates can be found in our annual report available from www.evokeplc.com <http://www.evokeplc.com/>.
