I've recently upgraded from 4.10.2 to 5.3.1 and I've hit an issue with slow commits on one of my cores. The core in question is relatively small (56k docs) and the issue only shows when commiting after a number of deletes, commiting after additions is fine. As an example commiting after deleting approximately 10% of the documents takes around 25mins. The same test on the 4.10.2 instance takes around 1 second.
I have done some investigation and the problem appears to be caused by having dynamic fields, the core in question has a large number, performing the same operation on this core with the dynamic fields removed sees a big improvement on the performance with the commit taking 11 seconds (still not quite on a par with 4.10.2). At the moment for this core it is quicker in 5.3.1 to delete everything and reindex the data than it is to delete old documents. Are there any changes that may have caused this or anything I should be doing differently in 5.3.1? I intend to download 5.4.1 next week to see if that improves things. Thanks Adam ##################################################################################### This E-mail is the property of Mass Consultants Ltd. It is confidential and intended only for the use of the addressee or with its permission. Use by anyone else for any purpose is prohibited. If you are not the addressee, you should not use, disclose, copy or distribute this e-mail and should notify us of receipt immediately by return e-mail to the address where the e-mail originated. This E-mail may not have been sent through a secure system and accordingly (i) its contents should not be relied upon by any person without independent verification from Mass Consultants Ltd and (ii) it is the responsibility of the recipient to ensure that the onward transmission, opening or use of this message and any attachments will not adversely affect its systems or data. No responsibility is accepted by Mass Consultants Ltd in this regard. Any e-mails that are sent to Mass Consultants Ltd's e-mail addresses may be monitored by systems or persons other than the addressee, for the purposes of ascertaining whether the communication complies with the law and Mass Consultants Ltd's policies. Mass Consultants Ltd is registered in England No. 1705804, Enterprise House, Great North Road, Little Paxton, Cambs., PE19 6BN, United Kingdom. Tel: +44 (0) 1480 222600. #####################################################################################