I’m asking about the Solr Admin UI. What I want to know is whether it’s possible to retrieve a very large number of documents directly from the UI, without having to use pagination or write an extra script.
Previously, when we used standalone (user-managed) Solr, we could pull that many documents in one go(100000). But now that we’ve moved to SolrCloud, the same approach doesn’t work. So my question is, could this be a configuration issue with my SolrCloud setup, or is it simply not recommended (or not possible) to pull that many documents directly from the Solr Admin UI when working with solr cloud due to its distributed nature? Thanks ________________________________ Can you elaborate on what you mean by "directly in the UI"? The solr admin ui? The ui you are writing for your app? You already mentioned the two features designed for exactly that task. Can you clarify why you are dissatisfied with them? Also, note that the other "just script it" reply here is either forgetting to mention cursormark, or hasn't yet understood why deep paging is costly in distributed search systems. On Tue, Aug 19, 2025 at 10:43 AM Ariolu, Joshua <joshua.ari...@invesco.com.invalid> wrote: > Hi Solr Community, > I'm currently trying to retrieve around 100,000 documents directly from > the SolrCloud UI, but I'm encountering lock errors when attempting to fetch > that many at once. Interestingly, smaller batches work fine. > Aside from using pagination with cursorMark or the /export request > handler, are there any other recommended approaches or best practices for > retrieving large result sets directly from the UI without running into such > issues? > Thanks in advance! > > Invesco Asset Management Limited, Company No. 949417, Firm Reference No. > 122674 > Invesco Fund Managers Limited, Company No. 898166, Firm Reference No. > 119298 > Invesco Pensions Limited, Company No. 3507379, Firm Reference No. 188249 > Invesco UK Services Limited, Company No. 06649814 > Invesco UK Limited, Company No. 3004959 > > The first two listed companies are authorised and regulated by the > Financial Conduct Authority. The third company is authorised by the > Prudential Regulation Authority and regulated by the Financial Conduct > Authority and the Prudential Regulation Authority. All companies are > registered in England and Wales with their registered offices at Perpetual > Park, Perpetual Park Drive, Henley-on-Thames, Oxfordshire, RG9 1HH, United > Kingdom. UK Group VAT No. 245 055 771. > > **************************************************************** > Confidentiality Note: The information contained in this > message, and any attachments, may contain confidential > and/or privileged material. It is intended solely for the > person(s) or entity to which it is addressed. Any review, > retransmission, dissemination, or taking of any action in > reliance upon this information by persons or entities other > than the intended recipient(s) is prohibited. If you received > this in error, please contact the sender and delete the > material from any device. > **************************************************************** > -- https://urldefense.com/v3/__http://www.needhamsoftware.com__;!!PVeQBqD1!ouOJpGQ_7Q9vcV5F__Avyl3XwGmhDakefrMX8tXJbKEfBy7w9kcp1pjc8HGE_joUcbPIC0Vfle_PxgvWjwn9$ (work) https://urldefense.com/v3/__https://a.co/d/b2sZLD9__;!!PVeQBqD1!ouOJpGQ_7Q9vcV5F__Avyl3XwGmhDakefrMX8tXJbKEfBy7w9kcp1pjc8HGE_joUcbPIC0Vfle_PxtTG8QLU$ (my fantasy fiction book) Invesco Asset Management Limited, Company No. 949417, Firm Reference No. 122674 Invesco Fund Managers Limited, Company No. 898166, Firm Reference No. 119298 Invesco Pensions Limited, Company No. 3507379, Firm Reference No. 188249 Invesco UK Services Limited, Company No. 06649814 Invesco UK Limited, Company No. 3004959 The first two listed companies are authorised and regulated by the Financial Conduct Authority. The third company is authorised by the Prudential Regulation Authority and regulated by the Financial Conduct Authority and the Prudential Regulation Authority. All companies are registered in England and Wales with their registered offices at Perpetual Park, Perpetual Park Drive, Henley-on-Thames, Oxfordshire, RG9 1HH, United Kingdom. UK Group VAT No. 245 055 771. **************************************************************** Confidentiality Note: The information contained in this message, and any attachments, may contain confidential and/or privileged material. It is intended solely for the person(s) or entity to which it is addressed. Any review, retransmission, dissemination, or taking of any action in reliance upon this information by persons or entities other than the intended recipient(s) is prohibited. If you received this in error, please contact the sender and delete the material from any device. ****************************************************************
