If I am reading this right, a search of 2000 docs with a result set page size of 10 is still slow. ? by ‘small set of 2000 docs’ do you mean that is all you have in the database total ? or does that mean it’s the total result set size from a total DB size of 5mil docs ?
Either way This is very unlikely to be the snippet code. The snippet code only runs on the return set. The first order indicator would be the search criteria – see if you can extract out the search and run it by itself. To get fast searches over many documents you need the search and indexing (and sometimes the data enriched slightly) so the server can narrow the search to only a few possible documents by indexes alone – Or – use a search that can ‘return early’ without having to search everything to come up with the first result. (preferably both). For example – a sort field on a term that is not indexed requires reading all documents matched before it can return the first one – even if the selection criteria is fully indexed. From: [email protected] [mailto:[email protected]] On Behalf Of Shashidhar Rao Sent: Saturday, May 02, 2015 9:01 PM To: [email protected] Subject: Re: [MarkLogic Dev General] Fragment root configuration Hi David, The size of each document varies but it ranges from 30 kb to 225kb max all XML. I would certainly look into the profile and with small set of documents roughly 2000 it gives me the same result. Only 10 docs I am showing maybe the code to get the snippets is the culprit. Let me check the snippet extraction code. Thanks On Sun, May 3, 2015 at 4:29 AM, Shashidhar Rao <[email protected]<mailto:[email protected]>> wrote: Thanks for your reply Christopher and David. Content is xml . The search app is taking rough 5.6 secs to show the contents snippets , facets etc with about 5 million records. Query used is JAVA API using QueryManager search function. Read that fragment root keeps each document as one so I thought it could be faster during the parsing stage, but haven't found anywhere to validate this one. Pagination is a bit slow. All others are fine like details, facets links and others. Only the QueryManager search takes long time. Thanks On Sat, May 2, 2015 at 6:08 AM, Shashidhar Rao <[email protected]<mailto:[email protected]>> wrote: Hi, Will configuring Fragment roots speed up my query. I am building a search application using Marklogic Java api and I have around 6 different root elements. My search app takes around 5 seconds , to search and to show the snippets and around 4 filters with roughly 5067188 docs. I read that Fragment roots make it one continuous compressed binary document will it speed up my search. Kindly suggest. Thanks
_______________________________________________ General mailing list [email protected] Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
