[MarkLogic Dev General] Phrase query mismatch Marklogic 7
Hi, I am querying for phrase testing method but it matches others such as test methods along with testing method. Why is that it is matching other phrases ? Stemmed is set to basic in Admin UI. How can I avoid such mismatches. Please help Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Difference between wildcard searches
Hi, Could somebody help me with the difference between these two 1.trailing wildcard searches (this I understood like play* ) 2. fast element trailing wildcard searches (this says predicates, but there will be no searches on xpath predicates /a/b/c[1] etc/ In my use case I am only going to do a string search like in abc* etc. I have created indexes on both but if I am only going to do a search on abc* etc then whether deleting 2 would I still get the results which I want in 1. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Difference between wildcard searches
Follow up question. Let's say there is a descr element and inside there are couple of words inside this element. Would I still get the results if I execute a string search like abc* with trailing wildcard searches index. On Wed, May 20, 2015 at 11:15 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, Could somebody help me with the difference between these two 1.trailing wildcard searches (this I understood like play* ) 2. fast element trailing wildcard searches (this says predicates, but there will be no searches on xpath predicates /a/b/c[1] etc/ In my use case I am only going to do a string search like in abc* etc. I have created indexes on both but if I am only going to do a search on abc* etc then whether deleting 2 would I still get the results which I want in 1. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Re-indexing new documents
Hi , We have loaded some 500GB of data and the re-indexing is almost done. These include fast character searches, word searches, word positions just to name a few. Now we need to store another 14 GB of data. When re-indexing is done again will Marklogic index only the newly added files or will it index all the documents again. Please help. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Re-indexing new documents
Hi Christopher, I wanted to check for this condition. Already 500GB loaded and re-indexing done. Now I first load 12 GB of data which has different elements without creating any range index. When loading is finished I enable the reindexer enable to false. Now I create the range indexes for these newly loaded data. Now I enable the reindexer enable to true and click ok. On the Admin status page, when re-index starts it always gives out the number of fragments and the time to complete. My question was on the number of fragments in this situation. Will the number of fragments will be 4 million plus newly loaded data number or just the newly added fragments say in this case .2 million. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] XDMP-INMMLISTFULL error
Hi Christopher, It's an error , below There is currently an XDMP-FORESTERR: Error in reindex of forest PROD_DB_1: XDMP-REINDEX: Error reindexing fn:doc(/home/data/TD078999.XML): XDMP-FRAGTOOLARGE: Fragment of /home/data/TD078999.XML too large for in-memory storage: XDMP-INMMLISTFULL: In-memory list storage full; list: table=100%, wordsused=50%, wordsfree=25%, overhead=25%; tree: table=0%, wordsused=6%, wordsfree=94%, overhead=0% exception. Information on this page may be missing. Any suggestion on how to resolve this error? This value 32555 MB if I increase it says invalid number. I have seen the link you have sent but I am just not getting the number. Thanks On Mon, May 11, 2015 at 8:06 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, I have seen various post regarding this error but it only says it needs to increase the size. The *in memory list size* is currently in my case. If I try to increase the size it says it is not valid size. What size will be valid? Please help. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Re-indexing new documents
Thanks Chrisopher for your suggestion. On Mon, May 11, 2015 at 7:28 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi Christopher, I wanted to check for this condition. Already 500GB loaded and re-indexing done. Now I first load 12 GB of data which has different elements without creating any range index. When loading is finished I enable the reindexer enable to false. Now I create the range indexes for these newly loaded data. Now I enable the reindexer enable to true and click ok. On the Admin status page, when re-index starts it always gives out the number of fragments and the time to complete. My question was on the number of fragments in this situation. Will the number of fragments will be 4 million plus newly loaded data number or just the newly added fragments say in this case .2 million. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] XDMP-INMMLISTFULL error
Hi, I have seen various post regarding this error but it only says it needs to increase the size. The *in memory list size* is currently in my case. If I try to increase the size it says it is not valid size. What size will be valid? Please help. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] How to reclaim disk space
I am running xdmp.merge({ mergeMaxSize: 500, mergeTimestamp: 14307959410102210, singleStand: false, forests: [ xdmp.forest(PROD_DB_1) ] }) But it is giving me syntax error [1.0-ml] XDMP-UNEXPECTED: (err:XPST0003) Unexpected token syntax error, unexpected Lbrace_ Stack TraceAt line 2 column 11: In xdmp:eval(xquery version '1.0-ml';#10;xdmp.merge({#10; qu..., (), options xmlns=xdmp:evaldatabase2070303732519796320/databasemodules207030373251979.../options) 1. xquery version '1.0-ml'; 2. xdmp.merge({ 3. mergeMaxSize: 500, 4. mergeTimestamp: 14307959410102210, where is the error here ? Thanks On Tue, May 5, 2015 at 8:18 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, Can someone help with reclaiming disk space as there are lot of deleted fragments but when I do manual merge the free space keeps coming down. Is there a way out? Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] How to reclaim disk space
Hi, Can someone help with reclaiming disk space as there are lot of deleted fragments but when I do manual merge the free space keeps coming down. Is there a way out? Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Fragment root configuration
Thanks for your reply Christopher and David. Content is xml . The search app is taking rough 5.6 secs to show the contents snippets , facets etc with about 5 million records. Query used is JAVA API using QueryManager search function. Read that fragment root keeps each document as one so I thought it could be faster during the parsing stage, but haven't found anywhere to validate this one. Pagination is a bit slow. All others are fine like details, facets links and others. Only the QueryManager search takes long time. Thanks On Sat, May 2, 2015 at 6:08 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, Will configuring Fragment roots speed up my query. I am building a search application using Marklogic Java api and I have around 6 different root elements. My search app takes around 5 seconds , to search and to show the snippets and around 4 filters with roughly 5067188 docs. I read that Fragment roots make it one continuous compressed binary document will it speed up my search. Kindly suggest. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Fragment root configuration
Hi David, The size of each document varies but it ranges from 30 kb to 225kb max all XML. I would certainly look into the profile and with small set of documents roughly 2000 it gives me the same result. Only 10 docs I am showing maybe the code to get the snippets is the culprit. Let me check the snippet extraction code. Thanks On Sun, May 3, 2015 at 4:29 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Thanks for your reply Christopher and David. Content is xml . The search app is taking rough 5.6 secs to show the contents snippets , facets etc with about 5 million records. Query used is JAVA API using QueryManager search function. Read that fragment root keeps each document as one so I thought it could be faster during the parsing stage, but haven't found anywhere to validate this one. Pagination is a bit slow. All others are fine like details, facets links and others. Only the QueryManager search takes long time. Thanks On Sat, May 2, 2015 at 6:08 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, Will configuring Fragment roots speed up my query. I am building a search application using Marklogic Java api and I have around 6 different root elements. My search app takes around 5 seconds , to search and to show the snippets and around 4 filters with roughly 5067188 docs. I read that Fragment roots make it one continuous compressed binary document will it speed up my search. Kindly suggest. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Basic search question
Hi, I have finished indexing on Fast case sensitive character searches but others such as word searches have not finished but have finished around 81% and wild card searches around 90%. Since case sensitive character searches indexes are done I presume I should be able to search case sensitive character searches but I am unable to search as it times out. Is case sensitive searches tied to word searches meaning until word indexes are not over or even 90% is complete I would not be able to search for case sensitive search features. Please help. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Fragment root configuration
Hi, Will configuring Fragment roots speed up my query. I am building a search application using Marklogic Java api and I have around 6 different root elements. My search app takes around 5 seconds , to search and to show the snippets and around 4 filters with roughly 5067188 docs. I read that Fragment roots make it one continuous compressed binary document will it speed up my search. Kindly suggest. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] XDMP-TOOMANYSTANDS
Hi David, Due to hardware limitations and the disk space I had to stick to 1 forest surely I will note of your suggestions once it becomes a full project now it is just a POC with limited hardware. Thanks On Sat, May 2, 2015 at 6:18 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi , Thanks all for your suggestions, now setting to 64GB MAX MERGE instead of 32 GB has improved my situation. Merging is constantly happening. But then I had configured too many features, 2,1 character searches and field positions and values which in the docs says it produces which already had run to almost 70% which I figured it out that I dont need these features. Now Marklogic has started deleting and started reclaiming those spaces and the spaces have increased. Now from 62 strands it has reduced to 50 and I have only 1 Forest . Thanks On Fri, May 1, 2015 at 6:06 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi , Based on the below link this https://docs.marklogic.com/8.0/messages/XDMP-en/XDMP-TOOMANYSTANDSHi for the above too many stands I have set the MAX-MERGE-SIZE to 64GB instead of 32 GB Can someone help me whether this 64gb is ok Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Too many stands exception
Hi , Thanks all for your suggestions, now setting to 64GB MAX MERGE instead of 32 GB has improved my situation. 1 Forest but then I had configured too many features, 2 character searches , 1 character searches but later found out that it is not needed when 3 character searches are enabled. I almost ran out of space now , changing to 64gb started deleting those 2 and 1 character and field value positions etc which I don't need and the spaces of these configurations , Marklogic have to started to reclaim it and started deleting it. Now space also is increasing. Now from 62 strands it has reduced to 50. Thanks On Fri, May 1, 2015 at 5:58 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, Could someone help me in resolving this error XDMP-TOOMANYSTANDS: Too many stands exception. I had one forrest and last time I remmeber was about 62 stands , can someone help me how to reduce the number of stands. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] XDMP-TOOMANYSTANDS
Hi , Thanks all for your suggestions, now setting to 64GB MAX MERGE instead of 32 GB has improved my situation. Merging is constantly happening. But then I had configured too many features, 2,1 character searches and field positions and values which in the docs says it produces which already had run to almost 70% which I figured it out that I dont need these features. Now Marklogic has started deleting and started reclaiming those spaces and the spaces have increased. Now from 62 strands it has reduced to 50 and I have only 1 Forest . Thanks On Fri, May 1, 2015 at 6:06 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi , Based on the below link this https://docs.marklogic.com/8.0/messages/XDMP-en/XDMP-TOOMANYSTANDSHi for the above too many stands I have set the MAX-MERGE-SIZE to 64GB instead of 32 GB Can someone help me whether this 64gb is ok Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Too many stands exception
Hi, Could someone help me in resolving this error XDMP-TOOMANYSTANDS: Too many stands exception. I had one forrest and last time I remmeber was about 62 stands , can someone help me how to reduce the number of stands. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] XDMP-TOOMANYSTANDS
Hi , Based on the below link this https://docs.marklogic.com/8.0/messages/XDMP-en/XDMP-TOOMANYSTANDSHi for the above too many stands I have set the MAX-MERGE-SIZE to 64GB instead of 32 GB Can someone help me whether this 64gb is ok Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Is data also store in forest
Thanks all for the info. On Tue, Apr 28, 2015 at 11:22 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi, We are running out of disk space due to the indexing . Could some answer a basic question. I have loaded data to Marklogic server from /home/data/data1 . Now the loading is finished and re-indexing and merging started. Does Marklogic server still require data to be in /home/data/data1 or can this data be deleted . I have always assumed that even after loading the data from the path above Marklogic still requires data to be in this folder. Basically I want the data to be deleted once the loading is complete as space is running out due to heavy re-indexing. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Searches not enabled error
Hi, I have the same configuration both in local and one in dev environment. I had made a constraint on the field name and this field name contain paths in both environments. The only difference right now is that re-indexing and merging is going in dev environment where as in my local it is only 2000 docs so everything is complete. But while executing the search with the constraint name it gives me 'Search is not enable'. Is it because the re-indexing and merging is still continuing in dev environment? Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Is data also store in forest
Hi, We are running out of disk space due to the indexing . Could some answer a basic question. I have loaded data to Marklogic server from /home/data/data1 . Now the loading is finished and re-indexing and merging started. Does Marklogic server still require data to be in /home/data/data1 or can this data be deleted . I have always assumed that even after loading the data from the path above Marklogic still requires data to be in this folder. Basically I want the data to be deleted once the loading is complete as space is running out due to heavy re-indexing. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Forest Warning
Hi, Can somebody help me how to fix this issue There is currently an XDMP-FORESTERR: Error in reindex of forest PROD_DB_1: XDMP-REINDEX: Error reindexing fn:doc(/home/data/Folder2/US07625699-20091201-T2.XML): XDMP-FRAGTOOLARGE: Fragment of /home/data/Folder2/US07625699-20091201-T2.XML too large for in-memory storage: XDMP-INMMLISTFULL: In-memory list storage full; list: table=100%, wordsused=50%, wordsfree=25%, overhead=25%; tree: table=0%, wordsused=6%, wordsfree=94%, overhead=0% exception. Information on this page may be missing. It says US07625699-20091201-T2.XML too large. what are the other options any suggestions would be helpful. Is deleting this file an option as the last resort? Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Same contraints name with multiple element indexes
Hi, Is it possible to have the same contraints name with multiple range index elements. The following I tried but only worked for one qname not multiple is there a way could somebody help me as I need to search from different element range indexes with the same contraint. Here's my code String optionsName = product; QueryOptionsManager optMgr = client.newServerConfigManager().newQueryOptionsManager(); // create the builder for query options QueryOptionsBuilder optBldr = new QueryOptionsBuilder(); // create a handle on the built query options QueryOptionsHandle optHandle = new QueryOptionsHandle(); // support constraints on the artistName and writer element indexes optHandle.withConstraints( optBldr.constraint(product, optBldr.elementQuery(new QName(description)) ), optBldr.constraint(product, optBldr.elementQuery(new QName(summary)) ) ); Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] mlcp stopped working after loading some documents
Hi , Could someone share some of the experiences of loading xml data through mlcp as it loaded partially. Total no of docs : 2361822 Total no of forests - 4 (Merging policy default one) Another one which is loaded from different folder about -1623444 xml files loaded only 7% and then restarted then it loaded till 46% of the total.(same database and same forests) Initially I had this space problem but then created a symlink to /var/opt/Marklogic to /home/Marklogic , everything went fine then it stopped. Now, I restarted mlcp and then it stops after saying 7% completed . What needs to be done any configuration changes I am missing. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] How to find particular element using path index
Hi , Below is the structure of my document. I want to find the date under the product-reference and not the date from the store-reference. XML-STRUCTURE product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference I have create this optionsname as date-product and constraint as constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/publication-reference/date/path-index /range /constraint JAVA CODE QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition(date-product, date); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } I am not getting any results. Am I missing something or could somebody correct my code or help me with how to find values with path-index with range element index I am getting the results. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] How to find particular element using path index
Sorry that was a typo from my side and yes I created the path index in admin ui constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/product-reference/date/path-index /range /constraint But still I could not get the results. Error : Local message: search failed: Bad Request. Server Message: null On Sun, Apr 12, 2015 at 9:43 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi , Below is the structure of my document. I want to find the date under the product-reference and not the date from the store-reference. XML-STRUCTURE product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference I have create this optionsname as date-product and constraint as constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/publication-reference/date/path-index /range /constraint JAVA CODE QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition(date-product, date); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } I am not getting any results. Am I missing something or could somebody correct my code or help me with how to find values with path-index with range element index I am getting the results. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] How to find particular element using path index
My search values in java code QueryOptionsManager optionsMgr = client.newServerConfigManager() .newQueryOptionsManager(); String optionXml = search:options + xmlns:search='http://marklogic.com/appservices/search' + search:values name='datepath' + search:range collation='http://marklogic.com/collation/' type='xs:string' + search:path-index/product-reference/date/search:path-index + /search:range + /search:values + /search:options; StringHandle writeHandle = new StringHandle(optionXml); optionsMgr.writeOptions(datepath, writeHandle); QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition( datepath,datepath); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } On Sun, Apr 12, 2015 at 11:19 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Sorry that was a typo from my side and yes I created the path index in admin ui constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/product-reference/date/path-index /range /constraint But still I could not get the results. Error : Local message: search failed: Bad Request. Server Message: null On Sun, Apr 12, 2015 at 9:43 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi , Below is the structure of my document. I want to find the date under the product-reference and not the date from the store-reference. XML-STRUCTURE product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference I have create this optionsname as date-product and constraint as constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/publication-reference/date/path-index /range /constraint JAVA CODE QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition(date-product, date); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } I am not getting any results. Am I missing something or could somebody correct my code or help me with how to find values with path-index with range element index I am getting the results. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] How to find particular element using path index
Thanks Indrajeet for the code. But as I look into your range path index admin ui configuration one thing I observed, you started from the root element and whereas I started in the from product reference. Probably you path is correct one i guess Maybe this is where I got it wrong , but do you really have to start from the root element say in this case I could start say //product-reference/product-id/date . But yes I think I forgot that product id. Thanks a lot On Mon, Apr 13, 2015 at 12:02 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: My search values in java code QueryOptionsManager optionsMgr = client.newServerConfigManager() .newQueryOptionsManager(); String optionXml = search:options + xmlns:search='http://marklogic.com/appservices/search ' + search:values name='datepath' + search:range collation=' http://marklogic.com/collation/' type='xs:string' + search:path-index/product-reference/date/search:path-index + /search:range + /search:values + /search:options; StringHandle writeHandle = new StringHandle(optionXml); optionsMgr.writeOptions(datepath, writeHandle); QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition( datepath,datepath); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } On Sun, Apr 12, 2015 at 11:19 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Sorry that was a typo from my side and yes I created the path index in admin ui constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/product-reference/date/path-index /range /constraint But still I could not get the results. Error : Local message: search failed: Bad Request. Server Message: null On Sun, Apr 12, 2015 at 9:43 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi , Below is the structure of my document. I want to find the date under the product-reference and not the date from the store-reference. XML-STRUCTURE product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference I have create this optionsname as date-product and constraint as constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/publication-reference/date/path-index /range /constraint JAVA CODE QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition(date-product, date); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } I am not getting any results. Am I missing something or could somebody correct my code or help me with how to find values with path-index with range element index I am getting the results. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] How to find particular element using path index
Thanks Indrajeet ,it worked this time and got the results I started from the root after seeing you screenshot. Really appreciate your help a big thanks to you and you saved my job. Thanks to all who have given me suggestions. This marklogic forum is just great . On Mon, Apr 13, 2015 at 1:11 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Thanks Indrajeet for the code. But as I look into your range path index admin ui configuration one thing I observed, you started from the root element and whereas I started in the from product reference. Probably you path is correct one i guess Maybe this is where I got it wrong , but do you really have to start from the root element say in this case I could start say //product-reference/product-id/date . But yes I think I forgot that product id. Thanks a lot On Mon, Apr 13, 2015 at 12:02 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: My search values in java code QueryOptionsManager optionsMgr = client.newServerConfigManager() .newQueryOptionsManager(); String optionXml = search:options + xmlns:search='http://marklogic.com/appservices/search ' + search:values name='datepath' + search:range collation=' http://marklogic.com/collation/' type='xs:string' + search:path-index/product-reference/date/search:path-index + /search:range + /search:values + /search:options; StringHandle writeHandle = new StringHandle(optionXml); optionsMgr.writeOptions(datepath, writeHandle); QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition( datepath,datepath); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } On Sun, Apr 12, 2015 at 11:19 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Sorry that was a typo from my side and yes I created the path index in admin ui constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/product-reference/date/path-index /range /constraint But still I could not get the results. Error : Local message: search failed: Bad Request. Server Message: null On Sun, Apr 12, 2015 at 9:43 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi , Below is the structure of my document. I want to find the date under the product-reference and not the date from the store-reference. XML-STRUCTURE product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference I have create this optionsname as date-product and constraint as constraint name='date' range collation='http://marklogic.com/collation/' type='xs:string' facet='false' path-index/publication-reference/date/path-index /range /constraint JAVA CODE QueryManager queryMgr = client.newQueryManager(); ValuesDefinition query = queryMgr.newValuesDefinition(date-product, date); ValuesHandle values = queryMgr.values(query, new ValuesHandle()); for (CountedDistinctValue value : values.getValues()) { String textValue = value.get(xs:string, String.class); System.out.println(textValue ); } I am not getting any results. Am I missing something or could somebody correct my code or help me with how to find values with path-index with range element index I am getting the results. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] DISK space error
Thanks to all experts who have given me suggestions really appreciate your help and have learnt so many things. I created a symbolic link to /var/opt/MarkLogic /home/Marklogic(where there is lots of space) and created 4 forest(This number I am not quite sure its the correct number) but the loading is going on without any error. By the way I am using mlcp to load. Thanks and thanks to everyone once again. On Sat, Apr 11, 2015 at 12:17 AM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Thanks Geert , I don't have any issue going over the steps again. As I want to start all over again. On Fri, Apr 10, 2015 at 11:41 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Thanks for all your suggestions Marklogic keeps all its data in /var/opt/Marklogic , so now I want to fix this issue. Below are the steps I would like to follow . /home has the highest disk space which is 1.2 TB So , I create a folder /home/opt/Marklogic ln -s /var/opt/Marklogic /home/opt/Marklogic There a couple of files inside in /var/opt/Marklogic from the previous database and forest creation such as forest , database and other xmls. Should I delete all these files, Won't there be any problem if I create a new database. Thanks once again. On Fri, Apr 10, 2015 at 5:57 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Hi Marklogic experts, We are running into space problem while trying to load data through mlcp 1. Total disk size 1.8 TB 2. Free space is 1.3 TB /home 3. we are loading 250 GB data. Error we are getting is below - SVC-FILWRT: File write error: write 'filename': No space left on device Error in merge of forest [Forest-Name]: XDMP-MERGESPACE: Not merging due to disk space limitations, need=584MB, have=260MB This I found somewhere-- Merges require at least twice as much free disk space as used by the forest data (3X rule). If a merge runs out of disk space, it will fail. We feel there is enough space as free space is 1.3 TB What configurations we can make in database merging page to avoid this error. Thanks ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Range index for duplicate element for facets how to
Could some help me with creating the range index for a duplicated nested element A snippet of my xml structure is given below and I want to create range index for the date under the product-reference for the facets and not the date under the store-reference . How should I do it . Appreciate if some could help me out. 2. Is it still possible for me to create both the date as range indexes which one marklogic will pick up if I create range indexes for both date under product-reference and date under store-reference. product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference thanks sd ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Range index for duplicate element for facets how to
Have tried replacing with path-index still getting this error RESTAPI-EMPTYBODY (err:FOER): ?xml version=1.0 encoding=UTF-8? options xmlns=http://marklogic.com/appservices/search; constraint name=date range collation=http://marklogic.com/collation/; type=xs:string facet=false path-indexproduct-reference/date/path-index /range /constraint /options Thanks sd On Sat, Apr 4, 2015 at 11:36 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Just created path range indexes for the above date, and was trying to write the options through QueryOptionsManager writeOptions method, but for Range index it is working but for Path range index the options is giving me java.lang.NullPointerException My Path Range Index settings. scalar type = string path expression = product-reference/date collation =http://marklogic.com/collation/; Options I want to write through QueryOptionsManager ?xml version=1.0 encoding=UTF-8? options xmlns=http://marklogic.com/appservices/search; constraint name=date range type=xs:string collation=http://marklogic.com/collation/; element ns= name=product-reference/date/ /range /constraint /options Appreciate if someone could help me fix this issue. I had gone through the documentation but could not find the options xml for Path range index. Maybe the range is not what is expected for Path range index. Thanks sd On Sat, Apr 4, 2015 at 6:47 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Could some help me with creating the range index for a duplicated nested element A snippet of my xml structure is given below and I want to create range index for the date under the product-reference for the facets and not the date under the store-reference . How should I do it . Appreciate if some could help me out. 2. Is it still possible for me to create both the date as range indexes which one marklogic will pick up if I create range indexes for both date under product-reference and date under store-reference. product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference thanks sd ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
Re: [MarkLogic Dev General] Range index for duplicate element for facets how to
Just created path range indexes for the above date, and was trying to write the options through QueryOptionsManager writeOptions method, but for Range index it is working but for Path range index the options is giving me java.lang.NullPointerException My Path Range Index settings. scalar type = string path expression = product-reference/date collation =http://marklogic.com/collation/; Options I want to write through QueryOptionsManager ?xml version=1.0 encoding=UTF-8? options xmlns=http://marklogic.com/appservices/search; constraint name=date range type=xs:string collation=http://marklogic.com/collation/; element ns= name=product-reference/date/ /range /constraint /options Appreciate if someone could help me fix this issue. I had gone through the documentation but could not find the options xml for Path range index. Maybe the range is not what is expected for Path range index. Thanks sd On Sat, Apr 4, 2015 at 6:47 PM, Shashidhar Rao raoshashidhar...@gmail.com wrote: Could some help me with creating the range index for a duplicated nested element A snippet of my xml structure is given below and I want to create range index for the date under the product-reference for the facets and not the date under the store-reference . How should I do it . Appreciate if some could help me out. 2. Is it still possible for me to create both the date as range indexes which one marklogic will pick up if I create range indexes for both date under product-reference and date under store-reference. product-reference product-id countryIND/country product-numberAA-503/product-number product-typeapparel/product-type date20130105/date /product-id /product-reference store-reference store-id countryJP/country store-number8369/store-number date20120906/date /store-id /store-reference thanks sd ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Data size and forest
Hi, Can someone help me with configuring the optimum number of Forests for a database . Details below Size of data is 1 TB. Format all xml files. I would like to know which one will be better option 1. 1 database say testdb and default forest- I think this would be slow. 2. 1 database and say ( here how many forest should I create to extract maximum performance ) What criteria should I decide to create the number of forest . I am thinking of 250GB per forest so around 4-5 forest. Is it correct? Please let me know. Thanks sd ___ General mailing list General@developer.marklogic.com Manage your subscription at: http://developer.marklogic.com/mailman/listinfo/general
[MarkLogic Dev General] Defining Collections in Marklogic
Hi. I have already loaded a bunch of xml files in marklogic database. I used Information studio to load these data. Now I want these loaded data to belong to a certain collection. Please help me in defining a collection for these data. How to make these data belong to a particular collection. Is there a way I can set in the database localhost:8001 or using java api Regards Shashi ___ General mailing list General@developer.marklogic.com http://developer.marklogic.com/mailman/listinfo/general