Re: Help with Boolean search using Solr parser edismax

2018-01-30 Thread Wendy2
Hi Emlr, Thank you for reading my post and for your reply. I updated my post with debug info and a better view of the definition of /search request handler. Any suggestion on what I should try? Thanks, Wendy -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-01-30 Thread Wendy2
Hi Emir, Thank you so much for your response. I updated my post with an image which display the configuration of the /search request handler. Any suggestions? Thanks, Wendy -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Wendy2
Good morning, Emir, Here are the debug output for case 1f-a (q=method:"x-ray*" "Solution NMR"), 1f-b (q=+method:"x-ray*" +"Solution NMR"). both returned zero counts. It looks that the querystrings are the same. Thanks for following up on my post and your help! -- Wendy

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Hi Erick, Thank you very much for the clarification. I will keep it in my mind since we are now in the process of migrating MySQL database to mongoDB. Best Regards, Wendy a happy Solr user -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Good morning, Emir, Thanks for letting me know that. I used dots to add tableName. as a field prefix because several columns from different tables have the same names. In your opinion, what will be the best way to replace dots? Happy Friday! Wendy -- Sent from:

Re: Help with Boolean search using Solr parser edismax

2018-02-02 Thread Wendy2
Hi Erick, Yes. Currently I re-index the database on a weekly basis because we only have weekly release. As part of the Solr weekly re-index, the batch job will delete the /solr/core/data folder, restart Solr server, then re-index. We use Luigi to build/control pipelines of Solr re-index batch

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Wendy2
And the coupon has no expiration date on it (LOL). Thank you again, Emir! Best Regards, Wendy -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with Boolean search using Solr parser edismax

2018-02-01 Thread Wendy2
Excellent!!! Thank you so much for all your help, Emir! Both worked now and I got 997 result counts back as the expected number :-) /rcsb/search?q=method:"x-ray*" "Solution NMR"=1 /rcsb/search?q=+method:"x-ray*" +"Solution NMR"=1 I will keep this in my mind regarding query with multiple

Re: Help with Boolean search using Solr parser edismax

2018-01-31 Thread Wendy2
Hi Emir, Thank you so much for following up with your ticket. Listed below are the parts of debugQuery outputs via /search request handler. The reason I used * in the query term is that there are a couple of methods starting with "x-ray". When I used space surrounding the "OR" boolean search

Re: Help with Boolean search using Solr parser edismax

2018-01-31 Thread Wendy2
Hi Emir, Listed below are the debugQuery outputs from query without "OR" operator. I really appreciate your help! --Wendy ===DebugQuery Outputs for case 1f-a, 1f-b without "OR" operator= *1f-a (/search?q=+method:"x-ray*" +method:"Solution NMR") result counts = 0: *

Help with Boolean search using Solr parser edismax

2018-01-29 Thread Wendy2
Hi Solr users,I am having an issue on boolean search with Solr parser edismax. The search "OR" doesn't work. The image below shows the different results tested on different Solr versions. There are two types of search requester handlers, /select vs /search. The /select requester uses Lucene

Re: How can I prevent adding duplicated copyfield into managed schema

2018-02-06 Thread Wendy2
What if you include the core name as part of the direct path? In my practice, managed-schema file is stored under ~/solr/coreName, so it is core specific and will never be shared with other cores. Wendy -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Help on indexing nested documenta in MongoDB

2018-07-27 Thread Wendy2
Hi fellow Solr users, I am looking for a way to index nested documents in mongodb using Solr's DataImportHandler. Is there any recommendations? I googled on the web in the last two weeks and found the following posts. I was able to index the top level fields W/O any issue, but had trouble in

Re: Help with error on indexing mongoDB document by Solr DataImportHandler

2018-08-13 Thread Wendy2
Update: I resolved this issue by checking key:value to convert ObjectId to String: if(value instanceof ObjectId) { map.put(key, (String) value.toString()); } else { .. } A Solr happy user :-) -- Sent from:

Help with error on indexing mongoDB document by Solr DataImportHandler

2018-08-13 Thread Wendy2
Hi Solr users:I encountered the following error when indexing MongoDB data by using Solr DataImportHandler:org.apache.solr.common.SolrException: TransactionLog doesn't know how to serialize class org.bson.types.ObjectId; try implementing ObjectResolver?Is there any fix or workaround for this

Re: Help with error on indexing mongoDB document by Solr DataImportHandler

2018-08-14 Thread Wendy2
H Shawn, Thank you very much for your response! Solr DataImportHandler "could not" directly index MongoDB collections. I used open source SolrMongoImporter project (https://github.com/james75/SolrMongoImporter) on top of Solr DIH to to directly index data of MongoDB collections. What I did was

How to ptotect middile initials during search

2018-04-18 Thread Wendy2
Hi fellow Users, Why did Solr return "Ellington, W.R." when I did a name search for "Ellington, A."? I even added "A." in the protwords.txt file. The debugQuery shows that the middle initial got dropped in the parsedquery. How can I make Solr NOT to drop the middle initial? Thanks for your

need help on search on last name + middile initial

2018-04-18 Thread Wendy2
Hi Solr experts: How can I make sure Solr doesn't drop middle initial when I do a name search? I did a search with double quotes for "Ellington, A.", but Solr parser dropped the middle initial, so I got both back: I even tried keeping A. in the protwords.txt file, but didn't work. Any work

Re: How to protect middile initials during search

2018-04-19 Thread Wendy2
Hi Jay, Thank you very much for your reply! I re-indexed the data after removing the stopword filter. It looks that Solr parsed the data correctly but didn't return any results. Anything else could I try? Thank you again! ===debugQuery Output= { "responseHeader":{

Re: need help on search on last name + middile initial

2018-04-19 Thread Wendy2
Hi Shawn, Thank you very much for your reply! Per your suggestion, I re-indexed the data after removing the stopword filter. It looks that Solr parsed the data correctly but didn't return any results. Anything else could I try? Thank you again! ===debugQuery Output= {

Re: How to protect middile initials during search

2018-04-20 Thread Wendy2
Hi Alessandro, Thank you very much for your reply! I got the issue resolved based on the suggestion from the article below: https://opensourceconnections.com/blog/2013/08/21/name-search-in-solr/ *I created a new fieldType:* -- Sent from:

Re: need help on search on last name + middile initial

2018-04-20 Thread Wendy2
The issue was resolved. *I created a new fieldType:* *A reference:* https://opensourceconnections.com/blog/2013/08/21/name-search-in-solr/ -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: need help on search on last name + middile initial

2018-04-20 Thread Wendy2
Hi Shawn, The issue got resolved :-) Thank you very much for your help!! *I created a new fieldType:* * A reference:* https://opensourceconnections.com/blog/2013/08/21/name-search-in-solr/ -- Sent from:

Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Solr users:I use Solr 7.3.1 and 150,000 documents and about 6GB in total. When I try to retrieve 2 ids (4 letter code, indexed and stored), it took 17s to retrieve 1.14M size data. I tried to increase RAM and cache, but only helped to some degree (from 25s to 17s). Any idea/suggestions

Re: Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Shawn, Thank you very much for your response! Here is a screen shot. Is the CPU an issue? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Shawn,Thanks for your response. I have several Solr cores on the same Solr instance. The particular core with slow retrieve response has 6 gb data. Sorry for the confusion.I restart Solr and ran same query with rows=0 vs 1, QTime for both are OK, so I guess it is the retrieving slow? I

Re: Help with slow retrieving data

2019-03-25 Thread Wendy2
Hi Eric, Thank you very much for your response! "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs." I tried use docValues and reduced about 3 seconds. Now I am going to "try 2> if that doesn’t make much of a difference, try adding useDocValuesAsStored

Re: Help with slow retrieving data

2019-03-25 Thread Wendy2
Hi Eric, Thank you very much for your response! I tried "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs. " I tried the above approach as you recommended, the performance was getting better, reduced about 3 seconds. Then I tested on a new cloud server

Can Solr facet on a particular element in a list

2019-03-26 Thread Wendy2
Hi Solr Users, Can Solr facet on a particular element in a list? For example, I have a list with 4 elements as below. Is it possible to facet on the individual element? facet on rcsb_enzyme_lineage.name(0), rcsb_enzyme_lineage.name(1), etc?? Thanks! "rcsb_enzyme_lineage.name":["NAD(+)

Re: Can Solr facet on a particular element in a list

2019-03-26 Thread Wendy2
Hi Erick, Thank you very much for your response! OK, I understand what you mean and will flaten the list into multiple fields. Thanks! -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with slow retrieving data

2019-03-26 Thread Wendy2
Hi Eric, Thank you for your response! On the old system, I changed to use docValues=true, and had better performance. But the searcher was not warmed before I measured it. Also the local disk was too small so I used an attached volume which turned out was a big cause of the slow retrieve. On

Re: where to see deleted document in Solr log

2019-06-05 Thread Wendy2
Hi Shawn, I see. Thank you so much for your reply! Best! -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

where to see deleted document in Solr log

2019-06-03 Thread Wendy2
Hi, I am using Solr 7.3.1 to index data via DIH. Solr admin panel indicated that 152160 documents got indexed, while 3944 documents were deleted. But DIH indicated that added/update: 662059 documents. Deleted 0 documents. I try to find the deleted documents, but I don't see anywhere in the solr

Re: strange behavior

2019-06-06 Thread Wendy2
Hi Shawn, I see. I added () and it works now. Thank you very much for your help! q=audit_author.name:(Burley,%20S.K.)%20AND%20entity.type:polymer=1 -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: strange behavior

2019-06-06 Thread Wendy2
Hi David, I see. It fixed now by adding the (). Thank you so much! q=audit_author.name:(Burley,%20S.K.)%20AND%20entity.type:polymer -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

strange behavior

2019-06-06 Thread Wendy2
Hi, Why "AND" didn't work anymore? I use Solr 7.3.1 and edismax parser. Could someone explain to me why the following query doesn't work any more? What could be the cause? Thanks! q=audit_author.name:Burley,%20S.K.%20AND%20entity.type:polymer It worked previously but now returned very

Indexing MongoDB via DIH

2019-06-16 Thread Wendy2
Hi, I need to index several large collection of mongoDB with filters via DIH. Ruled out vis mongo-connector. Any recommendations? Thanks! -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

indexing MongoDB using DIH

2019-06-17 Thread Wendy2
Hi, Has any one tried with the following project to index MongoDB via DIH? I tried to use it. But could not add a filter in the find() method. Any suggestions? Thanks! https://github.com/james75/SolrMongoImporter -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

how to check Solr correction path?

2019-06-19 Thread Wendy2
Hi, How to check Solr correction path? I created a several collections in Solr 7.3.1. and use DIH to index mongoDB. How can I get the path for the current Solr correction where DIH is running? Thanks! -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Why did Solr stats min/max values were returned as float number for field of type="pint"?

2019-05-02 Thread Wendy2
Hi Solr users, I have a pint field: But Solr stats min/max values were returned as float numbers ( "min":0.0, "max":1356.0) . I thought "pint" type fields should return min/max as int. Is there something that user can do to make sure it returns as int type (which matches the field

Re: Why did Solr stats min/max values were returned as float number for field of type="pint"?

2019-05-03 Thread Wendy2
Hi Joel, Thanks for your response. Regarding your response "This syntax is bringing back correct data types", I have a pint field, the stats returned the following min/max values. "min":0.0, "max":1356.0, But I was expecting min/max values like below. Is it possible?Thanks! "min":0