Re: Negation search help

2021-04-29 Thread amitesh116
During this change I had to change the way I store indexes. This change results in too many .cfs and .fdt files generated against earlier. Previously there were 5-7 files in index folder, now it has grown to 40+. Does it affect having change in the way how indexes are stored internally with this ch

Re: Negation search help

2021-04-29 Thread amitesh116
//Method to create document private static Document createDocumentTextField(HashMap fields) { Document document = new Document(); for (String key : fields.keySet()) { String val = fields.get(key); Field f = new TextField(key, val, Field.Store.YES);

Re: Negation search help

2021-04-29 Thread Michael Wechner
Yes, it would be great if you could share code snippets. Maybe it will help others or maybe someone will have a suggestion to improve or an alternative. All the best Michael Am 29.04.21 um 14:35 schrieb amitesh116: Thank you Michael! I solved this requirement by setting the tokenStream at t

Re: Negation search help

2021-04-29 Thread amitesh116
Thank you Michael! I solved this requirement by setting the tokenStream at the field level and not leaving it to the analyzer. This gives control over altering the full text before tokenization using custom methods. This has memory overhead which is handled by writing the documents one at a time

Re: Negation search help

2021-04-28 Thread Michael Wechner
Hi Amitesh Thanks for the more concrete examples. Unfortunately I do not know how to solve this better with Lucene itself in a more general context, but did you ever consider using BERT in combination with Lucene/Solr https://blog.google/products/search/search-language-understanding-bert/ ht

Re: Negation search help

2021-04-28 Thread amitesh116
Hi Gus, Thank you your reply! In my search system; users are complaining that they get results with negation terms when don't expect. As explained in my original post. User don't want to get documents having a term like "Non Vitamin K" when they search for "Vitamin K". But because each terms ar

Re: Negation search help

2021-04-28 Thread Gus Heck
Besides the possible statistical significance of your phrasing there are a number of other things you can do to improve your chances of getting good answers: http://www.catb.org/~esr/faqs/smart-questions.html On Wed, Apr 28, 2021 at 3:53 PM Michael Wechner wrote: > Hi Amitesh > > I don't have s

Re: Negation search help

2021-04-28 Thread Michael Wechner
Hi Amitesh I don't have statistical proof , but I think it doesn't help on mailing lists with volunteeers to write "I badly need some help", because it seems to me the contrary will happen, that people will not help at all. I think there are various reasons for this behaviour, which is inter

Re: Negation search help

2021-04-28 Thread amitesh116
I badly need some help on this one. Someone please give some direction. Regards Amitesh -- Sent from: https://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html - To unsubscribe, e-mail: java-user-unsubscr...@lucene.a