Re: Solr 7.2.1 OOME

2019-11-06 Thread Paras Lehana
Hi Antony, Each replica runs on a 10G heap. Is the min and max heap size same 10G? If full GCs are taking time, have you tried decreasing the heap to say 4-6GB? Nice article by Shawn. Also, your

Re: [Q] Ref Guide - What is Multi-Term Expansion?

2019-11-06 Thread Paras Lehana
Thank you so much, Erick and Alex! Strange how I could not understand it when wildcard were the first things we used in queries when I migrated Auto-Suggest to Solr. I remember how much we faced Stemming not working on partial user queries (servicin* not matching with services). We started using

Re: Ref Guide - Precision & Recall of Analyzers

2019-11-06 Thread Paras Lehana
Hey Mikhail, My doubt was regarding doing this on the query side. I think the text probably meant adding the filter on index side then. If willing to do this on the index side, as you suggested, we can capture all-caps by a regex like ^[A-Z]*$. But how do we proceed? Here is what I can think of:

Query regarding truncated Date Sort

2019-11-06 Thread Inderjeet Singh
Hi I am currently using solr 7.1.0. I have indexed a few documents which have a date associated with it. The Managed schema configuration for that field is : Example of few values are : "Published_Date":"2019-10-25T00:00:00Z" "Published_Date":"2019-10-21T10:00:00Z"

Re: When search term has two stopwords ('and' and 'a') together, it doesn't work

2019-11-06 Thread Paras Lehana
Hi Guilherme. I am sending they analysis result and the json result as requested. Thanks for the effort. Luckily, I can see your attachments (low quality though). >From the analysis screen, the analysis is working as expected. One of the reasons for query="lymphoid and *a* non-lymphoid cell"

Re: Good Open Source Front End for Solr

2019-11-06 Thread Alexandre Rafalovitch
For what purpose? Because, for example, Solr is not designed to serve direct to the browser, just like Mysql is not. So, usually, there is a custom middleware. On the other hand, Solr can serve as JDBC engine so you could use JDBC frontends to explore data. Or as an engine for visualisations.

subscribe - renew

2019-11-06 Thread Antony Alphonse

Good Open Source Front End for Solr

2019-11-06 Thread Java Developer
Hi, What is the best open source front-end for Solr Thanks

Solr 7.2.1 OOME

2019-11-06 Thread Antony Alphonse
Hi, I am trying to get some help on frequent OOME I am seeing in my collection. I have a single shard with four replicas. Each replica runs on a 10G heap. I have around 12 mil documents with size on disk around 15G. From the plot below, it looks to me that full GC are taking longer time. I am

Solr healthcheck fails all the time

2019-11-06 Thread amruth
I am running Solr Cloud 6.6 and all the nodes fail healthcheck too frequently with *Read Timed out * error. Here is the stacktrace, http://solr-host1:8983/solr/collection1/admin/ping is DOWN, error: HTTPConnectionPool(host='solr-host1', port=8983): Read timed out. (read timeout=1). Connection

Re: Error with Solr Suggester using lookupIml = FreeTextLookupFactory

2019-11-06 Thread Erick Erickson
This setting is pretty dangerous. It’ll build the suggester every time the Solr instance starts. The DocumentDictionaryFactory will read _every_ document in your index to extract the stored “suggest” field and create the dictionary. But this points to the fact that you hadn’t built the

Re: Error with Solr Suggester using lookupIml = FreeTextLookupFactory

2019-11-06 Thread Tyrone Tse
It's working now that I changed the solrconfig.xml to mySuggester FreeTextLookupFactory DocumentDictionaryFactory suggest 3 text_en_splitting *true* On Wed, Nov 6, 2019

Re: Solr 8.3 Solrj streaming expressions do not return all field values

2019-11-06 Thread Jörn Franke
I created a JIRA for this: https://issues.apache.org/jira/browse/SOLR-13894 On Wed, Nov 6, 2019 at 10:45 AM Jörn Franke wrote: > I have checked now Solr 8.3 server in admin UI. Same issue. > > Reproduction: > select(search(testcollection,q=“test”,df=“Default”,defType=“edismax”,fl=“id”, >

Re: Error with Solr Suggester using lookupIml = FreeTextLookupFactory

2019-11-06 Thread Tyrone Tse
What's the command to build it On Wed, Nov 6, 2019 at 3:06 PM Mikhail Khludnev wrote: > Hello, > > Have you build suggester before requesting? > > On Wed, Nov 6, 2019 at 12:50 PM Tyrone Tse wrote: > > > Solr version 8.1.1 > > > > My schema > > > > > multiValued="false" indexed="true"/> > >

Re: Error with Solr Suggester using lookupIml = FreeTextLookupFactory

2019-11-06 Thread Mikhail Khludnev
Hello, Have you build suggester before requesting? On Wed, Nov 6, 2019 at 12:50 PM Tyrone Tse wrote: > Solr version 8.1.1 > > My schema > > multiValued="false" indexed="true"/> > > > solconfig.xml > > > > mySuggester > FreeTextLookupFactory >

Error with Solr Suggester using lookupIml = FreeTextLookupFactory

2019-11-06 Thread Tyrone Tse
Solr version 8.1.1 My schema solconfig.xml mySuggester FreeTextLookupFactory DocumentDictionaryFactory suggest 3 text_en_splitting false

Re: Need some help on solr versions (LTS vs stable)

2019-11-06 Thread Erick Erickson
Pretty much correct. The only change I’d make is that 7x is not actively being supported in the sense that only seriously critical bugs will be addressed. You’ll note that the last release of 7x was 7.7.2 in early June. Increased functionality, speedups, etc won’t be back-ported. So I can’t

Re: Need some help on solr versions (LTS vs stable)

2019-11-06 Thread suyog joshi
Hi Erick, Thank you so much for sharing detailed information, indeed its really helpful for us to plan out the things. Really appreciate your guidance. So we can say its better to go with latest stable version (8.x) instead of 7.x, which is LTS right now, but can soon become EOL post launching

Filtering point fields filters everything.

2019-11-06 Thread Webster Homer
My company has been using solr for searching our product catalog. We migrated the data from Solr 6.6 to Solr 7.2. I am investigating the changes needed to migrate to Solr 8.*. Our current schema has a number of fields using the trie data types which are deprecated in 7 and gone in 8. I went

Re: ConcurrentModificationException in SolrInputDocument writeMap

2019-11-06 Thread Mikhail Khludnev
Hello, Tim. Please confirm my understanding. Does exception happens in standalone Java ingesting app? If, it's so, Does it reuse either SolrInputDocument instances of fields/values collections between update calls? On Wed, Nov 6, 2019 at 8:00 AM Tim Swetland wrote: > Nevermind my comment on not

Re: ConcurrentModificationException in SolrInputDocument writeMap

2019-11-06 Thread Tim Swetland
Nevermind my comment on not having this problem in 8.1. We do have it there as well, I just didn't look far enough back in our logs on my initial search. Would still appreciate whatever thoughts anyone might have on the exception. On Wed, Nov 6, 2019 at 10:17 AM Tim Swetland wrote: > I'm

Re: When search term has two stopwords ('and' and 'a') together, it doesn't work

2019-11-06 Thread Erick Erickson
I don’t see the attachments, maybe I deleted old e-mails or some such. The Apache server is fairly aggressive about stripping attachments though, so it’s also possible they didn’t make it through. > On Nov 6, 2019, at 9:28 AM, Guilherme Viteri wrote: > > Thanks Erick. > >> First, your index

Re: Leader node on specific host machines?

2019-11-06 Thread Koen De Groote
Hello Erick, Sorry for the late reply. I worked with this setting a bit and it works as expected. Indeed, I was not aware of the leader/follower task distribution and what you say shines a different light on things. Regardless, I now know about this property and can use it effectively, which I

ConcurrentModificationException in SolrInputDocument writeMap

2019-11-06 Thread Tim Swetland
I'm currently running into a ConcurrentModificationException ingesting data as we attempt to upgrade from Solr 8.1 to 8.2. It's not every document, but it definitely appears regularly in our logs. We didn't run into this problem in 8.1, so I'm not sure what might have changed. I feel like this is

Re: Ref Guide - Precision & Recall of Analyzers

2019-11-06 Thread Mikhail Khludnev
Hello, Audrey. Can you create a regexp capturing all-caps for https://lucene.apache.org/solr/guide/8_3/filter-descriptions.html#pattern-replace-filter ? On Wed, Nov 6, 2019 at 6:36 AM Audrey Lorberfeld - audrey.lorberf...@ibm.com wrote: > I would also love to know what filter to use to ignore

Re: Ref Guide - Precision & Recall of Analyzers

2019-11-06 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
I would also love to know what filter to use to ignore capitalized acronyms... which one can do this OOTB? -- Audrey Lorberfeld Data Scientist, w3 Search IBM audrey.lorberf...@ibm.com On 11/6/19, 3:54 AM, "Paras Lehana" wrote: Hi Community, In Ref Guide 8.3's *Understanding

Re: When search term has two stopwords ('and' and 'a') together, it doesn't work

2019-11-06 Thread Guilherme Viteri
Thanks Erick. > First, your index and analysis chains are considerably different, this can > easily be a source of problems. In particular, using two different tokenizers > is a huge red flag. I _strongly_ recommend against this unless you’re totally > sure you understand the consequences.

Re: When search term has two stopwords ('and' and 'a') together, it doesn't work

2019-11-06 Thread Erick Erickson
First, your index and analysis chains are considerably different, this can easily be a source of problems. In particular, using two different tokenizers is a huge red flag. I _strongly_ recommend against this unless you’re totally sure you understand the consequences. Additionally, your use of

Re: Need some help on solr versions (LTS vs stable)

2019-11-06 Thread Erick Erickson
It’s variable. The policy is that we try very hard to maintain one major version back-compat. So generally, if you start with, say, 7x upgrading to 8x should be relatively straightforward. However, you will _not_ be able to upgrade from 7x to 9x, you must re-index everything from scratch. The

Re: Solr 8.3 admin ui collection selector disabled

2019-11-06 Thread Erick Erickson
Whew! I often work in a private window to lessen these kinds of “surprises”….. > On Nov 6, 2019, at 4:35 AM, Jörn Franke wrote: > > Never mind. Restart of browser worked. > >> Am 06.11.2019 um 10:32 schrieb Jörn Franke : >> >> Hi, >> >> After upgrading to Solr 8.3 I observe that in the

Re: Questions about corrupted Segments files.

2019-11-06 Thread Dmitry Kan
Hi Kaya, Try luke: http://dmitrykan.blogspot.com/2018/01/new-luke-on-javafx.html Best, Dmitry On Wed 6. Nov 2019 at 3.24, Kayak28 wrote: > Hello, Community members: > > I am using Solr 7.7.2. > On the other day, while indexing to the Solr, my computer powered off. > As a result, there are

Re: [Q] Ref Guide - What is Multi-Term Expansion?

2019-11-06 Thread Erick Erickson
Say you want to search for “run*”. That should match “run”, “runner”, “running”, “runs” etc. one term->many == multiterm expansion. Conceptually, the search becomes (run OR runner OR running OR runs), all terms actually found in the index that have the prefix “run”. My advice would be to

Re: [Q] Ref Guide - What is Multi-Term Expansion?

2019-11-06 Thread Alexandre Rafalovitch
It mentions it in the start paragraph "Prefix, Wildcard, Regex, etc." So, if you search for "abc*" it expands to all terms that start from "abc", but then not everything can handle this situation as it is a lot of terms in the same position. So, not all analyzers can handle that and normally it

[Contribute] Merge Tokenizers/Filters About and Description Sections

2019-11-06 Thread Paras Lehana
Hi Community, In Ref Guide 8.3's *Understanding Analyzers, Tokenizers, and Filters Section* , I see that after giving general information about Analyzers, there are subsections in order "*About

[Q] Ref Guide - What is Multi-Term Expansion?

2019-11-06 Thread Paras Lehana
Hi Community, In Ref Guide 8.3's Understanding Analyzers subsection *Analysis for Multi-Term Expansion* , the text talks about multi-term expansion and explicit use of *analyzer type="multiterm"*. I could

Re: Solr 8.3 Solrj streaming expressions do not return all field values

2019-11-06 Thread Jörn Franke
I have checked now Solr 8.3 server in admin UI. Same issue. Reproduction: select(search(testcollection,q=“test”,df=“Default”,defType=“edismax”,fl=“id”, qt=“/export”, sort=“id asc”),id,if(eq(1,1),Y,N) as found) In 8.3 it returns only the id field. In 8.2 it returns id,found field. Since found

Re: Solr 8.3 admin ui collection selector disabled

2019-11-06 Thread Jörn Franke
Never mind. Restart of browser worked. > Am 06.11.2019 um 10:32 schrieb Jörn Franke : > > Hi, > > After upgrading to Solr 8.3 I observe that in the Admin UI the collection > selector is greyed out. I am using Chrome. The core selector works as > expected. > > Any idea why this is happening?

Solr 8.3 admin ui collection selector disabled

2019-11-06 Thread Jörn Franke
Hi, After upgrading to Solr 8.3 I observe that in the Admin UI the collection selector is greyed out. I am using Chrome. The core selector works as expected. Any idea why this is happening? Thank you. Best regards

Ref Guide - Precision & Recall of Analyzers

2019-11-06 Thread Paras Lehana
Hi Community, In Ref Guide 8.3's *Understanding Analyzers, Tokenizers, and Filters* section, the text talks about precision and recall depending on how you use analyzers during query and index time: