Re: solr 7.3 Combining Replica Types in a Cluster

2018-04-26 Thread Erick Erickson
"I just want to utilize my servers maximum for select query . Also i have approximately thousand of concurrent update/delete request to cluster and ten thousand of concurrent select request ." And remember, if you have, say, 100 shards and a thousand updates per second, that's only 10

Re: Search Analytics Help

2018-04-26 Thread Doug Turnbull
Honestly I haven’t seen anything satisfactory (yet). It’s a huge need in the open source community On Thu, Apr 26, 2018 at 3:38 PM Ennio Bozzetti wrote: > Hello, > > I'm setting up SOLR on an internal website for my company and I would like > to know if anyone can

RE: Search Analytics Help

2018-04-26 Thread Hanjan, Harinder
This seems promising https://github.com/lucidworks/banana -Original Message- From: Ennio Bozzetti [mailto:ebozze...@thorlabs.com] Sent: Thursday, April 26, 2018 1:39 PM To: solr-user@lucene.apache.org Subject: [EXT] Search Analytics Help Hello, I'm setting up SOLR on an internal

Search Analytics Help

2018-04-26 Thread Ennio Bozzetti
Hello, I'm setting up SOLR on an internal website for my company and I would like to know if anyone can recommend an analytics that I can see what the users are searching for? Does the log in SOLR give me that information? Thank you, Ennio Bozzetti

Re: solr 7.3 Combining Replica Types in a Cluster

2018-04-26 Thread kumar gaurav
Hi Erick Pleased to see your reply . I just want to utilize my servers maximum for select query . Also i have approximately thousand of concurrent update/delete request to cluster and ten thousand of concurrent select request . So Is it the right way to let segment merging in all replicas in

Re: ClassCastException: o.a.l.d.Field cannot be cast to o.a.l.d.StoredField

2018-04-26 Thread David Smiley
> but how would a DocumentTransformer affect UpdateLog replay? Oh right; nevermind that silly theory ;-) On Thu, Apr 26, 2018 at 10:42 AM Markus Jelsma wrote: > Hello David, > > Yes it was sporadic indeed, but how would a DocumentTransformer affect > UpdateLog

Re: Cannot Find My New Solr Configset (Solr Cloud 7.3.0)

2018-04-26 Thread Shawn Heisey
On 4/26/2018 11:02 AM, THADC wrote: ok, I am creating myConfigset from the _default configset. So, I am copying ALL the files under _default/conf to myConfigset/conf. I am only modifying the schema.xml, and then I will re-upload to ZP. Question: Do I need to modify any of the other copied

Re: docValue vs. analyzer

2018-04-26 Thread Uwe Reh
Hi Erick, Thank your for the hint about SortableTextField. This seems to be really the type I was looking for. UpdateProcesors could be a workaround, but I don't like them. For me they are neither fish nor fowl. (neither internal nor external) Uwe Am 19.04.2018 um 18:38 schrieb Erick

Re: Cannot Find My New Solr Configset (Solr Cloud 7.3.0)

2018-04-26 Thread THADC
ok, I am creating myConfigset from the _default configset. So, I am copying ALL the files under _default/conf to myConfigset/conf. I am only modifying the schema.xml, and then I will re-upload to ZP. Question: Do I need to modify any of the other copied files in the conf dir (e.g,

wired behavior of own tokenizer

2018-04-26 Thread Uwe Reh
Hi I'm trying to write a own tokenizer for Solr7. Doing this, everything seems to be fine: - the tokenizer compiles - the tokanizer is instanced fine by it's factory - the tokenizer seems to do his work, when tested with the gui. "../solr/#/collection/analysis" BUT - the expected result

Re: ExternalFileField management strategy with SolrCloud

2018-04-26 Thread Walter Underwood
We put a cron job on each host. That fetches the file from Amazon S3, then puts it in the data directories matching the collection name. The file will be loaded on the next commit, as far as I can tell. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) >

ExternalFileField management strategy with SolrCloud

2018-04-26 Thread Tom Peters
Is there a recommended way of managing external files with SolrCloud. At first glance it appears that I would need to manually manage the placement of the external_.txt file in each shard's data directory. Is there a better way of managing this (Solr API, interface, etc?) This message and any

7.3 appears to leak

2018-04-26 Thread Markus Jelsma
Hello, We just finished upgrading our three separate clusters from 7.2.1 to 7.3, which went fine, except for our main text search collection, it appears to leak memory on commit! After initial upgrade we saw the cluster slowly starting to run out of memory within about an hour and a half. We

Re: Cannot Find My New Solr Configset (Solr Cloud 7.3.0)

2018-04-26 Thread Shawn Heisey
On 4/26/2018 10:30 AM, THADC wrote: Shawn, thanks for the reply. The issue is that I need to modify the schema.xml file to add my customizations. Are you saying I cannot manually access the config set to modify the schema file? If not, how do I modify it? Make the change in a copy of the

Re: Cannot Find My New Solr Configset (Solr Cloud 7.3.0)

2018-04-26 Thread THADC
Shawn, thanks for the reply. The issue is that I need to modify the schema.xml file to add my customizations. Are you saying I cannot manually access the config set to modify the schema file? If not, how do I modify it? Thanks, Tim -- Sent from:

Re: Cannot Find My New Solr Configset (Solr Cloud 7.3.0)

2018-04-26 Thread Shawn Heisey
On 4/26/2018 10:16 AM, THADC wrote: I am pretty certain I created it because when I execute the request to list all configsets: http://localhost:8983/solr/admin/configs?action=LIST , I see my configset in the response: { "responseHeader":{ "status":0, "QTime":1}, "configSets":["_default",

Cannot Find My New Solr Configset (Solr Cloud 7.3.0)

2018-04-26 Thread THADC
Hello, I am migrating from solr 4.7 to solr cloud 7.3.0. I am trying to create a new custom configset set based on a default (_default) that came with the installation. I followed the instructions and used the following call:

Re: solr 7.3 Combining Replica Types in a Cluster

2018-04-26 Thread Erick Erickson
First I'd ask if you want anything except NRT types. Do you have any proof that this won't work? Here's the problem. Both TLOG and PULL replicas will lag behind the master. The polling is pretty quick IIRC, but there'll still be a lag. Plus that'll copy your indexes around as time passes, perhaps

solr-user-subscribe

2018-04-26 Thread Timothy Clotworthy
solr-user-subscribe

solr-user-subscribe

2018-04-26 Thread Timothy Clotworthy

AW: System collection - lazy loading mechanism not working for custom UpdateProcessors?

2018-04-26 Thread Johannes Brucher
Ty Shawn, I’m trying to use JustPaste.it to share my screenshots… Hi all, maybe I have found a more accurate example constellation to reproduce the error. By default the .system-collection is created with 1 shard and 1 replica if you using just one node. In this constellation, everything

Re: CDCR Bootstrap

2018-04-26 Thread Susheel Kumar
Thanks, Tom. Is that correct that i have to execute this for each shard? On Thu, Apr 26, 2018 at 10:19 AM, Tom Peters wrote: > I'm not sure under what conditions it will be automatically triggered, but > if you manually wanted to trigger a CDCR Bootstrap you need to issue

RE: ClassCastException: o.a.l.d.Field cannot be cast to o.a.l.d.StoredField

2018-04-26 Thread Markus Jelsma
Hello David, Yes it was sporadic indeed, but how would a DocumentTransformer affect UpdateLog replay? We removed the cast, no idea how it got there. Thanks, Markus -Original message- > From:David Smiley > Sent: Thursday 26th April 2018 16:31 > To:

Re: Highlighter throwing InvalidTokenOffsetsException for field with large number of synonyms

2018-04-26 Thread David Smiley
Yay! I'm glad the UnifiedHighlighter is serving you well. I was about to suggest it. If you think the fragmentation/snippeting could be improved in a general way then post a JIRA for consideration. Note: identical results with the original Highlighter is a non-goal. On Mon, Apr 23, 2018 at

Re: ClassCastException: o.a.l.d.Field cannot be cast to o.a.l.d.StoredField

2018-04-26 Thread David Smiley
I'm not sure but I wonder why you would want to cast it in the first place. Field is the base class; all it's subclasses are in one way or another utilities/conveniences. In other words, if you ever see code casting Field to some subclass, there's a good chance it's fundamentally wrong or making

Re: CDCR Bootstrap

2018-04-26 Thread Tom Peters
I'm not sure under what conditions it will be automatically triggered, but if you manually wanted to trigger a CDCR Bootstrap you need to issue the following query to the leader in your target data center. /solr//cdcr?action=BOOTSTRAP= The masterUrl will look something like (change the

Re: CDCR Bootstrap

2018-04-26 Thread Susheel Kumar
Anybody has idea how to trigger Solr CDCR BOOTSTRAP or under what condition it gets triggered ? Thanks, Susheel On Tue, Apr 24, 2018 at 12:34 PM, Susheel Kumar wrote: > Hello, > > I am wondering under what different conditions does that CDCR bootstrap > process gets

Re: AW: System collection - lazy loading mechanism not working for custom UpdateProcessors?

2018-04-26 Thread Shawn Heisey
On 4/26/2018 7:31 AM, Johannes Brucher wrote: Maybe I have found a more accurate example constellation to reproduce the error. By default the .system-collection is created with 1 shard and 1 replica. None of your screenshots have made it to the list. Attachments are almost always

AW: System collection - lazy loading mechanism not working for custom UpdateProcessors?

2018-04-26 Thread Johannes Brucher
Maybe I have found a more accurate example constellation to reproduce the error. By default the .system-collection is created with 1 shard and 1 replica. In this constellation, everything works as expected and no matter how often I try to restart the Solr Cloud, the error "SolrException: Blob

Storing multiple dates for a doc, filter on a date range and get count of matches within date range

2018-04-26 Thread Sebastian Riemer
Consider this situation, I've got documents, for which I'll have to store multiple dates, those could be access dates for example, or maybe "downloaded at"-dates or something similar. So, a document might look like this: {id:"1", name:"apache-solr-ref-guide-7.3.pdf",

RE: SolrCloud DIH (Data Import Handler) MySQL 404

2018-04-26 Thread msaunier
I have add debug and I have this error: null:java.lang.NullPointerException at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:429) at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:483) at

RE: SolrCloud DIH (Data Import Handler) MySQL 404

2018-04-26 Thread msaunier
Hello, Where I add that? In the Solr start command? I have add -verbose:class in the /etc/default/solr.in.sh file but they logs are they sames. Thanks, -Message d'origine- De : Mikhail Khludnev [mailto:m...@apache.org] Envoyé : mercredi 25 avril 2018 15:40 À : solr-user

Re: Preventing solr cache flush when committing

2018-04-26 Thread Mikhail Khludnev
Hello, Dmitri. You can try to use segmented caches which are more realtime. it should work like q={!parent which=COLOR:Blue v=''} instead of q= COLOR:Blue Make sure you have the following definition in solrconfig.xml this regenerator should transfer filter bitsets between searchers.

solr 7.3 Combining Replica Types in a Cluster

2018-04-26 Thread kumar gaurav
Hi I am setting up new cluster in solr cloud 7.3 . i am just confused to make a combination of replica types . Real time indexing update/delete request will coming in cluster continuously but very less than select query . Cluster will need to handle high concurrent select queries than update. I