Re: Suppress stack trace in error response

2019-02-21 Thread Zheng Lin Edwin Yeo
Hi, There's too little information provided in your questions. You can explain more on the issue or the exception that you are facing. Regards, Edwin On Thu, 21 Feb 2019 at 23:45, Branham, Jeremy (Experis) wrote: > When Solr throws an exception, like when a client sends a badly formed > query

Re: Full index replication upon service restart

2019-02-21 Thread Erick Erickson
There really is no such thing as the replica falling “too far behind”. The process is > leader gets an update > leader indexes locally and forwards the documents to the follower > follower acks back that it’s received the raw docs and is indexing them > the leader acks back to the client that the

Re: dynamic field issue

2019-02-21 Thread Erick Erickson
Dynamic fields are exactly the same as statically defined fields at the Lucene level, so this is exactly equivalent to “would defining N fields statically increase heap”. IOW, no more than defining that many fields manually. Best, Erick > On Feb 21, 2019, at 8:40 AM, Midas A wrote: > > Here

Re: Solr Cell, Tika and UpdateProcessorChains

2019-02-21 Thread Erick Erickson
Several things: 1> Please don’t use add-unknown…. It’s fine for prototyping, but guesses field definitions. 2> the solrocnfig appears to be malformed, I’m surprised it fires up at all. This never terminates for instance:

Solr Cell, Tika and UpdateProcessorChains

2019-02-21 Thread Demian Katz
I'm posting this question on behalf of Whitney Clarke, who is a pending member of this list but is not able to post on her own yet. I've been working with her on some troubleshooting, but I'm not familiar with the components she's using and thought somebody here might be able to point her in

Re: dynamic field issue

2019-02-21 Thread Midas A
Here we are indexing dynamic fields and we are using one of this field in* bf *. Would only indexing dynamic field will increase heap and load of master - slave solr servers ? Regards, Midas On Thu, Feb 21, 2019 at 10:03 PM Erick Erickson wrote: > 300 is still not excessive. As far as memory

Re: Full index replication upon service restart

2019-02-21 Thread Rahul Goswami
Eric, Thanks for the insight. We are looking at tuning the architecture. We are also stopping the indexing application before we bring down the Solr nodes for maintenance. However when both nodes are up, and one replica is falling behind too much we want to throttle the requests. Is there an API

RE: TLOG replica, updateHandler errors in metrics, no logs

2019-02-21 Thread Markus Jelsma
Hello Erick, I just delete a replica and add again, but with type=tlog. Yes, it is reproducibly both locally and in production, and with various collections. For each document added, the metric increments as well. I'll open a ticket! Thanks! Markus

Re: dynamic field issue

2019-02-21 Thread Erick Erickson
300 is still not excessive. As far as memory goes, sure. If you’re faceting, grouping, or sorting docValues would _certainly_ help with memory consumption. > On Feb 21, 2019, at 8:31 AM, Midas A wrote: > > Hi , > Plelase help me here we have crossed 100+ fields per dyanmic fields and we > have

Re: Newbie question - Error loading an existing config file

2019-02-21 Thread Erick Erickson
I have absolutely no idea when it comes to Drupal, the Drupal folks would be much better equipped to answer. Best, Erick > On Feb 21, 2019, at 8:16 AM, Greg Robinson wrote: > > Thanks for the feedback. > > So here is where I'm at. > > I first went ahead and deleted the existing core that was

Re: dynamic field issue

2019-02-21 Thread Midas A
Hi , Plelase help me here we have crossed 100+ fields per dyanmic fields and we have three dynamic fields. using docValues in dynamic fields will help in improving heap and query time ? Regards, Abhishek Tiwari On Thu, Feb 21, 2019 at 9:38 PM Midas A wrote: > Yes . We have crossed 100 fields

Re: Newbie question - Error loading an existing config file

2019-02-21 Thread Greg Robinson
Thanks for the feedback. So here is where I'm at. I first went ahead and deleted the existing core that was returning the error using the following command: bin/solr delete -c new_solr_core Now when I access the admin panel, there are no errors. I then referred to the large "warning" box on

Re: dynamic field issue

2019-02-21 Thread Midas A
Yes . We have crossed 100 fields . Would docValues help here ? What kind of information you want from my side ? On Thu, 21 Feb 2019, 9:31 pm Erick Erickson, wrote: > There’s no way to answer this given you’ve provided almost no > information. > > Do note that once you get to more than a few

Re: TLOG replica, updateHandler errors in metrics, no logs

2019-02-21 Thread Erick Erickson
How are you “moving”? There’s no provision that I know of to _change_ an existing replica. But no, if you’re starting with replicas created as TLOG then I haven’t heard of this. If the documents are getting indexed and replicated properly then it sounds like a bogus counter is being

Re: dynamic field issue

2019-02-21 Thread Erick Erickson
There’s no way to answer this given you’ve provided almost no information. Do note that once you get to more than a few hundred fields, Solr still functions, but I’ve seen performance degrade and memory increase. Best, Erick > On Feb 21, 2019, at 7:54 AM, Midas A wrote: > > Thanks for quick

Re: dynamic field issue

2019-02-21 Thread Midas A
Thanks for quick reply . we are creating search *query(keyword)* for dynamic field creation to use click ,cart and order data in search. But we are experiencing more heap and increase in query time . What could be the problem? can be anything related to it ? On Thu, Feb 21, 2019 at 8:43

Suppress stack trace in error response

2019-02-21 Thread Branham, Jeremy (Experis)
When Solr throws an exception, like when a client sends a badly formed query string, is there a way to suppress the stack trace in the error response? Jeremy Branham jb...@allstate.com Allstate Insurance Company | UCV Technology Services | Information Services Group

Re: Solr CDRC updating data in target and not in source

2019-02-21 Thread Susheel Kumar
Do you see CDCR forward messages in source solr logs and with some numbers? That will confirm if data indeed going thru source and forwarded to target. Also any auto/soft commit settings difference between source & target? On Wed, Feb 20, 2019 at 8:29 AM ypriverol wrote: > Hi: > > I'm using a

dynamic field issue

2019-02-21 Thread Midas A
Hi All, How many dynamic field we can create in solr ?. is there any limitation ? Is indexing dynamic field can increase heap memory on server . Regards, Midas

Re: dynamic field issue

2019-02-21 Thread Shawn Heisey
On 2/21/2019 8:01 AM, Midas A wrote: How many dynamic field we can create in solr ?. is there any limitation ? Is indexing dynamic field can increase heap memory on server . At the Lucene level, there is absolutely no difference between a standard field and a dynamic field. The difference in

Re: Trying to enable HTTP gzip compression

2019-02-21 Thread Walter Underwood
Years ago we did some testing with HTTP compression for search results with the Ultraseek search engine. It wasn’t faster. It was sometimes slower. Once you have enough RAM, search is a CPU-limited problem. HTTP compression uses more CPU to save network bandwidth. But search isn’t limited by

Re: Spring Boot Solr+ Kerberos+ Ambari

2019-02-21 Thread Furkan KAMACI
Hi, You can also check here: https://community.hortonworks.com/articles/15159/securing-solr-collections-with-ranger-kerberos.html On the other hand, we have a section for Solr Kerberos at documentation: https://lucene.apache.org/solr/guide/6_6/kerberos-authentication-plugin.html For any Ambari

Re: Querying on sum of child documents

2019-02-21 Thread flatmind
Hello Mikhail - Thanks for your help with the query and I was able to get the result. But when I am trying to add another condition to that, it is not showing any results, though there are matching records in the index. But when I execute those queries individually, I am getting the response.

Re: Trying to enable HTTP gzip compression

2019-02-21 Thread Jörn Franke
You could also change the responsewriter from json to javabin to improve performance. Or increase network bandwidth. Then often people fetch more from solr than they need. There is a huge saving potential. Increasing the cores for https encryption can sometimes help. Compression also leads to

Trying to enable HTTP gzip compression

2019-02-21 Thread Luthien Dulk
hi all, I was wondering if anyone could point me in the right direction. I am looking into whether enabling Gzip HTTP compression for our Solr clusters (all running Solr 6.6.5) would help performance; my problem is that I can’t figure out how to do that. Our infrastructure setup is like

Re: Spring Boot Solr+ Kerberos+ Ambari

2019-02-21 Thread Rushikesh Garadade
Hi Furkan, I think the link you provided is for ranger audit setting, please correct me if wrong? I use HDP 2.6.5. which has Solr 5.6 Thank you, Rushikesh Garadade On Thu, Feb 21, 2019, 2:57 PM Furkan KAMACI wrote: > Hi Rushikesh, > > Did you check here: > >

TLOG replica, updateHandler errors in metrics, no logs

2019-02-21 Thread Markus Jelsma
Hello, We are moving some replica's to TLOG, one collection runs 7.5, the others 7.7. When indexing, we see UPDATE.updateHandler.errors increment for each document being indexed, there is nothing in the logs. Is this a known issue? Thanks, Markus

Re: [lucene > nori ] special characters issue

2019-02-21 Thread Furkan KAMACI
Hi, Could you give some more information about your configuration? Also, check here for how to debug the reason: https://lucene.apache.org/solr/guide/7_6/analysis-screen.html Kind Regards, Furkan KAMACI On Tue, Feb 12, 2019 at 11:34 AM 유정인 wrote: > > Hi I'm using the "nori" analyzer. > >

Re: Spring Boot Solr+ Kerberos+ Ambari

2019-02-21 Thread Furkan KAMACI
Hi Rushikesh, Did you check here: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_security/content/solr_ranger_configure_solrcloud_kerberos.html By the way, which versions do you use? Kind Regards, Furkan KAMACI On Thu, Feb 21, 2019 at 11:41 AM Rushikesh Garadade <

Spring Boot Solr+ Kerberos+ Ambari

2019-02-21 Thread Rushikesh Garadade
Hi All, I am trying to set Kerberos for Solr which is installed on Hortonworks Ambari. Q1. Is Ranger a mandatory component for Solr Kerberos configuration on ambari.? I am getting little confused with documents available on internet for this. I tried to do without ranger but not getting any

Re: Upload Synonym to Solr Cloud

2019-02-21 Thread Jan Høydahl
Or use managed resource https://lucene.apache.org/solr/guide/6_6/managed-resources.html#ManagedResources-Synonyms Jan Høydahl > 21. feb. 2019 kl. 01:50 skrev Erick Erickson : > > bin/solr zk -help > particularly > bin/solr zk cp > >> On Feb 20, 2019, at 4:00 PM, Rathor, Piyush (US -