Re: Solr background merge in case of pull replicas

erying is not available not on > tlog at that moment. > You can check tlog logs and pull log when u are facing this issue. > > May i know which version of solr you are using? and what is the ration of > tlog and pull nodes. > > On Wed, 6 Jan 2021 at 2:46 PM, kshitij tyagi >

Solr background merge in case of pull replicas

Hi, I am having a tlog + pull replica solr cloud setup. 1. I am observing that whenever background segment merge is triggered automatically, i see high response time on all of my solr nodes. As far as I know merges must be happening on tlog and hence the increase response time, i am not able

Re: solrCloud client socketTimeout initiates retries

certain > wildcard patterns) you could intercept that before sending. > > Best, > Erick > > > On Dec 18, 2020, at 8:52 AM, kshitij tyagi > wrote: > > > > Hi Erick, > > > > I agree but in a huge cluster the retries keeps on happening, c

Re: solrCloud client socketTimeout initiates retries

> > Best, > Erick > > > On Dec 18, 2020, at 6:23 AM, kshitij tyagi > wrote: > > > > Hi, > > > > We have a Solrcloud setup and are using CloudSolrClient, What we are > seeing > > is if socketTimeoutOccurs then the same request is sent to other

solrCloud client socketTimeout initiates retries

Hi, We have a Solrcloud setup and are using CloudSolrClient, What we are seeing is if socketTimeoutOccurs then the same request is sent to other solr server. So if I set socketTimeout to a very low value say 100ms and my query takes around 200ms then client tries to query second server, then

Re: Solr Upgrade socketTimeout issue in 8.2

ust start from a fresh index with _no_ documents in it > when you upgrade more than one major version. Did you start over? > > Best, > Erick > > > On Feb 19, 2020, at 3:58 AM, kshitij tyagi > wrote: > > > > Hi, > > > > Any information on socket timeout i

Re: Solr Upgrade socketTimeout issue in 8.2

indexing of old > documents. I am badly stuck get get old document in migrated solr version. > > > > Should I do the re-indexing? If yes can you please share the way to > re-indexing? > > > > Can you please provide your inputs on this? > > > > Thank

Solr Upgrade socketTimeout issue in 8.2

Hi, We have upgraded our solrCloud from version 6.6.0 to 8.2.0 At the time of indexing intermittently we are observing socketTimeout exception when using Collection apis. example when we try reloading one of the collection using CloudSolrClient class. Is there any performance degradation in

Re: Upgrading solr to 8.2

Hi, Any suggestions from anyone? Regards, kshitij On Tue, Jan 14, 2020 at 4:11 PM Jan Høydahl wrote: > Please don’t cross-post, this discussion belongs in solr-user only. > > Jan > > > 14. jan. 2020 kl. 22:22 skrev kshitij tyagi >: > > > > Also trie fileds

Re: Upgrading solr to 8.2

Also trie fileds have been updated to point fields, will that by any chance degrade my response time by 50 percent? On Tue, Jan 14, 2020 at 1:37 PM kshitij tyagi wrote: > Hi Team, > > I am currently upgrading my system from solr 6.6 to solr 8.2 : > > 1. I am observing increa

Upgrading solr to 8.2

Hi Team, I am currently upgrading my system from solr 6.6 to solr 8.2 : 1. I am observing increased search time in my queries i.e. search response time is increasing along with cpu utilisation, although memory looks fine, on analysing heap dumps I figured out that queries are taking most of the

Re: Query on autoGeneratePhraseQueries

Hi, Try debugging your solr query and understand how it gets parsed. Try using "debug=true" for the same On Tue, Oct 15, 2019 at 12:58 PM Shubham Goswami wrote: > *Hi all,* > > I am a beginner to solr framework and I am trying to implement > *autoGeneratePhraseQueries* property in a fieldtype

Re: Solr Repeaters/Slaves replicating are every commit on Master instead of Optimize

Try changing commit to optimize Also, If it does not work, try removing the polling interval configuration from the slaves. What you are seeing is expected behaviour for solr and nothing is unusual. Try out the changes and I hope it should work fine. On Sun, Sep 1, 2019 at 7:52 AM Monil Parikh

Re: Solr edismax parser with multi-word synonyms

Hi sunil, 1. as you have added "microwave food" in synonym as a multiword synonym to "frozen dinner", edismax parsers finds your synonym in the file and is considering your query as a Phrase query. This is the reason you are seeing parsed query as +(((+title:microwave +title:food)

Re: Solr Sudden I/O spike

Hi, Can you checck and update if there is any indexing going on the core or a merge or an optimise triggered on the same. There might be an instance of high IO in case any bacckgroung merging triggers while serving query requests. Regards, kshitij On Fri, Jun 14, 2019 at 5:23 PM Sripra deep

Re: Sold Claud is missing in sole installation

Hi pradeep, You want your . architecture to be on cloud or master slave? Which script have you run from bin/solr to start the instance or share the command used for starting the instance. Regards, kshitij On Sat, Jun 23, 2018 at 3:05 PM, Pradeep Sharma wrote: > Hi, > > I have installed Solr

Re: In-place update vs Atomic updates

is not correct. Thanks, Kshitij On Mon, Jan 8, 2018 at 9:19 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 1/8/2018 4:05 AM, kshitij tyagi wrote: > >> What are the major differences between atomic and in-place updates, I have >> gone through the documentation but it does

In-place update vs Atomic updates

Hi, What are the major differences between atomic and in-place updates, I have gone through the documentation but it does not give detail internal information. 1. Does doing in-place update prevents solr cache burst or not, what are the benefits of using in-place updates? I want to update one

Re: max docs, deleted docs optimization

m/2013/08/23/understanding- > transaction-logs-softcommit-and-commit-in-sorlcloud/ > > See the third animation TieredMergePolicy which is the default here: > http://blog.mikemccandless.com/2011/02/visualizing- > lucenes-segment-merges.html > > Best, > Erick > > On Tue, Oct 31,

max docs, deleted docs optimization

Hi, I am using atomic update to update one of the fields, I want to know : 1. if total docs in core are 10 lakh and I partially update 2 lakhs docs then what will be the number of deleted docs? 2. Does higher number of deleted docs have affect on query time? means does query time increases if

Same queries taking more time

Hi, We are using master slave architecture, here are the observations: 1. Heap size and connections on slave are increasing and leading to more query time. 2. We are noticing on solr admin UI that segment count is huge and also no merging is taking place. 3. We have not made any changes and a

Help with facet.limit

Hi Team, I am using facet on particular field along with facet.limit=500, problem I am facing is: 1. As there are more than 500 facets and it is giving me 500 results, I want particular facets to be returned i.e can I specify to solr to return me 500 facets along with ones I require? eg facets

Re: Solr Index size keeps fluctuating, becomes ~4x normal size.

Hi Himanshu, maxWarmingSearchers would break nothing on production. Whenever you request solr to open a new searcher, it autowarms the searcher so that it can utilize caching. After autowarm is complete a new searcher is opened. The questions you need to adress here are 1. Are you using

Re: Issue with facet count

thanks Alex for taking out your valuable time and helping us to understand better. Cheers! Kshitij On Mon, Apr 10, 2017 at 4:00 PM, alessandro.benedetti wrote: > It really depends on the schema change... > Any addition/deletion usually implies you can avoid re-indexing if

Re: Issue with facet count

eld OR on type) with DocValues and another one without. > > Regards, >Alex. > > http://www.solr-start.com/ - Resources for Solr users, new and experienced > > > On 8 April 2017 at 18:42, kshitij tyagi <kshitij.shopcl...@gmail.com> > wrote: > > Hi Alex, > &

Re: Issue with facet count

pyField target. > Enabling debug would show you exactly what fields are being querying > with what (analyzed) token. > > http://www.solr-start.com/ - Resources for Solr users, new and experienced > > > On 8 April 2017 at 17:53, kshitij tyagi <kshitij.shopcl...@gma

Issue with facet count

Hi, I am getting zero count for all facets created by using facet.field in solr 5.1 The surprise element is that I am able to query correctly on fields, but my facet counts are returning zero count. Can anyone help me out here on what all I should check? Regards, Kshitij

Re: Updating 100 documents in one request

at was > >>> fixed in Solr 6.1, > >>> see: https://issues.apache.org/jira/browse/SOLR-445 Otherwise you > >> really have to > >>> write your code to re-transmit sub-packets, perhaps even one at a > >> time > >>> when a packet > &g

Updating 100 documents in one request

Hi Team, I am facing an issue when I am updating more than 1 document on solr. 1. If any 1 document gives 400 error them my other documents are also not updated. How can I approach to solve this? I need my other documents to be indexed which are not giving 400 error. Help appreciated!

Solr Partial Update query

Hi, I want to update document in solr partial. The issue I am facing is that I want to update only those documents in solr that are already present. I dont want to query solr to check if documnet is present or not, i just want to post updates to existing documents. How can I achieve this. Help

Same score listing order

Hi, I need to understand what is the order of listing the documents from query in case there is same score for all documents. Regards, Kshitij

Solr json facet api

Hi, We were earlier using solr 4.0 and now moved to solr 5.2: I am debugging queries and seeing that most of the time in queries are taken by solr facet queries. I have read about solr json facet api in solr 5 on wards, can anyone help me out to understand the difference between these both?

Re: Queries regarding solr cache

that the cache builds up properly even after commits and cache could be used properly, this is wasting a lot of my resources and also slowering up the queries. On Mon, Dec 5, 2016 at 9:06 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 12/5/2016 6:44 AM, kshitij tyagi wrote: > >

Re: Queries regarding solr cache

; On 12/1/2016 4:04 AM, kshitij tyagi wrote: > > I am using Solr and serving huge number of requests in my application. > > > > I need to know how can I utilize caching in Solr. > > > > As of now in then clicking Core Selector → [core name] → Plugins / > Stats. >

Queries regarding cache

Hi All, I am using Solr and serving huge number of requests in my application. I need to know how can I utilize caching in Solr. I am seeing hit ratio as 0 for all the caches in Plugins/Stats. My configurations in solrxml are : Can someone please help me out here to understand and optimise

Fwd: Queries regarding solr cache

-- Forwarded message -- From: kshitij tyagi <kshitij.shopcl...@gmail.com> Date: Thu, Dec 1, 2016 at 4:34 PM Subject: Queries regarding solr cache To: solr-user@lucene.apache.org Hi All, I am using Solr and serving huge number of requests in my application. I need to kn

Queries regarding solr cache

Hi All, I am using Solr and serving huge number of requests in my application. I need to know how can I utilize caching in Solr. As of now in then clicking Core Selector → [core name] → Plugins / Stats. I am seeing my hit ration as 0 for all the caches. What does this mean and how this can be

Re: Solr slow response collection-High Load

Hi Ankush, As you are updating highly on one of the cores, hard commit will play a major role. Reason: During hard commits solr merges your segments and this is a time taking process. During merging of segments indexing of documents gets affected i.e. gets slower. Try figuring out the right

solr query time

Hi, I am having 120 fields in a single document and i am indexing all of them i.e. index=true and stored=true in my schema. I need to understand how that might be affecting my query time overall. what is the relation between query time with respect to indexing all fields in schema?? Regards,

Re: How using fl in query affects query time

nners and intermediates: > http://www.solr-start.com/ > > > On 1 September 2016 at 20:04, kshitij tyagi <kshitij.shopcl...@gmail.com> > wrote: > > Hi, > > > > > > I am having around 100 fields in single document. I want to know that if > I > >

How using fl in query affects query time

Hi, I am having around 100 fields in single document. I want to know that if I use fl and get only single field from query will that reduce query time?? or getting all the fields through query and getting one field using fl in query both will have same query time??

Re: Need to understand solr merging and commit relationship

thanks shawn that was really helpful On Sat, Aug 20, 2016 at 3:17 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 8/16/2016 11:47 AM, kshitij tyagi wrote: > > I need to understand clearly that is there any relationship between solr > > merging and solr commit? > >

Re: What does refCount denotes in solr admin

how to shrink solr container thread pool?? On Thu, Aug 18, 2016 at 2:53 PM, kshitij tyagi <kshitij.shopcl...@gmail.com> wrote: > refcount 171 is seen when i reindex a number of documents simultaneously? > what does this means? I am observing that my indexing speeds slows down >

Re: What does refCount denotes in solr admin

gt;2 even when instance is > idle, it means some plugin leak it - avoid to close/decref solr core. > Hope it helps. > > On Wed, Aug 17, 2016 at 5:27 PM, kshitij tyagi < > kshitij.shopcl...@gmail.com> > wrote: > > > any update?? > > > > On Wed, Aug 17,

Re: What does refCount denotes in solr admin

any update?? On Wed, Aug 17, 2016 at 12:47 PM, kshitij tyagi <kshitij.shopcl...@gmail.com > wrote: > Hi, > > I need to understand what is refcount in stats section of solr admin. > > I am seeing refcount: 2 on my solr cores and on one of the core i am > seeing re

index size increses dramatically

Hi, Suddenly my index size just doubles and indexing just slows down poorly. After sometime it reduces back to normal and indexing starts working. Can someone help me out in finding why index size doubles abnormally??

What does refCount denotes in solr admin

Hi, I need to understand what is refcount in stats section of solr admin. I am seeing refcount: 2 on my solr cores and on one of the core i am seeing refcount:171. The core with refcount with higher number is having very slow indexing speed?

Re: Indexing (posting document) taking a lot of time

gt; http://www.solr-start.com/ > > > On 16 August 2016 at 22:49, kshitij tyagi <kshitij.shopcl...@gmail.com> > wrote: > > 400kb is size of single document and i am sending 100 documents per > request. > > solr heap size is 16gb and running on multithread.

Re: Need to understand solr merging and commit relationship

by the MergePolicy in effect (TieredMergePolicy is the default). > > Best, > Erick > > On Tue, Aug 16, 2016 at 10:47 AM, kshitij tyagi > <kshitij.shopcl...@gmail.com> wrote: > > I need to understand clearly that is there any relationship between solr > > merging and solr com

Need to understand solr merging and commit relationship

I need to understand clearly that is there any relationship between solr merging and solr commit? If there is then what is it? Also i need to understand how both of these affect indexing speed on the core?

Re: Indexing (posting document) taking a lot of time

ields' analysis? > > Regards, > Emir > > > On 16.08.2016 13:25, kshitij tyagi wrote: > >> hi, >> >> we are sending about 100 documents per request for indexing? we have >> autocmmit set to false and commit only when 1 documents are >> present.

Re: Indexing (posting document) taking a lot of time

> Hi, > > Do you send one doc per request? How frequently do you commit? Where is > Solr running? What is network connection between your machine and Solr? > What are JVM settings? Is 10-30s for entire indexing or single doc? > > Regards, > Emir > > > On 16.08.2

Re: Indexing (posting document) taking a lot of time

luster setup? > > On 16 Aug 2016 6:33 PM, "kshitij tyagi" <kshitij.shopcl...@gmail.com> > wrote: > > > Hi, > > > > I am indexing a lot of data about 8GB, but it is taking a lot of time. I > > have read about maxBufferedDocs, ramBufferSizeMB, merge

Indexing (posting document) taking a lot of time

Hi, I am indexing a lot of data about 8GB, but it is taking a lot of time. I have read about maxBufferedDocs, ramBufferSizeMB, merge policy ,etc in solrconfig file. It would be helpful if someone could help me out tune the segtting for faster indexing speeds. *I have read the docs but not able

Re: Reindexing in SOlr

xml > Also is your previuos and new solr have different versions ? > > Thanks > > > > On Wed, Feb 24, 2016 at 12:08 PM, kshitij tyagi > <kshitij.shopcl...@gmail.com> wrote: > > Hi, > > > > I am following the following article > > https://wik

Reindexing in SOlr

Hi, I am following the following article https://wiki.apache.org/solr/HowToReindex to reindex the data using Solr itself as a datasource. Means one solr instance has all fields with stored true and indexed=false. When I am using this instance as a datasource and indexing it on other instance

Size of logs are high

Hi, I have migrated to solr 5.2 and the size of logs are high. Can anyone help me out here how to control this?

Re: Need to move on SOlr cloud (help required)

ow much data (number of documents) do you have? > > > > What is your typical query latency? > > > > > > -- Jack Krupansky > > > > On Wed, Feb 10, 2016 at 2:15 AM, kshitij tyagi < > > kshitij.shopcl...@gmail.com> > > wrote: > > > > > Hi, > &g

Need to move on SOlr cloud (help required)

Hi, We are currently using solr 5.2 and I need to move on solr cloud architecture. As of now we are using 5 machines : 1. I am using 1 master where we are indexing ourdata. 2. I replicate my data on other machines One or the other machine keeps on showing high load so I am planning to move on