Re: Different number of replicas for different shards

@Erick Actually, i thought further and realized what you were saying. I am hoping to rely on the murmur3 hash of the routing key to find the destination shard. On Sun, Jun 30, 2019 at 3:32 AM Nawab Zada Asad Iqbal wrote: > Hi Erick, > > I plan to use the composite-id routing. And

Re: Different number of replicas for different shards

ve more _replicas_ for those shards with the ADDREPLICA > collections API command. > > > > On Jun 29, 2019, at 7:00 AM, Shawn Heisey wrote: > > > > On 6/29/2019 12:23 AM, Nawab Zada Asad Iqbal wrote: > >> is it possible to specify different number of replicas for di

Different number of replicas for different shards

Hi, is it possible to specify different number of replicas for different shards? i.e if I expect some shard to get more queries , i can add more replicas to that shard alone, instead of adding replicas for all the shards. Thanks Nawab

Re: Solr metric for finding number of merges in progress

Actually, i found this after posting; (still if someone has more to offer, please reply) https://lucene.apache.org/solr/guide/7_0/metrics-reporting.html#index-merge-metrics On Fri, Sep 7, 2018 at 12:13 PM Nawab Zada Asad Iqbal wrote: > Hi, > > Does Solr expose a metric to find t

Solr metric for finding number of merges in progress

Hi, Does Solr expose a metric to find the number of segment merges which are in progress? Thanks Nawab

Re: Internal details on how ADDREPLICA executes?

> your particular installation by issuing that collections API > command. > > Best, > Erick > > On Thu, Aug 2, 2018 at 12:20 PM, Nawab Zada Asad Iqbal > wrote: > > Hi, > > > > I am considering using SolrCloud and enable autoADDREPLICA. > > I am curious o

Internal details on how ADDREPLICA executes?

Hi, I am considering using SolrCloud and enable autoADDREPLICA. I am curious on how long does it take for SolrCloud to setup the replica. Before the new replica can start to serve queries, it needs to copy all the documents in the current leader and also index whatever new traffic is arriving.

Re: SolrCloud: Different replicationFactor for different shards in same collection

ng the default composite id routing having one shard get > substantially more queries than the others is unexpected. > > If you're using implicit routing then it's perfectly understandable. > > Best, > Erick > > On Tue, Jul 31, 2018 at 4:12 PM, Nawab Zada Asad Iqbal &

SolrCloud: Different replicationFactor for different shards in same collection

Hi, I am looking at Solr 7.x and couldn't find an answer in the documentation. Is it possibly to specify different replicationFactor for different shards in same collection? E.g. if a certain shard is receiving more queries than rest of the collection I would like to add more replicas for it to

Re: Mysterious Solr crash

any other meaningful part and will copy here. On Sun, Jun 3, 2018 at 6:07 PM, Shawn Heisey wrote: > On 6/3/2018 7:52 AM, Nawab Zada Asad Iqbal wrote: > >> I am running a batch indexing job and Solr core mysteriously shut down >> without any particular error. How can I inve

Mysterious Solr crash

Good morning I am running a batch indexing job and Solr core mysteriously shut down without any particular error. How can I investigate this? I am focusing on the line which mentions "Shutting down CoreContainer instance". There are errors soon after that, but they seemed to be caused by the

Query logs when query reached the solr server

Hi, 1. Is there a way to enable query log when the query first reached the solr server? 2. In recent Solr versions, there is a NOW value in the query log. Is it correct to assume that this is the time when query arrived on that server? Thanks Nawab

Solr admin Segments page legend

Hi, Solr has a nice segments visualization at [core_name]/segments , but I am wondering what the colors mean? Gray color is probably deleted documents., But I couldn't guess the significance of pink color: Thanks Nawab

Re: Solr 7.3 debug/explain with boost applied

I didn't know you can add boosts like that (=2 ). Are you boosting on a field or document by using that syntax? On Sun, Apr 22, 2018 at 10:51 PM, Ryan Yacyshyn wrote: > Hi all, > > When viewing the explain under debug=true in Solr 7.3.0 using > the edismax query parser

Re: Solr document routing using composite key

. I've never seen the number of docs on various shards be off by > more than 2-3% when enough docs are indexed to be statistically valid. > > Best, > Erick > > On Fri, Mar 16, 2018 at 5:34 AM, Shawn Heisey <apa...@elyograg.org> wrote: > > On 3/6/2018 11:53 AM, Nawab Z

Solr Metrics mismatch the query logs

Hi, I gather solr metrics from the following URL for my request handler. [solr-host]/solr/core1/admin/mbeans?stats=true=json Specifically, there is a requests value in the stats map for each handler. I use this value to calculate the requests which arrived between two successive intervals

Solr document routing using composite key

Hi solr community: I have been thinking to use composite key for my next project iteration and tried it today to see how it distributes the documents. Here is a gist of my code: https://gist.github.com/niqbal/3e293e2bcb800d6912a250d914c9d478 I have 117 shards and i tried to use document ids

Re: Are flushed (but not committed yet) segments mutable?

f the index. If tlogs are around, then Solr replays the documents > since that point. > > Best, > Erick > > On Fri, Feb 9, 2018 at 8:07 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > Hi, > > > > When a segment is flushed to disk because it is exc

Are flushed (but not committed yet) segments mutable?

Hi, When a segment is flushed to disk because it is exceeding available memory, is it sill updated when new documents are added? I also read somewhere that a segment is not committed even if it is flushed. How is a flushed-but-not-committed segment different from a committed segment? For

Using 'learning to rank' with user specific features

hi, I am going through learning to rank examples in Solr7. In the examples, the features are part of the searched document. Can I use solr's learning to rank system if my features are user specific? e.g., if searching for products, i want to rank some products higher if they have been used by

Substitute for SmartChineseWordTokenFilterFactory in Solr7

Hi, I used to use SmartChineseSentenceTokenizerFactory and SmartChineseWordTokenFilterFactory in Solr4 for analyzing Chinese text. In solr7, I found that SmartChineseSentenceTokenizerFactory is replaced with HMMChineseTokenizerFactory, but i cannot locate a Chinese Word Tokenizer. Is that not

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

Chris / Hoss Thanks for the detailed explanation. Erick Erickson's explanation made sense to me but it didn't explain the part why the fields are different for 'hello' vs '*:*' . I had never paid much attention the parser part of query handling and so far focused only on the field definitions. I

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

Thanks everyone, that was a very informative thread. One more curiosity: why are different set of fields being used based on the query string:- http://localhost:8983/solr/filesearch/select?fq=id:1193; q=*:*=true - parsedquery: "+DisjunctionMaxQuery((user_email:*:* | user_name:*:* |

Re: CommonGramsFilter

Actually, i have found that it is *not* mandatory to use phrase search with CommonGramsFilter . PS: i had some other code change (which is unnecessary) which was causing the above behavior. On Thu, Jan 4, 2018 at 6:56 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > After some

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

4, 2018, at 20:39, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > > > Thanks Erik > > Here is the output, > > > > http://localhost:8983/solr/filesearch/select?fq=id:1193; > q.alt=*:*=true > > > > > > - parsedquery: "+MatchAll

Re: CommonGramsFilter

the stopwords to the CommonGramsFilter? On Thu, Jan 4, 2018 at 6:08 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi, > > I am looking at this documentation and wondering if it would be better to > optionally skip indexing of original stopwords. > > https://lucene.a

CommonGramsFilter

Hi, I am looking at this documentation and wondering if it would be better to optionally skip indexing of original stopwords. https://lucene.apache.org/solr/guide/6_6/filter-descriptions.html# FilterDescriptions-CommonGramsFilter

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

the parsed queries differ. > > On Jan 4, 2018 15:14, "Nawab Zada Asad Iqbal" <khi...@gmail.com> wrote: > > > Hi, > > > > In my SearchHandler solrconfig, i have q.alt=*:* . This allows me to run > > queries which only have `fq` filters and no `q`. &

trivia question: why q=*:* doesn't return same result as q.alt=*:*

Hi, In my SearchHandler solrconfig, i have q.alt=*:* . This allows me to run queries which only have `fq` filters and no `q`. If I remove q.alt from the solrconfig and specify `q=*:*` in the query parameters, it does not give any results. I also tried `q=*` but of no avail. Is there some good

Re: Small Tokenization issue

ing - Log Management - Alerting - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > > > On 3 Jan 2018, at 21:04, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > > > > Hi, > > > > So, I have a st

Small Tokenization issue

Hi, So, I have a string for indexing: abc - def (notice the space on either side of hyphen) which is being processed with this filter-list:- I get two shingle tokens at the

Re: fq: OR operator (sometimes) not working

iated types. > > Because it worked for me just fine in the simple case, so some > non-obvious combination of things is causing this. Since neither of us > know _what_, include everything ;).. > > Best, > Erick > > On Wed, Dec 27, 2017 at 4:45 PM, Nawab Zada Asad Iqbal <

Re: fq: OR operator (sometimes) not working

ts exapmle > 2> that's not what I wanted, you just reiterated the _input_. > I asked for the results when adding =query to the string so you > can see the parsed query. > You should see something similar to: > > "parsed_filter_queries":["file_type:jpg file_type:j

Re: fq: OR operator (sometimes) not working

.0.1). Regards Nawab On Wed, Dec 27, 2017 at 3:54 PM, Erick Erickson <erickerick...@gmail.com> wrote: > What does adding =query show in the two cases? > > Best, > Erick > > On Wed, Dec 27, 2017 at 3:40 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: &g

fq: OR operator (sometimes) not working

Hi, Are the following two queries equal: In my understanding, I can specify the arguments the operator once in the {} local parameter syntax (example 1) or I can interleave OR between different clauses (example 2). But I am getting my result in the second case only. What am I doing wrong? This

Re: Do i need to reindex after changing similarity setting

This JIRA also throws some light. There is a discussion of encoding norm during indexing. The contributor eventually comments that "norms" encoded by different similarity are compatible to each other. On Thu, Nov 30, 2017 at 5:12 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> wro

Re: Do i need to reindex after changing similarity setting

the collection allows it. " On Wed, Nov 22, 2017 at 9:11 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Thanks Walter > > On Mon, Nov 20, 2017 at 4:59 PM Walter Underwood <wun...@wunderwood.org> > wrote: > >> Similarity is query time. >> >

Re: Do i need to reindex after changing similarity setting

Thanks Walter On Mon, Nov 20, 2017 at 4:59 PM Walter Underwood <wun...@wunderwood.org> wrote: > Similarity is query time. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > > On Nov 20, 2017, at

Re: Solr7: Very High number of threads on aggregator node

Rick Your suspicion is correct. I mostly reused my config from solr4 except where it was deprecated or obsoleted and I switched to the newer configs: Having said that I couldn't find any new query related settings which can impact us, since most of our queries dont use fancy new features. I

Do i need to reindex after changing similarity setting

Hi, I want to switch to Classic similarity instead of BM25 (default in solr7). Do I need to reindex all cores after this? Or is it only a query time setting? Thanks Nawab

Re: Solr7: Very High number of threads on aggregator node

for the process, rather it is somewhere else. Thanks Nawab On Sat, Nov 18, 2017 at 10:22 AM, Rick Leir <rl...@leirtech.com> wrote: > Nawab > You probably need to share the relevant config to get an answer to this. > Cheers -- Rick > > On November 17, 2017 2:19:03 PM EST,

Solr7: Very High number of threads on aggregator node

Hi, I have a sharded solr7 cluster and I am using an aggregator node (which has no data/index of its own) to distribute queries and aggregate results from the shards. I am puzzled that when I use solr7 on the aggregator node, then number of threads shoots up to 32000 on that host and then the

Re: Solr7: Bad query throughput around commit time

ct that enabling docValues will > cause your index size on disk to grow. Paradoxically that will > actually _lower_ the size of the JVM heap requirements. Essentially > the additional size on disk is the serialized structure that would > have to be built in the JVM. Since it is pre-bu

Re: Solr7: Bad query throughput around commit time

; On Sat, Nov 11, 2017 at 1:08 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > > Thanks for a quick and detailed response, Erick! > > > > Unfortunately i don't have a proof, but our servers with solr 4.5 are > > running really nicely with the above config. I

Re: Solr7: Bad query throughput around commit time

ngs here > that untangling which one is the culprit will be hard. You want the > JVM to have as little memory as possible, unfortunately that's > something you figure out by experimentation. > > Best, > Erick > > On Thu, Nov 9, 2017 at 8:42 PM, Nawab Zada Asad Iqbal <khi.

Solr7: Bad query throughput around commit time

Hi, I am committing every 5 minutes using a periodic cron job "curl http://localhost:8984/solr/core1/update?commit=true;. Besides this, my app doesn't do any soft or hard commits. With Solr 7 upgrade, I am noticing that query throughput plummets every 5 minutes - probably when the commit

Re: update document stuck on: java.net.SocketInputStream.socketRead0

), to at least improve my performance. PS: I have also posted this question here: https://stackoverflow.com/questions/47098816/solr-jetty-9-webserver-sending-a-ton-of-socket-timeouts Thanks Nawab On Thu, Oct 26, 2017 at 7:03 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi, > > After

Re: SOLR-11504: Provide a config to restrict number of indexing threads

ting on my client side - on the other side of the wire. Thanks Nawab On Wed, Nov 1, 2017 at 7:11 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 10/31/2017 4:57 PM, Nawab Zada Asad Iqbal wrote: > >> I hit this issue https://issues.apache.org/jira/browse/SOLR-11504 while >&

SOLR-11504: Provide a config to restrict number of indexing threads

Hi, I hit this issue https://issues.apache.org/jira/browse/SOLR-11504 while migrating to solr6 and locally working around it in Lucene code. I am thinking to fix it properly and hopefully patch back to Solr. Since, Lucene code does not want to keep any such config, I am thinking to use a counting

update document stuck on: java.net.SocketInputStream.socketRead0

Hi, After Solr 7 upgrade, I am realizing that my '/update' request is sometimes getting stuck on this:- - java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int, int, int) @bci=0 (Compiled frame; information may be imprecise) - java.net.SocketInputStream.read(byte[], int,

Measuring time spent in analysis and writing to index

Hi, I want to analyze the time spent in different stages during add/update document request. E.g., I want to compare time spend in analysis vs writing to Lucene index. Does Solr provide any such thing? I have looked at [core/admin/mbeans?stats=true=json=true] which provides overall stats but I

Re: 3 color jvm memory usage bar

n each bar is the available resource and the > darker shade is used. > > Best, > Erick > > On Thu, Oct 19, 2017 at 7:27 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > Good morning, > > > > > > What do the 3 colors mean in this bar on Solr dashboard page? (please see > > attached) : > > > > > > Regards > > Nawab >

3 color jvm memory usage bar

Good morning, What do the 3 colors mean in this bar on Solr dashboard page? (please see attached) : Regards Nawab

Re: [EXTERNAL] Re: OOM during indexing with 24G heap - Solr 6.5.1

Randy That is one issue, i don't know if it fixes everything for you or not. However, Lucene doesn't put a limit on number of incoming requests and after https://issues.apache.org/jira/browse/LUCENE-6659 , solr has no way (i don't know at least) to limit threads. So if you have ton of parallel

Re: solr 7.0: What causes the segment to flush

; Lucidworks, Inc. > 415-589-9269 > www.lucidworks.com > Twitter http://twitter.com/lucidworks > LinkedIn: https://www.linkedin.com/in/sarkaramrit2 > > On Tue, Oct 17, 2017 at 12:48 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > > Hi, > > >

solr 7.0: What causes the segment to flush

Hi, I have tuned (or tried to tune) my settings to only flush the segment when it has reached its maximum size. At the moment,I am using my application with only a couple of threads (i have limited to one thread for analyzing this scenario) and my ramBufferSizeMB=2 (i.e. ~20GB). With this,

Re: Solr test runs: test skipping logic

Thanks Chris, That very likely is the reason. I had noticed the seed and realized that it will be controlling the random input generation for the tests to make failures reproducible. However, i didn't consider that it can also cause test skipping. Thanks! Nawab On Thu, Oct 5, 2017 at 3:13 PM,

Re: Maven build error (Was: Jenkins setup for continuous build)

Hi Steve, I did this: ant get-maven-poms cd maven-build/ mvn -DskipTests install On Wed, Oct 4, 2017 at 4:56 PM, Steve Rowe <sar...@gmail.com> wrote: > Hi Nawab, > > > On Oct 4, 2017, at 7:39 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > >

Re: Jenkins setup for continuous build

] Is that expected? Can someone share me the details about how https://builds.apache.org/job/Lucene-Solr-Maven-master is configured On Wed, Oct 4, 2017 at 9:14 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi, > > I have s

Maven build error (Was: Jenkins setup for continuous build)

(TestCustomDocTransformer.java:78) [ERROR] Scanned 1290 (and 2112 related) class file(s) for forbidden API invocations (in 2.74s), 1 error(s). On Wed, Oct 4, 2017 at 9:14 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi, > > I have some custom code in solr (which is not of good quality for >

Jenkins setup for continuous build

Hi, I have some custom code in solr (which is not of good quality for contributing back) so I need to setup my own continuous build solution. I tried jenkins and was hoping that ant build (ant clean compile) in Execute Shell textbox will work, but I am stuck at this ivy-fail error: To work

Solr test runs: test skipping logic

Hi, I am seeing that in different test runs (e.g., by executing 'ant test' on the root folder in 'lucene-solr') a different subset of tests are skipped. Where can I find more about it? I am trying to create parity between test successes before and after my changes and this is causing confusion.

solr 7.0: mbeans stats missing for many keys

hi, When upgrading from solr4.5 to solr 7.0, I noticed that many key names in solr-mbeans ( http://localhost:8983/solr/tcore/admin/mbeans?stats=true=json) have changed. Mostly, "parent key" name is also appended to the stats keyname e.g., instead of cumulative_evictions, I now have to look for

Re: how to recover from OpenSearcher called on closed core

Hi Are you upgrading from an earlier version? If not, I am curious why not try SolrCloud instead of Master/Slave. Is there any other error before this error in the logs? Did the core close after a crash? Regards Nawab On Thu, Sep 28, 2017 at 2:57 AM, rubi.hali wrote: >

Re: Solr Beginner!!

Hi Jaya Text extraction is a step before you put data into solr. Say, you have pdf or doc type documents, you will extract the text (minus unnecessary formatting details etc.) and store in solr. Later you can query it as you said. i have not worked in extraction area, but look at this for an

Re: Solr cloud most stable version

Hi Lars Although, that doesn't really answer of whether 6.6.1 is the most stable one or not, but there has been a recent security fix, so definitely go to 6.6.1 . Copied the detail below:- CVE-2017-9803: Security vulnerability in kerberos delegation token functionality Severity: Important

Re: solr 7.0: possible analysis error: startOffset must be non-negative

, 2017 at 3:12 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi, > > I upgraded to solr 7 today and i am seeing tonnes of following errors for > various fields. > > o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: > Exception writing document id fi

solr 7.0: possible analysis error: startOffset must be non-negative

Hi, I upgraded to solr 7 today and i am seeing tonnes of following errors for various fields. o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Exception writing document id file_3881549 to the index; possible analysis error: startOffset must be non-negative, and endOffset

Re: When will be solr 7.1 released?

gt; > On Sep 26, 2017, at 8:04 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > > > Thanks , another question(s): > > > > why is this released marked 'unreleased' ? > > https://issues.apache.org/jira/projects/SOLR/versions/12335718 > > The 7.0

Re: When will be solr 7.1 released?

> if it's a super-critical bug merge with branch_7_0 > > Best, > Erick > > > On Tue, Sep 26, 2017 at 11:02 AM, Nawab Zada Asad Iqbal > <khi...@gmail.com> wrote: > > Thanks Yonik and Erick. > > > > That is helpful. > > I am slightly confused about t

Re: When will be solr 7.1 released?

wab, > >> > >> Committership is a prerequisite for the Lucene/Solr release manager > role. > >> > >> Some info here about the release process: <https://wiki.apache.org/ > lucene-java/ReleaseTodo> > >> > >> -- > >> Steve > >>

Re: When will be solr 7.1 released?

re > enough changes to warrant spinning a new version, they volunteer. > Nobody has stepped up to do that yet, although I expect it to be in > the next 2-3 months, but that's only a guess. > > Best, > Erick > > On Mon, Sep 25, 2017 at 5:21 PM, Nawab Zada Asad Iqbal <

When will be solr 7.1 released?

Hi, How are the release dates decided for new versions, are they known in advance? Thanks Nawab

Re: solr 6.6.1: Lock held by this virtual machine

without haproxy traffic), I was able to make start and use (index 100s GB and queries for many hours) this solr version (6.6.1) without any problem. Thanks Nawab On Fri, Aug 25, 2017 at 3:38 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Thanks Erik > I expected that but

Re: solr 6.6.1: Lock held by this virtual machine

have two different cores pointing to the > _same_ data directory. Examine your core.properties files and see if > any dataDir variables are set > > Best, > Erick > > On Fri, Aug 25, 2017 at 1:12 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > Ok, af

Re: solr 6.6.1: Lock held by this virtual machine

:582) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) On Fri, Aug 25, 2017 at 10:47 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi, > > I am getting this error. i have deleted the file and restarted the server, > but this err

solr 6.6.1: Lock held by this virtual machine

Hi, I am getting this error. i have deleted the file and restarted the server, but this error doesn't go away. What should I do to fix it? Caused by: org.apache.solr.common.SolrException: Error opening new searcher at org.apache.solr.core.SolrCore.(SolrCore.java:977) at

Re: Request Highlighting only for the final set of rows

the scenario when user is asking for only ids. > > > Nawab > > On Fri, Aug 18, 2017 at 8:33 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > >> Thanks Erick for the pointing to better option. I will explore that. >> After your email, I found that if

Re: Request Highlighting only for the final set of rows

On Fri, Aug 18, 2017 at 8:33 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Thanks Erick for the pointing to better option. I will explore that. After > your email, I found that if i have specified 'fl=*' in the query then it is > doing the right thing (a 2 pass process). Howe

Re: Request Highlighting only for the final set of rows

d? Or are you misinterpreting the log message for the first > pass? > > Best, > Erick > > On Thu, Aug 17, 2017 at 5:43 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > > Hi, > > > > In a multi-node solr installation (without SolrCloud), during a paging

Request Highlighting only for the final set of rows

Hi, In a multi-node solr installation (without SolrCloud), during a paging scenario (e.g., start=1000, rows=200), the primary node asks for 1200 rows from each shard. If highlighting is ON, then the primary node is asking for highlighting all the 1200 results from each shard, which doesn't scale

Re: solr asks more and more rows from shards

So, it turned out that i was not paying attention to the start parameter. I found that the 'primary' node is asking for very large count of rows from shard nodes when the start= is a large value. On Thu, Aug 17, 2017 at 11:28 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: >

Re: Unable to write response, client closed connection or we are shutting down

wrote: > On 8/12/2017 11:48 AM, Nawab Zada Asad Iqbal wrote: > > I am executing a query performance test against my solr 6.6 setup and I > > noticed following exception every now and then. What do I need to do? > > > > Aug 11, 2017 08:40:07 AM INFO (qtp761960786-250) [ x:fil

solr asks more and more rows from shards

Hi solr community I am having performance issues after solr6 upgrade. I have multiple nodes in the cluster and direct queries to one of them with `shards=[list of hosts]` which takes care of submitting queries to all the shards and aggregating the results. All the original queries have rows=200.

Re: Solr query help

Hi Krishna I haven't used date range queries myself. But if Solr only supports a particular date format, you can write a thin client for queries, which will convert the date to solr's format and query solr. Nawab On Thu, Aug 17, 2017 at 7:36 AM, chiru s wrote: > Hello

Re: Unable to write response, client closed connection or we are shutting down

:09 PM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi Rick > > My software is not very sophisticated. I have picked some queries from > production logs, which I am replaying against this solr installation. It is > not a SolrCloud but i specify "shards=" in the

Breaking down QTime for debugging performance

Hi all For a given solr host and shard, is there any way to get a breakdown on QTime to see where is the time being spent? Thanks Nawab

Re: Unable to write response, client closed connection or we are shutting down

b > What test software do you use? What else is happening when the exception > occurs? > Cheers -- Rick > > On August 12, 2017 1:48:19 PM EDT, Nawab Zada Asad Iqbal <khi...@gmail.com> > wrote: > >Hi, > > > >I am executing a query performance test a

Unable to write response, client closed connection or we are shutting down

Hi, I am executing a query performance test against my solr 6.6 setup and I noticed following exception every now and then. What do I need to do? Aug 11, 2017 08:40:07 AM INFO (qtp761960786-250) [ x:filesearch] o.a.s.s.HttpSolrCall Unable to write response, client closed connection or we are

which class is: o.a.s.c.S.Request

Hi I see logs from this class 'o.a.s.c.S.Request', and I am able to tune this log by going to the logging webpage (Solr -> Request), but I cannot find the full class name in code. What should I put in the log properties file to disable this log? Thanks Nawab

Solr 6.6: Configure number of indexing threads

: https://issues.apache.org/jira/plugins/servlet/mobile#issue/LUCENE-6659 Is there any config in solr 6.6 to control this ? If not , why was the current config considered useless ? Thanks Nawab -- Forwarded message - From: Nawab Zada Asad Iqbal <khi...@gmail.com> Date: Sun,

Commit takes very long with NoSuchFileException

Hi, I have a host with 3 solr processes running, each with one shard only; there are no replicas. I am reindexing some 100 GB of data per solr (or per shard since each solr has one shard). After about 3 hours, I manually committed once. I was able to get through 40 GB in each shard, and the

Re: logging support in Lucene code

for lucene, as it is included in other projects too. Regards Nawab On Fri, Jul 28, 2017 at 6:57 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 7/27/2017 10:57 AM, Nawab Zada Asad Iqbal wrote: > > I see a lot of discussion on this topic from almost 10 years ago: e.g., > > http

Re: logging support in Lucene code

then you > can route the infoStream logging to Solr's log files by setting an option > in the solrconfig.xml. See > http://lucene.apache.org/solr/guide/6_6/indexconfig-in-solrconfig.html# > IndexConfiginSolrConfig-OtherIndexingSettings > > On Fri, Jul 28, 2017 at 11:13 AM,

master replication: what are 'master (searching)' and 'master (replicable)' fields

Hi, >From the solr console, I see 'master (searching)' and 'master (replicable)' fields on `host/solr/#/core_1/replication` page and wondering how does it impact me given that I don't have any replicas. If I don't have any replicas, does it make any impact on performance by enabling or

Re: logging support in Lucene code

Any doughnut for me ? Regards Nawab On Thu, Jul 27, 2017 at 9:57 AM Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > Hi, > > I see a lot of discussion on this topic from almost 10 years ago: e.g., > https://issues.apache.org/jira/browse/LUCENE-1482 > > For 4.5, I relie

Re: Unable to create core [collection] Caused by: null

Lucas may be hitting this issue: https://stackoverflow.com/questions/4659151/recurring-exception-without-a-stack-trace-how-to-reset Could you try running your server with jvm value: -XX:-OmitStackTraceInFastThrow ? Nawab On Wed, Jul 26, 2017 at 11:42 AM, Anshum Gupta

logging support in Lucene code

Hi, I see a lot of discussion on this topic from almost 10 years ago: e.g., https://issues.apache.org/jira/browse/LUCENE-1482 For 4.5, I relied on 'System.out.println' for writing information for debugging in production. In 6.6, I notice that some classes in Lucene are instantiating a Logger,

Re: How to use javacc with QueryParser.jj

ucene/solr/ don't accomplish this. So to do this, run 'ant javacc' from lucene/solr/core/. That's it. " On Mon, Jul 24, 2017 at 7:31 AM, Nawab Zada Asad Iqbal <khi...@gmail.com> wrote: > [Subject changed for reposting] > > Good morning, > > If I want to change something i

How to use javacc with QueryParser.jj

[Subject changed for reposting] Good morning, If I want to change something in the lucene-solr/solr/core/src/java /org/apache/solr/parser/QueryParser.jj, what is the workflow to generate the new Java code? Thanks Nawab On Fri, Jul 21, 2017 at 7:33 PM, Nawab Zada Asad Iqbal <khi...@gmail.

  1   2   >