Re: Whether SolrCloud can support 2 TB data?

Hey Yago, 12 T is very impressive. Can you also share some numbers about the shards, replicas, machine count/specs and docs/second for your case? I think you would not be having a single index of 12 TB too. So some details on that would be really helpful too.

Confusing debug=timing parameter

Hi, I am using Solr 4.10 and its response time for the clients is not very good. Even though the Solr's plugin/stats shows less than 200 milliseconds, clients report several seconds in response time. So I tried using debug-timing parameter from the Solr UI and this is what I got. Note how the

How to identify documents failed in a batch request?

Hi, I am using the following code to send documents to Solr: final UpdateRequest request = new UpdateRequest(); request.setAction(UpdateRequest.ACTION.COMMIT, false, false); request.add(docsList); UpdateResponse response = request.process(solrClient); The

Re: Memory leak in Solr

e > > > > On Dec 2, 2016, at 4:49 PM, Shawn Heisey <apa...@elyograg.org> wrote: > > > >> On 12/2/2016 12:01 PM, S G wrote: > >> This post shows some stats on Solr which indicate that there might be a > >> memory leak in there. > >> >

Re: Memory leak in Solr

n do to > help you resolve your issues assuming it's > simply inappropriate sizing. I'd really recommend > you create a stress environment so you can > test different scenarios to become confident about > your expected performance, here's a blog on the > subject: > > https:/

Memory leak in Solr

Hi, This post shows some stats on Solr which indicate that there might be a memory leak in there. http://stackoverflow.com/questions/40939166/is-this-a-memory-leak-in-solr Can someone please help to debug this? It might be a very good step in making Solr stable if we can fix this. Thanks SG

Re: Confusing debug=timing parameter

ading bits from disk, etc. > > Also, there is another parameter named as *elapsed time*. It shows time > frame of the query sent to Solr and response is returned. Includes query > time, reading bits from disk, constructing the response and transmissioning > it, etc. > > Kind Regards

Limiting the number of queries/updates to Solr

Hi, My team provides Solr clusters to several other teams in my company. We get peak-requirements for query-rate and update-rate from our customers and load-test the cluster based on the same. This helps us arrive at a cluster suitable for a given peak load. Problem is that peak load estimates

CloudSolrClient preferred over LBHttpSolrClient

Hi, Does anyone know if CloudSolrClient is preferred over LBHttpSolrClient ? If yes, why so and has there been any good performance benefits documented anywhere? Thanks SG

Re: Limiting the number of queries/updates to Solr

ts > > Let's continue the discussion on the Jira > > On Thu, Aug 3, 2017 at 2:03 AM, Rick Leir <rl...@leirtech.com> wrote: > > > > > > > On 2017-08-02 11:33 PM, Shawn Heisey wrote: > > > >> On 8/2/2017 8:41 PM, S G wrote: > >> > >>> Pro

Re: Limiting the number of queries/updates to Solr

-not-working Has someone has worked on this before and can help? Thanks SG On Fri, Aug 4, 2017 at 5:51 PM, S G <sg.online.em...@gmail.com> wrote: > timeAllowed parameter is a not a good choice for rate limiting and could > crash the whole Solr cluster. > In fact, timeAllowed p

Re: Recommended index-size per core

or doc values part of index too? Are they stored in JVM or OS-cache? (I would guess latter, but does that mean JVM is just not required for those or a small percentage?) Thanks SG On Thu, May 11, 2017 at 7:33 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 5/10/2017 11:5

Recommended index-size per core

Hi, Is there a recommendation on the size of index that one should host per core? Idea is to come up with an *initial* shard/replica setting for a load test. And then arrive at a good cluster size based on that testing. *Example: * Num documents: 100 million Average document size: 1kb So total

Backing up indexes to an HDFS filesystem

Hi, I have a few doubts regarding the documentation at https://cwiki.apache.org/ confluence/display/solr/Making+and+Restoring+Backups for backing up the indexes to a HDFS filesystem 1) How frequently are the indexes backed up? 2) Is there a possibility of data-loss if Solr crashes between two

Re: SolrException: Error trying to proxy request for url: solr/sync-status/admin/system

Got no response on the solr-user mailing list and so trying the dev-mailing list. Please guide me if this should not be done. But I thought that the issue looks strange enough to post it here. Thanks SG On Mon, Jun 19, 2017 at 8:13 PM, S G <sg.online.em...@gmail.com> wrote: > H

SolrException: Error trying to proxy request for url: solr/sync-status/admin/system

Hi, We are stuck in a strange problem. Whole cluster is red. All nodes are being shown as down. Restart of the nodes is not helping either. All our nodes seem to have gone into a distributed lock. Here is the grep command I ran on all the solr.log files: grep "Error trying to proxy request"

admin/metrics API or read JMX by jolokia?

Hi, The API admin/metrics in 6.x version of Solr seems to be very good. Is it performance friendly as well? We want to use this API to query the metrics every minute or so from all Solr nodes and

Invalid shift value (64) in prefixCoded bytes (is encoded value really an INT?)

Hi, We are seeing some very bad performance on our performance test that tries to load a 2 shard, 3 replica system with about 2000 writes/sec and 2000 reads/sec The exception stack trace seems to point to a specific line of code and a similar stack trace is reported by users on Elastic-Search

FilterCache size should reduce as index grows?

Hi, Here is a discussion we had recently with a fellow Solr user. It seems reasonable to me and wanted to see if this is an accepted theory. The bit-vectors in filterCache are as long as the maximum number of documents in a core. If there are a billion docs per core, every bit vector will have a

Re: FilterCache size should reduce as index grows?

the best of both the worlds? On Thu, Oct 5, 2017 at 7:23 AM, Yonik Seeley <ysee...@gmail.com> wrote: > On Thu, Oct 5, 2017 at 3:20 AM, Toke Eskildsen <t...@kb.dk> wrote: > > On Wed, 2017-10-04 at 21:42 -0700, S G wrote: > > > > It seems that the memory limit optio

Running Solr-Server inside other process

Hi, We are looking to run Solr in-memory for testing and examples. For example: 1) Cassandra has cassandra-unit: https://github.com/jsevellec/cassandra-unit/wiki/How-to-use-it-in-your-code 2) Storm has local-mode: http://storm.apache.org/releases/current/Local-mode.html Is there something

Re: Running Solr-Server inside other process

gt; On Thu, Aug 24, 2017 at 11:15 AM, S G <sg.online.em...@gmail.com> wrote: > > Hi, > > > > We are looking to run Solr in-memory for testing and examples. > > > > For example: > > 1) Cassandra has cassandra-unit: > > https://github.com/jsevellec/cass

Re: Solr staying constant on popularity indexes

I find myself in the same boat as TI when a Solr node goes into recovery. Solr UI and the logs are really of no help at that time. It would be really nice to enhance the Solr UI with the features mentioned in the original post. On Tue, Oct 10, 2017 at 4:14 AM, Charlie Hull

How to debug slow update queries?

Hi, Our logs are spewing a lot of the following: org.apache.solr.core.SolrCore; slow: [my_coll_shard8_replica1] webapp=/solr path=/update params={wt=javabin=2} status=0 QTime=1736 And the QTime is as high as 3-4 seconds in some cases. Shouldn't the slow logger print the document also which

Re: JVM GC Issue

On Sun, Dec 3, 2017 at 12:02 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 12/2/2017 6:59 PM, S G wrote: > >> I am a bit curious on the docValues implementation. >> I understand that docValues do not use JVM memory and >> they make use of OS cache - that i

Re: DocValues

gt; Best, > Erick > > On Fri, Nov 17, 2017 at 5:44 AM, Shawn Heisey <apa...@elyograg.org> wrote: > > On 11/17/2017 12:53 AM, S G wrote: > >> > >> Going through > >> > >> https://www.elastic.co/guide/en/elasticsearch/guide/ > current/_dee

DocValues

Hi, I am trying to understand docValues. Almost every link I have gone through says that enable docValues if you want to sort/facet/pivot. Does that mean I should enable docValues even if I just want to index and store simple integer-type fields? If that is true, then the default numeric fields

Re: DocValues

can it be retrieved? I am guessing that stored comes naturally when a field has docValues enabled. Is that a correct understanding? Thanks SG On Thu, Nov 16, 2017 at 11:48 PM, S G <sg.online.em...@gmail.com> wrote: > Hi, > > I am trying to understand docValues. > > Almost e

Re: Multiple collections for a write-alias

lerting - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > > > On 9 Nov 2017, at 19:09, S G <sg.online.em...@gmail.com> wrote: > > > > Hi, > > > > We have a use-case to re-create a solr-collection by

NullPointerException in PeerSync.handleUpdates

Hi, We are running 6.2 version of Solr and hitting this error frequently. Error while trying to recover. core=my_core:java.lang.NullPointerException at org.apache.solr.update.PeerSync.handleUpdates(PeerSync.java:605) at

Re: NullPointerException in PeerSync.handleUpdates

re recent versions? > > On Tue, Nov 21, 2017 at 1:13 AM, S G <sg.online.em...@gmail.com> wrote: > > Hi, > > > > We are running 6.2 version of Solr and hitting this error frequently. > > > > Error while trying to reco

Multiple collections for a write-alias

Hi, We have a use-case to re-create a solr-collection by re-ingesting everything but not tolerate a downtime while that is happening. We are using collection alias feature to point to the new collection when it has been re-ingested fully. However, re-ingestion takes several hours to complete

Re: JVM GC Issue

I am a bit curious on the docValues implementation. I understand that docValues do not use JVM memory and they make use of OS cache - that is why they are more performant. But to return any response from the docValues, the values in the docValues' column-oriented-structures would need to be

Re: Remove schema.xml in favor of managed-schema

le, > > and is just an API you use to configure a Solr. In this case 'mutable' > > doesn't imply anything about files, just the state of the Solr config. > > > > -Doug > > > > On Sat, Jun 16, 2018 at 12:24 AM S G wrote: > > > >> Hi, > >

Remove schema.xml in favor of managed-schema

Hi, As per https://lucene.apache.org/solr/guide/7_2/schema-factory-definition-in-solrconfig.html#SchemaFactoryDefinitioninSolrConfig-Classicschema.xml, the only difference between schema.xml and managed-schema is that one accepts schema-changes through an API while the other one does not.

Re: UUIDUpdateProcessorFactory can cause duplicate documents?

; Suppose id field is the UUID linked field in the configuration and if > this > > is missing in the document coming to index then it will generate a UUID > and > > set it in id field. However if id field is present with some value then > it > > shouldn't. > > > >

UUIDUpdateProcessorFactory can cause duplicate documents?

Hi, Is it correct to assume that UUIDUpdateProcessorFactory will produce 2 documents even if the same document is indexed twice without the "id" field ? And to avoid such a thing, we can use the technique mentioned in https://wiki.apache.org/solr/Deduplication ? Thanks SG

Re: Remove schema.xml in favor of managed-schema

riety and the config file approach is simplest for > most > > teams. > > > > At least that's my 2 cents :) > > -Doug > > > > > > On Tue, Jun 19, 2018 at 11:58 AM Alexandre Rafalovitch < > arafa...@gmail.com> > > wrote: > > > >>

Re: 7.1.0 weird messages bad core before recovery

> > Never seen it before, bug? Already fixed? I have seen it many times before in almost all Solr versions. Do not remember the exact stack trace though. Generally a restart fixes the problem (Like almost all software :) On Fri, Jan 5, 2018 at 6:57 AM, Markus Jelsma

Re: Confusing DocValues documentation

ied. If you have a complex query > you need to get a result set before even considering the > facet/sort/whatever question so gathering the term information as I > searched wouldn't particularly work. > > Best, > Erick > > On Thu, Dec 21, 2017 at 9:56 AM, S G <sg.

Re: regarding exposing merge metrics

because of large performance degradations. For more > > details, see https://issues.apache.org/jira/browse/SOLR-10130 > > > > On Tue, Jan 9, 2018 at 9:11 AM, S G <sg.online.em...@gmail.com> wrote: > > > Yes, this is actually confusing and the documentation (

Re: regarding exposing merge metrics

Yes, this is actually confusing and the documentation ( https://lucene.apache.org/solr/guide/7_2/metrics-reporting.html) does not help either: *Index Merge Metrics* : These metrics are collected in respective registries for each core (e.g., solr.core.collection1…​.), under the INDEX category.

Adding a child doc incrementally

Hi, We have a use-case where a single document can contain thousands of child documents. However, I could not find any way to do it incrementally. Only way is to read the full document from Solr, add the new child document to it and then re-index the full document will all of its child documents

Re: Adding a child doc incrementally

ry has to cross shards, that won't work (yet... > https://issues.apache.org/jira/browse/SOLR-11384). > > More info here: > https://www.slideshare.net/lucidworks/solr-graph-query- > presented-by-kevin-watters-kmw-technology > > On Mon, Jan 15, 2018 at 2:09 PM, S G <sg.online.em

Re: SOLR Data Backup

Another option is to have CDCR enabled for Solr and replicate your data to another Solr cluster continuously. BTW, why do we not recommend having Solr as a source of truth? On Thu, Jan 18, 2018 at 4:08 AM, Florian Gleixner wrote: > Am 18.01.2018 um 10:21 schrieb Wael Kader: > >

Re: 7.2.1 cluster dies within minutes after restart

Hi Markus, We are in the process of upgrading our clusters to 7.2.1 and I am not sure I quite follow the conversation here. Is there a simple workaround to set the ZK_CLIENT_TIMEOUT to a higher value in the config (and it's just a default value being wrong/overridden somewhere)? Or is it more

Re: 7.2.1 cluster dies within minutes after restart

Yeah, definitely check the zookeeper version. 3.4.6 is not a good one I know and you can say the same for all the versions below it too. We have used 3.4.9 with no issues. While Solr 7.x uses 3.4.10 Another dimension could be the use or (dis-use) of p-fields like pint, plong etc. If you are using

Re: 7.2.1 cluster dies within minutes after restart

Our 3.4.6 ZK nodes were unable to join the cluster unless their quorum got broken. So if there was 5 node zookeeper and it lost 2 nodes, they would not rejoin because ZK still had its quorum. To make them join, you had to break the quorum by restarting a node in quorum. Only when quorum broke, did

Re: 7.2.1 cluster dies within minutes after restart

ok, good to know that 7.x shows good performance for you too. 1) Regarding the zookeeper problem, do you know for sure that it does not occur in 6.x ? I would suggest to write a small load-test that can send a similar kind of load to 6.x and 7.x clusters and see which one breaks. I know

Re: 7.2.1 cluster dies within minutes after restart

We did some basic load testing on our 7.1.0 and 7.2.1 clusters. And that came out all right. We saw a performance increase of about 30% in read latencies between 6.6.0 and 7.1.0 And then we saw a performance degradation of about 10% between 7.1.0 and 7.2.1 in many metrics. But overall, it still

Re: Long GC Pauses

Hey Maulin, I hope you are using some tools to look at your gc.log file (There are couple available online) or grepping for pauses. Do you mind sharing your G1GC settings and some screenshots from your gc.log analyzer's output ? -SG On Wed, Jan 31, 2018 at 9:16 AM, Erick Erickson

Re: 9000+ CLOSE_WAIT connections in solr v6.2.2 causing it to "die"

Hi Arcadius, Most of the clients use Solrj to interact with Solr. Does it not automatically handle the connection pools? SG On Fri, Feb 2, 2018 at 4:47 PM, Arcadius Ahouansou wrote: > I have seen a lot of CLOSE_WAIT in the past. > In many cases, it was that the client

Move the lang-configurations from managed-schema to its own xml file

Hi, I think it would be good to move the lang-configurations from managed-schema to its own xml file as discussed in https://issues.apache.org/jira/browse/SOLR-11948 What do other people think? Thanks SG

New replica types

Hi, I was excited to see some good work in having more replica types for Solr. However, Solr documentation left me with a few questions. https://lucene.apache.org/solr/guide/7_2/shards-and-indexing-data-in-solrcloud.html#types-of-replicas This is what I could come up with: (Note that each

Re: New replica types

100) Thanks SG On Tue, Jan 2, 2018 at 8:58 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 1/2/2018 8:02 PM, S G wrote: > >> If the above is incorrect, can someone please point that out? >> > > Assuming I have a correct understanding of how the different replic

Re: Confusing DocValues documentation

the _internal_ Lucene document id, > which is a simple zero-based integer that contains the value > associated with that doc for that field (I'm simplifying a bit, but > that's conceptually the deal). > FieldA > doc1 = 1 > doc2 = 2 > doc3 = > > FieldB > doc1 = 2 >

"add-field" completes in minutes and sends replicas into full recovery

Hi, I have a Solr 6.5.1 cluster with a collection spawning 30 VMs. I see that commands like the below "add-field" command complete in minutes and send replicas into full recovery: curl -X POST -H 'Content-type:application/json' --data-binary

Confusing DocValues documentation

Hi, It seems that docValues are not really explained well anywhere. Here are 2 links that try to explain it: 1) https://lucidworks.com/2013/04/02/fun-with-docvalues-in-solr-4-2/ 2) https://www.elastic.co/guide/en/elasticsearch/guide/current/docvalues.html And official Solr documentation that

DocValues for multivalued strings and boolean fields

Hi, One of our Solr users is trying to set docValues="true" for multivalued string fields and boolean-type fields. I am not sure what the performance impact of that would be. Can docValues negatively affect performance in any way? We are using Solr 6.5.1 and also experimenting with 7.1.0

KeeperErrorCode = NoNode for /collections/my-valid-collection/state.json

Hi, Following error is very commonly seen in Solr. Does anybody know why that is so? And is it asking the user to do something about it? org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for

Why are cursor mark queries recommended over regular start, rows combination?

Hi, We have use-cases where some queries will return about 100k to 500k records. As per https://lucene.apache.org/solr/guide/7_2/pagination-of-results.html, it seems that using start=x, rows=y is a bad combination performance wise. 1) However, it is not clear to me why the alternative:

Re: Why are cursor mark queries recommended over regular start, rows combination?

Thanks everybody. This is lot of good information. And we should try to update this in the documentation too to help users make the right choice. I can take a stab at this if someone can point me how to update the documentation. Thanks SG On Tue, Mar 13, 2018 at 2:04 PM, Chris Hostetter

Expose a metric for percentage-recovered during full recoveries

Hi, Solr does full recoveries very frequently - sometimes even for seemingly simple cases like adding a field to the schema, a couple of nodes go into recovery. It would be nice if it did not do such full recoveries so frequently but since that may require a lot of fixing, can we have a metric

Solr 7 or 6 - stability and performance

Hi, Solr 7 has been out for about 6 months now. (Sep-2017 to Mar-2018) We are planning some major upgrades from 6.2 and 6.4 versions of Solr and I wanted to see how is Solr 7 looking in terms of stability and performance. (Have seen http://lucene.apache.org/solr/news.html but some real users'

Can high RF slow down updates?

Hi, To support higher select-query-rates, we are planning to increase the replication factor from 15 to 24. Will this put too much load on the leader nodes? since each update now has to be propagated to 24 replica nodes. Each node is on a different IP but in the same availability region within a

Re: ZooKeeper for Solr 7.6

Why don't you try 3.4.13 instead? That's a version newer than 3.4.12 On Tue, Dec 18, 2018 at 12:37 AM Yasufumi Mizoguchi wrote: > Thank you Jan. > > I will try it. > > Thanks, > Yasufumi. > > 2018年12月18日(火) 17:21 Jan Høydahl : > > > That is no problem, doing it myself. > > > > -- > > Jan

Discuss: virtual nodes in Solr

Hi, Has Solr tried to use vnodes concept like Cassandra: https://www.datastax.com/dev/blog/virtual-nodes-in-cassandra-1-2 If this can be implemented carefully, we need not live with just shard-splitting alone that can only double the number of shards. With vnodes, shards can be increased

Does Solr delete child documents with parents?

Hi, Last section of https://lucene.apache.org/solr/guide/8_0/indexing-nested-documents.html is a little bit confusing: To delete a nested document, you can delete it by the ID of the root document. If you try to use an ID of a child document, nothing will happen since only root document IDs are

Re: Discuss: virtual nodes in Solr

her than > doubling shards isn’t an extraordinary benefit. That effort would come at > the expense of a lot of other work. > > Another way of saying it is that the burden of proof for the benefits is > on you ;). > > Best, > Erick > > > On Jun 28, 2019, at 8:51 PM, Wil

Why does Solr sort on _docid_ with rows=0 ?

Hi, I see a lot of such queries in my Solr 7.6.0 logs: *path=/select params={q=*:*=false=_docid_+asc=0=javabin=2} hits=287128180 status=0 QTime=7173* On some searching, this is the code seems to fire the above:

Re: Why does Solr sort on _docid_ with rows=0 ?

So no one knows this then? It seems like a good opportunity to get some performance! On Tue, Feb 25, 2020 at 2:01 PM S G wrote: > Hi, > > I see a lot of such queries in my Solr 7.6.0 logs: > > > *path=/select > params={q=*:*=false=_docid_+asc=0=javabin=2} > hits=28712

Re: Why does Solr sort on _docid_ with rows=0 ?

Thanks Hoss. Yes, that jira seems like a good one to fix. And the variable name definitely does not explain why it will not cause any sort operation. -SG On Mon, Mar 2, 2020 at 10:06 AM Chris Hostetter wrote: > : docid is the natural order of the posting lists, so there is no sorting > effort.

Is Banana deprecated?

Hello, I still see releases happening on it: https://github.com/lucidworks/banana/pull/355 So it is something recommended to be used for production? Regards, SG

Re: Solrcloud 7.6 OOM due to unable to create native threads

to > > separate DCs rathe than try to have CDCR re-invent that wheel. > > > > Best, > > Erick > > > > > On Mar 29, 2020, at 6:47 PM, S G wrote: > > > > > > Is CDCR even recommended to be used in production? > > > Or it was abandoned b

Re: Solrcloud 7.6 OOM due to unable to create native threads

Is CDCR even recommended to be used in production? Or it was abandoned before it could become production ready ? Thanks SG On Sun, Mar 29, 2020 at 5:18 AM Erick Erickson wrote: > What that error usually means is that there are a zillion threads running. > > Try taking a thread dump. It’s

Re: Cross DC CloudSolr Client

Is there any good way of having a load-balancer across two SolrCloud clusters (version 8.x or 7.x) that are in different regions (like Azure East and Azure West) ? Thanks SG On Thu, Mar 26, 2020 at 4:53 AM Erick Erickson wrote: > I’ve never even heard of someone trying to put > different

Re: Solr Ref Guide Redesign coming in 8.6

I really like the docs and version selecting provided by Graylog https://docs.graylog.org/en/3.2/ It says this on the bottom: Built with Sphinx using a theme provided by Read the Docs . I do not have

Can Solr-Zookeeper traffic be encrypted in 8.x?

Hi, Documentation says that this is not supported https://lucene.apache.org/solr/guide/8_4/enabling-ssl.html#ssl-with-solrcloud But most of the ZK-issues mentioned there are resolved or duplicates of resolved issues. And Zookeeper has a page on how to use SSL with no mention of any issues.

Getting rid of zookeeper

Hello, I recently stumbled across KIP-500: Replace ZooKeeper with a Self-Managed Metadata Quorum Elastic-search does this too. And so do many other systems. Is there some work to

Recommended version of zookeeper for latest 8.7 or upcoming 8.8 version

Hello, What version of zookeeper is recommended for latest 8.7 or upcoming 8.8 version ? Can we use the 3.6.2 version of zookeeper? Thanks!

Re: impressive improvement in documentation

One good way to achieve this is to use an alias 'current' So the 'current' replaces the latest version string like 7.1 and 8.6 in the URL. And Google will most likely show the current version on top always as it will see it as changing frequently, so will think that it is something more important

Re: Is 8.8.x going be stabilized and finalized?

Hey Subhajit, Can you share briefly what issues are being seen with 8.7+ versions? We are planning to move a big workload from 7.6 to 8.7 version. We created a small load-testing tool for sanitizing new Solr versions and that showed throughput of traffic decreasing much more than Solr 7.6 as we