Re: Search inside grouping list

Hi Emir, Grouping by default is part of the configuration true assetid true Don. -- View this message in context: http://lucene.472066.n3.nabble.com/Search-inside-grouping-list-tp4333488p4334136.html Sent from the Solr - User mailing list

Re: SOLR as nosql database store

You will want to have both solr and a sql/nosql data storage option. They serve different purposes > On May 8, 2017, at 10:43 PM, bharath.mvkumar > wrote: > > Hi All, > > We have a use case where we have mysql database which stores documents and > also some of

Re: SOLR as nosql database store

Hi Bharath, In general its not a good idea to use Solr as the *primary data store* for various reasons listed here, https://wiki.apache.org/solr/HowToReindex But if you design your system such that at-least one copy of the raw data is stored in some

SOLR as nosql database store

Hi All, We have a use case where we have mysql database which stores documents and also some of the fields in the document is also indexed in solr. We plan to move all those documents to solr by making solr as the nosql datastore for storing those documents. The reason we plan to do this is

Re: OutOfMemoryError and Too many open files

Solr/Lucene really like having a bunch of files available, so bumping the ulimit is often the right thing to do. This assumes you don't have any custom code that is failing to close searchers and the like. Best, Erick On Mon, May 8, 2017 at 10:40 AM, Satya Marivada

Re: OutOfMemoryError and Too many open files

On 5/8/2017 11:40 AM, Satya Marivada wrote: > Started getting below errors/exceptions. I have listed the resolution > inline. Could you please see if I am headed right? > > java.lang.OutOfMemoryError: unable to create new native thread > java.io.IOException: Too many open files I have never had

Re: SessionExpiredException

This is on solr-6.3.0 and external zookeeper 3.4.9 On Wed, May 3, 2017 at 11:39 PM Zheng Lin Edwin Yeo wrote: > Are you using SolrCloud with external ZooKeeper, or Solr's internal > ZooKeeper? > > Also, which version of Solr are you using? > > Regards, > Edwin > > On 3 May

OutOfMemoryError and Too many open files

Hi, Started getting below errors/exceptions. I have listed the resolution inline. Could you please see if I am headed right? The below error basically says that there are no more threads can be created as the limit has reached. We have big index and I assume the threads are being created outside

Need Help on solr for Email Search

HI Team, We are using solr for Quick retrieval of search result. Recently we are encountered with a problem while searching for Email in solr. search is performing well when i enter simple text ,but When i enter any special characters (Like @ ,(comma)) it is not returning any results. i have

Re: SessionExpiredException

The 3g memory is doing well, performing a gc at 600-700 MB. -XX:+UseConcMarkSweepGC -XX:+UseParNewGC Here are my jvm start up The start up parameters are: java -server -Xms3g -Xmx3g -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC

Re: SessionExpiredException

Which garbage collector are you using? The default GC will probably give long pauses. You need to use CMS or G1. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On May 8, 2017, at 8:48 AM, Erick Erickson wrote: > > 3G of

Re: SessionExpiredException

3G of memory should not lead to long GC pauses unless you're running very close to the edge of available memory. Paradoxically, running with 6G of memory may lead to _fewer_ noticeable pauses since the background threads can do the work, well, in the background. Best, Erick On Mon, May 8, 2017

Re: distribution of leader and replica in SolrCloud

Also, you can specify custom placement rules, see: https://cwiki.apache.org/confluence/display/solr/Rule-based+Replica+Placement But Shawn's statement is the nub of what you're seeing, by default multiple JVMs on the same physical machine are considered separate Solr instances. Also note that if

Re: JSON facet performance for aggregations

On Mon, May 8, 2017 at 3:55 AM, Mikhail Ibraheem wrote: > Thanks Yonik. > It is double because our use case allows to group by any field of any type. Grouping in Solr does not require a double type, so I'm not sure how that logically follows. Perhaps it's a

Re: distribution of leader and replica in SolrCloud

On 5/8/2017 5:38 AM, Bernd Fehling wrote: > boss -- shard1 - server2:7574 >| |-- server2:8983 (leader) The reason that this happened is because you've got two nodes running on every server. From SolrCloud's perspective, there are ten distinct nodes, not five.

Re: SessionExpiredException

Hi Piyush and Shawn, May I ask what is the solution for it, if it is the long gc pauses? I am skeptical about the same problem in our case too. We have started with 3G of memory for the heap. Did you have to adjust some of the memory allotted? Very much appreciated. Thanks, Satya On Sat, May 6,

Re: Adding shards dynamically when the automatic routing is used

On 5/8/2017 2:07 AM, mganeshs wrote: > Is there possiblity in near future in coming new releases, adding > shards dynamically though compositeId ( default ) based routing is > used. Currently only option is we need to split the shard, instead we > should able to add shards dynamically and then on

Re: distribution of leader and replica in SolrCloud

And then delete replica shard2-->server1:8983 and add replica shard2-->server2:7574 ? Would be nice to have some automatic logic like ES (_cluster/reroute with move). Regards Bernd Am 08.05.2017 um 14:16 schrieb Amrit Sarkar: > Bernd, > > When you create a collection via Collections API, the

Re: Search inside grouping list

Hi Don, This is query without grouping and returns expected results. But when you apply grouping by some field, you get wrong results? Can you share query results and query with grouping. Emir On 08.05.2017 14:28, donjose wrote: Hi Emir, Thank you for the response. Please find the query

Re: Search inside grouping list

Hi Emir, Thank you for the response. Please find the query which i am sending to SOLR http://localhost:8983/solr/pema/select?fq=color:red=on=*:*=json Regards, Don. -- View this message in context: http://lucene.472066.n3.nabble.com/Search-inside-grouping-list-tp4333488p4333936.html Sent

Re: SPLITSHARD Working

Vrinda, The expected behavior if parent shard 'shardA' resides on node'1', node'2' ... node'n' and do a SPLITSHARD on it. the child shards, shardA_0 and shardA_1 will reside on node'1', node'2' ... node'n'. shardA --- node'1' (leader) & node'2' (replica) after splitshard; shardA ---

Re: distribution of leader and replica in SolrCloud

Bernd, When you create a collection via Collections API, the internal logic tries its best to equally distribute the nodes across the shards but sometimes it don't happen. The best thing about SolrCloud is you can manipulate its cloud architecture on the fly using Collections API. You can delete

Re: Search inside grouping list

Hi, Can you please provide full query that you are sending to Solr. Thanks, Emir On 08.05.2017 07:18, donjose wrote: Could anyone can please reply for this query -- View this message in context: http://lucene.472066.n3.nabble.com/Search-inside-grouping-list-tp4333488p4333870.html Sent

distribution of leader and replica in SolrCloud

My assumption was that the strength of SolrCloud is the distribution of leader and replica within the Cloud and make the Cloud somewhat failsafe. But after setting up SolrCloud with a collection I have both, leader and replica, on the same shard. And this should be failsafe?

Re: SPLITSHARD Working

Thanks I go it. But I see that distribution of shards and replicas is not equal. For Example in my case : I had shard 1 and shard2 on Node 1 and their replica_1 and replica_2 on Node 2. I did SHARDSPLIT on shard1 to get shard1_0 and shard1_1 such that and shard1_0_replica0 are created on

Re: SPLITSHARD Working

No, split always happens on the original node. But you can move the sub-shard leader to a new node once the split is complete by using AddReplica/DeleteReplica collection API. On Mon, May 8, 2017 at 1:02 PM, vrindavda wrote: > Hi, > > I need to SPLITSHARD such that one split

Re: Automatic conversion to Range Query

Of course, I should have noticed he typed 3G instead of 32G. On 2017-05-07 10:46 AM, Aman Deep Singh wrote: Yes Rick, User is actually typing this type of queries ,this was a random user query pick from access logs On 07-May-2017 7:29 PM, "Rick Leir" wrote: Hi Aman, Is

6.5.1. cloud went partially down

Hi, Multiple 6.5.1. clouds / collections went down this weekend around the same time, they share the same ZK quorum. The nodes stayed up but did not rejoin the cluster (find or connect to ZK) This is what the log told us: 2017-05-06 18:58:34.893 WARN

Adding shards dynamically when the automatic routing is used

All, Is there possiblity in near future in coming new releases, adding shards dynamically though compositeId ( default ) based routing is used. Currently only option is we need to split the shard, instead we should able to add shards dynamically and then on all new documents should go on new

RE: JSON facet performance for aggregations

Thanks Yonik. It is double because our use case allows to group by any field of any type. According to your below valuable explanation, is it better at this case to use flat faceting instead of JSON faceting? Indexing the field should give us better performance than flat faceting? Do you

SPLITSHARD Working

Hi, I need to SPLITSHARD such that one split remains on the same machine as original and another uses new machines for leader and replicas. Is this possible ? Please let me know what properties do I need to specify in Collection API to achieve this. Thank you, Vrinda Davda -- View this

Re: Fw: How to secure solr-6.2.0 in standalone mode?

Christian Cool, you prompted me to learn something. Is your answer in the following cwiki link? https://cwiki.apache.org/confluence/display/solr/Kerberos+Authentication+Plugin cheers -- Rick google apache kerberos basic auth On 2017-05-07 05:21 PM, FOTACHE CHRISTIAN wrote: Hi I'm