Re: solrcloud through aws elb

2017-12-26 Thread Rick Leir
>I am trying to connect to a solrcloud through a elb from a Drupal 7 >install, the elb is a tcp elb which seems to work well, drupal says it >can talk to the solr install through the elb but when I try to index >nothing seems to happen. > >Does anyone have any ideas on how to r

solrcloud through aws elb

2017-12-26 Thread Per Qvindesland
Hi All I am trying to connect to a solrcloud through a elb from a Drupal 7 install, the elb is a tcp elb which seems to work well, drupal says it can talk to the solr install through the elb but when I try to index nothing seems to happen. Does anyone have any ideas on how to resolve

Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-25 Thread hemanth
As per my understanding, distrib=false will be added in select query to restrict the document selection to particular shard. But how should i route the documents to only particular shard, is still my need. Thanks Hemanth -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-25 Thread Erick Erickson
I suspect that when you create your collections, somehow you're not doing it like you expect. The red flag is: I tried creating a collection with compositeId routing which created shard1,shard2,shard3 , but when I indexed , all the documents went to one shard only This simply shouldn't be

Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-25 Thread hemanth
Hi Erik, Thanks for your reply. I have no issues of using either Implicit or Composite routing but I want to insert the documents to a particular shard, so that when I want to query the data , I can hit a particular shard, which gives me the results in lesser time as it hits only particular shard.

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-20 Thread Erick Erickson
> wrote: >> >> > >> >> > > On 12/19/2017 3:06 PM, Greg Roodt wrote: >> >> > > > Thanks for your reply Erick. >> >> > > > >> >> > > > This is what I'm doing at the moment with Solr 6.2 (I was >&

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-20 Thread Greg Roodt
> Thanks for your reply Erick. > >> > > > > >> > > > This is what I'm doing at the moment with Solr 6.2 (I was > mistaken, > >> > > before > >> > > > I said 6.1). > >> > > > > >> > > > 1. A

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-20 Thread Erick Erickson
>> > > > 1. A new instance comes online >> > > > 2. Systemd starts solr with a custom start.sh script >> > > > 3. This script creates a core.properties file that looks like this: >> > > > ``` >> > > > name=blah >> > >

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Greg Roodt
; > name=blah > > > > shard=shard1 > > > > ``` > > > > 4. Script starts solr via the jar. > > > > ``` > > > > java -DzkHost=... -jar start.jar > > > > ``` > > > > > > The way that we would expect this

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Erick Erickson
gt; > > 4. Script starts solr via the jar. > > > ``` > > > java -DzkHost=... -jar start.jar > > > ``` > > > > The way that we would expect this to be normally done is a little > > different. Adding a node to the cloud normally will NOT copy any

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Greg Roodt
t; shard=shard1 > > ``` > > 4. Script starts solr via the jar. > > ``` > > java -DzkHost=... -jar start.jar > > ``` > > The way that we would expect this to be normally done is a little > different. Adding a node to the cloud normally will NOT copy any

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Shawn Heisey
to the cloud normally will NOT copy any indexes.  You have basically tricked SolrCloud into adding the replica automatically by creating a core before Solr starts.  SolrCloud incorporates the new core into the cluster according to the info that you have put in core.properties, notices that it has no i

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-19 Thread Greg Roodt
Thanks for your reply Erick. This is what I'm doing at the moment with Solr 6.2 (I was mistaken, before I said 6.1). 1. A new instance comes online 2. Systemd starts solr with a custom start.sh script 3. This script creates a core.properties file that looks like this: ``` name=blah shard=shard1

Re: Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-18 Thread Erick Erickson
What have you configured to add the replica when a new node is spun up? If you're just copying the entire directory including the core.properties file, you're just getting lucky. The legcyCloud=true default is _probably_ adding the replica with a new URL and thus making it distinct. Please

Solr 7.1 Solrcloud dynamic/automatic replicas

2017-12-18 Thread Greg Roodt
Hi Background: * I am looking to upgrade from Solr 6.1 to Solr 7.1. * Currently the system is run in cloud mode with a single collection and single shard per node. * Currently when a new node is added to the cluster, it becomes a replica and copies the data / core "automagically". Question: Is

Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-15 Thread Erick Erickson
You're misinterpreting the docs. _route_ is used to tell _queries_ where to go, or to route a document as part of the parameters when you send the doc, not a field in the doc. So when you added the _route_ field to the doc, you didn't have it in the schema in the first place. So you could add a

Re: indexing data to solrcloud with "implicit" is not distributing across cluster.

2017-12-15 Thread hemanth
I created a collection with implicit routing mechanism and my shared names are Active and Disabled , these are the values of one of my collection field: Status. But when I am trying to upload the document using Solr UI documents section : Upload using JSON format with all the fields including

Re: SolrCloud

2017-12-15 Thread John Davis
Thanks Erick. I agree SolrCloud is better than master/slave, however we have some questions between managing replicas separately vs with solrcloud. For eg how much overhead do SolrCloud nodes have wrt memory/cpu/disk in order to be able to sync pending index updates to other replicas? What

Re: SolrCloud

2017-12-15 Thread Erick Erickson
The main advantage in SolrCloud in your setup is HA/DR. You say you have multiple replicas and shards. Either you have to index to each replica separately or you use master/slave replication. In either case you have to manage and fix the case where some node goes down. If you're using master/slave

SolrCloud

2017-12-15 Thread John Davis
Hello, We are thinking about migrating to SolrCloud. Our current setup is: 1. Multiple replicas and shards. 2. Each query typically hits a single shard only. 3. We have an external system that assigns a document to a shard based on it's origin and is also used by solr clients when querying to find

RE: [EXTERNAL] - Re: sharing the same param value in Solrcloud

2017-12-14 Thread Steve Pruitt
solr-user <solr-user@lucene.apache.org> Subject: [EXTERNAL] - Re: sharing the same param value in Solrcloud Solr gets the query on some node. It then sends sub-requests out to one replica for each shard, perhaps on other nodes. You'd have to insure that the parameters get added before

Re: sharing the same param value in Solrcloud

2017-12-13 Thread Erick Erickson
Solr gets the query on some node. It then sends sub-requests out to one replica for each shard, perhaps on other nodes. You'd have to insure that the parameters get added before the subrequests are made. In the logs you'll see things like DISTRIB=false for sub-requests, so the first thing to check

sharing the same param value in Solrcloud

2017-12-13 Thread Steve Pruitt
I am trying to work out how to share a parameter value in all the Solr nodes in a cluster. I have two custom search components. One is defined in the first-components list and the other is defined in the last-components list. Ideally, the first-component creates the parameter value and sets

Re: solrcloud in production - Jetty vs tomcat

2017-12-13 Thread Cassandra Targett
gt; wrote: > We are setting up solrcloud 6.6 in production. In some blogs, I see that > Jetty is not recommended in prod environment. Is that the case ? Any > specific disadvantages of going with Jetty ? > > Sent from Yahoo Mail on Android

solrcloud in production - Jetty vs tomcat

2017-12-13 Thread Hari Baskar
We are setting up solrcloud 6.6 in production. In some blogs, I see that Jetty is not recommended in prod environment. Is that the case ? Any specific disadvantages of going with Jetty ? Sent from Yahoo Mail on Android

Re: How to perform delta-import on SolrCloud mode through a scheduler?

2017-12-12 Thread Shawn Heisey
is available as a Java object that's easy to use in code -- you don't have to worry about parsing the response into Java objects. > Now, I want to deploy the application in SolrCloud mode and for each core, > there will be 2 more replicas. Most things in SolrCloud should be done at the collection

Re: Solrcloud Drupal 7

2017-12-11 Thread Fengtan
; On 11 Dec 2017, at 14:57, Fengtan <fengtan...@gmail.com> wrote: > > > > Hi, > > > > Drupal can talk to a SolrCloud cluster the same way it talks to a > > standalone Solr server, i.e. by using the Search API suite > > https://www.drupal.org/project/search_a

Re: Solrcloud Drupal 7

2017-12-11 Thread Per Qvindesland
the instances. Regards Per > On 11 Dec 2017, at 14:57, Fengtan <fengtan...@gmail.com> wrote: > > Hi, > > Drupal can talk to a SolrCloud cluster the same way it talks to a > standalone Solr server, i.e. by using the Search API suite > https://www.drupal.org/project/se

Re: Solrcloud Drupal 7

2017-12-11 Thread Fengtan
Hi, Drupal can talk to a SolrCloud cluster the same way it talks to a standalone Solr server, i.e. by using the Search API suite https://www.drupal.org/project/search_api You will have to create the collection yourself on Solr though (Drupal will not do it for you). If you want to take

Solrcloud Drupal 7

2017-12-11 Thread Per Qvindesland
the redundancy and maybe even the performance, I followed http://www.francelabs.com/blog/tutorial-deploying-solrcloud-6-on-amazon-ec2/ to get the cloud up and running but I need some guidance on how to add in a new shard/collection so I can point the drupal instances to the new solr cloud, does

How to perform delta-import on SolrCloud mode through a scheduler?

2017-12-08 Thread Sabeer Hussain
new InputStreamReader( connection.getInputStream())); String decodedString; while ((decodedString = in.readLine()) != null) { System.out.println(decodedString); } in.close(); out.cl

Re: [EXTERNAL] - Re: SolrCloud Windows Service

2017-12-06 Thread Shawn Heisey
On 12/6/2017 11:15 AM, Steve Pruitt wrote: > If I sign out, I lose my running Solr. I need to start it up and then sign > out. If you're starting Solr with NSSM and having that problem, I think that would be something to discuss with the NSSM project.  That behavior sounds like Solr is not

RE: [EXTERNAL] - Re: SolrCloud Windows Service

2017-12-06 Thread Steve Pruitt
If I sign out, I lose my running Solr. I need to start it up and then sign out. Thanks. -S -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Wednesday, December 06, 2017 12:10 PM To: solr-user@lucene.apache.org Subject: [EXTERNAL] - Re: SolrCloud Windows Service

Re: SolrCloud Windows Service

2017-12-06 Thread Shawn Heisey
On 12/6/2017 9:39 AM, Steve Pruitt wrote: > Can someone suggest the best method for starting SolrCloud as a Windows > Service? > > I have used nssm prior. It works ok for Solr standalone, but doesn't seem to > work correctly for SolrCloud. This could simply be me not configuring

SolrCloud Windows Service

2017-12-06 Thread Steve Pruitt
Can someone suggest the best method for starting SolrCloud as a Windows Service? I have used nssm prior. It works ok for Solr standalone, but doesn't seem to work correctly for SolrCloud. This could simply be me not configuring the service in nssm. If anyone has a working method, my thanks

Re: Logging in Solrcloud

2017-12-05 Thread Walter Underwood
+Business Media. > --- > Springer Science+Business Media Deutschland GmbH > Registered Office: Berlin / Amtsgericht Berlin-Charlottenburg, HRB 152987 B > Directors: Derk Haank, Martin Mos, Dr. Ulrich Vest > > ____ > Von: Walter Underwood

AW: Logging in Solrcloud

2017-12-05 Thread Matzdorf, Stefan, Springer SBM DE
cht Berlin-Charlottenburg, HRB 152987 B Directors: Derk Haank, Martin Mos, Dr. Ulrich Vest Von: Walter Underwood <wun...@wunderwood.org> Gesendet: Dienstag, 5. Dezember 2017 16:20 An: solr-user@lucene.apache.org Betreff: Re: Logging in Solrcloud In 6.5.1, t

Re: Logging in Solrcloud

2017-12-05 Thread Walter Underwood
In 6.5.1, the intra-cluster requests are POST, which makes them easy to distinguish in the request logs. Also, the intra-cluster requests go to a specific core instead of to the collection. So we use the request logs and grep out the GET lines. We are considering fronting every Solr process

Re: Logging in Solrcloud

2017-12-05 Thread Matzdorf, Stefan, Springer SBM DE
To be more precisely and provide some more details, i tried to simplify the problem by using the Solr-examples that were delivered with the solr So i started bin/solr -e cloud, using 2 nodes, 2 shards and replication of 2. To understand the following, it might be important to know, which

Re: Logging in Solrcloud

2017-12-05 Thread Emir Arnautović
Hi Stefan, I am not aware of option to log only client side queries, but I think that you can find workaround with what you currently have. If you take a look at log lines for query that comes from the client and one that is result of querying shards, you will see differences - the most simple

Logging in Solrcloud

2017-12-04 Thread Matzdorf, Stefan, Springer SBM DE
Hey everybody, i have a question regarding query-request logging in solr-cloud. I've set the the "org.apache.solr.core.SolrCore.Request"-logger to INFO-level and its logging all those query-requests. So far so good. BUT, as I'm running Solr in cloud mode with 3 nodes and 3 shards per

Re: [EXTERNAL] - Re: starting SolrCloud nodes

2017-12-04 Thread Shawn Heisey
't define this, Solr will use Java APIs to figure out the primary IP address of the machine, and it will use that when registering itself into the SolrCloud clusterstate in ZK. Sometimes the Java APIs will choose the wrong address, especially on multi-homed systems, which is why Solr provid

RE: [EXTERNAL] - Re: starting SolrCloud nodes

2017-12-04 Thread Steve Pruitt
:34 PM To: solr-user@lucene.apache.org Subject: [EXTERNAL] - Re: starting SolrCloud nodes On 12/1/2017 10:13 AM, Steve Pruitt wrote: > Thanks to previous help. I have a ZK ensemble of three nodes running. I > have uploaded the config for my collection and the solr.xml file. > I have Solr insta

Re: starting SolrCloud nodes

2017-12-01 Thread Shawn Heisey
y correct. If ZK_HOST is defined or you use the -z option, you do not need to include the -c option when starting Solr.  SolrCloud mode is assumed when ZK info is available.  The only time the -c option is *required* is when you want to start the embedded zookeeper.  Having the option won't

Re: [EXTERNAL] - Re: Basic SolrCloud help

2017-12-01 Thread Shawn Heisey
On 11/30/2017 8:53 AM, Steve Pruitt wrote: > I took the hint and looked at both solr.in.cmd and solr.in.sh. Clearly > setting ZK_HOST is a first step. I am sure this is explained somewhere, but > I overlooked it. > From here, once I have Solr installed, I can run the Control Script to upload

Re: starting SolrCloud nodes

2017-12-01 Thread Erick Erickson
Looks good. If you set ZK_HOST in your solr.in.sh you can forgo setting it when you start, but that's not necessary. Best, Erick On Fri, Dec 1, 2017 at 9:13 AM, Steve Pruitt wrote: > Thanks to previous help. I have a ZK ensemble of three nodes running. I > have uploaded

starting SolrCloud nodes

2017-12-01 Thread Steve Pruitt
Thanks to previous help. I have a ZK ensemble of three nodes running. I have uploaded the config for my collection and the solr.xml file. I have Solr installed on three machines. I think my next steps are: Start up each Solr instance: bin/solr start -c -z "zoo1:2181,zoo2:2181,zoo3:2181" //

RE: [EXTERNAL] - Re: Basic SolrCloud help

2017-11-30 Thread Steve Pruitt
Thanks Shawn, it all mainly made sense. I took the hint and looked at both solr.in.cmd and solr.in.sh. Clearly setting ZK_HOST is a first step. I am sure this is explained somewhere, but I overlooked it. From here, once I have Solr installed, I can run the Control Script to upload a config

Re: Basic SolrCloud help

2017-11-29 Thread Shawn Heisey
On 11/29/2017 11:44 AM, Steve Pruitt wrote: > I want ZK to manage the config files. The config set and the solr.xml file. > I wanted to upload them explicitly. > > This is where my questions begin. > I assume I upload the config files prior to starting Solr? If you're storing solr.xml in ZK,

Basic SolrCloud help

2017-11-29 Thread Steve Pruitt
A couple of steps are still not clear to me. Currently, I have my schema defined. Plus, I have six VM's. I have ZK running on three of the VM's. Now I want to get a SolrCloud cluster running on other three. I may use only two VM's and use my local machine as the third node. I want ZK to manage

Re: Data inconsistencies and updates in solrcloud

2017-11-21 Thread Tom Barber
learly user error, we have a collection in solrcloud that is started numShards=2 replicationFactor=1 solr seems happy the collection seems happy. Yet when we post and update to it and then look at the record again, it seems to only affect one core and not the second. What are we likely to be

Re: Data inconsistencies and updates in solrcloud

2017-11-21 Thread Erick Erickson
, all of the replicas associated with that shard would change. Best, Erick On Tue, Nov 21, 2017 at 12:56 PM, Tom Barber <magicaltr...@apache.org> wrote: > Hi folks > > I can't find an answer to this, and its clearly user error, we have a > collection in solrcloud that is s

Data inconsistencies and updates in solrcloud

2017-11-21 Thread Tom Barber
Hi folks I can't find an answer to this, and its clearly user error, we have a collection in solrcloud that is started numShards=2 replicationFactor=1 solr seems happy the collection seems happy. Yet when we post and update to it and then look at the record again, it seems to only affect one

Re: SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-30 Thread Ere Maijala
On the Solr side there's at least https://issues.apache.org/jira/browse/SOLR-9818 which may cause trouble with the queue. I once had the core reload command in the admin UI add more than 200k entries to the overseer queue.. --Ere Shawn Heisey kirjoitti 25.10.2017 klo 15.57: On 10/24/2017

SSL Enabled SolrCloud to hive - Error while inserting data into external table

2017-10-27 Thread vikashirwani
0 down vote favorite I have solrCloud installed with SSL settings I have created collection1 on solr and created following external table. CREATE EXTERNAL TABLE SolrExtTable (id int,time string,sourceaddress) STORED BY 'com.lucidworks.hadoop.hive.LWStorageHandler' with serdeproperties

Re: [External] Re: SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-25 Thread Shawn Heisey
ding nodes when it exceeds > the buffer. > > We are currently using ZK 3.4.6 to use with SolrCloud 5.1.0. The ZOOKEEPER-1162 issue has not been fixed.  It is a very old bug -- opened six years ago.  They probably aren't going to fix it. If you find that restarting a single Solr instance e

Re: [External] Re: SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-25 Thread Erick Erickson
r suggestion and hope it will > resolve the issue. > > On the side note, would you know if this is an existing bug? if yes, has it > been resolved in later version? i.e. zk allows adding nodes when it exceeds > the buffer. > > We are currently using ZK 3.4.6 to use with SolrCloud

Re: [External] Re: SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-25 Thread Tarjono, C. A.
using ZK 3.4.6 to use with SolrCloud 5.1.0. Thanks again! Best Regards, Christopher Tarjono Accenture Pte Ltd +65 9347 2484 c.a.tarj...@accenture.com From: Shawn Heisey <apa...@elyograg.org> Sent: 25 October 2017 20:57:30 To: solr-user@lucene.apache.org S

Re: SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-25 Thread Shawn Heisey
On 10/24/2017 8:11 AM, Tarjono, C. A. wrote: > Would like to check if anyone have seen this issue before, we started > having this a few days ago: > >   > > The only error I can see in solr console is below: > > 5960847[main-SendThread(172.16.130.132:2281)] WARN > org.apache.zookeeper.ClientCnxn [

RE: [External] Re: SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-25 Thread Tarjono, C. A.
Thanks Eric for your response, please see below link for the image of our solrcloud dashboard that shows the error. https://imgur.com/QCn9BCl Best Regards, Christopher Tarjono Accenture Pte Ltd +65 9347 2484 c.a.tarj...@accenture.com -Original Message- From: Erick Erickson

Re: SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-24 Thread Erick Erickson
The mail server aggressively removes attachments and the like, you'll have to put it somewhere and provide a link. Did anything change in that time frame? Best, Erick On Tue, Oct 24, 2017 at 7:11 AM, Tarjono, C. A. wrote: > Hi All, > > > > Would like to check if

SolrCloud not able to view cloud page - Loading of "/solr/zookeeper?wt=json" failed (HTTP-Status 500)

2017-10-24 Thread Tarjono, C. A.
Hi All, Would like to check if anyone have seen this issue before, we started having this a few days ago: [cid:image003.jpg@01D34D14.FC34F4D0] The only error I can see in solr console is below: 5960847 [main-SendThread(172.16.130.132:2281)] WARN org.apache.zookeeper.ClientCnxn [ ] - Session

Re: Unbalanced CPU no SolrCloud

2017-10-17 Thread Emir Arnautović
hmoud >>>>> >>>>> >>>>> On Mon, Oct 16, 2017 at 12:32 PM, Emir Arnautović < >>>>> emir.arnauto...@sematext.com> wrote: >>>>> >>>>>> Hi Mahmoud, >>>>>> Is this something t

SolrCloud - scalability issues with many collections

2017-10-16 Thread Shawn Heisey
Some time ago, I did some testing with SolrCloud (mostly 5.0 and branch_5x) handling thousands of collections. How that testing went is documented in SOLR-7191.  That issue has been marked as resolved in version 6.3, but no commits were made in the issue, and I haven't seen any evidence

RE: solrcloud dead-lock

2017-10-16 Thread Younge, Kent A - Norman, OK - Contractor
or Cipher_MISMATCH. -Original Message- From: SOLR6931 [mailto:solrpubl...@gmail.com] Sent: Monday, October 16, 2017 9:13 AM To: solr-user@lucene.apache.org Subject: Re: solrcloud dead-lock Hey Kent, Have you managed to find a solution to your problem? I'm currently encountering the exact same

Re: solrcloud dead-lock

2017-10-16 Thread SOLR6931
Hey Kent, Have you managed to find a solution to your problem? I'm currently encountering the exact same issue. Jack -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Mahmoud Almokadem
ources. Even if host same documents (e.g. > leader > >> and > >>>> replica) merges are not likely to happen at the same time and you can > >>>> expect to see such cases. > >>>> > >>>> Thanks, > >>>>

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Emir Arnautović
Solr & Elasticsearch Consulting Support Training - http://sematext.com/ >>>> >>>> >>>> >>>>> On 16 Oct 2017, at 11:58, Mahmoud Almokadem <prog.mahm...@gmail.com> >>>> wrote: >>>>> >

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Mahmoud Almokadem
gt; >>> > >>> On Mon, Oct 16, 2017 at 11:37 AM, Mahmoud Almokadem < > >> prog.mahm...@gmail.com> > >>> wrote: > >>> > >>>> Hi Emir, > >>>> > >>>> We doesn't use routing. > >>>> >

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Emir Arnautović
> prog.mahm...@gmail.com> >>> wrote: >>> >>>> Hi Emir, >>>> >>>> We doesn't use routing. >>>> >>>> Servers is already balanced and the number of documents on each shard >> are >>>> approxi

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Mahmoud Almokadem
n't use routing. > >> > >> Servers is already balanced and the number of documents on each shard > are > >> approximately the same. > >> > >> Nothing running on the servers except Solr and ZooKeeper. > >>

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Emir Arnautović
same. >> >> Nothing running on the servers except Solr and ZooKeeper. >> >> I initialized the client as >> >> String zkHost = "192.168.1.89:2181,192.168.1.99:2181"; >> >> CloudSolrClient solrCloud = new Cl

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Mahmoud Almokadem
s is already balanced and the number of documents on each shard are > approximately the same. > > Nothing running on the servers except Solr and ZooKeeper. > > I initialized the client as > > String zkHost = "192.168.1.89:2181,192.168.1.99:2181"; > &g

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Mahmoud Almokadem
SolrClient solrCloud = new CloudSolrClient.Builder() .withZkHost(zkHost) .build(); solrCloud.setIdField("document_id"); solrCloud.setDefaultCollection(collection); solrCloud.setRequestWriter(new BinaryRequestWriter());

Re: Unbalanced CPU no SolrCloud

2017-10-16 Thread Emir Arnautović
size? Thanks, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 16 Oct 2017, at 10:46, Mahmoud Almokadem <prog.mahm...@gmail.com> wrote: > > We've installed SolrCloud 7.0.1 with two

Unbalanced CPU no SolrCloud

2017-10-16 Thread Mahmoud Almokadem
We've installed SolrCloud 7.0.1 with two nodes and 8 shards per node. The configurations and the specs of the two servers are identical. When running bulk indexing using SolrJ we see one of the servers is fully loaded as you see on the images and the other is normal. Images URLs: https

Re: Solrcloud replication not working

2017-10-12 Thread Shawn Heisey
(Replicable) There is no other error messages related to replication.Any idea why this is happening? Is there any API to run replication manually. The replication feature (which is what exposes the version numbers you have referenced) is *not* a part of normal SolrCloud operation

Re: Solrcloud replication not working

2017-10-12 Thread solr2020
The problem was replicationFactor was set to 1.Now replication works fine while setting replicationFactor as 2. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

[Solr 6.6 w/SolrCloud]: Subqueries - Solr returning a 400 status code, Bad Request when attempting to use the [subquery] transformer

2017-10-12 Thread Damien Hawes
Good day, *Context and background:* I have a set of documents, that initially are quite deeply nested, but as part of the pre-index step the documents are flattened, such that they are at most 2 levels deep - a root document and a list of child documents. Each child document is given some

Re: Querying a specific replica in SolrCloud

2017-10-11 Thread Chris Ulicny
Thanks! I was trying the distrib=false option but was apparently using it incorrectly for the cloud. The shard.info parameter was what I was originally looking for. On Wed, Oct 11, 2017 at 1:09 PM Erick Erickson wrote: > You can route a request to a specific replica by

Re: Querying a specific replica in SolrCloud

2017-10-11 Thread Erick Erickson
You can route a request to a specific replica by solr_node:port/solr/collection1_shard1_replica1/query?distrib=false blah blah The "distrib=false" bit will cause the query to go to that replica and only that replica. You can get the shard (collection1_shard1_replica1) from the admin UI "cores"

Querying a specific replica in SolrCloud

2017-10-11 Thread Chris Ulicny
Hi, We're trying to investigate a possible data issue between two replicas in our cloud setup. We have docValues enabled for a string field, and when we facet by it, the results come back with the expected numbers per value, or zero for all values. Is there a way to tell which replica is

Re: Issue while using Document Routing in SolrCloud 6.1

2017-10-11 Thread Emir Arnautović
Thanki > Sent: Tuesday, October 10, 2017 4:18 PM > To: 'solr-user@lucene.apache.org' > Subject: Issue while using Document Routing in SolrCloud 6.1 > > Hi, > > Need the help regarding to below mention query. > I have configure the 2 collections with each has 2 shard and 2 r

FW: Issue while using Document Routing in SolrCloud 6.1

2017-10-10 Thread Ketan Thanki
r 10, 2017 4:18 PM To: 'solr-user@lucene.apache.org' Subject: Issue while using Document Routing in SolrCloud 6.1 Hi, Need the help regarding to below mention query. I have configure the 2 collections with each has 2 shard and 2 replica and i have implemented Composite document routing for my unique f

Re: Issue while using Document Routing in SolrCloud 6.1

2017-10-10 Thread Emir Arnautović
Hi Ketan, Is it possible that you are indexing only one tenant and that is causing single shard to become hotspot? Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 10 Oct 2017, at 12:47, Ketan

Issue while using Document Routing in SolrCloud 6.1

2017-10-10 Thread Ketan Thanki
Hi, Need the help regarding to below mention query. I have configure the 2 collections with each has 2 shard and 2 replica and i have implemented Composite document routing for my unique field 'Id' where I have use 2 level Tenant route as mentions below. e.g : projectId:158380 modelId:3606

Re: Solrcloud replication not working

2017-10-10 Thread solr2020
i could see different version of the below entries in Leader and replica. While doing index , in replica instance logs we could see it is keep receiving update request from leader but it says no changes, skipping commit. Master (Searching) Master (Replicable) There is no other error

Re: Question regarding Upgrading to SolrCloud

2017-10-05 Thread Cassandra Targett
. On Thu, Oct 5, 2017 at 9:01 AM, Erick Erickson <erickerick...@gmail.com> wrote: > Gopesh: > > There is brand new functionality in Solr 7, see: SOLR-10233, the > "PULL" replica type which is a hybrid SolrCloud replica that uses > master/slave type replication. You should fin

Re: Solrcloud replication not working

2017-10-05 Thread solr2020
thanks. We dont see any error message/any message in logs. And we have enough disk space. We are running solr as root user in ubuntu box but zookeeper process running as zookeeper user.Will that cause the problem? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Solrcloud replication not working

2017-10-05 Thread solr2020
Hi, We are using Solr 6.4.2 & SolrCloud setup. We have two solr instances in the solr cluster.This solrcloud running in ubuntu OS. The problem is replication is not happening between these two solr instances. sometimes it replicate 10% of the content and sometimes not. In Zookeeper ensembl

Re: Solrcloud replication not working

2017-10-05 Thread Erick Erickson
com> wrote: > Hi, > > We are using Solr 6.4.2 & SolrCloud setup. We have two solr instances in the > solr cluster.This solrcloud running in ubuntu OS. The problem is replication > is not happening between these two solr instances. sometimes it replicate > 10%

Re: Question regarding Upgrading to SolrCloud

2017-10-05 Thread Erick Erickson
Gopesh: There is brand new functionality in Solr 7, see: SOLR-10233, the "PULL" replica type which is a hybrid SolrCloud replica that uses master/slave type replication. You should find this in the reference guide, the 7.0 ref guide should be published soon. Meanwhile, that JIRA will le

Solrcloud replication not working

2017-10-05 Thread solr2020
Hi, We are using Solr 6.4.2 & SolrCloud setup. We have two solr instances in the solr cluster.This solrcloud running in ubuntu OS. The problem is replication is not happening between these two solr instances. sometimes it replicate 10% of the content and sometimes not. In Zookeeper ensembl

Question regarding Upgrading to SolrCloud

2017-10-05 Thread Gopesh Sharma
Hello Guys, As of now we are running Solr 3.4 with Master Slave Configuration. We are planning to upgrade it to the lastest version (6.6 or 7). Questions I have before upgrading 1. Since we do not have a lot of data, is it required to move to SolrCloud or continue using it Master Slave

Re: Question regarding Upgrading to SolrCloud

2017-10-05 Thread Emir Arnautović
uys, > > As of now we are running Solr 3.4 with Master Slave Configuration. We are > planning to upgrade it to the lastest version (6.6 or 7). Questions I have > before upgrading > > > 1. Since we do not have a lot of data, is it required to move to SolrCl

Question regarding Upgrading to SolrCloud

2017-10-05 Thread Gopesh Sharma
Hello Guys, As of now we are running Solr 3.4 with Master Slave Configuration. We are planning to upgrade it to the lastest version (6.6 or 7). Questions I have before upgrading 1. Since we do not have a lot of data, is it required to move to SolrCloud or continue using it Master Slave

Re: tipping point for using solrcloud—or not?

2017-10-04 Thread Shawn Heisey
On 9/29/2017 6:34 AM, John Blythe wrote: complete noob as to solrcloud here. almost-non-noob on solr in general. we're experiencing growing pains in our data and am thinking through moving to solrcloud as a result. i'm hoping to find out if it seems like a good strategy or if we need to get

SolrCloud 6.5.1 Error trying to proxy request for url

2017-10-03 Thread ankurgaikwad
Log - 2017-10-02 20:08:19.346 WARN (qtp1533664441-161957) [ ] o.e.j.h.HttpParser parse exception: java.lang.IllegalStateException: too much data seeking EOF in CLOSE for HttpChannelOverHttp@1aec8a82{r=1,c=false,a=IDLE,uri=null} 2017-10-02 20:08:19.409 ERROR (qtp1533664441-160833) [ ]

Re: tipping point for using solrcloud—or not?

2017-10-02 Thread John Blythe
/S will work for you. > > But otherwise I'd be using SolrCloud. > > Best, > Erick > > On Mon, Oct 2, 2017 at 1:48 PM, John Blythe <johnbly...@gmail.com> wrote: > > thanks for the responses, guys. > > > > erick: we do need NRT in several cases. also in need of

Re: tipping point for using solrcloud—or not?

2017-10-02 Thread Erick Erickson
NRT it's really "10 minutes is OK" then M/S will work for you. But otherwise I'd be using SolrCloud. Best, Erick On Mon, Oct 2, 2017 at 1:48 PM, John Blythe <johnbly...@gmail.com> wrote: > thanks for the responses, guys. > > erick: we do need NRT in several cases. also in

<    4   5   6   7   8   9   10   11   12   13   >