Re: Query regarding Solr Cloud Setup

[Erick Erickson]

Ok, you can set it as a sysvar when starting solr. Or you can change your
solrconfig.xml to either use classic schema (schema.xml) or take out the
add-unknown-fields... from the update processor chain. You can also set a
cluster property IIRC. Better to use one of the supported options...

On Fri, Sep 6, 2019, 05:22 Porritt, Ian  wrote:

> Hi Jörn/Erick/Shawn thanks for your responses.
>
> @Jörn - much apprecaited for the heads up on Kerberos authentication its
> something we havent really considered at the moment, more production this
> may well be the case. With regards to the Solr Nodes 3 is something we are
> looking as a minimum, when adding a new Solr Node to the cluster will
> settings/configuration be applied by Zookeeper on the new node or is there
> manual intervention?
> @Erick - With regards to the core.properties, on standard Solr the
> update.autoCreateFields=false is within the core.properites file however
> for Cloud I have it added within Solrconfig.xml which gets uploaded to
> Zookeeper, apprecaite standard and cloud may work entirely different just
> wanted to ensure it’s the correct way of doing it.
> @Shawn - Will try the creation of the lib directory in Solr Home to see if
> it gets picked up and having 5 Zookeepers would more than satisy high
> availability.
>
>
> Regards
> Ian
>
> -Original Message-
> From: Jörn Franke 
>
> If you have a properly secured cluster eg with Kerberos then you should
> not update files in ZK directly. Use the corresponding Solr REST interfaces
> then you also less likely to mess something up.
>
> If you want to have HA you should have at least 3 Solr nodes and replicate
> the collection to all three of them (more is not needed from a HA point of
> view). This would also allow you upgrades to the cluster without downtime.
>
> -Original Message-
> From: erickerick...@gmail.com>
> Having custom core.properties files is “fraught”. First of all, that file
> can be re-written. Second, the collections ADDREPLICA command will create a
> new core.properties file. Third, any mistakes you make when hand-editing
> the file can have grave consequences.
>
> What change exactly do you want to make to core.properties and why?
>
> Trying to reproduce “what a colleague has done on standalone” is not
> something I’d recommend, SolrCloud is a different beast. Reproducing the
> _behavior_ is another thing, so what is the behavior you want in SolrCloud
> that causes you to want to customize core.properties?
>
> Best,
> Erick
>
> -Original Message-
> From: Shawn Heisey 
>
> I cannot tell what you are asking here.  The core.properties file lives
> on the disk, not in ZK.
>
> I was under the impression that .jar files could not be loaded into ZK
> and used in a core config.  Documentation saying otherwise was recently
> pointed out to me on the list, but I remain skeptical that this actually
> works, and I have not tried to implement it myself.
>
> The best way to handle custom jar loading is to create a "lib" directory
> under the solr home, and place all jars there.  Solr will automatically
> load them all before any cores are started, and no config commands of
> any kind will be needed to make it happen.
>
> > Also from a high availability aspect, if I effectivly lost 2 of the Solr
> > Servers due to an outage will the system still work as expected? Would I
> > expect any data loss?
>
> If all three Solr servers have a complete copy of all your indexes, then
> you should remain fully operational if two of those Solr servers go down.
>
> Note that if you have three ZK servers and you lose two, that means that
> you have lost zookeeper quorum, and in that situation, SolrCloud will
> transition to read only -- you will not be able to change any index in
> the cloud.  This is how ZK is designed and it cannot be changed.  If you
> want a ZK deployment to survive the loss of two servers, you must have
> at least five total ZK servers, so more than 50 percent of the total
> survives.
>
> Thanks,
> Shawn
>

RE: Query regarding Solr Cloud Setup

[Porritt, Ian]

Hi Jörn/Erick/Shawn thanks for your responses.

@Jörn - much apprecaited for the heads up on Kerberos authentication its 
something we havent really considered at the moment, more production this may 
well be the case. With regards to the Solr Nodes 3 is something we are looking 
as a minimum, when adding a new Solr Node to the cluster will 
settings/configuration be applied by Zookeeper on the new node or is there 
manual intervention?
@Erick - With regards to the core.properties, on standard Solr the 
update.autoCreateFields=false is within the core.properites file however for 
Cloud I have it added within Solrconfig.xml which gets uploaded to Zookeeper, 
apprecaite standard and cloud may work entirely different just wanted to ensure 
it’s the correct way of doing it.
@Shawn - Will try the creation of the lib directory in Solr Home to see if it 
gets picked up and having 5 Zookeepers would more than satisy high availability.


Regards
Ian 

-Original Message-
From: Jörn Franke  

If you have a properly secured cluster eg with Kerberos then you should not 
update files in ZK directly. Use the corresponding Solr REST interfaces then 
you also less likely to mess something up. 

If you want to have HA you should have at least 3 Solr nodes and replicate the 
collection to all three of them (more is not needed from a HA point of view). 
This would also allow you upgrades to the cluster without downtime.

-Original Message-
From: erickerick...@gmail.com>
Having custom core.properties files is “fraught”. First of all, that file can 
be re-written. Second, the collections ADDREPLICA command will create a new 
core.properties file. Third, any mistakes you make when hand-editing the file 
can have grave consequences.

What change exactly do you want to make to core.properties and why?

Trying to reproduce “what a colleague has done on standalone” is not something 
I’d recommend, SolrCloud is a different beast. Reproducing the _behavior_ is 
another thing, so what is the behavior you want in SolrCloud that causes you to 
want to customize core.properties?

Best,
Erick  

-Original Message-
From: Shawn Heisey 

I cannot tell what you are asking here.  The core.properties file lives 
on the disk, not in ZK.

I was under the impression that .jar files could not be loaded into ZK 
and used in a core config.  Documentation saying otherwise was recently 
pointed out to me on the list, but I remain skeptical that this actually 
works, and I have not tried to implement it myself.

The best way to handle custom jar loading is to create a "lib" directory 
under the solr home, and place all jars there.  Solr will automatically 
load them all before any cores are started, and no config commands of 
any kind will be needed to make it happen.

> Also from a high availability aspect, if I effectivly lost 2 of the Solr 
> Servers due to an outage will the system still work as expected? Would I 
> expect any data loss?

If all three Solr servers have a complete copy of all your indexes, then 
you should remain fully operational if two of those Solr servers go down.

Note that if you have three ZK servers and you lose two, that means that 
you have lost zookeeper quorum, and in that situation, SolrCloud will 
transition to read only -- you will not be able to change any index in 
the cloud.  This is how ZK is designed and it cannot be changed.  If you 
want a ZK deployment to survive the loss of two servers, you must have 
at least five total ZK servers, so more than 50 percent of the total 
survives.

Thanks,
Shawn


smime.p7s
Description: S/MIME cryptographic signature

Re: Query regarding Solr Cloud Setup

[Jörn Franke]

If you have a properly secured cluster eg with Kerberos then you should not 
update files in ZK directly. Use the corresponding Solr REST interfaces then 
you also less likely to mess something up. 

If you want to have HA you should have at least 3 Solr nodes and replicate the 
collection to all three of them (more is not needed from a HA point of view). 
This would also allow you upgrades to the cluster without downtime.

> Am 03.09.2019 um 15:22 schrieb Porritt, Ian :
> 
> Hi,
>  
> I am relatively new to Solr especially Solr Cloud and have been using it for 
> a few days now. I think I have setup Solr Cloud correctly however would like 
> some guidance to ensure I am doing it correctly. I ideally want to be able to 
> process 40 million documents on production via Solr Cloud. The number of 
> fields is undefined as the documents may differ but could be around 20+.
>  
> The current setup I have at present is as follows: (note this is all on 1 
> machine for now). A 3 Zookeeper Ensemble (all running on different ports) and 
> works as expected.
>  
> 3 Solar Nodes started on separate ports (note: directory path à 
> D:\solr-7.7.1\example\cloud\Node (1/2/3).
>  
> 
>  
> Setup of Solr would be similar to the above except its on my local, the below 
> is the Graph status in Solr Cloud.
>  
> 
>  
> I have a few questions which I cannot seem to find the answer for on the web.
>  
> We have a schema which I have managed to upload to Zookeeper along with the 
> Solrconfig, how do I get the system to recognise both a lib/.jar extension 
> and a custom core.properties file? I bypassed the issue of the 
> core.properties by amending the update.autoCreateField in the Solrconfig.xml 
> to false however would like to include as a colleague has done on Solr 
> Standlone.
>  
> Also from a high availability aspect, if I effectivly lost 2 of the Solr 
> Servers due to an outage will the system still work as expected? Would I 
> expect any data loss?
>  
>  

Re: Query regarding Solr Cloud Setup

[Erick Erickson]

Having custom core.properties files is “fraught”. First of all, that file can 
be re-written. Second, the collections ADDREPLICA command will create a new 
core.properties file. Third, any mistakes you make when hand-editing the file 
can have grave consequences.

What change exactly do you want to make to core.properties and why?

Trying to reproduce “what a colleague has done on standalone” is not something 
I’d recommend, SolrCloud is a different beast. Reproducing the _behavior_ is 
another thing, so what is the behavior you want in SolrCloud that causes you to 
want to customize core.properties?

Best,
Erick

> On Sep 3, 2019, at 10:15 AM, Shawn Heisey  wrote:
> 
> On 9/3/2019 7:22 AM, Porritt, Ian wrote:
>> We have a schema which I have managed to upload to Zookeeper along with the 
>> Solrconfig, how do I get the system to recognise both a lib/.jar extension 
>> and a custom core.properties file? I bypassed the issue of the 
>> core.properties by amending the update.autoCreateField in the Solrconfig.xml 
>> to false however would like to include as a colleague has done on Solr 
>> Standlone.
> 
> I cannot tell what you are asking here.  The core.properties file lives on 
> the disk, not in ZK.
> 
> I was under the impression that .jar files could not be loaded into ZK and 
> used in a core config.  Documentation saying otherwise was recently pointed 
> out to me on the list, but I remain skeptical that this actually works, and I 
> have not tried to implement it myself.
> 
> The best way to handle custom jar loading is to create a "lib" directory 
> under the solr home, and place all jars there.  Solr will automatically load 
> them all before any cores are started, and no config commands of any kind 
> will be needed to make it happen.
> 
>> Also from a high availability aspect, if I effectivly lost 2 of the Solr 
>> Servers due to an outage will the system still work as expected? Would I 
>> expect any data loss?
> 
> If all three Solr servers have a complete copy of all your indexes, then you 
> should remain fully operational if two of those Solr servers go down.
> 
> Note that if you have three ZK servers and you lose two, that means that you 
> have lost zookeeper quorum, and in that situation, SolrCloud will transition 
> to read only -- you will not be able to change any index in the cloud.  This 
> is how ZK is designed and it cannot be changed.  If you want a ZK deployment 
> to survive the loss of two servers, you must have at least five total ZK 
> servers, so more than 50 percent of the total survives.
> 
> Thanks,
> Shawn

Re: Query regarding Solr Cloud Setup

[Shawn Heisey]

On 9/3/2019 7:22 AM, Porritt, Ian wrote:
We have a schema which I have managed to upload to Zookeeper along with 
the Solrconfig, how do I get the system to recognise both a lib/.jar 
extension and a custom core.properties file? I bypassed the issue of the 
core.properties by amending the update.autoCreateField in the 
Solrconfig.xml to false however would like to include as a colleague has 
done on Solr Standlone.


I cannot tell what you are asking here.  The core.properties file lives 
on the disk, not in ZK.


I was under the impression that .jar files could not be loaded into ZK 
and used in a core config.  Documentation saying otherwise was recently 
pointed out to me on the list, but I remain skeptical that this actually 
works, and I have not tried to implement it myself.


The best way to handle custom jar loading is to create a "lib" directory 
under the solr home, and place all jars there.  Solr will automatically 
load them all before any cores are started, and no config commands of 
any kind will be needed to make it happen.


Also from a high availability aspect, if I effectivly lost 2 of the Solr 
Servers due to an outage will the system still work as expected? Would I 
expect any data loss?


If all three Solr servers have a complete copy of all your indexes, then 
you should remain fully operational if two of those Solr servers go down.


Note that if you have three ZK servers and you lose two, that means that 
you have lost zookeeper quorum, and in that situation, SolrCloud will 
transition to read only -- you will not be able to change any index in 
the cloud.  This is how ZK is designed and it cannot be changed.  If you 
want a ZK deployment to survive the loss of two servers, you must have 
at least five total ZK servers, so more than 50 percent of the total 
survives.


Thanks,
Shawn

Query regarding Solr Cloud Setup

[Porritt, Ian]

Hi,

 

I am relatively new to Solr especially Solr Cloud and have been using it for
a few days now. I think I have setup Solr Cloud correctly however would like
some guidance to ensure I am doing it correctly. I ideally want to be able
to process 40 million documents on production via Solr Cloud. The number of
fields is undefined as the documents may differ but could be around 20+. 

 

The current setup I have at present is as follows: (note this is all on 1
machine for now). A 3 Zookeeper Ensemble (all running on different ports)
and works as expected. 

 

3 Solar Nodes started on separate ports (note: directory path à
D:\solr-7.7.1\example\cloud\Node (1/2/3). 

 



 

Setup of Solr would be similar to the above except its on my local, the
below is the Graph status in Solr Cloud.

 



 

I have a few questions which I cannot seem to find the answer for on the
web. 

 

We have a schema which I have managed to upload to Zookeeper along with the
Solrconfig, how do I get the system to recognise both a lib/.jar extension
and a custom core.properties file? I bypassed the issue of the
core.properties by amending the update.autoCreateField in the Solrconfig.xml
to false however would like to include as a colleague has done on Solr
Standlone.

 

Also from a high availability aspect, if I effectivly lost 2 of the Solr
Servers due to an outage will the system still work as expected? Would I
expect any data loss? 

 

 



smime.p7s
Description: S/MIME cryptographic signature

Re: Solr cloud setup

[Erick Erickson]

First of all, do not shard unless necessary to handle your QPS requirements. 
Sharding adds overhead and has some functionality limitations. How to define 
“necessary”? Load test a single shard (or even stand-alone with a single core) 
until it falls over. See: 
https://lucidworks.com/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/
 for an outline of the process.

“handle your QPS rate” is a bit tricky. What I’m talking about there is the 
ability to 
1> index at an adequate speed
2> get queries back with acceptable latency.

Let’s say you test and can get 20 queries per second on a single shard, but 
need 100 QPS. Then add 4 more _replicas_ (not shards) to that single-sharded 
system for a total of 5 replicas x 1 shard.

My general expectation (and YMMV) is for 50M docs/shard. I’ve seen 300M docs on 
a single shard and 10M so the range is very wide depending on your particular 
needs. Given your index size, you’re in the range where sharding becomes 
desirable, but you have to test first.

Finally, note that there’s quite a jump going from  1 replica (leader only)  to 
2 in terms of indexing. The leader has to forward the docs to the follower and 
that shows up. In very heavy indexing scenarios I’ve seen this matter, if it 
does in your situation consider TLOG or PULL replica types.

Best,
Erick

> On Jun 7, 2019, at 1:53 AM, Emir Arnautović  
> wrote:
> 
> Hi Abhishek,
> Here is a nice blog post about migrating to SolrCloud: 
> https://sematext.com/blog/solr-master-slave-solrcloud-migration/ 
> 
> 
> Re number of shards - there is no definite answer - it depends on your 
> indexing/search latency requirements. Only tests can tell. Here are some 
> thought on how to perform tests: 
> https://www.od-bits.com/2018/01/solrelasticsearch-capacity-planning.html 
> 
> 
> HTH,
> Emir
> --
> Monitoring - Log Management - Alerting - Anomaly Detection
> Solr & Elasticsearch Consulting Support Training - http://sematext.com/
> 
> 
> 
>> On 7 Jun 2019, at 09:05, Midas A  wrote:
>> 
>> Hi ,
>> 
>> Currently we are in master slave architechture we want to move in solr
>> cloud architechture .
>> how i should decide shard number in solr cloud ?
>> 
>> My current solr in version 6 and index size is 300 GB.
>> 
>> 
>> 
>> Regards,
>> Abhishek Tiwari
> 

Re: Solr cloud setup

[Emir Arnautović]

Hi Abhishek,
Here is a nice blog post about migrating to SolrCloud: 
https://sematext.com/blog/solr-master-slave-solrcloud-migration/ 


Re number of shards - there is no definite answer - it depends on your 
indexing/search latency requirements. Only tests can tell. Here are some 
thought on how to perform tests: 
https://www.od-bits.com/2018/01/solrelasticsearch-capacity-planning.html 


HTH,
Emir
--
Monitoring - Log Management - Alerting - Anomaly Detection
Solr & Elasticsearch Consulting Support Training - http://sematext.com/



> On 7 Jun 2019, at 09:05, Midas A  wrote:
> 
> Hi ,
> 
> Currently we are in master slave architechture we want to move in solr
> cloud architechture .
> how i should decide shard number in solr cloud ?
> 
> My current solr in version 6 and index size is 300 GB.
> 
> 
> 
> Regards,
> Abhishek Tiwari

Solr cloud setup

[Midas A]

Hi ,

Currently we are in master slave architechture we want to move in solr
cloud architechture .
how i should decide shard number in solr cloud ?

My current solr in version 6 and index size is 300 GB.



Regards,
Abhishek Tiwari

Re: Solr numFound > 0 but doc list empty in Solr Cloud setup

[Christian Strohmaier]

I came across this posting with exactly the same symptoms in my solr cloud.

Here is what finally repaired my system:
I had an id with fieldType class="solr.TextField"
I changed this to class="solr.StrField"

Best regards
Christian 



--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr Cloud setup and deoployment in Azure cloud

[Aniket Khare]

Just wanted to add few more details.
I want to create 7 VM set where 4 servers will be used for solrcloud setup
and 3 VM as zokkeper instance.

On Thu, Jul 14, 2016 at 4:15 PM, Aniket Khare 
wrote:

> Hi,
>
> I was looking for option to deploy SolrCloud in Azure. I am using ARM
> templetes for the deployment.
> Please refer the following link for ARM(Azure resource manager) templete.
> https://github.com/Azure/azure-quickstart-templates
>
> https://azure.microsoft.com/en-us/documentation/articles/resource-group-authoring-templates/
>
> Could you please let me know if there is any available ARM templete or
> anyone have done similar set of deployment.
>
>
> --
> Regards,
>
> Aniket S. Khare
>



-- 
Regards,

Aniket S. Khare

Solr Cloud setup and deoployment in Azure cloud

[Aniket Khare]

Hi,

I was looking for option to deploy SolrCloud in Azure. I am using ARM
templetes for the deployment.
Please refer the following link for ARM(Azure resource manager) templete.
https://github.com/Azure/azure-quickstart-templates
https://azure.microsoft.com/en-us/documentation/articles/resource-group-authoring-templates/

Could you please let me know if there is any available ARM templete or
anyone have done similar set of deployment.


-- 
Regards,

Aniket S. Khare

Re: Fwd: Solr cloud setup with zookeeper in windows

[Zheng Lin Edwin Yeo]

I have used the NSSM method from the link mentioned by Shawn to set up
zookeeper as a service. Just follow the same steps and point it to the
zookeeper startup script, but leave the Arugment field empty.

Regards,
Edwin

On 23 March 2016 at 22:02, Shawn Heisey  wrote:

> On 3/23/2016 6:30 AM, manohar c wrote:
> >Can you please provide me steps for set up multiple solr clouds
> with
> > zookeeper in windows machines. I am using solr 5.4.1 and zookeeper 3.4.6
>
> Solr doesn't come with an installation method for Windows.  Although
> Solr will run on Windows, and we include a start script for Windows,
> exactly how to install Solr and run it at boot time is left up to the
> user.  We do have a lot of interest for including a Windows installation
> option, but none has been written yet.  There is an enhancement issue
> already filed, with some ideas:
>
> https://issues.apache.org/jira/browse/SOLR-7105
>
> We *will* get there, it is just going to take some time.
>
> Because Solr is an open source project, most of the people associated
> with the project also prefer open source operating systems.  Those
> operating systems are free, unlike Windows, which adds a significant
> cost to each server that runs it.  The *client* operating systems from
> Microsoft are typically cheaper, but Microsoft has intentionally
> crippled the client operating systems so they don't run server workloads
> very well.  It is my opinion that Linux is a far better environment for
> Solr than Windows Server, even if you ignore the cost considerations.
> That's all I'm going to say on that subject -- the "Windows vs. Open
> Source" debate usually devolves into a flamewar.
>
> A number of people around the Internet have described ways to run Solr
> 5.x as a service on Windows.
>
> Here's one of them:
>
> http://www.norconex.com/how-to-run-solr5-as-a-service-on-windows/
>
> There should also be instructions out there for running zookeeper as a
> service.  Although Solr does have the ability to run with zookeeper
> embedded, we strongly recommend that you use an external zookeeper for
> production.
>
> Zookeeper is a separate program from Solr.  It is included in Solr, but
> we cannot provide full support for it.
>
> Thanks,
> Shawn
>
>

Re: Fwd: Solr cloud setup with zookeeper in windows

[Shawn Heisey]

On 3/23/2016 6:30 AM, manohar c wrote:
>Can you please provide me steps for set up multiple solr clouds with
> zookeeper in windows machines. I am using solr 5.4.1 and zookeeper 3.4.6

Solr doesn't come with an installation method for Windows.  Although
Solr will run on Windows, and we include a start script for Windows,
exactly how to install Solr and run it at boot time is left up to the
user.  We do have a lot of interest for including a Windows installation
option, but none has been written yet.  There is an enhancement issue
already filed, with some ideas:

https://issues.apache.org/jira/browse/SOLR-7105

We *will* get there, it is just going to take some time.

Because Solr is an open source project, most of the people associated
with the project also prefer open source operating systems.  Those
operating systems are free, unlike Windows, which adds a significant
cost to each server that runs it.  The *client* operating systems from
Microsoft are typically cheaper, but Microsoft has intentionally
crippled the client operating systems so they don't run server workloads
very well.  It is my opinion that Linux is a far better environment for
Solr than Windows Server, even if you ignore the cost considerations. 
That's all I'm going to say on that subject -- the "Windows vs. Open
Source" debate usually devolves into a flamewar.

A number of people around the Internet have described ways to run Solr
5.x as a service on Windows.

Here's one of them:

http://www.norconex.com/how-to-run-solr5-as-a-service-on-windows/

There should also be instructions out there for running zookeeper as a
service.  Although Solr does have the ability to run with zookeeper
embedded, we strongly recommend that you use an external zookeeper for
production.

Zookeeper is a separate program from Solr.  It is included in Solr, but
we cannot provide full support for it.

Thanks,
Shawn

Fwd: Solr cloud setup with zookeeper in windows

[manohar c]

Hi,

   Can you please provide me steps for set up multiple solr clouds with
zookeeper in windows machines. I am using solr 5.4.1 and zookeeper 3.4.6


Thanks and regards,
Manohar

Solr numFound 0 but doc list empty in Solr Cloud setup

[Jaikit Savla]

I am using below tutorial for Solr Cloud setup with 2 shards
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster


I am able to get the default set up working. However, I have a requirement 
where my index is not in default location (data/index) and hence when I start 
jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when I 
query I get results with numFound  0 but doc list is always empty.

I verified that my index does have fields stored and indexed. Anyone else faced 
similar issue or have an idea on what I am missing ? Verified that by loading 
single core.

Appreciate any help.

request:

http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1


response:
{ responseHeader: { status: 0, QTime: 18, params: { shards: 
http://localhost:/solr/collection1;, indent: true, q: body:\to\, 
_: 1421390858638, wt: json } }, response: { numFound: 2564, 
start: 0, maxScore: 0.4523638, docs: [] } }

Re: Solr numFound 0 but doc list empty in Solr Cloud setup

[Erick Erickson]

Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?

Best,
Erick

On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
 I am using below tutorial for Solr Cloud setup with 2 shards
 http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster


 I am able to get the default set up working. However, I have a requirement 
 where my index is not in default location (data/index) and hence when I start 
 jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when 
 I query I get results with numFound  0 but doc list is always empty.

 I verified that my index does have fields stored and indexed. Anyone else 
 faced similar issue or have an idea on what I am missing ? Verified that by 
 loading single core.

 Appreciate any help.

 request:

 http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1


 response:
 { responseHeader: { status: 0, QTime: 18, params: { shards: 
 http://localhost:/solr/collection1;, indent: true, q: 
 body:\to\, _: 1421390858638, wt: json } }, response: { 
 numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }

Re: Solr numFound 0 but doc list empty in Solr Cloud setup

[Jaikit Savla]

Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true  stored=true 
multiValued=true /



-- 
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true

{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}



On Friday, January 16, 2015 9:56 AM, Erick Erickson erickerick...@gmail.com 
wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?

Best,
Erick


On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
 I am using below tutorial for Solr Cloud setup with 2 shards
 http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster


 I am able to get the default set up working. However, I have a requirement 
 where my index is not in default location (data/index) and hence when I start 
 jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when 
 I query I get results with numFound  0 but doc list is always empty.

 I verified that my index does have fields stored and indexed. Anyone else 
 faced similar issue or have an idea on what I am missing ? Verified that by 
 loading single core.

 Appreciate any help.

 request:

 http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1


 response:
 { responseHeader: { status: 0, QTime: 18, params: { shards: 
 http://localhost:/solr/collection1;, indent: true, q: 
 body:\to\, _: 1421390858638, wt: json } }, response: { 
 numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }

Re: Solr numFound 0 but doc list empty in Solr Cloud setup

[Jaikit Savla]

As I said earlier - single core set up works fine with same solrconfig.xml and 
schema.xml

cd example
java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar 

I am running Solr-4.10. Do I need to change any other configuration for running 
in solr cloud mode ?



On Friday, January 16, 2015 11:56 AM, Jaikit Savla 
jaikit.sa...@yahoo.com.INVALID wrote:
Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true  stored=true 
multiValued=true /



-- 
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true

{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}




On Friday, January 16, 2015 9:56 AM, Erick Erickson erickerick...@gmail.com 
wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?

Best,
Erick


On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
 I am using below tutorial for Solr Cloud setup with 2 shards
 http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster


 I am able to get the default set up working. However, I have a requirement 
 where my index is not in default location (data/index) and hence when I start 
 jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when 
 I query I get results with numFound  0 but doc list is always empty.

 I verified that my index does have fields stored and indexed. Anyone else 
 faced similar issue or have an idea on what I am missing ? Verified that by 
 loading single core.

 Appreciate any help.

 request:

 http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1


 response:
 { responseHeader: { status: 0, QTime: 18, params: { shards: 
 http://localhost:/solr/collection1;, indent: true, q: 
 body:\to\, _: 1421390858638, wt: json } }, response: { 
 numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }

Re: Solr numFound 0 but doc list empty in Solr Cloud setup

[Jaikit Savla]

One more point: 
In cloud mode: If I submit a request with fl=id, it returns doc list. But when 
I add any other field, I get an empty doc list. 

http://localhost:/solr/select?q=domain:ebaywt=jsonshards=http://localhost:/solr/fl=idrows=1

{
responseHeader: {
status: 0,
QTime: 7,
params: {
fl: id,
shards: http://localhost:/solr/;,
q: domain:ebay,
wt: json,
rows: 1
}
},
response: {
numFound: 17,
start: 0,
maxScore: 3.8559604,
docs: [
{
id: d8406557-6cd8-46d9-9a5e-29844387afc4
}
]
}
}


Note: all of above works in single core mode.



On Friday, January 16, 2015 12:13 PM, Jaikit Savla 
jaikit.sa...@yahoo.com.INVALID wrote:
As I said earlier - single core set up works fine with same solrconfig.xml and 
schema.xml

cd example
java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar 

I am running Solr-4.10. Do I need to change any other configuration for running 
in solr cloud mode ?




On Friday, January 16, 2015 11:56 AM, Jaikit Savla 
jaikit.sa...@yahoo.com.INVALID wrote:
Verified that all my fields are stored and marked as indexed.
field name=bodytype=string indexed=true  stored=true 
multiValued=true /



-- 
http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true

{
responseHeader: {
status: 0,
QTime: 19,
params: {
shards: http://localhost:/solr/collection1;,
indent: true,
start: 1,
q: body:from,
shards.info: true,
wt: json,
rows: 10
}
},
shards.info: {
http://localhost:/solr/collection1: {
numFound: 1717,
maxScore: 0.5327856,
shardAddress: http://localhost:/solr/collection1;,
time: 12
}
},
response: {
numFound: 1707,
start: 1,
maxScore: 0.5327856,
docs: [ ]
}
}




On Friday, January 16, 2015 9:56 AM, Erick Erickson erickerick...@gmail.com 
wrote:
Any chance that you've defined rows=0 in your handler? Or is it possible
that you have not set stored=true for any of your fields?

Best,
Erick


On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
jaikit.sa...@yahoo.com.invalid wrote:
 I am using below tutorial for Solr Cloud setup with 2 shards
 http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster


 I am able to get the default set up working. However, I have a requirement 
 where my index is not in default location (data/index) and hence when I start 
 jvm for each shard I run with -Dsolr.data.dir=custom index path . Now when 
 I query I get results with numFound  0 but doc list is always empty.

 I verified that my index does have fields stored and indexed. Anyone else 
 faced similar issue or have an idea on what I am missing ? Verified that by 
 loading single core.

 Appreciate any help.

 request:

 http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1


 response:
 { responseHeader: { status: 0, QTime: 18, params: { shards: 
 http://localhost:/solr/collection1;, indent: true, q: 
 body:\to\, _: 1421390858638, wt: json } }, response: { 
 numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }

Re: Solr numFound 0 but doc list empty in Solr Cloud setup

[Anshum Gupta]

Looks like a config issue to me more than anything else.
Can you share your solrconfig? You will not be able to attach a file here
but you could share it via pastebin or something similar.
Also, why are you adding the shards=http://localhost:8983/solr/collection1;
part to your request? You don't need to do that in most cases.

On Fri, Jan 16, 2015 at 12:20 PM, Jaikit Savla 
jaikit.sa...@yahoo.com.invalid wrote:

 One more point:
 In cloud mode: If I submit a request with fl=id, it returns doc list. But
 when I add any other field, I get an empty doc list.


 http://localhost:/solr/select?q=domain:ebaywt=jsonshards=http://localhost:/solr/fl=idrows=1

 {
 responseHeader: {
 status: 0,
 QTime: 7,
 params: {
 fl: id,
 shards: http://localhost:/solr/;,
 q: domain:ebay,
 wt: json,
 rows: 1
 }
 },
 response: {
 numFound: 17,
 start: 0,
 maxScore: 3.8559604,
 docs: [
 {
 id: d8406557-6cd8-46d9-9a5e-29844387afc4
 }
 ]
 }
 }


 Note: all of above works in single core mode.



 On Friday, January 16, 2015 12:13 PM, Jaikit Savla
 jaikit.sa...@yahoo.com.INVALID wrote:
 As I said earlier - single core set up works fine with same solrconfig.xml
 and schema.xml

 cd example
 java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar

 I am running Solr-4.10. Do I need to change any other configuration for
 running in solr cloud mode ?




 On Friday, January 16, 2015 11:56 AM, Jaikit Savla
 jaikit.sa...@yahoo.com.INVALID wrote:
 Verified that all my fields are stored and marked as indexed.
 field name=bodytype=string indexed=true  stored=true
 multiValued=true /



 --

 http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true

 {
 responseHeader: {
 status: 0,
 QTime: 19,
 params: {
 shards: http://localhost:/solr/collection1;,
 indent: true,
 start: 1,
 q: body:from,
 shards.info: true,
 wt: json,
 rows: 10
 }
 },
 shards.info: {
 http://localhost:/solr/collection1: {
 numFound: 1717,
 maxScore: 0.5327856,
 shardAddress: http://localhost:/solr/collection1;,
 time: 12
 }
 },
 response: {
 numFound: 1707,
 start: 1,
 maxScore: 0.5327856,
 docs: [ ]
 }
 }




 On Friday, January 16, 2015 9:56 AM, Erick Erickson 
 erickerick...@gmail.com wrote:
 Any chance that you've defined rows=0 in your handler? Or is it possible
 that you have not set stored=true for any of your fields?

 Best,
 Erick


 On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
 jaikit.sa...@yahoo.com.invalid wrote:
  I am using below tutorial for Solr Cloud setup with 2 shards
 
 http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
 
 
  I am able to get the default set up working. However, I have a
 requirement where my index is not in default location (data/index) and
 hence when I start jvm for each shard I run with -Dsolr.data.dir=custom
 index path . Now when I query I get results with numFound  0 but doc list
 is always empty.
 
  I verified that my index does have fields stored and indexed. Anyone
 else faced similar issue or have an idea on what I am missing ? Verified
 that by loading single core.
 
  Appreciate any help.
 
  request:
 
 
 http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
 
 
  response:
  { responseHeader: { status: 0, QTime: 18, params: { shards: 
 http://localhost:/solr/collection1;, indent: true, q:
 body:\to\, _: 1421390858638, wt: json } }, response: {
 numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }




-- 
Anshum Gupta
http://about.me/anshumgupta

Re: Solr numFound 0 but doc list empty in Solr Cloud setup

[Jaikit Savla]

I followed all the steps listed here: 
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster

I have not updated solrconfig.xml and it is same as what comes default with 
4.10.

The only thing I added extra was list of my fields in 
example/solr/collection1/conf/schema.xml

@shards: If I query with out that param, it returns below error:
http://localhost:/solr/collection1/select?q=*:*
response
lst name=responseHeader
int name=status503/int
int name=QTime3/int
lst name=params
str name=q*:*/str
/lst
/lst
lst name=error
str name=msgno servers hosting shard:/str
int name=code503/int
/lst
/response


 

 




On Friday, January 16, 2015 12:37 PM, Anshum Gupta ans...@anshumgupta.net 
wrote:
Looks like a config issue to me more than anything else.
Can you share your solrconfig? You will not be able to attach a file here
but you could share it via pastebin or something similar.
Also, why are you adding the shards=http://localhost:8983/solr/collection1;
part to your request? You don't need to do that in most cases.


On Fri, Jan 16, 2015 at 12:20 PM, Jaikit Savla 
jaikit.sa...@yahoo.com.invalid wrote:

 One more point:
 In cloud mode: If I submit a request with fl=id, it returns doc list. But
 when I add any other field, I get an empty doc list.


 http://localhost:/solr/select?q=domain:ebaywt=jsonshards=http://localhost:/solr/fl=idrows=1

 {
 responseHeader: {
 status: 0,
 QTime: 7,
 params: {
 fl: id,
 shards: http://localhost:/solr/;,
 q: domain:ebay,
 wt: json,
 rows: 1
 }
 },
 response: {
 numFound: 17,
 start: 0,
 maxScore: 3.8559604,
 docs: [
 {
 id: d8406557-6cd8-46d9-9a5e-29844387afc4
 }
 ]
 }
 }


 Note: all of above works in single core mode.



 On Friday, January 16, 2015 12:13 PM, Jaikit Savla
 jaikit.sa...@yahoo.com.INVALID wrote:
 As I said earlier - single core set up works fine with same solrconfig.xml
 and schema.xml

 cd example
 java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar

 I am running Solr-4.10. Do I need to change any other configuration for
 running in solr cloud mode ?




 On Friday, January 16, 2015 11:56 AM, Jaikit Savla
 jaikit.sa...@yahoo.com.INVALID wrote:
 Verified that all my fields are stored and marked as indexed.
 field name=bodytype=string indexed=true  stored=true
 multiValued=true /



 --

 http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true

 {
 responseHeader: {
 status: 0,
 QTime: 19,
 params: {
 shards: http://localhost:/solr/collection1;,
 indent: true,
 start: 1,
 q: body:from,
 shards.info: true,
 wt: json,
 rows: 10
 }
 },
 shards.info: {
 http://localhost:/solr/collection1: {
 numFound: 1717,
 maxScore: 0.5327856,
 shardAddress: http://localhost:/solr/collection1;,
 time: 12
 }
 },
 response: {
 numFound: 1707,
 start: 1,
 maxScore: 0.5327856,
 docs: [ ]
 }
 }




 On Friday, January 16, 2015 9:56 AM, Erick Erickson 
 erickerick...@gmail.com wrote:
 Any chance that you've defined rows=0 in your handler? Or is it possible
 that you have not set stored=true for any of your fields?

 Best,
 Erick


 On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
 jaikit.sa...@yahoo.com.invalid wrote:
  I am using below tutorial for Solr Cloud setup with 2 shards
 
 http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
 
 
  I am able to get the default set up working. However, I have a
 requirement where my index is not in default location (data/index) and
 hence when I start jvm for each shard I run with -Dsolr.data.dir=custom
 index path . Now when I query I get results with numFound  0 but doc list
 is always empty.
 
  I verified that my index does have fields stored and indexed. Anyone
 else faced similar issue or have an idea on what I am missing ? Verified
 that by loading single core.
 
  Appreciate any help.
 
  request:
 
 
 http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
 
 
  response:
  { responseHeader: { status: 0, QTime: 18, params: { shards: 
 http://localhost:/solr/collection1;, indent: true, q:
 body:\to\, _: 1421390858638, wt: json } }, response: {
 numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }




-- 
Anshum Gupta
http://about.me/anshumgupta

Re: Solr numFound 0 but doc list empty in Solr Cloud setup

[Jaikit Savla]

Anshuman,

You are right about @shards param not required. One of my shard was down and 
hence when I added 
shards.tolerant=true, it worked without shards param. However document list is 
still empty.


content of solrconfig.xml
http://pastebin.com/CJxD22t1

 




On Friday, January 16, 2015 1:24 PM, Jaikit Savla jaikit.sa...@yahoo.com 
wrote:
I followed all the steps listed here: 
http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster

I have not updated solrconfig.xml and it is same as what comes default with 
4.10.

The only thing I added extra was list of my fields in 
example/solr/collection1/conf/schema.xml

@shards: If I query with out that param, it returns below error:
http://localhost:/solr/collection1/select?q=*:*
response
lst name=responseHeader
int name=status503/int
int name=QTime3/int
lst name=params
str name=q*:*/str
/lst
/lst
lst name=error
str name=msgno servers hosting shard:/str
int name=code503/int
/lst
/response










On Friday, January 16, 2015 12:37 PM, Anshum Gupta ans...@anshumgupta.net 
wrote:
Looks like a config issue to me more than anything else.
Can you share your solrconfig? You will not be able to attach a file here
but you could share it via pastebin or something similar.
Also, why are you adding the shards=http://localhost:8983/solr/collection1;
part to your request? You don't need to do that in most cases.


On Fri, Jan 16, 2015 at 12:20 PM, Jaikit Savla 
jaikit.sa...@yahoo.com.invalid wrote:

 One more point:
 In cloud mode: If I submit a request with fl=id, it returns doc list. But
 when I add any other field, I get an empty doc list.


 http://localhost:/solr/select?q=domain:ebaywt=jsonshards=http://localhost:/solr/fl=idrows=1

 {
 responseHeader: {
 status: 0,
 QTime: 7,
 params: {
 fl: id,
 shards: http://localhost:/solr/;,
 q: domain:ebay,
 wt: json,
 rows: 1
 }
 },
 response: {
 numFound: 17,
 start: 0,
 maxScore: 3.8559604,
 docs: [
 {
 id: d8406557-6cd8-46d9-9a5e-29844387afc4
 }
 ]
 }
 }


 Note: all of above works in single core mode.



 On Friday, January 16, 2015 12:13 PM, Jaikit Savla
 jaikit.sa...@yahoo.com.INVALID wrote:
 As I said earlier - single core set up works fine with same solrconfig.xml
 and schema.xml

 cd example
 java -Djetty.port= -Dsolr.data.dir=/index/path -jar start.jar

 I am running Solr-4.10. Do I need to change any other configuration for
 running in solr cloud mode ?




 On Friday, January 16, 2015 11:56 AM, Jaikit Savla
 jaikit.sa...@yahoo.com.INVALID wrote:
 Verified that all my fields are stored and marked as indexed.
 field name=bodytype=string indexed=true  stored=true
 multiValued=true /



 --

 http://localhost:/solr/collection1/query?q=body%3A%22from%22wt=jsonindent=trueshards=http://localhost:/solr/collection1start=1rows=10shards.info=true

 {
 responseHeader: {
 status: 0,
 QTime: 19,
 params: {
 shards: http://localhost:/solr/collection1;,
 indent: true,
 start: 1,
 q: body:from,
 shards.info: true,
 wt: json,
 rows: 10
 }
 },
 shards.info: {
 http://localhost:/solr/collection1: {
 numFound: 1717,
 maxScore: 0.5327856,
 shardAddress: http://localhost:/solr/collection1;,
 time: 12
 }
 },
 response: {
 numFound: 1707,
 start: 1,
 maxScore: 0.5327856,
 docs: [ ]
 }
 }




 On Friday, January 16, 2015 9:56 AM, Erick Erickson 
 erickerick...@gmail.com wrote:
 Any chance that you've defined rows=0 in your handler? Or is it possible
 that you have not set stored=true for any of your fields?

 Best,
 Erick


 On Fri, Jan 16, 2015 at 9:46 AM, Jaikit Savla
 jaikit.sa...@yahoo.com.invalid wrote:
  I am using below tutorial for Solr Cloud setup with 2 shards
 
 http://wiki.apache.org/solr/SolrCloud#Example_A:_Simple_two_shard_cluster
 
 
  I am able to get the default set up working. However, I have a
 requirement where my index is not in default location (data/index) and
 hence when I start jvm for each shard I run with -Dsolr.data.dir=custom
 index path . Now when I query I get results with numFound  0 but doc list
 is always empty.
 
  I verified that my index does have fields stored and indexed. Anyone
 else faced similar issue or have an idea on what I am missing ? Verified
 that by loading single core.
 
  Appreciate any help.
 
  request:
 
 
 http://localhost:/solr/collection1/select?q=body%3A%22to%22wt=jsonindent=trueshards=http://localhost:/solr/collection1
 
 
  response:
  { responseHeader: { status: 0, QTime: 18, params: { shards: 
 http://localhost:/solr/collection1;, indent: true, q:
 body:\to\, _: 1421390858638, wt: json } }, response: {
 numFound: 2564, start: 0, maxScore: 0.4523638, docs: [] } }




-- 
Anshum Gupta
http://about.me/anshumgupta

Re: Solr cloud setup question

[Erick Erickson]

That page is talking about leaders/followers coming up
and going down, but pretty much after they've been
assigned in the first place. Your problem is just the
assigned in the first place bit.

Since Solr 4.8, there's the addreplica collections API
command that is what you want I think, see:
https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api_addreplica

Best,
Erick

On Mon, Sep 22, 2014 at 12:45 PM, Susmit Shukla shukla.sus...@gmail.com wrote:
 Hi solr experts,

 I am building out a solr cluster with this configuration

 3 external zookeeprs
 15 solr instances (nodes)
 3 shards

 I need to start out with 3 nodes and remaining 12 nodes would be added to
 cluster. I am able to create a collection with 3 shards. This process works
 fine using collections create API.
 The core directory is automatically created by solr -
 multishard_shard1_replica1, multishard_shard2_replica1 etc with
 core.properties file containing shard and replica info

 However, when I add new machines running solr and pointing to this zk
 cluster, they do not get added as replicas. The new machines have solr.home
 directory available but no core specific directories beneath it since I
 want solr to auto add as replica.
 If I create the directories manually beneath solr.home named
 multishard_shard2_replica2, multishard_shard2_replica3 and so on and
 provide core.properties file, they are correctly added to the cloud as
 replicas.

 Is there a way to automatically do it? since solr documentation says so..

 https://cwiki.apache.org/confluence/display/solr/Nodes%2C+Cores%2C+Clusters+and+Leaders
 in Leaders and Replicas section

 Thanks,
 Susmit

Re: Solr Cloud Setup

[Flavio Pompermaier]

What was the problem..?


On Tue, Jul 30, 2013 at 10:33 PM, AdityaR aditya.ravinuth...@gmail.comwrote:

 I was able to get the setup to work.



 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/Solr-Cloud-Setup-tp4080182p4081434.html
 Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Cloud Setup

[AdityaR]

Flavio, 

There was a problem with the solrconfig and schema files. 

One of the team members had deleted some entries in the solrconfig.xml and I
was picking the same solr configuration everytime, I got the latest version
of solr and carefully edited the solrconfig and schema files and it worked. 

We have the cloud up and running, testing is in progress and it looks good. 



Thanks for all your help. 

-Aditya



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Cloud-Setup-tp4080182p4081654.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Cloud Setup

[Erick Erickson]

I'd advise you to tear it down and start over. You should be
creating new _collections_, not cores at this level I believe. And
manually editing the cluster state is just _asking_ for
trouble unless you really understand what's happening under
the covers, and since you say you're relatively new

See: 
http://wiki.apache.org/solr/SolrCloud#Managing_collections_via_the_Collections_API

Best
Erick

On Wed, Jul 24, 2013 at 6:11 PM, AdityaR aditya.ravinuth...@gmail.com wrote:
 Hi,

 I am new to solr and am trying to setup a solr cloud

 I have created 3 server solr cloud and 1 zookeeeper and I am facing the
 following problems with my set up.

 1) When I create a new core using the collections API , the cores are
 created, but all are in down state. How can I make them active? or is there
 anything wrong with my set up?

 I edited the clusterstate.json to get them active and then they become
 active.

 2 ) I have configured a collection to have 2 shards and 2 replicas and added
 documents to the collection. But when I query the servers, I am getting
 inconsistent results. I have in one shard 241 documents and in another 230
 documents. When I query any server in the cloud I get randomly 471, 230 or
 241 documents. Could you suggest as to where the problem might be.

 Thanks,
 Aditya



 --
 View this message in context: 
 http://lucene.472066.n3.nabble.com/Solr-Cloud-Setup-tp4080182.html
 Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Cloud Setup

[Flavio Pompermaier]

I find this article very interesting about cloud deployment:
http://myjeeva.com/solrcloud-cluster-single-collection-deployment.html

Best,
Flavio


On Thu, Jul 25, 2013 at 1:59 PM, Erick Erickson erickerick...@gmail.comwrote:

 I'd advise you to tear it down and start over. You should be
 creating new _collections_, not cores at this level I believe. And
 manually editing the cluster state is just _asking_ for
 trouble unless you really understand what's happening under
 the covers, and since you say you're relatively new

 See:
 http://wiki.apache.org/solr/SolrCloud#Managing_collections_via_the_Collections_API

 Best
 Erick

 On Wed, Jul 24, 2013 at 6:11 PM, AdityaR aditya.ravinuth...@gmail.com
 wrote:
  Hi,
 
  I am new to solr and am trying to setup a solr cloud
 
  I have created 3 server solr cloud and 1 zookeeeper and I am facing the
  following problems with my set up.
 
  1) When I create a new core using the collections API , the cores are
  created, but all are in down state. How can I make them active? or is
 there
  anything wrong with my set up?
 
  I edited the clusterstate.json to get them active and then they become
  active.
 
  2 ) I have configured a collection to have 2 shards and 2 replicas and
 added
  documents to the collection. But when I query the servers, I am getting
  inconsistent results. I have in one shard 241 documents and in another
 230
  documents. When I query any server in the cloud I get randomly 471, 230
 or
  241 documents. Could you suggest as to where the problem might be.
 
  Thanks,
  Aditya
 
 
 
  --
  View this message in context:
 http://lucene.472066.n3.nabble.com/Solr-Cloud-Setup-tp4080182.html
  Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Cloud Setup

[AdityaR]

Thanks Eric and Flavio for your responses. Sorry, I meant to I was creating
collections and not cores. 

I used the same article as suggested by Flavio to set up the solr cloud and
I did it twice. Both the times I am facing the same issue. I am not sure
where the problem is.  

I am using the following versions: 

Zookeeper : 3.4.5
Solr : 4.3.1
tomcat : 6.0.36

Thanks, 
Aditya



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Cloud-Setup-tp4080182p4080352.html
Sent from the Solr - User mailing list archive at Nabble.com.

Solr Cloud Setup

[AdityaR]

Hi, 

I am new to solr and am trying to setup a solr cloud 

I have created 3 server solr cloud and 1 zookeeeper and I am facing the
following problems with my set up.

1) When I create a new core using the collections API , the cores are
created, but all are in down state. How can I make them active? or is there
anything wrong with my set up? 

I edited the clusterstate.json to get them active and then they become
active.

2 ) I have configured a collection to have 2 shards and 2 replicas and added
documents to the collection. But when I query the servers, I am getting
inconsistent results. I have in one shard 241 documents and in another 230
documents. When I query any server in the cloud I get randomly 471, 230 or
241 documents. Could you suggest as to where the problem might be.

Thanks, 
Aditya



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Solr-Cloud-Setup-tp4080182.html
Sent from the Solr - User mailing list archive at Nabble.com.

Http status 503 Error in solr cloud setup

[Sagar Chaturvedi]

Hi,

I setup 2 solr instances on 2 different machines and configured 2 zookeeper 
servers on these machines also. When I start solr on both machines and try to 
access the solr web-admin then I get following error on browser -
Http status 503 - server is shutting down

When I setup a single standalone solr without zookeeper, I do not get this 
error.

Any insights ?

Thanks and Regards,
Sagar Chaturvedi
Member Of Technical Staff
NEC Technologies India, Noida
[cid:image001.jpg@01CE74F4.F9A4EA60]09711931646
[cid:image002.jpg@01CE74F4.F9A4EA60]





DISCLAIMER:
---
The contents of this e-mail and any attachment(s) are confidential and
intended
for the named recipient(s) only. 
It shall not attach any liability on the originator or NEC or its
affiliates. Any views or opinions presented in 
this email are solely those of the author and may not necessarily reflect the
opinions of NEC or its affiliates. 
Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of 
this message without the prior written consent of the author of this e-mail is
strictly prohibited. If you have 
received this email in error please delete it and notify the sender
immediately. .
---

Re: Http status 503 Error in solr cloud setup

[Lance Norskog]

I do not know what causes the error. This setup will not work. You need 
one or three zookeepers. SolrCloud demands that a majority of the ZK 
servers agree. If you have two ZKs this will not work.


On 06/29/2013 05:47 AM, Sagar Chaturvedi wrote:


Hi,

I setup 2 solr instances on 2 different machines and configured 2 
zookeeper servers on these machines also. When I start solr on both 
machines and try to access the solr web-admin then I get following 
error on browser --


Http status 503 -- server is shutting down

When I setup a single standalone solr without zookeeper, I do not get 
this error.


Any insights ?

/Thanks and Regards,/

/Sagar Chaturvedi/

/Member Of Technical Staff /

/NEC Technologies India, Noida/

/09711931646/

DISCLAIMER:
---
The contents of this e-mail and any attachment(s) are confidential and
intended
for the named recipient(s) only.
It shall not attach any liability on the originator or NEC or its
affiliates. Any views or opinions presented in
this email are solely those of the author and may not necessarily reflect the
opinions of NEC or its affiliates.
Any form of reproduction, dissemination, copying, disclosure, modification,
distribution and / or publication of
this message without the prior written consent of the author of this e-mail is
strictly prohibited. If you have
received this email in error please delete it and notify the sender
immediately. .
---

Solr cloud setup

[Sagar Chaturvedi]

Hi,

I am new to Solr. I have a question regarding solrCloud - What is the 
difference between solr and solrcloud?

Also please let me know if the complete procedure to setup solr cloud is 
mentioned somewhere.

Regards,
Sagar



DISCLAIMER:

---

The contents of this e-mail and any attachment(s) are confidential and
intended

for the named recipient(s) only. 

It shall not attach any liability on the originator or NECHCL or its

affiliates. Any views or opinions presented in 

this email are solely those of the author and may not necessarily reflect the

opinions of NECHCL or its affiliates. 

Any form of reproduction, dissemination, copying, disclosure, modification,

distribution and / or publication of 

this message without the prior written consent of the author of this e-mail is

strictly prohibited. If you have 

received this email in error please delete it and notify the sender

immediately. .

---

Re: Solr cloud setup

[Gora Mohanty]

On 20 May 2013 16:16, Sagar Chaturvedi
sagar.chaturv...@nectechnologies.in wrote:

 Hi,

 I am new to Solr. I have a question regarding solrCloud - What is the 
 difference between solr and solrcloud?

 Also please let me know if the complete procedure to setup solr cloud is 
 mentioned somewhere.
[...]

Please do some basic legwork yourself: Just typing solrcloud into
Google search would get you started. See, for example,
http://wiki.apache.org/solr/SolrCloud

Regards,
Gora

Re: Solr cloud setup

[Furkan KAMACI]

You can start reading from here: http://wiki.apache.org/solr/SolrCloud and
here: http://docs.lucidworks.com/display/solr/SolrCloud

Furkan KAMACI
--

2013/5/20 Sagar Chaturvedi sagar.chaturv...@nectechnologies.in


 Hi,

 I am new to Solr. I have a question regarding solrCloud - What is the
 difference between solr and solrcloud?

 Also please let me know if the complete procedure to setup solr cloud is
 mentioned somewhere.

 Regards,
 Sagar



 DISCLAIMER:


 ---

 The contents of this e-mail and any attachment(s) are confidential and
 intended

 for the named recipient(s) only.

 It shall not attach any liability on the originator or NECHCL or its

 affiliates. Any views or opinions presented in

 this email are solely those of the author and may not necessarily reflect
 the

 opinions of NECHCL or its affiliates.

 Any form of reproduction, dissemination, copying, disclosure, modification,

 distribution and / or publication of

 this message without the prior written consent of the author of this
 e-mail is

 strictly prohibited. If you have

 received this email in error please delete it and notify the sender

 immediately. .


 ---

Issues With Solr Cloud Setup

[Rakhi Khatwani]

Hi,
 I was going through solr cloud documentation (
http://wiki.apache.org/solr/SolrCloud). and was trying out a simple setup.
I could execute example A and B successfully.
However whn i try example C, i get the following exception:
2010 12:22:29 PM org.apache.log4j.Category warn
WARNING: Exception closing session 0x0 to
sun.nio.ch.selectionkeyi...@1385660
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
at
org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):933)
May 14, 2010 12:22:29 PM org.apache.log4j.Category warn
WARNING: Ignoring exception during shutdown input
java.nio.channels.ClosedChannelException
at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:638)
at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:360)
at
org.apache.zookeeper.ClientCnxn$SendThread.cleanup(zookeeper:ClientCnxn.java):999)
at
org.apache.zookeeper.ClientCnxn$SendThread.run(zookeeper:ClientCnxn.java):970)
May 14, 2010 12:22:29 PM org.apache.log4j.Category warn

Probably this exception is because i hv not set localhost in my etc/hosts
(still wonder how the 1st two worked).
I tried replacing localhost with my domain name

(java -Dbootstrap_confdir=./solr/conf -Dcollection.configName=myconf -DzkRun
-DzkHost=raakhi:9983,raakhi:8574,raakhi:9900 -jar start.jar)

and i get the following exception:
java.lang.IllegalArgumentException: solr/zoo_data/myid file is missing
at
org.apache.solr.cloud.SolrZkServerProps.parseProperties(SolrZkServer.java:453)
at org.apache.solr.cloud.SolrZkServer.parseConfig(SolrZkServer.java:83)
at org.apache.solr.core.CoreContainer.initZooKeeper(CoreContainer.java:109)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:344)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:298)
at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:213)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:88)
at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:99)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:594)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:139)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1218)
at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:500)
at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:448)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at
org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:161)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:117)
at org.mortbay.jetty.Server.doStart(Server.java:210)
at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:929)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.mortbay.start.Main.invokeMain(Main.java:183)
at org.mortbay.start.Main.start(Main.java:497)
at org.mortbay.start.Main.main(Main.java:115)

Am i going wrong somewhere?
Regards,
Raakhi