Re: solrcloud configuration: solr failed to start with multiple zookeeper servers

[Shawn Heisey]

On 9/13/2018 6:47 AM, Gu, Steve (CDC/OD/OADS) (CTR) wrote:

After zk servers have started, I got the following error when I tried to start 
solr:  localhost:2182 was unexpected at this time.


Where is this error seen?  Was there more to the message?  In addition 
to knowing that, we will need to see the FULL text of all errors in the 
solr.log file.


Thanks,
Shawn

RE: solrcloud configuration: solr failed to start with multiple zookeeper servers

[Gu, Steve (CDC/CDC OD/OADS) (CTR)]

Edwin,

Solr is 7.4.0, and zookeeper is 3.4.12.

Interestingly, when I started solr with ZK_HOST="localhost:2181", I can still 
access solr via other zk_host with CloudSolrClient.

Thanks
Steve

-Original Message-
From: Zheng Lin Edwin Yeo  
Sent: Thursday, September 13, 2018 11:10 PM
To: solr-user@lucene.apache.org
Subject: Re: solrcloud configuration: solr failed to start with multiple 
zookeeper servers

Which version of Solr and ZooKeeper are you using?

What is the command that you used to start Solr?

Regards,
Edwin


On Thu, 13 Sep 2018 at 21:56, Gu, Steve (CDC/OD/OADS) (CTR) 
wrote:

> Yes, my zookeeper ensemble have 3 servers and they are all up running.
>
> -Original Message-
> From: Pure Host - Wolfgang Freudenberger 
> 
> Sent: Thursday, September 13, 2018 8:57 AM
> To: solr-user@lucene.apache.org
> Subject: Re: solrcloud configuration: solr failed to start with 
> multiple zookeeper servers
>
> did you configure the zookeeper as a quorum?
>
> Am 13.09.2018 um 14:47 schrieb Gu, Steve (CDC/OD/OADS) (CTR):
> > Hi,
> >
> > I am prototyping solrcloud and I have three zookeeper servers
> (localhost:2181,localhost:2182,localhost:2183).  I set the zkHost in 
> solr.in.cmd file as:
> >
> > set ZK_HOST="localhost:2181,localhost:2182,localhost:2183"
> >
> > After zk servers have started, I got the following error when I 
> > tried to
> start solr:  localhost:2182 was unexpected at this time.
> >
> > Solr starts ok if I set ZK_Host to only one server, such as set
> ZK_HOST="localhost:2181".
> >
> > Any suggestions?
> >
> > Thanks
> > Steve
> >
>
>
>

Re: solrcloud configuration: solr failed to start with multiple zookeeper servers

[Zheng Lin Edwin Yeo]

Which version of Solr and ZooKeeper are you using?

What is the command that you used to start Solr?

Regards,
Edwin


On Thu, 13 Sep 2018 at 21:56, Gu, Steve (CDC/OD/OADS) (CTR) 
wrote:

> Yes, my zookeeper ensemble have 3 servers and they are all up running.
>
> -Original Message-
> From: Pure Host - Wolfgang Freudenberger 
> Sent: Thursday, September 13, 2018 8:57 AM
> To: solr-user@lucene.apache.org
> Subject: Re: solrcloud configuration: solr failed to start with multiple
> zookeeper servers
>
> did you configure the zookeeper as a quorum?
>
> Am 13.09.2018 um 14:47 schrieb Gu, Steve (CDC/OD/OADS) (CTR):
> > Hi,
> >
> > I am prototyping solrcloud and I have three zookeeper servers
> (localhost:2181,localhost:2182,localhost:2183).  I set the zkHost in
> solr.in.cmd file as:
> >
> > set ZK_HOST="localhost:2181,localhost:2182,localhost:2183"
> >
> > After zk servers have started, I got the following error when I tried to
> start solr:  localhost:2182 was unexpected at this time.
> >
> > Solr starts ok if I set ZK_Host to only one server, such as set
> ZK_HOST="localhost:2181".
> >
> > Any suggestions?
> >
> > Thanks
> > Steve
> >
>
>
>

RE: solrcloud configuration: solr failed to start with multiple zookeeper servers

[Gu, Steve (CDC/OD/OADS) (CTR)]

Yes, my zookeeper ensemble have 3 servers and they are all up running.

-Original Message-
From: Pure Host - Wolfgang Freudenberger  
Sent: Thursday, September 13, 2018 8:57 AM
To: solr-user@lucene.apache.org
Subject: Re: solrcloud configuration: solr failed to start with multiple 
zookeeper servers

did you configure the zookeeper as a quorum?

Am 13.09.2018 um 14:47 schrieb Gu, Steve (CDC/OD/OADS) (CTR):
> Hi,
>
> I am prototyping solrcloud and I have three zookeeper servers 
> (localhost:2181,localhost:2182,localhost:2183).  I set the zkHost in 
> solr.in.cmd file as:
>
> set ZK_HOST="localhost:2181,localhost:2182,localhost:2183"
>
> After zk servers have started, I got the following error when I tried to 
> start solr:  localhost:2182 was unexpected at this time.
>
> Solr starts ok if I set ZK_Host to only one server, such as set 
> ZK_HOST="localhost:2181".
>
> Any suggestions?
>
> Thanks
> Steve
>

Re: solrcloud configuration: solr failed to start with multiple zookeeper servers

[Pure Host - Wolfgang Freudenberger]

did you configure the zookeeper as a quorum?

Am 13.09.2018 um 14:47 schrieb Gu, Steve (CDC/OD/OADS) (CTR):

Hi,

I am prototyping solrcloud and I have three zookeeper servers 
(localhost:2181,localhost:2182,localhost:2183).  I set the zkHost in 
solr.in.cmd file as:

set ZK_HOST="localhost:2181,localhost:2182,localhost:2183"

After zk servers have started, I got the following error when I tried to start 
solr:  localhost:2182 was unexpected at this time.

Solr starts ok if I set ZK_Host to only one server, such as set 
ZK_HOST="localhost:2181".

Any suggestions?

Thanks
Steve

Re: Solrcloud configuration

[Shashi Roushan]

Hello All,

Thanks to reply. After long time , I found the solution of configuration
uploading in sold cloud from the following link:

http://mtitek.com/tutorials/solr/collections.php

Regards,
Shashi Roushan

On Sep 20, 2017 3:42 AM, "John Bickerstaff" 
wrote:

This may also be of some assistance:

https://gist.github.com/maxivak/3e3ee1fca32f3949f052

I haven't tested, just found it.

On Tue, Sep 19, 2017 at 4:10 PM, John Bickerstaff 
wrote:

> This may be of some assistance...
>
> http://lucene.apache.org/solr/guide/6_6/
>
> There is a section discussing sharding and another section that includes
> the schema.
>
> On Tue, Sep 19, 2017 at 1:42 PM, Shashi Roushan 
> wrote:
>
>> Hello David
>>
>> No, I didn't read any documentation on the schema and DIH.
>>
>> Actually we are already using Solr 4 version. I am now upgrading in
>> solrcloud with shards. I have done lots of google, but not getting
>> relevant
>> information DIH and schema with Solr shards. I am getting result with
>> older
>> version of Solr.
>>
>>
>> On Sep 20, 2017 12:58 AM, "David Hastings" 
>> wrote:
>>
>> Did you read the documentation on the schema and the DIH?
>>
>> On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan 
>> wrote:
>>
>> > Hi All,
>> >
>> > I need your help to configure solrcloud with shards.
>> > I have created collection and shards using solr6 and Zookeeper. Its
>> working
>> > fine.
>> > My problems are:
>> > Where I put schema and dbdataconfig files?
>> > How I can use DIH to import data from SQL server To solr?
>> >  In older version I was using schema and DIH to import data from SQL
>> > server.
>> >
>> > Please help.
>> >
>> > Regards
>> > Shashi Roushan
>> >
>>
>
>

Re: Solrcloud configuration

[John Bickerstaff]

Addendum:  It's not sql server, but I imagine the steps will be similar if
not identical except for the details of the JDBC driver you need.

On Tue, Sep 19, 2017 at 4:11 PM, John Bickerstaff 
wrote:

> This may also be of some assistance:
>
> https://gist.github.com/maxivak/3e3ee1fca32f3949f052
>
> I haven't tested, just found it.
>
> On Tue, Sep 19, 2017 at 4:10 PM, John Bickerstaff <
> j...@johnbickerstaff.com> wrote:
>
>> This may be of some assistance...
>>
>> http://lucene.apache.org/solr/guide/6_6/
>>
>> There is a section discussing sharding and another section that includes
>> the schema.
>>
>> On Tue, Sep 19, 2017 at 1:42 PM, Shashi Roushan 
>> wrote:
>>
>>> Hello David
>>>
>>> No, I didn't read any documentation on the schema and DIH.
>>>
>>> Actually we are already using Solr 4 version. I am now upgrading in
>>> solrcloud with shards. I have done lots of google, but not getting
>>> relevant
>>> information DIH and schema with Solr shards. I am getting result with
>>> older
>>> version of Solr.
>>>
>>>
>>> On Sep 20, 2017 12:58 AM, "David Hastings" >> >
>>> wrote:
>>>
>>> Did you read the documentation on the schema and the DIH?
>>>
>>> On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan >> >
>>> wrote:
>>>
>>> > Hi All,
>>> >
>>> > I need your help to configure solrcloud with shards.
>>> > I have created collection and shards using solr6 and Zookeeper. Its
>>> working
>>> > fine.
>>> > My problems are:
>>> > Where I put schema and dbdataconfig files?
>>> > How I can use DIH to import data from SQL server To solr?
>>> >  In older version I was using schema and DIH to import data from SQL
>>> > server.
>>> >
>>> > Please help.
>>> >
>>> > Regards
>>> > Shashi Roushan
>>> >
>>>
>>
>>
>

Re: Solrcloud configuration

[John Bickerstaff]

This may also be of some assistance:

https://gist.github.com/maxivak/3e3ee1fca32f3949f052

I haven't tested, just found it.

On Tue, Sep 19, 2017 at 4:10 PM, John Bickerstaff 
wrote:

> This may be of some assistance...
>
> http://lucene.apache.org/solr/guide/6_6/
>
> There is a section discussing sharding and another section that includes
> the schema.
>
> On Tue, Sep 19, 2017 at 1:42 PM, Shashi Roushan 
> wrote:
>
>> Hello David
>>
>> No, I didn't read any documentation on the schema and DIH.
>>
>> Actually we are already using Solr 4 version. I am now upgrading in
>> solrcloud with shards. I have done lots of google, but not getting
>> relevant
>> information DIH and schema with Solr shards. I am getting result with
>> older
>> version of Solr.
>>
>>
>> On Sep 20, 2017 12:58 AM, "David Hastings" 
>> wrote:
>>
>> Did you read the documentation on the schema and the DIH?
>>
>> On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan 
>> wrote:
>>
>> > Hi All,
>> >
>> > I need your help to configure solrcloud with shards.
>> > I have created collection and shards using solr6 and Zookeeper. Its
>> working
>> > fine.
>> > My problems are:
>> > Where I put schema and dbdataconfig files?
>> > How I can use DIH to import data from SQL server To solr?
>> >  In older version I was using schema and DIH to import data from SQL
>> > server.
>> >
>> > Please help.
>> >
>> > Regards
>> > Shashi Roushan
>> >
>>
>
>

Re: Solrcloud configuration

[John Bickerstaff]

This may be of some assistance...

http://lucene.apache.org/solr/guide/6_6/

There is a section discussing sharding and another section that includes
the schema.

On Tue, Sep 19, 2017 at 1:42 PM, Shashi Roushan 
wrote:

> Hello David
>
> No, I didn't read any documentation on the schema and DIH.
>
> Actually we are already using Solr 4 version. I am now upgrading in
> solrcloud with shards. I have done lots of google, but not getting relevant
> information DIH and schema with Solr shards. I am getting result with older
> version of Solr.
>
>
> On Sep 20, 2017 12:58 AM, "David Hastings" 
> wrote:
>
> Did you read the documentation on the schema and the DIH?
>
> On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan 
> wrote:
>
> > Hi All,
> >
> > I need your help to configure solrcloud with shards.
> > I have created collection and shards using solr6 and Zookeeper. Its
> working
> > fine.
> > My problems are:
> > Where I put schema and dbdataconfig files?
> > How I can use DIH to import data from SQL server To solr?
> >  In older version I was using schema and DIH to import data from SQL
> > server.
> >
> > Please help.
> >
> > Regards
> > Shashi Roushan
> >
>

Re: Solrcloud configuration

[Shashi Roushan]

Hello David

No, I didn't read any documentation on the schema and DIH.

Actually we are already using Solr 4 version. I am now upgrading in
solrcloud with shards. I have done lots of google, but not getting relevant
information DIH and schema with Solr shards. I am getting result with older
version of Solr.


On Sep 20, 2017 12:58 AM, "David Hastings" 
wrote:

Did you read the documentation on the schema and the DIH?

On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan 
wrote:

> Hi All,
>
> I need your help to configure solrcloud with shards.
> I have created collection and shards using solr6 and Zookeeper. Its
working
> fine.
> My problems are:
> Where I put schema and dbdataconfig files?
> How I can use DIH to import data from SQL server To solr?
>  In older version I was using schema and DIH to import data from SQL
> server.
>
> Please help.
>
> Regards
> Shashi Roushan
>

Re: Solrcloud configuration

[David Hastings]

Did you read the documentation on the schema and the DIH?

On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan 
wrote:

> Hi All,
>
> I need your help to configure solrcloud with shards.
> I have created collection and shards using solr6 and Zookeeper. Its working
> fine.
> My problems are:
> Where I put schema and dbdataconfig files?
> How I can use DIH to import data from SQL server To solr?
>  In older version I was using schema and DIH to import data from SQL
> server.
>
> Please help.
>
> Regards
> Shashi Roushan
>

Re: SolrCloud Configuration

[Wunna Lwin]

That is work on standalone cluster. and i think did not work in solrcloud
mode.
I created collection, name document but that actual collection doesn't
exist. So,
In the cloud mode, I am not sure where I have upload those lib.

On Thu, Nov 10, 2016 at 4:10 PM, Wunna Lwin  wrote:

> The easiest way is to create a /lib directory under each solr node and
> place the custom jar in it. But I think it doesn't get distributed over
> cluster, so this approach requires jar to be placed manually on each node.
> IIRC, it was recommended that such custom jar to be on disc than uploaded
> to zookeeper.
> Lets wait for experts thoughts and suggestions.
>
>
> On Thu, Nov 10, 2016 at 1:40 AM, Wunna Lwin  wrote:
>
> > Hi,
> >
> > I just using solrCloud version 6.2.1 and everything is find but I would
> > like to add some additional custom plugin into solrCloud.
> >
> > So, I upload my custom lib using Blob api and create requestHandler and
> > components using config api into .system collection. But config api didn't
> > load my custom lib when I use custom lib.
> >
> > Is there any specific documents to upload custom lib?
> > I also want to know different between Blob api and Config api.
> >
> > Also the last question is I create .system collection and upload custom lib
> > to that collection to share config files to all collections. Is this right
> > way or should I upload explicit to main collection?
> >
> > Thanks
> > Wunna
> >
>
>

Re: SolrCloud Configuration

[Reth RM]

The easiest way is to create a /lib directory under each solr node and
place the custom jar in it. But I think it doesn't get distributed over
cluster, so this approach requires jar to be placed manually on each node.
IIRC, it was recommended that such custom jar to be on disc than uploaded
to zookeeper.
Lets wait for experts thoughts and suggestions.


On Thu, Nov 10, 2016 at 1:40 AM, Wunna Lwin  wrote:

> Hi,
>
> I just using solrCloud version 6.2.1 and everything is find but I would
> like to add some additional custom plugin into solrCloud.
>
> So, I upload my custom lib using Blob api and create requestHandler and
> components using config api into .system collection. But config api didn't
> load my custom lib when I use custom lib.
>
> Is there any specific documents to upload custom lib?
> I also want to know different between Blob api and Config api.
>
> Also the last question is I create .system collection and upload custom lib
> to that collection to share config files to all collections. Is this right
> way or should I upload explicit to main collection?
>
> Thanks
> Wunna
>

Re: SolrCloud configuration in a zookeeper node

[Timothy Potter]

/configs/collectionName

You should be able to see this from the Solr admin console as well:
Cloud  Tree  configs  collectionName

Cheers,
Tim

On Mon, Feb 18, 2013 at 4:23 PM, mshirman mshir...@gmail.com wrote:

 I'm relatively new to zk/SolrCloud, and I have new environment configured
 with an ZK ensemble  (3 nodes) running with SolrCloud. Things are running,
 yet I'm puzzled since I can't find the Solr config data on zookeeper nodes.

 What is the default location?

 Thank you in advance!

 /michael



 --
 View this message in context: 
 http://lucene.472066.n3.nabble.com/SolrCloud-configuration-in-a-zookeeper-node-tp4041205.html
 Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - configuration management in ZooKeeper

[Tomás Fernández Löbbe]

Hi Alexey, responses are inline:

Zookeeper manages not only the cluster state, but also the common
 configuration files.
 My question is, what are the exact rules of precedence? That is, when SOLR
 node will decide to download new configuration files?

When the SolrCore is started.


 Will configuration files be updated from ZooKeeper every time the core is
 refreshed?

Yes, every time the SolrCore is reloaded. If you need to force this, you
can either reload all the cores or reload the collection:
https://issues.apache.org/jira/browse/SOLR-3488

 What if bootstrapping is defined (bootstrap_configdir)? Will the
 node always try to upload?

if bootstrap_confdir is set, and the config name is always the same, every
time you start Solr it will upload the configuration files and override the
old ones in the same zk location.

 What are the best practices for production environment? Is it better to use
 external tool (ZkCLI) to trigger configuration changes?

I would at least not attach the bootstrap_confdir to a start script and
make it explicit. There are some Solr specific zk scripts that you can use.
See
http://wiki.apache.org/solr/SolrCloud#Getting_your_Configuration_Files_into_ZooKeeper

I would use Solr's zk script for managing the configuration.

Tomás


 Thanks




 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/SolrCloud-configuration-management-in-ZooKeeper-tp4018432.html
 Sent from the Solr - User mailing list archive at Nabble.com.