Re: changing web context and port for SolrCloud Zookeeper

[John Bickerstaff]

Excellent! That file gave me fits at first.  It lives in two locations, but
the one that counts for booting SOLR is the /etc/default one.
On May 11, 2016 12:53 PM, "Tom Gullo"  wrote:

That helps.  I ended up updating the sole.in.sh file in /etc/default and
that was in getting picked up.  Thanks

> On May 11, 2016, at 2:05 PM, Tom Gullo  wrote:
>
> My Solr installation is running on Tomcat on port 8080 with a  web
context name that is different than /solr.   We want to move to a basic
jetty setup with all the defaults.  I haven’t found a clean way to do
this.  A lot of the values like baseurl and /leader/elect/shard1 have
values that need to be updated.  If I try shutting down the servers, change
the zookeeper settings and then restart Solr in Jetty I get issues - like
Solr thinks they are replicas.   So I’m looking to see if anyone knows what
is the cleanest way to move from a Tomcat/8080 install to a Jetty/8983 one.
>
> Thanks
>
>> On May 11, 2016, at 1:59 PM, John Bickerstaff 
wrote:
>>
>> I may be answering the wrong question - but SolrCloud goes in by default
on
>> 8983, yes?  Is yours currently on 8080?
>>
>> I don't recall where, but I think I saw a config file setting for the
port
>> number (In Solr I mean)
>>
>> Am I on the right track or are you asking something other than how to get
>> Solr on host:8983/solr ?
>>
>> On Wed, May 11, 2016 at 11:56 AM, Tom Gullo  wrote:
>>
>>> I need to change the web context and the port for a SolrCloud
installation.
>>>
>>> Example, change:
>>>
>>> host:8080/some-api-here/
>>>
>>> to this:
>>>
>>> host:8983/solr/
>>>
>>> Does anyone know how to do this with SolrCloud?  There are values stored
>>> in clusterstate.json and /leader/elect and I could change
them
>>> but that seems a little messy.
>>>
>>> Thanks
>

Re: changing web context and port for SolrCloud Zookeeper

[Tom Gullo]

That helps.  I ended up updating the sole.in.sh file in /etc/default and that 
was in getting picked up.  Thanks

> On May 11, 2016, at 2:05 PM, Tom Gullo  wrote:
> 
> My Solr installation is running on Tomcat on port 8080 with a  web context 
> name that is different than /solr.   We want to move to a basic jetty setup 
> with all the defaults.  I haven’t found a clean way to do this.  A lot of the 
> values like baseurl and /leader/elect/shard1 have values that need to be 
> updated.  If I try shutting down the servers, change the zookeeper settings 
> and then restart Solr in Jetty I get issues - like Solr thinks they are 
> replicas.   So I’m looking to see if anyone knows what is the cleanest way to 
> move from a Tomcat/8080 install to a Jetty/8983 one.
> 
> Thanks
> 
>> On May 11, 2016, at 1:59 PM, John Bickerstaff  
>> wrote:
>> 
>> I may be answering the wrong question - but SolrCloud goes in by default on
>> 8983, yes?  Is yours currently on 8080?
>> 
>> I don't recall where, but I think I saw a config file setting for the port
>> number (In Solr I mean)
>> 
>> Am I on the right track or are you asking something other than how to get
>> Solr on host:8983/solr ?
>> 
>> On Wed, May 11, 2016 at 11:56 AM, Tom Gullo  wrote:
>> 
>>> I need to change the web context and the port for a SolrCloud installation.
>>> 
>>> Example, change:
>>> 
>>> host:8080/some-api-here/
>>> 
>>> to this:
>>> 
>>> host:8983/solr/
>>> 
>>> Does anyone know how to do this with SolrCloud?  There are values stored
>>> in clusterstate.json and /leader/elect and I could change them
>>> but that seems a little messy.
>>> 
>>> Thanks
> 

Re: changing web context and port for SolrCloud Zookeeper

[John Bickerstaff]

Oh, I see -

Hmmm... I just did a disaster recovery work up for my IT guys and basically
I recommended they build SOLR from scratch and reindex rather than try to
recover (same for changing versions)

However, we've got a small-ish data set and that may not work for everyone.

Any chance you can just rebuild (with the default Jetty) and re-index?

On Wed, May 11, 2016 at 12:05 PM, Tom Gullo  wrote:

> My Solr installation is running on Tomcat on port 8080 with a  web context
> name that is different than /solr.   We want to move to a basic jetty setup
> with all the defaults.  I haven’t found a clean way to do this.  A lot of
> the values like baseurl and /leader/elect/shard1 have values that need to
> be updated.  If I try shutting down the servers, change the zookeeper
> settings and then restart Solr in Jetty I get issues - like Solr thinks
> they are replicas.   So I’m looking to see if anyone knows what is the
> cleanest way to move from a Tomcat/8080 install to a Jetty/8983 one.
>
> Thanks
>
> > On May 11, 2016, at 1:59 PM, John Bickerstaff 
> wrote:
> >
> > I may be answering the wrong question - but SolrCloud goes in by default
> on
> > 8983, yes?  Is yours currently on 8080?
> >
> > I don't recall where, but I think I saw a config file setting for the
> port
> > number (In Solr I mean)
> >
> > Am I on the right track or are you asking something other than how to get
> > Solr on host:8983/solr ?
> >
> > On Wed, May 11, 2016 at 11:56 AM, Tom Gullo  wrote:
> >
> >> I need to change the web context and the port for a SolrCloud
> installation.
> >>
> >> Example, change:
> >>
> >> host:8080/some-api-here/
> >>
> >> to this:
> >>
> >> host:8983/solr/
> >>
> >> Does anyone know how to do this with SolrCloud?  There are values stored
> >> in clusterstate.json and /leader/elect and I could change
> them
> >> but that seems a little messy.
> >>
> >> Thanks
>
>

Re: changing web context and port for SolrCloud Zookeeper

[John Bickerstaff]

Yup - bottom of solr.in.sh - if you used the "install for production"
script.

/etc/default/solr.in.sh (on linux which is all I do these days)

Hope that helps...  Ping back if not.

SOLR_PID_DIR="/var/solr"
SOLR_HOME="/var/solr/data"
LOG4J_PROPS="/var/solr/log4j.properties"
SOLR_LOGS_DIR="/var/solr/logs"
SOLR_PORT="8983"

On Wed, May 11, 2016 at 11:59 AM, John Bickerstaff  wrote:

> I may be answering the wrong question - but SolrCloud goes in by default
> on 8983, yes?  Is yours currently on 8080?
>
> I don't recall where, but I think I saw a config file setting for the port
> number (In Solr I mean)
>
> Am I on the right track or are you asking something other than how to get
> Solr on host:8983/solr ?
>
> On Wed, May 11, 2016 at 11:56 AM, Tom Gullo  wrote:
>
>> I need to change the web context and the port for a SolrCloud
>> installation.
>>
>> Example, change:
>>
>> host:8080/some-api-here/
>>
>> to this:
>>
>> host:8983/solr/
>>
>> Does anyone know how to do this with SolrCloud?  There are values stored
>> in clusterstate.json and /leader/elect and I could change them
>> but that seems a little messy.
>>
>> Thanks
>
>
>

Re: changing web context and port for SolrCloud Zookeeper

[Tom Gullo]

My Solr installation is running on Tomcat on port 8080 with a  web context name 
that is different than /solr.   We want to move to a basic jetty setup with all 
the defaults.  I haven’t found a clean way to do this.  A lot of the values 
like baseurl and /leader/elect/shard1 have values that need to be updated.  If 
I try shutting down the servers, change the zookeeper settings and then restart 
Solr in Jetty I get issues - like Solr thinks they are replicas.   So I’m 
looking to see if anyone knows what is the cleanest way to move from a 
Tomcat/8080 install to a Jetty/8983 one.

Thanks

> On May 11, 2016, at 1:59 PM, John Bickerstaff  
> wrote:
> 
> I may be answering the wrong question - but SolrCloud goes in by default on
> 8983, yes?  Is yours currently on 8080?
> 
> I don't recall where, but I think I saw a config file setting for the port
> number (In Solr I mean)
> 
> Am I on the right track or are you asking something other than how to get
> Solr on host:8983/solr ?
> 
> On Wed, May 11, 2016 at 11:56 AM, Tom Gullo  wrote:
> 
>> I need to change the web context and the port for a SolrCloud installation.
>> 
>> Example, change:
>> 
>> host:8080/some-api-here/
>> 
>> to this:
>> 
>> host:8983/solr/
>> 
>> Does anyone know how to do this with SolrCloud?  There are values stored
>> in clusterstate.json and /leader/elect and I could change them
>> but that seems a little messy.
>> 
>> Thanks

Re: changing web context and port for SolrCloud Zookeeper

[John Bickerstaff]

I may be answering the wrong question - but SolrCloud goes in by default on
8983, yes?  Is yours currently on 8080?

I don't recall where, but I think I saw a config file setting for the port
number (In Solr I mean)

Am I on the right track or are you asking something other than how to get
Solr on host:8983/solr ?

On Wed, May 11, 2016 at 11:56 AM, Tom Gullo  wrote:

> I need to change the web context and the port for a SolrCloud installation.
>
> Example, change:
>
> host:8080/some-api-here/
>
> to this:
>
> host:8983/solr/
>
> Does anyone know how to do this with SolrCloud?  There are values stored
> in clusterstate.json and /leader/elect and I could change them
> but that seems a little messy.
>
> Thanks

changing web context and port for SolrCloud Zookeeper

[Tom Gullo]

I need to change the web context and the port for a SolrCloud installation.

Example, change:

host:8080/some-api-here/

to this:

host:8983/solr/

Does anyone know how to do this with SolrCloud?  There are values stored in 
clusterstate.json and /leader/elect and I could change them but 
that seems a little messy.

Thanks

Re: SolrCloud Zookeeper disconnection/reconnection

[lboutros]

Thanks a lot for your answer.

Is there a web page, on the wiki for instance, where we could find some JVM
settings or recommandations that we should used for Solr with some index
configurations? 

Ludovic.





-
Jouve
France.
--
View this message in context: 
http://lucene.472066.n3.nabble.com/SolrCloud-Zookeeper-disconnection-reconnection-tp4117101p4117653.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud Zookeeper disconnection/reconnection

[Ramkumar R. Aiyengar]

Start with http://wiki.apache.org/solr/SolrPerformanceProblems It has a
section on GC tuning and a link to some example settings.
On 16 Feb 2014 21:19, lboutros boutr...@gmail.com wrote:

 Thanks a lot for your answer.

 Is there a web page, on the wiki for instance, where we could find some JVM
 settings or recommandations that we should used for Solr with some index
 configurations?

 Ludovic.





 -
 Jouve
 France.
 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/SolrCloud-Zookeeper-disconnection-reconnection-tp4117101p4117653.html
 Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud Zookeeper disconnection/reconnection

[Ramkumar R. Aiyengar]

Ludovic, recent Solr changes won't do much to prevent ZK session expiry,
you might want to enable GC logging on Solr and Zookeeper to check for
pauses and tune appropriately.

The patch below fixes a situation under which the cloud can get to a bad
state during the recovery after session expiry. The recovery after a
session expiry is unavoidable, but as you guessed, it would be quick if
there aren't too many updates.

4.6.1 also has SOLR-5577 which will prevent updates from unnecessarily
stalling when you are disconnected from ZK for a short while.

These changes (and probably others) will thus probably help the cloud
behave better on ZK expiry and for that reason I would encourage you to
upgrade, but the ZK expiry problem would have to be dealt with ensuring
that ZK and Solr don't pause for too long and by choosing an appropriate
session timeout (which btw will be defaulted up to 30s from 15s in Solr 4.7
onwards).
On 13 Feb 2014 08:23, lboutros boutr...@gmail.com wrote:

 Dear all,

 we are currenty using Solr 4.3.1 in production (With SolrCloud).

 We encounter quite the same problem described in this other old post:


 http://lucene.472066.n3.nabble.com/SolrCloud-CloudSolrServer-Zookeeper-disconnects-and-re-connects-with-heavy-memory-usage-consumption-td4026421.html

 Sometime some nodes are disconnected from Zookeeper and then they try to
 reconnect. The process is quite long because we have a quite long warming
 process. And because of this long warming process, just after the recovery
 process, the node is disconnected again and so on... until OOM sometime.

 We already increased the Zk timeout. But it is not enought.

 We are thinking to migrate to Solr 4.6.1 at least (perhaps 4.7 will be up
 before the end of the migration :) ).

 I know that a lot of SolrCloud bugs are corrected since Solr 4.3.1.

 But, could we be sure that this problem will be resolved ? Or can this
 problem occur with the last Solr version ? (I know this is not an easy
 question ;) )

 It seems that this correction :

 Deadlock while trying to recover after a ZK session expiry :
 https://issues.apache.org/jira/browse/SOLR-5615

 is a good point in addressing our current problem.

 But do you think it will be enought ?

 One last thing, I don't know if it is already adressed by a correction,
 but,
 if there is no updates between disconnection and the reconnection, the
 recovery process should not do anything more than the reconnection, I mean:
 no replication, no tLog replay and no warming process. Is it the case ?

 Ludovic.



 -
 Jouve
 France.
 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/SolrCloud-Zookeeper-disconnection-reconnection-tp4117101.html
 Sent from the Solr - User mailing list archive at Nabble.com.

SolrCloud Zookeeper disconnection/reconnection

[lboutros]

Dear all,

we are currenty using Solr 4.3.1 in production (With SolrCloud).

We encounter quite the same problem described in this other old post:

http://lucene.472066.n3.nabble.com/SolrCloud-CloudSolrServer-Zookeeper-disconnects-and-re-connects-with-heavy-memory-usage-consumption-td4026421.html

Sometime some nodes are disconnected from Zookeeper and then they try to
reconnect. The process is quite long because we have a quite long warming
process. And because of this long warming process, just after the recovery
process, the node is disconnected again and so on... until OOM sometime.

We already increased the Zk timeout. But it is not enought.

We are thinking to migrate to Solr 4.6.1 at least (perhaps 4.7 will be up
before the end of the migration :) ).

I know that a lot of SolrCloud bugs are corrected since Solr 4.3.1.

But, could we be sure that this problem will be resolved ? Or can this
problem occur with the last Solr version ? (I know this is not an easy
question ;) )

It seems that this correction : 

Deadlock while trying to recover after a ZK session expiry :
https://issues.apache.org/jira/browse/SOLR-5615

is a good point in addressing our current problem.

But do you think it will be enought ?

One last thing, I don't know if it is already adressed by a correction, but,
if there is no updates between disconnection and the reconnection, the
recovery process should not do anything more than the reconnection, I mean:
no replication, no tLog replay and no warming process. Is it the case ?

Ludovic.



-
Jouve
France.
--
View this message in context: 
http://lucene.472066.n3.nabble.com/SolrCloud-Zookeeper-disconnection-reconnection-tp4117101.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problem with SolrCloud + Zookeeper

[Erick Erickson]

Usually that error means you have a mix of old and new jars
in your classpath somehow. How that's only being triggered
when you have multiple nodes I'm not sure. By chance have
you copied any jars into different places somehow?

Best
Erick


On Fri, Aug 23, 2013 at 2:48 AM, 兴涛孙 sunxing...@gmail.com wrote:

 hello,guys:



 I've encounted a problem about configuring many cluested nodes with
 solr,so i want to ask for your help,thanks in advance!

 The problems lists as follows:

 1.Installation platform:

 solr4.3.1,zookeeper 3.4.5 and tomcat 7 with jdk1.7

 2.when i configured single node with DIH to build index,it can work
 properly,but when i configured one more(three nodes present) shard nodes
 with solr,then import data with DIH,some errors occured,i cannot find the
 reason,error information lists as follows:

 2013-08-09 08:19:24,349 : ERROR [http-bio-8983-exec-72]
 null:java.lang.ClassCastException:
 org.apache.lucene.codecs.BlockTreeTermsWriter$PendingTerm cannot be cast to
 org.apache.lucene.codecs.BlockTreeTermsWriter$PendingBlock

 3.It can be successfully import on each node independently.

 4.Details information and error messages enclosed with this message,for
 more information,please refer to it.



  Looking forward to hearing from
 you,thanks a lot.



 Yours,

Re: SolrCloud Zookeeper Exception

[Shalin Shekhar Mangar]

I don't think that the ZooKeeper errors are related to the DIH
problems. Can you post your data-config and dih output using
http://apaste.info or other pastebin like website?

On Mon, Aug 19, 2013 at 4:58 PM, Prasi S prasi1...@gmail.com wrote:
 Hi,
 I have setup solrcloud with 4.4 version. There is one external zookeeper
 and two instances of solr ( Total 4 shards - 2 shards in each instance)

 I was using dih to index from sql server. I twas indexing fine initially.
 Later when i shutdown solr and zookeeper's and then restarted them, I get
 the below infor in Zookeeper commandprompt,

 2013-08-19 05:23:45,257 [myid:] - INFO  [ProcessThread(sid:0
 cport:-1)::PrepRequ
 estProcessor@627] - Got user-level KeeperException when processing
 sessionid:0x1
 409617c5750005 type:create cxid:0x29a zxid:0x842 txntype:-1 reqpath:n/a
 Error Pa
 th:/overseer Error:KeeperErrorCode = NodeExists for /overseer


 When i give Solr indexing in dih, it is running but at last, it giving 
 Added 0 documents. I have chacked the DB. It has results.

 What could be the problem.

 REgards,
 Prasi



-- 
Regards,
Shalin Shekhar Mangar.

SolrCloud Zookeeper Exception

[Prasi S]

Hi,
I have setup solrcloud with 4.4 version. There is one external zookeeper
and two instances of solr ( Total 4 shards - 2 shards in each instance)

I was using dih to index from sql server. I twas indexing fine initially.
Later when i shutdown solr and zookeeper's and then restarted them, I get
the below infor in Zookeeper commandprompt,

2013-08-19 05:23:45,257 [myid:] - INFO  [ProcessThread(sid:0
cport:-1)::PrepRequ
estProcessor@627] - Got user-level KeeperException when processing
sessionid:0x1
409617c5750005 type:create cxid:0x29a zxid:0x842 txntype:-1 reqpath:n/a
Error Pa
th:/overseer Error:KeeperErrorCode = NodeExists for /overseer


When i give Solr indexing in dih, it is running but at last, it giving 
Added 0 documents. I have chacked the DB. It has results.

What could be the problem.

REgards,
Prasi

Re: Problem with SolrCloud + Zookeeper + DataImportHandler

[Erick Erickson]

The mail programs usually strip out attachments, so your
attachments didn't go through.

Maybe put it on Pastebin or similar?

But since you say it works on a single node, I wonder if
one or more of your nodes has an old jar on it that's
getting used. One could test it by trying to run your
import on each node independently.

Best
Erick


On Thu, Aug 8, 2013 at 11:19 PM, 兴涛孙 sunxing...@gmail.com wrote:

 hello,guys:



 I've encounted a problem about configuring many cluested nodes with solr,so
 i want to ask for your help,thanks in advance!

 The problems lists as follows:

 1.Installation platform:

 solr4.3.1,zookeeper 3.4.5 and tomcat 7 with jdk1.7

 2.when i configured single node with DIH to build index,it can work
 properly,but when i configured one more(three nodes present) shard nodes
 with solr,then import data with DIH,some errors occured,i cannot find the
 reason,error information lists as follows:

 2013-08-09 08:19:24,349 : ERROR [http-bio-8983-exec-72]
 null:java.lang.ClassCastException:
 org.apache.lucene.codecs.BlockTreeTermsWriter$PendingTerm cannot be cast to
 org.apache.lucene.codecs.BlockTreeTermsWriter$PendingBlock

 3.Details information and error messages enclosed with this message,for
 more information,please refer to it.



  Looking forward to hearing from
 you,thanks a lot.



 Yours,



 ★★★
 § sunxingtao
 § MOBILE:18643108123
 § EMail:sunxing...@gmail.com
 ★★★

Problem with SolrCloud + Zookeeper + DataImportHandler

[兴涛孙]

hello,guys:



I've encounted a problem about configuring many cluested nodes with solr,so
i want to ask for your help,thanks in advance!

The problems lists as follows:

1.Installation platform:

solr4.3.1,zookeeper 3.4.5 and tomcat 7 with jdk1.7

2.when i configured single node with DIH to build index,it can work
properly,but when i configured one more(three nodes present) shard nodes
with solr,then import data with DIH,some errors occured,i cannot find the
reason,error information lists as follows:

2013-08-09 08:19:24,349 : ERROR [http-bio-8983-exec-72]
null:java.lang.ClassCastException:
org.apache.lucene.codecs.BlockTreeTermsWriter$PendingTerm cannot be cast to
org.apache.lucene.codecs.BlockTreeTermsWriter$PendingBlock

3.Details information and error messages enclosed with this message,for
more information,please refer to it.



 Looking forward to hearing from
you,thanks a lot.



Yours,



★★★
§ sunxingtao
§ MOBILE:18643108123
§ EMail:sunxing...@gmail.com
★★★

SolrCloud Zookeeper SaslClient

[kowish.adamosh]

Hi,

Is there any documentation of how to configure SolrCloud Zookeeper using
SASL (on JBOSS 5). When I start SolrCloud on Jboss 5 I see WARN:

/2013-07-16 21:38:17,425 INFO 
[org.apache.solr.common.cloud.ConnectionManager:157] (main) Waiting for
client to connect to ZooKeeper
2013-07-16 21:38:17,437 WARN 
[org.apache.zookeeper.client.ZooKeeperSaslClient:437]
(main-SendThread(localhost:2181)) Could not login: the client is being asked
for a password, but the Zookeeper client code does not currently support
obtai
ning a password from the user. Make sure that the client is configured to
use a ticket cache (using the JAAS configuration setting
'useTicketCache=true)' and restart the client. If you still get this message
after that, the TGT in the tick
et cache has expired and must be manually refreshed. To do so, first
determine if you are using a password or a keytab. If the former, run kinit
in a Unix shell in the environment of the user who is running this Zookeeper
client using the 
command 'kinit princ' (where princ is the name of the client's Kerberos
principal). If the latter, do 'kinit -k -t keytab princ' (where princ
is the name of the Kerberos principal, and keytab is the location of the
keytab file)
. After manually refreshing your cache, restart this client. If you continue
to see this message after manually refreshing your cache, ensure that your
KDC host's clock is in sync with this host's clock.
2013-07-16 21:38:17,438 WARN  [org.apache.zookeeper.ClientCnxn:949]
(main-SendThread(localhost:2181)) SASL configuration failed:
javax.security.auth.login.FailedLoginException: Password Incorrect/Password
Required Will continue connection 
to Zookeeper server without SASL authentication, if Zookeeper server allows
it./

Any example or tutorial? I'd like to configure it to be secured :-)

Kowish




--
View this message in context: 
http://lucene.472066.n3.nabble.com/SolrCloud-Zookeeper-SaslClient-tp4078447.html
Sent from the Solr - User mailing list archive at Nabble.com.

solrcloud-zookeeper

[adm1n]

Hi all,
the first question:
is there a way to reduce timeout when sold shard comes up? it looks in log
file as follows:

Feb 12, 2013 1:19:08 PM org.apache.solr.cloud.ShardLeaderElectionContext
waitForReplicasToComeUp
INFO: Waiting until we see more replicas up: total=2 found=1
timeoutin=178992
Feb 12, 2013 1:19:09 PM org.apache.solr.cloud.ShardLeaderElectionContext
waitForReplicasToComeUp
INFO: Waiting until we see more replicas up: total=2 found=1
timeoutin=178489
Feb 12, 2013 1:19:09 PM org.apache.solr.cloud.ShardLeaderElectionContext
waitForReplicasToComeUp
INFO: Waiting until we see more replicas up: total=2 found=1
timeoutin=177986


And another one - let's assume I have 2 shards and one of them is down (both
- master and slave) for some reason.
What is happening now is that cluster returns 503 on the search request. Is
there a way to configure to get responses from other shard?


thanks.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/solrcloud-zookeeper-tp4039934.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: solrcloud-zookeeper

[Mark Miller]

By default, on cluster startup, we wait until we see all the replicas for a 
shard come up. This is for safety. You may have introduced an old shard with 
old data or a new shard with no data, and you don't want something like that 
becoming the leader.

If you don't want to do this wait, it's configurable. In solr.xml change the 
cores attribute leaderVoteWait to n milliseconds or 0. It defaults to 18 
(3 minutes).

- Mark

On Feb 12, 2013, at 8:31 AM, adm1n evgeni.evg...@gmail.com wrote:

 Hi all,
 the first question:
 is there a way to reduce timeout when sold shard comes up? it looks in log
 file as follows:
 
 Feb 12, 2013 1:19:08 PM org.apache.solr.cloud.ShardLeaderElectionContext
 waitForReplicasToComeUp
 INFO: Waiting until we see more replicas up: total=2 found=1
 timeoutin=178992
 Feb 12, 2013 1:19:09 PM org.apache.solr.cloud.ShardLeaderElectionContext
 waitForReplicasToComeUp
 INFO: Waiting until we see more replicas up: total=2 found=1
 timeoutin=178489
 Feb 12, 2013 1:19:09 PM org.apache.solr.cloud.ShardLeaderElectionContext
 waitForReplicasToComeUp
 INFO: Waiting until we see more replicas up: total=2 found=1
 timeoutin=177986
 
 
 And another one - let's assume I have 2 shards and one of them is down (both
 - master and slave) for some reason.
 What is happening now is that cluster returns 503 on the search request. Is
 there a way to configure to get responses from other shard?
 
 
 thanks.
 
 
 
 --
 View this message in context: 
 http://lucene.472066.n3.nabble.com/solrcloud-zookeeper-tp4039934.html
 Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud Zookeeper questions

[Jack Krupansky]

In case you missed the parallel thread running right now, a read of the main 
zookeeper admin web page is a good background to have:


http://zookeeper.apache.org/doc/r3.4.5/zookeeperAdmin.html

-- Jack Krupansky

-Original Message- 
From: Jamie Johnson

Sent: Thursday, December 06, 2012 5:09 PM
To: solr-user@lucene.apache.org
Subject: SolrCloud Zookeeper questions

I was wondering if anyone had any recommendations for zookeeper
configurations when running SolrCloud?  I am really not 100% sure what
specifically to ask, but any initial thoughts to get the conversation
started I think would be useful to the community at large. 

SolrCloud - Zookeeper Questions

[deniz]

Hi All,

I have been digging web for answers to some of my questions in my mind but
till now I am still not clear on them..

first (and main)question is about zookeeper itself.. are there any tutorials
in detail how we can use it with solr other than wikies? SolrCloud wiki page
is useful for sure, but i want to know how to control some operations like
removing a shard/replica temporarily and then adding back again and so on... 
I did some trials for that but basically it was playing with the command
line witb zKClient.sh, which I am not sure if it is the correct was to
administer SolrCloud. 

anyone has experience with zookeeper? 




-
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: 
http://lucene.472066.n3.nabble.com/SolrCloud-Zookeeper-Questions-tp4020971.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud - Zookeeper Questions

[Mark Miller]

On Nov 18, 2012, at 10:02 PM, deniz denizdurmu...@gmail.com wrote:

 removing a shard/replica temporarily and then adding back again 

I'd unload them with http cmds (without using the options that delete things on 
disk) and then create them again when I wanted them back.

- Mark

Re: SolrCloud - Zookeeper Questions

[deniz]

Mark Miller-3 wrote
 On Nov 18, 2012, at 10:02 PM, deniz lt;

 denizdurmus87@

 gt; wrote:
 
 removing a shard/replica temporarily and then adding back again 
 
 I'd unload them with http cmds (without using the options that delete
 things on disk) and then create them again when I wanted them back.
 
 - Mark


so then, the reason zookeeper is a part of SolrCloud is only for storing
config information? 

and instead of using the steps here
http://lucidworks.lucidimagination.com/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files
can we directly change the configs and then reloading by http would do the
new configs valid? 



-
Zeki ama calismiyor... Calissa yapar...
--
View this message in context: 
http://lucene.472066.n3.nabble.com/SolrCloud-Zookeeper-Questions-tp4020971p4020981.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Daniel Brügge]

Yes, I did this and the Words with the Umlaute went through the Stopfilter.
The ones without Umlaute were correctly removed.

On Thu, Nov 8, 2012 at 2:22 AM, Lance Norskog goks...@gmail.com wrote:

 You can debug this with the 'Analysis' page in the Solr UI. You pick
 'text_general' and then give words with umlauts in the text box for
 indexing and queries.

 Lance

 - Original Message -
 | From: Daniel Brügge daniel.brue...@googlemail.com
 | To: solr-user@lucene.apache.org
 | Sent: Wednesday, November 7, 2012 8:45:45 AM
 | Subject: SolrCloud, Zookeeper and Stopwords with Umlaute or other
 special characters
 |
 | Hi,
 |
 | i am running a SolrCloud cluster with the 4.0.0 version. I have a
 | stopwords
 | file
 | which is in the correct encoding. It contains german Umlaute like
 | e.g. 'ü'.
 | I am
 | also running a standalone Zookeeper which contains this stopwords
 | file. In
 | my schema
 | i am using the stopwords file in the standard way:
 |
 | 
 |  fieldType name=text_general class=solr.TextField
 |  positionIncrementGap=100
 |analyzer type=index
 |  tokenizer class=solr.StandardTokenizerFactory/
 |  filter class=solr.StopFilterFactory
 |  ignoreCase=true
 |  words=my_stopwords.txt
 |  enablePositionIncrements=true /
 |
 |
 | When I am indexing i recognized, that all stopwords without Umlaute
 | are
 | correctly removed, but the ones with
 | Umlaute still exist.
 |
 | Is this a problem with ZK or Solr?
 |
 | Thanks  regards
 |
 | Daniel
 |

Re: SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Daniel Brügge]

When I look at the text_de fieldType provided in the example schema i can
see:


 filter class=solr.LowerCaseFilterFactory/
 filter class=solr.StopFilterFactory ignoreCase=true
 words=lang/stopwords_de.txt format=snowball
 enablePositionIncrements=true/
 filter class=solr.GermanNormalizationFilterFactory/
 filter class=solr.GermanLightStemFilterFactory/


I have tried with this and this removed the words with Umlaute. It seems,
that is because of format=snowball. I haven't used this, because I though
I had one word per line. But maybe some invisible characters got into my
stopword file and destroyed it.

Thanks.

Daniel

On Thu, Nov 8, 2012 at 10:36 AM, Daniel Brügge 
daniel.brue...@googlemail.com wrote:

 Yes, I did this and the Words with the Umlaute went through the
 Stopfilter. The ones without Umlaute were correctly removed.

 On Thu, Nov 8, 2012 at 2:22 AM, Lance Norskog goks...@gmail.com wrote:

 You can debug this with the 'Analysis' page in the Solr UI. You pick
 'text_general' and then give words with umlauts in the text box for
 indexing and queries.

 Lance

 - Original Message -
 | From: Daniel Brügge daniel.brue...@googlemail.com
 | To: solr-user@lucene.apache.org
 | Sent: Wednesday, November 7, 2012 8:45:45 AM
 | Subject: SolrCloud, Zookeeper and Stopwords with Umlaute or other
 special characters
 |
 | Hi,
 |
 | i am running a SolrCloud cluster with the 4.0.0 version. I have a
 | stopwords
 | file
 | which is in the correct encoding. It contains german Umlaute like
 | e.g. 'ü'.
 | I am
 | also running a standalone Zookeeper which contains this stopwords
 | file. In
 | my schema
 | i am using the stopwords file in the standard way:
 |
 | 
 |  fieldType name=text_general class=solr.TextField
 |  positionIncrementGap=100
 |analyzer type=index
 |  tokenizer class=solr.StandardTokenizerFactory/
 |  filter class=solr.StopFilterFactory
 |  ignoreCase=true
 |  words=my_stopwords.txt
 |  enablePositionIncrements=true /
 |
 |
 | When I am indexing i recognized, that all stopwords without Umlaute
 | are
 | correctly removed, but the ones with
 | Umlaute still exist.
 |
 | Is this a problem with ZK or Solr?
 |
 | Thanks  regards
 |
 | Daniel
 |

Re: SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Robert Muir]

On Wed, Nov 7, 2012 at 11:45 AM, Daniel Brügge
daniel.brue...@googlemail.com wrote:
 Hi,

 i am running a SolrCloud cluster with the 4.0.0 version. I have a stopwords
 file
 which is in the correct encoding.

What makes you think that?

Note: Because I can read it is not the correct answer.

Ensure any of your stopwords files etc are in UTF-8. This is often
different from the encoding your computer uses by default if you open
a file, start typing in it, and press save.

Re: SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Daniel Brügge]

I trust the 'file' command output. And if i can read there UTF-8 Unicode
I believe that this is correct. Don't know if this is the 'correct answer'
for you ;)

BTW: It works locally, but not with ZK. So it's maybe more a ZK issue, which
somehow destroys my file. Will check.

On Thu, Nov 8, 2012 at 12:12 PM, Robert Muir rcm...@gmail.com wrote:

 On Wed, Nov 7, 2012 at 11:45 AM, Daniel Brügge
 daniel.brue...@googlemail.com wrote:
  Hi,
 
  i am running a SolrCloud cluster with the 4.0.0 version. I have a
 stopwords
  file
  which is in the correct encoding.

 What makes you think that?

 Note: Because I can read it is not the correct answer.

 Ensure any of your stopwords files etc are in UTF-8. This is often
 different from the encoding your computer uses by default if you open
 a file, start typing in it, and press save.

Re: SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Daniel Brügge]

Weird, if i return the file contents in ZK with 'get' it returns me

w??rde  |  would
w??rden |  would

for example. So the Umlaute are not shown. Does anyone have an idea if this
is because of Zookeepers cli or of the file contents itself?

Thanks  regards.

On Thu, Nov 8, 2012 at 12:24 PM, Daniel Brügge 
daniel.brue...@googlemail.com wrote:

 I trust the 'file' command output. And if i can read there UTF-8 Unicode
 I believe that this is correct. Don't know if this is the 'correct answer'
 for you ;)

 BTW: It works locally, but not with ZK. So it's maybe more a ZK issue,
 which
 somehow destroys my file. Will check.


 On Thu, Nov 8, 2012 at 12:12 PM, Robert Muir rcm...@gmail.com wrote:

 On Wed, Nov 7, 2012 at 11:45 AM, Daniel Brügge
 daniel.brue...@googlemail.com wrote:
  Hi,
 
  i am running a SolrCloud cluster with the 4.0.0 version. I have a
 stopwords
  file
  which is in the correct encoding.

 What makes you think that?

 Note: Because I can read it is not the correct answer.

 Ensure any of your stopwords files etc are in UTF-8. This is often
 different from the encoding your computer uses by default if you open
 a file, start typing in it, and press save.

Re: SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Daniel Brügge]

Ah, I have fixed it. It was necessary to import the files into Zookeeper
using the file.encoding system property and set it to UTF-8. Then it
worked. Hooray. :)

e.g.

java -Dfile.encoding=UTF-8 -Dbootstrap_confdir=/home/me/myconfdir
-Dcollection.configName=config1 -DzkHost=zkhost:2181 -DnumShards=2
-Dsolr.solr.home=/home/me/solr -jar start.jar



On Thu, Nov 8, 2012 at 2:09 PM, Daniel Brügge daniel.brue...@googlemail.com
 wrote:

 Weird, if i return the file contents in ZK with 'get' it returns me

 w??rde  |  would
 w??rden |  would

 for example. So the Umlaute are not shown. Does anyone have an idea if
 this is because of Zookeepers cli or of the file contents itself?

 Thanks  regards.

 On Thu, Nov 8, 2012 at 12:24 PM, Daniel Brügge 
 daniel.brue...@googlemail.com wrote:

 I trust the 'file' command output. And if i can read there UTF-8 Unicode
 I believe that this is correct. Don't know if this is the 'correct
 answer' for you ;)

 BTW: It works locally, but not with ZK. So it's maybe more a ZK issue,
 which
 somehow destroys my file. Will check.


 On Thu, Nov 8, 2012 at 12:12 PM, Robert Muir rcm...@gmail.com wrote:

 On Wed, Nov 7, 2012 at 11:45 AM, Daniel Brügge
 daniel.brue...@googlemail.com wrote:
  Hi,
 
  i am running a SolrCloud cluster with the 4.0.0 version. I have a
 stopwords
  file
  which is in the correct encoding.

 What makes you think that?

 Note: Because I can read it is not the correct answer.

 Ensure any of your stopwords files etc are in UTF-8. This is often
 different from the encoding your computer uses by default if you open
 a file, start typing in it, and press save.

SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Daniel Brügge]

Hi,

i am running a SolrCloud cluster with the 4.0.0 version. I have a stopwords
file
which is in the correct encoding. It contains german Umlaute like e.g. 'ü'.
I am
also running a standalone Zookeeper which contains this stopwords file. In
my schema
i am using the stopwords file in the standard way:


 fieldType name=text_general class=solr.TextField
 positionIncrementGap=100
   analyzer type=index
 tokenizer class=solr.StandardTokenizerFactory/
 filter class=solr.StopFilterFactory
 ignoreCase=true
 words=my_stopwords.txt
 enablePositionIncrements=true /


When I am indexing i recognized, that all stopwords without Umlaute are
correctly removed, but the ones with
Umlaute still exist.

Is this a problem with ZK or Solr?

Thanks  regards

Daniel

Re: SolrCloud, Zookeeper and Stopwords with Umlaute or other special characters

[Lance Norskog]

You can debug this with the 'Analysis' page in the Solr UI. You pick 
'text_general' and then give words with umlauts in the text box for indexing 
and queries.

Lance

- Original Message -
| From: Daniel Brügge daniel.brue...@googlemail.com
| To: solr-user@lucene.apache.org
| Sent: Wednesday, November 7, 2012 8:45:45 AM
| Subject: SolrCloud, Zookeeper and Stopwords with Umlaute or other special 
characters
| 
| Hi,
| 
| i am running a SolrCloud cluster with the 4.0.0 version. I have a
| stopwords
| file
| which is in the correct encoding. It contains german Umlaute like
| e.g. 'ü'.
| I am
| also running a standalone Zookeeper which contains this stopwords
| file. In
| my schema
| i am using the stopwords file in the standard way:
| 
| 
|  fieldType name=text_general class=solr.TextField
|  positionIncrementGap=100
|analyzer type=index
|  tokenizer class=solr.StandardTokenizerFactory/
|  filter class=solr.StopFilterFactory
|  ignoreCase=true
|  words=my_stopwords.txt
|  enablePositionIncrements=true /
| 
| 
| When I am indexing i recognized, that all stopwords without Umlaute
| are
| correctly removed, but the ones with
| Umlaute still exist.
| 
| Is this a problem with ZK or Solr?
| 
| Thanks  regards
| 
| Daniel
| 

Re: SolrCloud Zookeeper view does not work on latest snapshot

[Stefan Matheis]

Hey Jamie

On Saturday, April 7, 2012 at 2:45 AM, Jamie Johnson wrote: 
 Thanks Ryan. So to be clear this is a bug then? I went into the
 cloud.js and changed the url used to access this information so that
 it would work, wasn't sure if it was kosher or not.

Yes, it's a bug. My only installation with Zookeeper is a SingleCore-Setup and 
there it's still working -.- Created 
https://issues.apache.org/jira/browse/SOLR-3339 and already attached a patch - 
could you confirm that it's changing more or less them same than you did to 
bring back your local installation?

Regards
Stefan

Re: SolrCloud Zookeeper view does not work on latest snapshot

[Jamie Johnson]

Yes very similar. I had hard coded /solr but it was these locations. I'll
update to use the provided patch and reverify on Monday.

On Saturday, April 7, 2012, Stefan Matheis matheis.ste...@googlemail.com
wrote:
 Hey Jamie

 On Saturday, April 7, 2012 at 2:45 AM, Jamie Johnson wrote:
 Thanks Ryan. So to be clear this is a bug then? I went into the
 cloud.js and changed the url used to access this information so that
 it would work, wasn't sure if it was kosher or not.

 Yes, it's a bug. My only installation with Zookeeper is a
SingleCore-Setup and there it's still working -.- Created
https://issues.apache.org/jira/browse/SOLR-3339 and already attached a
patch - could you confirm that it's changing more or less them same than
you did to bring back your local installation?

 Regards
 Stefan

SolrCloud Zookeeper view does not work on latest snapshot

[Jamie Johnson]

I just downloaded the latest snapshot and fired it up to take a look
around and I'm getting the following error when looking at the Cloud
view.

Loading of undefined failed with HTTP-Status 404

The request I see going out is as follows

http://localhost:8501/solr/slice1_shard1/zookeeper?wt=json

this doesn't work but this does

http://localhost:8501/solr/zookeeper?wt=json

Any thoughts why this would happen?

Re: SolrCloud Zookeeper view does not work on latest snapshot

[Jamie Johnson]

I looked at our old system and indeed it used to make a call to
/solr/zookeeper not /solr/corename/zookeeper.  I am making a change
locally so I can run with this but is this a bug or did I much
something up with my configuration?

On Fri, Apr 6, 2012 at 9:33 AM, Jamie Johnson jej2...@gmail.com wrote:
 I just downloaded the latest snapshot and fired it up to take a look
 around and I'm getting the following error when looking at the Cloud
 view.

 Loading of undefined failed with HTTP-Status 404

 The request I see going out is as follows

 http://localhost:8501/solr/slice1_shard1/zookeeper?wt=json

 this doesn't work but this does

 http://localhost:8501/solr/zookeeper?wt=json

 Any thoughts why this would happen?

Re: SolrCloud Zookeeper view does not work on latest snapshot

[Ryan McKinley]

There have been a bunch of changes getting the zookeeper info and UI
looking good.  The info moved from being on the core to using a
servlet at the root level.

Note, it is not a request handler anymore, so the wt=XXX has no
effect.  It is always JSON

ryan


On Fri, Apr 6, 2012 at 7:01 AM, Jamie Johnson jej2...@gmail.com wrote:
 I looked at our old system and indeed it used to make a call to
 /solr/zookeeper not /solr/corename/zookeeper.  I am making a change
 locally so I can run with this but is this a bug or did I much
 something up with my configuration?

 On Fri, Apr 6, 2012 at 9:33 AM, Jamie Johnson jej2...@gmail.com wrote:
 I just downloaded the latest snapshot and fired it up to take a look
 around and I'm getting the following error when looking at the Cloud
 view.

 Loading of undefined failed with HTTP-Status 404

 The request I see going out is as follows

 http://localhost:8501/solr/slice1_shard1/zookeeper?wt=json

 this doesn't work but this does

 http://localhost:8501/solr/zookeeper?wt=json

 Any thoughts why this would happen?

Re: SolrCloud Zookeeper view does not work on latest snapshot

[Jamie Johnson]

Thanks Ryan.  So to be clear this is a bug then?  I went into the
cloud.js and changed the url used to access this information so that
it would work, wasn't sure if it was kosher or not.

On 4/6/12, Ryan McKinley ryan...@gmail.com wrote:
 There have been a bunch of changes getting the zookeeper info and UI
 looking good.  The info moved from being on the core to using a
 servlet at the root level.

 Note, it is not a request handler anymore, so the wt=XXX has no
 effect.  It is always JSON

 ryan


 On Fri, Apr 6, 2012 at 7:01 AM, Jamie Johnson jej2...@gmail.com wrote:
 I looked at our old system and indeed it used to make a call to
 /solr/zookeeper not /solr/corename/zookeeper.  I am making a change
 locally so I can run with this but is this a bug or did I much
 something up with my configuration?

 On Fri, Apr 6, 2012 at 9:33 AM, Jamie Johnson jej2...@gmail.com wrote:
 I just downloaded the latest snapshot and fired it up to take a look
 around and I'm getting the following error when looking at the Cloud
 view.

 Loading of undefined failed with HTTP-Status 404

 The request I see going out is as follows

 http://localhost:8501/solr/slice1_shard1/zookeeper?wt=json

 this doesn't work but this does

 http://localhost:8501/solr/zookeeper?wt=json

 Any thoughts why this would happen?

RE: Problem with SolrCloud + Zookeeper + DataImportHandler

[Agnieszka Kukałowicz]

Hi,

As you've asked.
https://issues.apache.org/jira/browse/SOLR-3165

If you have any questions or need more details I can debug this problem
more.

Agnieszka

 -Original Message-
 From: Mark Miller [mailto:markrmil...@gmail.com]
 Sent: Friday, February 24, 2012 10:11 PM
 To: solr-user@lucene.apache.org
 Subject: Re: Problem with SolrCloud + Zookeeper + DataImportHandler

 The key piece is ZkSolrResourceLoader does not support getConfigDir()
 

 Apparently DIH is doing something that requires getting the local
 config dir path - but this is on ZK in SolrCloud mode, not the local
 filesystem.

 Could you make a JIRA issue for this? I could look into a work around
 depending on why DIH needs to do this.

 - Mark

 On Feb 20, 2012, at 7:28 AM, Agnieszka Kukałowicz wrote:

  Hi All,
 
  I've recently downloaded latest solr trunk to configure solrcloud
 with
  zookeeper
  using standard configuration from wiki:
  http://wiki.apache.org/solr/SolrCloud.
 
  The problem occurred when I tried to configure DataImportHandler in
  solrconfig.xml:
 
   requestHandler name=/dataimport
  class=org.apache.solr.handler.dataimport.DataImportHandler
 lst name=defaults
str name=configdb-data-config.xml/str
 /lst
   /requestHandler
 
 
  After starting solr with zookeeper I've got errors:
 
  Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log
  SEVERE: null:org.apache.solr.common.SolrException
 at org.apache.solr.core.SolrCore.init(SolrCore.java:606)
 at org.apache.solr.core.SolrCore.init(SolrCore.java:490)
 at
  org.apache.solr.core.CoreContainer.create(CoreContainer.java:705)
 at
 org.apache.solr.core.CoreContainer.load(CoreContainer.java:442)
 at
 org.apache.solr.core.CoreContainer.load(CoreContainer.java:313)
 at
 
 org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer
 .ja
  va:262)
 at
 
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java
 :98
  )
 at
  org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
 at
 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50
 )
 at
 
 org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java
 :71
  3)
 at
  org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
 at
 
 org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:
 128
  2)
 at
 
 org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:51
 8)
 at
 
 org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
 at
 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50
 )
 at
 
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.j
 ava
  :152)
 at
 
 org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandl
 erC
  ollection.java:156)
 at
 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50
 )
 at
 
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.j
 ava
  :152)
 at
 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50
 )
 at
 
 org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:13
 0)
 at org.mortbay.jetty.Server.doStart(Server.java:224)
 at
 
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50
 )
 at
  org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at
 
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.ja
 va:
  39)
 at
 
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccesso
 rIm
  pl.java:25)
 at java.lang.reflect.Method.invoke(Method.java:597)
 at org.mortbay.start.Main.invokeMain(Main.java:194)
 at org.mortbay.start.Main.start(Main.java:534)
 at org.mortbay.start.Main.start(Main.java:441)
 at org.mortbay.start.Main.main(Main.java:119)
  Caused by: org.apache.solr.common.SolrException: FATAL: Could not
 create
  importer. DataImporter config invalid
 at
 
 org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportH
 and
  ler.java:120)
 at
 
 org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:
 542
  )
 at org.apache.solr.core.SolrCore.init(SolrCore.java:601)
 ... 31 more
  Caused by: org.apache.solr.common.cloud.ZooKeeperException:
  ZkSolrResourceLoader does not support getConfigDir() - likely, w
 at
 
 org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceL
 oad
  er.java:99)
 at
 
 org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePr
 ope
  rtiesWriter.java:47)
 at
 
 org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.jav
 a:1
  12

Re: Problem with SolrCloud + Zookeeper + DataImportHandler

[Mark Miller]

The key piece is ZkSolrResourceLoader does not support getConfigDir() 

Apparently DIH is doing something that requires getting the local config dir 
path - but this is on ZK in SolrCloud mode, not the local filesystem.

Could you make a JIRA issue for this? I could look into a work around depending 
on why DIH needs to do this.

- Mark

On Feb 20, 2012, at 7:28 AM, Agnieszka Kukałowicz wrote:

 Hi All,
 
 I've recently downloaded latest solr trunk to configure solrcloud with
 zookeeper
 using standard configuration from wiki:
 http://wiki.apache.org/solr/SolrCloud.
 
 The problem occurred when I tried to configure DataImportHandler in
 solrconfig.xml:
 
  requestHandler name=/dataimport
 class=org.apache.solr.handler.dataimport.DataImportHandler
lst name=defaults
   str name=configdb-data-config.xml/str
/lst
  /requestHandler
 
 
 After starting solr with zookeeper I've got errors:
 
 Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log
 SEVERE: null:org.apache.solr.common.SolrException
at org.apache.solr.core.SolrCore.init(SolrCore.java:606)
at org.apache.solr.core.SolrCore.init(SolrCore.java:490)
at
 org.apache.solr.core.CoreContainer.create(CoreContainer.java:705)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:442)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:313)
at
 org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.ja
 va:262)
at
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:98
 )
at
 org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
 org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:71
 3)
at
 org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
at
 org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:128
 2)
at
 org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
at
 org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java
 :152)
at
 org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerC
 ollection.java:156)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java
 :152)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
 org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
 org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
 sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
 39)
at
 sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
 pl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
 Caused by: org.apache.solr.common.SolrException: FATAL: Could not create
 importer. DataImporter config invalid
at
 org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand
 ler.java:120)
at
 org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:542
 )
at org.apache.solr.core.SolrCore.init(SolrCore.java:601)
... 31 more
 Caused by: org.apache.solr.common.cloud.ZooKeeperException:
 ZkSolrResourceLoader does not support getConfigDir() - likely, w
at
 org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoad
 er.java:99)
at
 org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePrope
 rtiesWriter.java:47)
at
 org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.java:1
 12)
at
 org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand
 ler.java:114)
... 33 more
 
 I've checked if file db-data-config.xml is available in Zookeeper:
 
 [zk: localhost:2181(CONNECTED) 0] ls /configs/conf1
 [admin-extra.menu-top.html, dict, solrconfig.xml, dataimport.properties,
 admin-extra.html, solrconfig.xml.old, solrconfig.xml.new, solrconfig.xml~,
 xslt, db-data-config.xml, velocity, elevate.xml,
 admin-extra.menu-bottom.html, solrconfig.xml.dataimport, schema.xml]
 [zk: localhost:2181(CONNECTED) 1]
 
 Is it possible to configure DIH with Zookeper? And how 

Problem with SolrCloud + Zookeeper + DataImportHandler

[Agnieszka Kukałowicz]

Hi All,

I've recently downloaded latest solr trunk to configure solrcloud with
zookeeper
using standard configuration from wiki:
http://wiki.apache.org/solr/SolrCloud.

The problem occurred when I tried to configure DataImportHandler in
solrconfig.xml:

  requestHandler name=/dataimport
class=org.apache.solr.handler.dataimport.DataImportHandler
lst name=defaults
   str name=configdb-data-config.xml/str
/lst
  /requestHandler


After starting solr with zookeeper I've got errors:

Feb 20, 2012 11:30:12 AM org.apache.solr.common.SolrException log
SEVERE: null:org.apache.solr.common.SolrException
at org.apache.solr.core.SolrCore.init(SolrCore.java:606)
at org.apache.solr.core.SolrCore.init(SolrCore.java:490)
at
org.apache.solr.core.CoreContainer.create(CoreContainer.java:705)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:442)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:313)
at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.ja
va:262)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:98
)
at
org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:71
3)
at
org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:128
2)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java
:152)
at
org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerC
ollection.java:156)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java
:152)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
at org.mortbay.jetty.Server.doStart(Server.java:224)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
at
org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorIm
pl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.mortbay.start.Main.invokeMain(Main.java:194)
at org.mortbay.start.Main.start(Main.java:534)
at org.mortbay.start.Main.start(Main.java:441)
at org.mortbay.start.Main.main(Main.java:119)
Caused by: org.apache.solr.common.SolrException: FATAL: Could not create
importer. DataImporter config invalid
at
org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand
ler.java:120)
at
org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:542
)
at org.apache.solr.core.SolrCore.init(SolrCore.java:601)
... 31 more
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
ZkSolrResourceLoader does not support getConfigDir() - likely, w
at
org.apache.solr.cloud.ZkSolrResourceLoader.getConfigDir(ZkSolrResourceLoad
er.java:99)
at
org.apache.solr.handler.dataimport.SimplePropertiesWriter.init(SimplePrope
rtiesWriter.java:47)
at
org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.java:1
12)
at
org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHand
ler.java:114)
... 33 more

I've checked if file db-data-config.xml is available in Zookeeper:

[zk: localhost:2181(CONNECTED) 0] ls /configs/conf1
[admin-extra.menu-top.html, dict, solrconfig.xml, dataimport.properties,
admin-extra.html, solrconfig.xml.old, solrconfig.xml.new, solrconfig.xml~,
xslt, db-data-config.xml, velocity, elevate.xml,
admin-extra.menu-bottom.html, solrconfig.xml.dataimport, schema.xml]
[zk: localhost:2181(CONNECTED) 1]

Is it possible to configure DIH with Zookeper? And how to do it?
I'm little confused with that.

Regards
Agnieszka Kukalowicz

Re: SolrCloud (ZooKeeper)

[Stijn Vanhoorelbeke]

Hi,

Has anyone used Zookeeper on a Tomcat 5 system?
Could someone point me to a good guide how to implement Zookeeper/solr
combination? The SolCloud wiki page doesn't give much info at all.

Thank you,

SolrCloud (ZooKeeper)

[Stijn Vanhoorelbeke]

Hi,

I've completed the quickdirty tutorials of SolrCloud ( see
http://wiki.apache.org/solr/SolrCloud ).
The whole concept of SolrCloud and ZooKeeper look indeed very promising.

I found also some info about a 'ZooKeeperComponent' - From this conponent it
should be possible to configure ZooKeeper directly from the sorlconfig.xml (
see http://wiki.apache.org/solr/ZooKeeperIntegration ).

Is this functionality already implemented (or is something for the future)?
If so, can you please point me to a good guide/tutorial, cause I do not find
much on the regular web. Or else copy me your real working
ZooKeeperComponent layout  how you configured ZooKeeper.

Thanks for helping me,

Re: SolrCloud (ZooKeeper)

[Yonik Seeley]

On Thu, Feb 10, 2011 at 5:00 PM, Stijn Vanhoorelbeke
stijn.vanhoorelb...@gmail.com wrote:
 I've completed the quickdirty tutorials of SolrCloud ( see
 http://wiki.apache.org/solr/SolrCloud ).
 The whole concept of SolrCloud and ZooKeeper look indeed very promising.

 I found also some info about a 'ZooKeeperComponent' - From this conponent it
 should be possible to configure ZooKeeper directly from the sorlconfig.xml (
 see http://wiki.apache.org/solr/ZooKeeperIntegration ).

That's not part of what has been committed to trunk.
Also, if one want's to get solrconfig from zookeeper, having the
zookeeper config in solrconfig is a bit chicken and eggish ;-)

-Yonik
http://lucidimagination.com