Re: SolrCloud - Path must not end with / character

2013-08-29 Thread Mark Miller
and is confusing. - Mark On Aug 29, 2013, at 5:23 AM, sathish_ix skandhasw...@inautix.co.in wrote: Hi , Check your configuration files uploaded into zookeeper is valid and no error in config files uploaded. I think due to this error, solr core will not be created. Thanks, Sathish

Re: Data Centre recovery/replication, does this seem plausible?

2013-08-29 Thread Mark Miller
updates during that replication, then it replays all those updates from the buffer. No 'target' number of updates applies here. - Mark

Re: Transaction log on-disk guarantees

2013-08-27 Thread Mark Miller
. - Mark

Re: Transaction log on-disk guarantees

2013-08-27 Thread Mark Miller
: On Aug 27, 2013, at 11:43 AM, Sandro Zbinden zbin...@imagic.ch wrote: Hey Mark Thank you very much for the quick answer. We have a single node environment. I try to find the fsync option but was not successful. Ended up in the UpdateLog class :-) How do I enable fsync

Re: Problems installing Solr4 in Jetty9

2013-08-18 Thread Mark Miller
On Aug 17, 2013, at 9:01 AM, Robert Muir rcm...@gmail.com wrote: I think this is only a test dependency ? Right - it's only for the hdfs 'test' setup. I thought that when Steve moved it from the test module to the core, he handled it so that it would not go out in the dist. - mark

Re: Clusterstate says state:recovering, but Core says I see state: null?

2013-08-14 Thread Mark Miller
What does the cluster state and leader say? Anything interesting you can pull from the logs? - Mark On Aug 14, 2013, at 4:58 AM, Tor Egil trefs...@gmail.com wrote: Setup: 3 zk servers 3 solr 4.4 servers (1 shard with 2 replicas) Every now and then Solr gets trapped recovering

Re: Wrong leader election leads to shard removal

2013-08-14 Thread Mark Miller
had no tlog, it should have recovered from the one that still had a tlog. How does the zookeeper compare the 2 tlogs to know which one is more recent? does it not rely on the version number shown in the admin UI? It looks at recent id's in the tlogs of both and compares them. - Mark

Re: Clusterstate says state:recovering, but Core says I see state: null?

2013-08-14 Thread Mark Miller
about throwing an exception on this and one or two other core admin commands. We might want to support them in some way at some point, but currently, swap is def no good in SolrCloud. - Mark

Re: Clusterstate says state:recovering, but Core says I see state: null?

2013-08-14 Thread Mark Miller
alias instead. - Mark

Re: Percolate feature?

2013-08-13 Thread Mark
Any ideas? On Aug 10, 2013, at 6:28 PM, Mark static.void@gmail.com wrote: Our schema is pretty basic.. nothing fancy going on here fieldType name=text class=solr.TextField omitNorms=false analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ filter

Re: Percolate feature?

2013-08-10 Thread Mark
So to reiteratve your examples from before, but change the labels a bit and add some more converse examples (and ignore the highlighting aspect for a moment... doc1 = Sony doc2 = Samsung Galaxy doc3 = Sony Playstation queryA = Sony Experia ... matches only doc1 queryB = Sony

Re: Percolate feature?

2013-08-10 Thread Mark
any of these queries (but doesn't score a hit on your direct check for whether it is a clean keyword match.) In your previous examples you only gave clean product titles, not examples of circumventions of simple keyword matches. -- Jack Krupansky -Original Message- From: Mark

Re: Percolate feature?

2013-08-09 Thread Mark
at 8:19 AM, Erick Erickson erickerick...@gmail.com wrote: This _looks_ like simple phrase matching (no slop) and highlighting... But whenever I think the answer is really simple, it usually means that I'm missing something Best Erick On Thu, Aug 8, 2013 at 11:18 PM, Mark

Re: Percolate feature?

2013-08-09 Thread Mark
I'll look into this. Thanks for the concrete example as I don't even know which classes to start to look at to implement such a feature. On Aug 9, 2013, at 9:49 AM, Roman Chyla roman.ch...@gmail.com wrote: On Fri, Aug 9, 2013 at 11:29 AM, Mark static.void@gmail.com wrote: *All

Re: Percolate feature?

2013-08-08 Thread Mark
Ok forget the mention of percolate. We have a large list of known keywords we would like to match against. Product keyword: Sony Product keyword: Samsung Galaxy We would like to be able to detect given a product title whether or not it matches any known keywords. For a keyword to be

Re: problems running solr 4.4 with HDFS HA

2013-08-06 Thread Mark Miller
=org.apache.solr.core.HdfsDirectoryFactory str name=solr.hdfs.home${solr.hdfs.home:}/str str name=solr.hdfs.confdir${solr.hdfs.confdir:}/str /directoryFactory - Mark

Re: Problems matching delimited field

2013-08-05 Thread Mark
That was it… thanks On Aug 2, 2013, at 3:27 PM, Shawn Heisey s...@elyograg.org wrote: On 8/2/2013 4:16 PM, Robert Zotter wrote: The problem is the query get's expanded to 1 Foo not ( 1 OR Foo) str name=rawquerystring1Foo/str str name=querystring1Foo/str str

Re: Percolate feature?

2013-08-05 Thread Mark
.28Minimum_.27Should.27_Match.29 Try to clarify your requirements... or maybe min-should-match was all you needed? -- Jack Krupansky -Original Message- From: Mark Sent: Friday, August 02, 2013 7:50 PM To: solr-user@lucene.apache.org Subject: Percolate feature? We have a set

Re: Percolate feature?

2013-08-05 Thread Mark
, then write the query that way: +foo +bar baz But it still doesn't sound as if any of this relates to prospective search/percolate. -- Jack Krupansky -Original Message- From: Mark Sent: Monday, August 05, 2013 2:11 PM To: solr-user@lucene.apache.org Subject: Re: Percolate feature

Percolate feature?

2013-08-02 Thread Mark
We have a set number of known terms we want to match against. In Index: term one term two term three I know how to match all terms of a user query against the index but we would like to know how/if we can match a user's query against all the terms in the index? Search Queries: my search term

Re: Sharding with a SolrCloud

2013-08-01 Thread Mark Miller
to get to the bottom of why you randomly don't see the documents in the response. - Mark

Re: Sharding with a SolrCloud

2013-08-01 Thread Mark Miller
to any node in the cluster to work if possible (via proxing the request or whatever). - Mark

Alternative searches

2013-07-31 Thread Mark
Can someone explain how one would go about providing alternative searches for a query… similar to Amazon. For example say I search for Red Dump Truck - 0 results for Red Dump Truck - 500 results for Red Truck - 350 results for Dump Truck Does this require multiple searches? Thanks

Re: SolrCloud commit process is too time consuming, even if documents are light

2013-07-30 Thread Mark Miller
I don't seem to be seeing a signifigant slowdown over time when I use the old defaults for merge threads and max merges. - Mark On Jul 25, 2013, at 10:17 AM, Mark Miller markrmil...@gmail.com wrote: I'm looking into some possible slow down after long indexing issues when I get back from

Re: .lock file not created when making a backup snapshot

2013-07-29 Thread Mark Triggs
Hi Artem, I noticed this recently too. I created a JIRA issue here: https://issues.apache.org/jira/browse/SOLR-5040 Cheers, Mark Artem Karpenko a.karpe...@oxseed.com writes: Hi, when making a backup snapshot using /replication?command=backup call, a snapshot directory is created

Re: Performance vs. maxBufferedAddsPerServer=10

2013-07-29 Thread Mark Miller
SOLR-4816 won't address this - it will just speed up *different* parts. There are other things that will need to be done to speed up that part. - Mark On Jul 26, 2013, at 3:53 PM, Erick Erickson erickerick...@gmail.com wrote: This is current a hard-coded limit from what I've understood. From

Re: SolrCloud shard down

2013-07-29 Thread Mark Miller
and get to it otherwise. - Mark

Re: Performance vs. maxBufferedAddsPerServer=10

2013-07-29 Thread Mark Miller
Yes, the internal document forwarding path is different and does not use the CloudSolrServer. It currently works with a buffer of 10. - Mark On Jul 29, 2013, at 3:10 PM, Erick Erickson erickerick...@gmail.com wrote: Why wouldn't it? Or are you saying that the routing to replicas from

Re: SolrCloud commit process is too time consuming, even if documents are light

2013-07-25 Thread Mark Miller
settings. - Mark On Jul 25, 2013, at 8:36 AM, Radu Ghita r...@wmds.ro wrote: Forgot to attach server and solr configurations: SolrCloud 4.1, internal Zookeeper, 16 shards, custom java importer. Server: Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, 32 cores, 192gb RAM, 10tb SSD and 50tb SAS memory

Duplicate documents based on attribute

2013-07-25 Thread Mark
How would I go about doing something like this. Not sure if this is something that can be accomplished on the index side or its something that should be done in our application. Say we are an online store for shoes and we are selling Product A in red, blue and green. Is there a way when we

Re: Duplicate documents based on attribute

2013-07-25 Thread Mark
on it outside of solr. On Thu, Jul 25, 2013 at 10:12 PM, Mark static.void@gmail.com wrote: How would I go about doing something like this. Not sure if this is something that can be accomplished on the index side or its something that should be done in our application. Say we

Re: Auto-sharding and numShard parameter

2013-07-22 Thread Mark Miller
There is a reason of course, or else it wouldn't be like that. We addressed it recently. https://issues.apache.org/jira/browse/SOLR-3633 https://issues.apache.org/jira/browse/SOLR-3677 https://issues.apache.org/jira/browse/SOLR-4943 - Mark On Jul 22, 2013, at 10:57 AM, Michael Della Bitta

Re: Auto-sharding and numShard parameter

2013-07-20 Thread Mark Miller
using the Collections API - preconfigured collections will be second class and possibly deprecated at some point. - Mark On Jul 20, 2013, at 10:13 PM, Erick Erickson erickerick...@gmail.com wrote: Flavio: One of the great things about having people continually using Solr (and SolrCloud

Re: Norms

2013-07-14 Thread Mark Miller
On Jul 10, 2013, at 4:39 AM, Daniel Collins danwcoll...@gmail.com wrote: QueryNorm is what I'm still trying to get to the bottom of exactly :) If you have not seen it, some reading from the past here… https://issues.apache.org/jira/browse/LUCENE-1896 - Mark

Re: Moving replica from node to node?

2013-07-11 Thread Mark Miller
Yeah, though CREATE and UNLOAD end up being kind of funny descriptors. You'd think LOAD and UNLOAD or CREATE and DELETE or something... On Wed, Jul 10, 2013 at 11:35 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Thanks Mark. I assume you are referring to using the Core Admin API

Re: Solr Live Nodes not updating immediately

2013-07-09 Thread Mark Miller
Something is wrong if it actually takes 20 minutes. - Mark On Jul 9, 2013, at 7:43 AM, Ranjith Venkatesan ranjit...@zohocorp.com wrote: Hi, I am new to solr. Currently i m using Solr-4.3.0. I had setup a solrcloud setup in 3 machines. If I kill a node running in any of the machine using

Re: Is there an easy way to know if a Solr cloud node is a shard leader?

2013-07-09 Thread Mark Miller
If you call /solr/zookeeper on a specific node, that servlet would tell you - output is a bit verbose for what you want though. - Mark On Jul 9, 2013, at 10:36 AM, Robert Stewart robert_stew...@epam.com wrote: I would like to be able to do it without consulting Zookeeper. Is there some

Re: Every collection.reload makes zookeeper think shards are down

2013-07-08 Thread Mark Miller
It's a known bug, fix coming in 4.4, 4.4 likely coming within a couple weeks. https://issues.apache.org/jira/browse/SOLR-4805 - Mark On Jul 8, 2013, at 10:30 AM, adfel70 adfe...@gmail.com wrote: Hi each time I reload a collection via collections API, zookeeper thinks that all the shards

Re: Solr cloud date based paritioning

2013-07-08 Thread Mark Miller
this pattern with a single collection as the custom sharding features advance. - Mark On Jul 6, 2013, at 7:23 AM, Erick Erickson erickerick...@gmail.com wrote: Not saying it's always one way or the other, just that one shouldn't automatically _assume_ putting the most recent data on a single node

Re: SolrJ and SolrCloud

2013-07-08 Thread Mark Miller
CloudSolrServer(?); right away? Or will point to one instance using HttpSolrServer suffice for now? Yes, it will. - Mark Thanks.

Re: Moving replica from node to node?

2013-07-08 Thread Mark Miller
It's simply a sugar method that no one has gotten to yet. I almost have once or twice, but I always have moved onto other things before even starting. It's fairly simple to just start another replica on the TO node and then delete the replica on the FROM node, so not a lot of urgency. - Mark

Re: Solr cloud date based paritioning

2013-07-03 Thread Mark Miller
using the trick forever with Lucene. - Mark

Re: OOM killer script woes

2013-07-02 Thread Mark Miller
Please file a JIRA issue so that we can address this. - Mark On Jul 2, 2013, at 6:20 AM, Daniel Collins danwcoll...@gmail.com wrote: On looking at the code in SolrDispatchFilter, is this intentional or not? I think I remember Mark Miller mentioning that in an OOM case, the best course

Re: Shard tolerant partial results

2013-07-01 Thread Mark Miller
On Jul 1, 2013, at 6:56 AM, Phil Hoy p...@brightsolid.com wrote: Perhaps an http header could be added or another attribute added to the solr result node. I thought that was already done - I'm surprised that it's not. If that's really the case, please make a JIRA issue. - Mark

Re: Does solr cloud required passwordless ssh?

2013-07-01 Thread Mark Miller
No, SolrCloud does not currently use ssh. - Mark On Jul 1, 2013, at 12:58 PM, adfel70 adfe...@gmail.com wrote: Hi Does solr cloud on a cluster of servers require passwordless ssh to be configured between the servers? -- View this message in context: http://lucene.472066.n3

Re: shardkey

2013-06-28 Thread Mark Miller
Yeah, that is what I would try until 4.4 comes out - and it should not matter replica or leader. - Mark On Jun 28, 2013, at 3:13 PM, Joshi, Shital shital.jo...@gs.com wrote: Thanks Mark. We use commit=true as part of the request to add documents. Something like this: echo $data| curl

Re: Classic 4.2 master-slave replication not completing

2013-06-27 Thread Mark Miller
Odd - looks like it's stuck waiting to be notified that a new searcher is ready. - Mark On Jun 27, 2013, at 8:58 AM, Neal Ensor nen...@gmail.com wrote: Okay, I have done this (updated to 4.3.1 across master and four slaves; one of these is my own PC for experiments, it is not being accessed

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-06-27 Thread Mark Bennett
/requestHandler Thanks Jack On Tue, Mar 12, 2013 at 12:16 PM, Mark Miller markrmil...@gmail.com wrote: There should be a stack trace - also, you shouldn't have to do anything special to use this class. It's the default and only truly supported implementation… - Mark On Mar 12, 2013, at 2

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-06-27 Thread Mark Bennett
removed copies of my jar from other lib directories which I had been experimenting with. -- Mark Bennett / LucidWorks: Search Big Data / mark.benn...@lucidworks.com Office: 408-898-4201 / Telecommute: 408-733-0387 / Cell: 408-829-6513 On Mar 13, 2013, at 11:52 AM, Jack Park jackp...@topicquests.org

Re: Querying across multiple *identical* Collections

2013-06-27 Thread Mark Miller
http://wiki.apache.org/solr/SolrCloud#Distributed_Requests - Mark On Jun 27, 2013, at 2:34 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi, This search across multiple collections question has come up a few times recently: http://search-lucene.com/m/2Q1BE0IT4Y/subj=Search

Re: state of new config format in 4.3.1

2013-06-27 Thread Mark Miller
There were a variety of little bugs - it will just be a bit of a land mine situation if you try and do it with 4.3.1. If it ends up working for you, that's that. - Mark On Jun 27, 2013, at 3:22 PM, shikhar shik...@schmizz.net wrote: Can anyone (Eric?) outline what's changing between 4.3.1

Re: shardkey

2013-06-27 Thread Mark Miller
You might be seeing https://issues.apache.org/jira/browse/SOLR-4923 ? The commit true part of the request that add documents? If so, it might be SOLR-4923 and you should try the commit in a request after adding the docs. - Mark On Jun 27, 2013, at 4:42 PM, Joshi, Shital shital.jo...@gs.com

Re: shard failure, leader transition took 11s (seems high?)

2013-06-24 Thread Mark Miller
call first - by the time jetty (or whatever container) tells Solr it's shutting down, it's too late to pull the node out gracefully. I've danced around it in the past, but have never gotten to making that clean shutdown/stop API. - Mark On Jun 24, 2013, at 8:25 AM, Daniel Collins danwcoll

Re: Waiting until we see more replicas up message??

2013-06-24 Thread Mark Miller
everyone we know about in the shard up to 3 or 5 min by default. Then we know all the shards participate in the leader election and the leader will end up with all updates it should have. You can lower that wait or turn it off with 0. - Mark On Jun 24, 2013, at 2:15 PM, Timothy Potter thelabd

Re: Shard splitting and document routing

2013-06-18 Thread Mark Miller
No, the hash ranges are split and new docs go to both new shards. - Mark On Jun 18, 2013, at 12:25 PM, Otis Gospodnetic otis.gospodne...@gmail.com wrote: Hi, Imagine a (common) situation where you use document routing and you end up with 1 large shards (e.g. 1 large user with lots of docs

Re: Solr Cloud Hangs consistently .

2013-06-17 Thread Mark Miller
expected it to be so easily hit with only 2 replicas per shard. I should be able to tell from a stack trace though. If it is that, it's on my short list to investigate (been there a long time now though - but I still hope to look at it soon). - Mark On Jun 17, 2013, at 1:44 PM, Rishi Easwaran

Re: Solr Cloud Hangs consistently .

2013-06-17 Thread Mark Miller
are being used that likely causes it or makes it easier to cause. But again, the issue I know about involves threads that are not even created in the replicationFactor = 1 case, so that could be a first report afaik. - Mark On Jun 17, 2013, at 5:52 PM, Rishi Easwaran rishi.easwa...@aol.com wrote

Re: Avoiding OOM fatal crash

2013-06-17 Thread Mark Miller
layer and put limits on user requests before making Solr requests. - Mark On Jun 17, 2013, at 4:44 PM, Manuel Le Normand manuel.lenorm...@gmail.com wrote: Hello again, After a heavy query on my index (returning 100K docs in a single query) my JVM heap's floods and I get an JAVA OOM exception

Re: What is Difference Between Down and Gone At Admin Cloud Page?

2013-06-12 Thread Mark Miller
state. Gone means it has given up or disappeared. It's not likely to make another state change without your intervention. - Mark

Re: index merge question

2013-06-11 Thread Mark Miller
every time - of course, depending your cluster size, that could be quite expensive. - Mark On Jun 10, 2013, at 8:36 PM, Jamie Johnson jej2...@gmail.com wrote: Thanks Mark. My question is stemming from the new cloudera search stuff. My concern its that if while rebuilding the index someone

Re: Why there is no getter method for defaultCollection at CloudSolrServer?

2013-06-11 Thread Mark Miller
On Jun 11, 2013, at 4:51 AM, Furkan KAMACI furkankam...@gmail.com wrote: Why there is no getter method for defaultCollection at CloudSolrServer? Want to create a JIRA issue to add it? - Mark

Re: external zookeeper with SolrCloud

2013-06-11 Thread Mark Miller
On Jun 11, 2013, at 10:15 AM, Joshi, Shital shital.jo...@gs.com wrote: Thanks Mark. Looks like this bug is fixed in Solr 4.4. Do you have any date for official release of 4.4? Looks like it might come out in a couple of weeks. Is there any instruction available on how to build Solr 4.4

Re: index merge question

2013-06-11 Thread Mark Miller
. The final step is the golive step, where the indexes will be deployed to the running Solr cluster - this is what uses the core admin merge command, and if you are doing updates or adds outside of map reduce, you will face the issues we have discussed. - Mark On Jun 11, 2013, at 11:57 AM, James

Re: Solr 4.3.0 Cloud Issue indexing pdf documents

2013-06-10 Thread Mark Wilson
to $tomcat_home/bin/setenv.sh Thanks again Regards Mark On 07/06/2013 19:29, Michael Della Bitta michael.della.bi...@appinions.com wrote: Hi Mark, This is a total shot in the dark, but does passing -Djava.awt.headless=true when you run the server help at all? More on awt headless mode

Re: external zookeeper with SolrCloud

2013-06-10 Thread Mark Miller
This might be https://issues.apache.org/jira/browse/SOLR-4899 - Mark On Jun 10, 2013, at 5:59 PM, Joshi, Shital shital.jo...@gs.com wrote: Hi, We're setting up 5 shard SolrCloud with external zoo keeper. When we bring up Solr nodes while the zookeeper instance is not up and running

Re: Why clusterstate.json says active for a killed Solr Node?

2013-06-09 Thread Mark Miller
The true current state is the live nodes info combined with the clusterstate.json. If a node is not live, whatever is in clusterstate.json is simply it's last state, not the current one. - Mark On Sun, Jun 9, 2013 at 4:40 PM, Furkan KAMACI furkankam...@gmail.comwrote: I want to get cluster

Re: Why clusterstate.json says active for a killed Solr Node?

2013-06-09 Thread Mark Miller
You currently kind of have to look at both if you want to know the true state. An active state means that shard is up to date and online serving - as long as it's live node is also up. - Mark On Jun 9, 2013, at 6:18 PM, Furkan KAMACI furkankam...@gmail.com wrote: Is it enough just look

Re: Get Statistics With CloudSolrServer?

2013-06-09 Thread Mark Miller
handler that exposes them as one option: the /admin/mbeans admin request handler - you can use solrj to hit that handler. - Mark

Re: index merge question

2013-06-08 Thread Mark Miller
, it will update the doc that was just merged in. If the merge comes second, you have the doc twice and it's a problem. - Mark

Re: Lucene/Solr Filesystem tunings

2013-06-08 Thread Mark Miller
workspace for lucene/solr dev. (Still use ext4 for root and home). Have not checked that recently, and it may not be a large concern for many use cases. - Mark On Jun 4, 2013, at 6:48 PM, Tim Vaillancourt t...@elementspace.com wrote: Hey all, Does anyone have any advice or special

Re: HdfsDirectoryFactory

2013-06-07 Thread Mark Miller
Eagle eye man. Yeah, we plan on contributing hdfs support for Solr. I'm flying home today and will create a JIRA issue for it shortly after I get there. - Mark On Jun 6, 2013, at 6:16 PM, Jamie Johnson jej2...@gmail.com wrote: I've seen reference to an HdfsDirectoryFactory in the new

Solr 4.3.0 Cloud Issue indexing pdf documents

2013-06-07 Thread Mark Wilson
=trueliteral.id=pdf1} {commit=} 0 106 Does anyone have any idea how to resolve this? Thanks in advance Mark -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number

Re: problem with zkcli.sh linkconfig

2013-06-05 Thread Mark Miller
Sounds like a bug - we probably don't have a test that updates a link - if you can make a JIRA issue, I'll be happy to look into it soon. - Mark On Jun 4, 2013, at 8:16 AM, Shawn Heisey s...@elyograg.org wrote: I've got Solr 4.2.1 running SolrCloud. I need to change the config set

Re: SolrCloud Load Balancer weight

2013-06-03 Thread Mark Miller
On Jun 3, 2013, at 3:33 PM, Tim Vaillancourt t...@elementspace.com wrote: Should I JIRA this? Thoughts? Yeah - it's always been in the back of my mind - it's come up a few times - eventually we would like nodes to report some stats to zk to influence load balancing. - mark

Re: How to Get Cluster State By Solrj?

2013-06-03 Thread Mark Miller
It actually accepts a comma separated list of zk host addresses (your quorum). Same format as zk describes in it's docs. To get the cluster state, get the ZkStateReader from the CloudSolrServer and then it's getClusterState or something. - Mark On Jun 3, 2013, at 5:30 PM, Furkan KAMACI

Re: Leader election deadlock after restarting leader in 4.2.1

2013-06-03 Thread Mark Miller
Thanks - I can try and look into this perhaps next week. You might copy the details into a JIRA issue to prevent it from getting lost though... - Mark On Jun 3, 2013, at 4:46 PM, John Guerrero jguerr...@tagged.com wrote: SOLR 4.2.1, tomcat 6.0.35, CentOS 6.2 (2.6.32-220.4.1.el6.x86_64 #1 SMP

Re: Collections API Reload killing my cloud

2013-05-30 Thread Mark Miller
https://issues.apache.org/jira/browse/SOLR-4805 - Mark On May 30, 2013, at 3:09 PM, davers dboych...@improvementdirect.com wrote: Everytime I try to do a reload using the collections API my entire cloud goes down and I cannot search it. The solrconfig.xml and schema.xml are good because when

Re: Core admin action CREATE fails for existing core

2013-05-23 Thread Mark Miller
, and that has been the case for all of 4.x release if I remember right. I supported making this change to force people who might still be doing what is likely quite a buggy operation to switch to the correct code. Sorry about the inconvenience. - Mark On May 23, 2013, at 10:45 AM, André Widhani

Re: Core admin action CREATE fails for existing core

2013-05-23 Thread Mark Miller
Your right - that does seem to be a new limitation. Could you create a JIRA issue for it? It would be fairly simple to add another reload method that also took the name of a new solrconfig/schema file. - Mark On May 23, 2013, at 4:11 PM, André Widhani andre.widh...@digicol.de wrote: Mark

Re: Zookeeper Ensemble Startup Parameters For SolrCloud?

2013-05-17 Thread Mark Miller
The way Solr uses ZK, unless you are also using ZK with something else, I wouldn't worry about it at all. In a steady state, the cluster won't even really talk to ZK in any intensive manner at all. - Mark On May 16, 2013, at 5:07 PM, Furkan KAMACI furkankam...@gmail.com wrote: Hi Shawn; I

Re: Using the Collections API

2013-05-17 Thread Mark Miller
What version of Solr? I think there was a bug a couple versions back (perhaps introduced in 4.1 if I remember right) that made it so creates were not spread correctly. - Mark

Re: Migrating from 4.2.1 to 4.3.0

2013-05-16 Thread Mark Miller
Your solr webapp context appears to be rather than solr. There was a JIRA issue in 4.3 that may have affected this, but I only saw it from a distance, so just a guess. What does it say in solr.xml for the context (an attribute on cores) - Mark On May 16, 2013, at 2:02 PM, M. Flatterie

Re: Controlling which node(s) hold(s) a collection

2013-05-16 Thread Mark Miller
You can control simply with the CoreAdmin api - the core is created at the location of whatever url you use…simply fire the creates at whatever nodes you want the collection to live on. The collections api also takes a list of nodes names to use optionally. - Mark On May 16, 2013, at 7:34 PM

Re: Using the Collections API

2013-05-15 Thread Mark Miller
Yeah, I use both on an empty Solr - what is the error? - Mark On May 15, 2013, at 6:53 AM, A.Eibner a_eib...@yahoo.de wrote: Hi, I just wanted to ask, if anyone is using the collections API to create collections, or if not how they use the coreAPI to create a collection with replication

Re: SEVERE:IOException occured when talking to server

2013-05-15 Thread Mark Miller
: The target server failed to respond - Mark On May 15, 2013, at 10:24 AM, Gesty, Jim jge...@cscinfo.com wrote: We have a simple SolrCloud setup (4.1) running with a single shard and multiple replicas across 3 servers, and it's working fine except once in a while, the leader logs this error

Re: SOLR Cloud Collection Management quesiotn.

2013-05-15 Thread Mark Miller
more nodes via that api, and either don't pass the shard and it will be assigned to the shard with the fewest current replicas, or you can explicitly tell it what shard to join. - Mark On May 15, 2013, at 9:57 AM, Rishi Easwaran rishi.easwa...@aol.com wrote: Hi Anshum, What if you have more

Re: Using the Collections API

2013-05-15 Thread Mark Miller
On May 15, 2013, at 12:26 PM, Jared Rodriguez jrodrig...@kitedesk.com wrote: the cores in the collection stay offline even if there are no material changes. I've used reload - if you are having trouble with it, please post more details or file a JIRA issue. - Mark

Re: Compatible collections SOLR4 / SOLRCloud?

2013-05-15 Thread Mark Miller
They need to be similar enough to satisfy the particular queries. - Mark On May 15, 2013, at 12:23 PM, Marcin mar...@workdigital.co.uk wrote: Hi there, I am trying to figure out what SOLR means by compatible collection in order to be able to run the following query: |Query all shards

Re: question about the file data/index.properties

2013-05-15 Thread Mark Miller
It's fairly meaningless from a user perspective, but it happens when an index is replicated that cannot be simply merged with the existing index files and needs a new directory. - Mark On May 15, 2013, at 5:38 PM, Bill Au bill.w...@gmail.com wrote: I am running 2 separate 4.3 SolrCloud

Re: Solr Admin Page Says Leader is Down, Replica is Up, Zookeeper Says Thar They are Both Active

2013-05-14 Thread Mark Miller
The actual state is a mix of the clusterstate.json and the ephemeral live nodes - a node may be listed as active or whatever, and if it's live node is not up, it doesn't matter - it's considered down. - Mark On May 14, 2013, at 8:08 AM, Furkan KAMACI furkankam...@gmail.com wrote: Node

Re: Solr 4.2 rollback not working

2013-05-09 Thread Mark Miller
At the least it should throw an exception if you try rollback with SolrCloud - though now there is discussion about removing it entirely. But yes, it's not supported and there are no real plans to support it. - Mark On May 9, 2013, at 7:21 AM, mark12345 marks1900-pos...@yahoo.com.au wrote

Re: Solr Cloud with large synonyms.txt

2013-05-07 Thread Mark Miller
with it? Perhaps hit up the ZK list? They doc it as simply raising jute.maxbuffer, though you have to do it for each ZK instance. - Mark

Re: Solr Cloud with large synonyms.txt

2013-05-07 Thread Mark Miller
On May 7, 2013, at 10:24 AM, Mark Miller markrmil...@gmail.com wrote: On May 6, 2013, at 12:32 PM, Son Nguyen s...@trancorp.com wrote: I did some researches on internet and found out that because Zookeeper znode size limit is 1MB. I tried to increase the system property jute.maxbuffer

Re: Solr Cloud with large synonyms.txt

2013-05-07 Thread Mark Miller
degree that registers. I'm going to have to see problems loading these larger config files from ZooKeeper before I'm worried that it's a problem. - Mark On May 7, 2013, at 12:21 PM, Son Nguyen s...@trancorp.com wrote: Mark, I tried to set that property on both ZK (I have only one ZK instance

Re: disaster recovery scenarios for solr cloud and zookeeper

2013-05-06 Thread Mark Miller
ZooKeeper comes back. - Mark On May 6, 2013, at 2:59 AM, Furkan KAMACI furkankam...@gmail.com wrote: Hi Mark; You said: So it's pretty simple - when you lost the ability to talk to ZK, everything keeps working based on the most recent clusterstate - except that updates are blocked and you cannot

Re: Solr 4.3 and SLF4j

2013-05-06 Thread Mark Miller
switch impls. - Mark On May 6, 2013, at 1:55 PM, Jonatan Fournier jonatan.fourn...@gmail.com wrote: Hi, I've read from http://wiki.apache.org/solr/SolrLogging that Solr no longer ships with Logging jars bundled into the WAR file. For simplicity in package management, other than Solr, I'm

Re: disaster recovery scenarios for solr cloud and zookeeper

2013-05-05 Thread Mark Miller
clusterstate - except that updates are blocked and you cannot add new nodes to the cluster. You are essentially in steady state. The ZK clients will continue trying to reconnect so that when ZK comes back updates while start being accepted again and new nodes may join the cluster. - Mark On May 3, 2013

Re: zookeeper errors

2013-05-05 Thread Mark Miller
collector) is best. - Mark On May 5, 2013, at 1:50 PM, Michael Della Bitta michael.della.bi...@appinions.com wrote: Hi, I'm running a Solr 4.2.1 cloud with an external three-node Zookeeper 2.4.5 setup. I'm seeing a lot of these errors in the zookeeper logs: 2013-05-05 15:06:22,863 - WARN

Re: Solr 4.2 rollback not working

2013-05-04 Thread Mark Miller
Rollback is unsupported in SolrCloud - this is a bug really - you should get an error back. - Mark On May 1, 2013, at 11:12 PM, Dipti Srivastava dipti.srivast...@apollogrp.edu wrote: Hi All, WE have setup a 4.2 Solr cloud with 4 nodes and while the add/update/delete operations are working

Re: Pulling Config Folder from Zookeeper at SolrCloud

2013-05-04 Thread Mark Miller
The ZkCli cmd line tool allows you to pull config down too - so just pull the latest down, update it, and push it back up. Alternatively, there may be ZK UI tools that let you do this if you look. - Mark On May 2, 2013, at 1:45 AM, Furkan KAMACI furkankam...@gmail.com wrote: I use the same

<    1   2   3   4   5   6   7   8   9   10   >