What does replicationFactor really do?

2015-07-16 Thread Jim . Musil
Hi, In 5.1, we are creating a collection using the Collections API with an initial replicationFactor of X. This value is then stored in the state.json file for that collection. If I try to issue ADDREPLICA on this cluster, it throws an error saying that there are no live nodes for additional

CREATE collection bug or feature?

2015-06-19 Thread Jim . Musil
I noticed that when I issue the CREATE collection command to the api, it does not automatically put a replica on every live node connected to zookeeper. So, for example, if I have 3 solr nodes connected to a zookeeper ensemble and create a collection like this:

Re: CREATE collection bug or feature?

2015-06-19 Thread Jim . Musil
Thanks as always for the great answers! Jim On 6/19/15, 11:57 AM, Erick Erickson erickerick...@gmail.com wrote: Jim: This is by design. There's no way to tell Solr to find all the cores available and put one replica on each. In fact, you're explicitly telling it to create one and only one

Collections API and adding new boxes

2015-06-18 Thread Jim . Musil
. What's the expected next step? This is Solr 5.1. Thanks! Jim Musil

Re: Clarification on Collections API for 5.x

2015-05-27 Thread Jim . Musil
are also connected to a zookeeper ensemble. Part of the core definition is to set the configSet to use. This configSet is uploaded to zookeeper separately. This effectively creates a Collection. Is this method no long supported in 5.x? Thanks! Jim Musil

Re: Clarification on Collections API for 5.x

2015-05-27 Thread Jim . Musil
. These nodes are also connected to a zookeeper ensemble. Part of the core definition is to set the configSet to use. This configSet is uploaded to zookeeper separately. This effectively creates a Collection. Is this method no long supported in 5.x? Thanks! Jim Musil

Clarification on Collections API for 5.x

2015-05-21 Thread Jim . Musil
definition is to set the configSet to use. This configSet is uploaded to zookeeper separately. This effectively creates a Collection. Is this method no long supported in 5.x? Thanks! Jim Musil

ConfigSets and SolrCloud

2015-05-20 Thread Jim . Musil
, will it automatically upload these named config sets to zookeeper? Thanks! Jim Musil

Confusion about zkcli.sh and solr.war

2015-05-13 Thread Jim . Musil
I'm trying to use zkcli.sh to upload configurations to zookeeper and solr 5.1. It's throwing an error because it references webapps/solr.war which no longer exists. Do I have to build my own solr.war in order to use zkcli.sh? Please forgive me if I'm missing something here. Jim Musil

Possible to dump clusterstate, system stats into solr log?

2015-02-11 Thread Jim . Musil
Hi, Is it possible to periodically dump the cluster state contents (or system diagnostics) into the main solr log file? We have many security protocols in place that prevents us from running diagnostic requests directly to the solr boxes, but we do have access to the shipped logs. Thanks!

Re: Where can we set the parameters in Solr Config?

2015-02-03 Thread Jim . Musil
We set them as extra parameters sent to to the servlet (jetty or tomcat). eg java -Dsolr.lock.type=native -jar start.jar Jim On 2/3/15, 11:58 AM, O. Olson olson_...@yahoo.it wrote: I'm sorry if this is a basic question, but I am curious where, or at least, how can we set the parameters in the

Re: SOLR retrieve data using URL

2015-02-02 Thread Jim . Musil
You don't have to use SolrJ. It's just a web request to a url, so just issue the request in Java and parse the JSON response. http://stackoverflow.com/questions/7467568/parsing-json-from-url SolrJ does make it simpler, however. Jim On 2/2/15, 12:57 PM, mathewvino vinojmat...@hotmail.com wrote:

Re: Solr throwing SocketException: Connection Reset

2015-02-02 Thread Jim . Musil
throwing the error? Are all the updates coming from one machine? Is there some other bottleneck in your network (like a load balancer) that is limiting connections? Good luck, Jim Musil On 2/2/15, 5:29 AM, nkgupta nitinkumargu...@gmail.com wrote: I have 8 node solr cloud cluster connected

Re: Solr pattern tokenizer

2015-02-02 Thread Jim . Musil
It looks to me like you simply want to split the incoming query by the hyphen, so that it searches for exact codes like this ³CHQ PAID² ³INWARD TRAN² ³HDFC LTD². If that¹s true, I¹d either just change the query at the client to do what you want, or look into something like the PatternTokenizer:

Re: An interesting approach to grouping

2015-01-27 Thread Jim . Musil
. Jim Musil On 1/27/15, 10:14 AM, Jim.Musil jim.mu...@target.com javascript:; wrote: When using group.main=true, the results are not mixed as you expect: If true, the result of the last field grouping command is used as the main result list in the response, using group.format=simple

Re: An interesting approach to grouping

2015-01-27 Thread Jim . Musil
=rint(scale(query({!type=edismax v=$q}),0,20)) // puts into buckets group.limit=20 // gives you 20 from each bucket group.sort=category asc // this will sort by category within each bucket, but this can be a function as well. Jim Musil On 1/27/15, 10:14 AM, Jim.Musil jim.mu

Re: An interesting approach to grouping

2015-01-27 Thread Jim . Musil
into buckets group.limit=20 // gives you 20 from each bucket group.sort=category asc // this will sort by category within each bucket, but this can be a function as well. Jim Musil On 1/27/15, 10:14 AM, Jim.Musil jim.mu...@target.com javascript:; wrote: When using group.main=true

Re: An interesting approach to grouping

2015-01-27 Thread Jim . Musil
for a Jira issue and open if I can¹t find one. Jim Musil On 1/26/15, 6:34 PM, Ryan Josal r...@josal.com wrote: I have an index of products, and these products have a category which we can say for now is a good approximation of its location in the store. I'm investigating altering the ordering

Re: An interesting approach to grouping

2015-01-27 Thread Jim . Musil
and open if I can¹t find one. Jim Musil On 1/26/15, 6:34 PM, Ryan Josal r...@josal.com javascript:; wrote: I have an index of products, and these products have a category which we can say for now is a good approximation of its location in the store. I'm investigating altering the ordering

Re: An interesting approach to grouping

2015-01-27 Thread Jim . Musil
be a function as well. Jim Musil On 1/27/15, 10:14 AM, Jim.Musil jim.mu...@target.com wrote: When using group.main=true, the results are not mixed as you expect: If true, the result of the last field grouping command is used as the main result list in the response, using group.format=simple” https

Re: Indexed epoch time in Solr

2015-01-26 Thread Jim . Musil
If you are using the DataImportHandler, you can leverage on of the transformers, such as the DateFormatTransformer: http://wiki.apache.org/solr/DataImportHandler#DateFormatTransformer If you are updating documents directly you can define a regex transformation in your schema.xml:

Does CloudSolrServer hit zookeeper for every request?

2014-06-02 Thread Jim . Musil
I’m curious how CloudSolrServer works in practice. I understand that it gets the active solr nodes from zookeeper, but does it do this for every request? If it does hit zk for every request, that seems to put a lot of pressure on the zk ensemble. If it does NOT hit zk for every request, then

Status of configName in core.properties

2014-05-30 Thread Jim . Musil
Hi, I’m attempting to define a core using the new core discovery method described here: http://wiki.apache.org/solr/Core%20Discovery%20(4.4%20and%20beyond) At the bottom of the page is a parameter named configName that should allow me to specify a configuration name to use for a collection.