Re: Solr-Ajax client

2014-03-12 Thread Shawn Heisey
On 3/11/2014 11:48 PM, Davis Marques wrote: Just a quick announcement and request for guidance: I've developed an open source, Javascript client for Apache Solr. Its very easy to implement and can be configured to provide faceted search to an existing Solr index in just a few minutes. The

Re: Partial Counts in SOLR

2014-03-12 Thread Dmitry Kan
As Hoss pointed out above, different projects have different requirements. Some want to sort by date of ingestion reverse, which means that having posting lists organized in a reverse order with the early termination is the way to go (no such feature in Solr directly). Some other projects want to

Re: PHP Solr Client - spellchecker

2014-03-12 Thread rachun
Thank you very much Shawn, Now i'm trying to use prefix for my suggestion instead. Best regards, Chun -- View this message in context: http://lucene.472066.n3.nabble.com/PHP-Solr-Client-spellchecker-tp4122780p4123054.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: NOT SOLVED searches for single char tokens instead of from 3 uppwards

2014-03-12 Thread Andreas Owen
I now have the following: analyzer type=query tokenizer class=solr.WhiteSpaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory types=at-under-alpha.txt/ filter class=solr.LowerCaseFilterFactory/

Solr read-only mode with same datadir: commits are not working.

2014-03-12 Thread Luis Cappa Banda
Hey guys, I've doing some tests sharing the same index between three Solr servers: *SolrA*: is allowed to both read and index. The index is stored in a NFS. It has its own configuration files. *SolrB and SolrC*: they can only read from the shared index and each one has their own configuration

Re: Solr read-only mode with same datadir: commits are not working.

2014-03-12 Thread Luis Cappa Banda
I've seen that StandardDirectoryReader appears in the commit logs. Maybe this DirectoryReader type is caching somehow the old segments in SolrB and SolrC even if they have been commited previosly. If that's true, does exist any other DirectoyReader type (I don't know, SimpleDirectoryReader or

Re: NOT SOLVED searches for single char tokens instead of from 3 uppwards

2014-03-12 Thread Jack Krupansky
You didn't show the new index analyzer - it's tricky to assure that index and query are compatible, but the Admin UI Analysis page can help. Generally, using pure defaults for WDF is not what you want, especially for query time. Usually there needs to be a slight asymmetry between index and

Re: Solr use with Cloudera HDFS failed creating directory

2014-03-12 Thread soodyogesh
does anyone able to sort this one out ? im hitting same error is there a way to fix this by copying right version of jars. I tried copying older version of jar in solr lib but get same error. Solr: 4.6.1 Hadoop: 2.0.0..CDH -- View this message in context:

Re[2]: NOT SOLVED searches for single char tokens instead of from 3 uppwards

2014-03-12 Thread Andreas Owen
yes that is exactly what happend in the analyzer. the term i searched for was listed on both sides (index query). here's the rest: analyzer type=index         tokenizer class=solr.WhitespaceTokenizerFactory/         !-- in this example, we will only use synonyms at query time         filter

Attention: Lucene 4.8 and Solr 4.8 will require minimum Java 7

2014-03-12 Thread Uwe Schindler
Hi, the Apache Lucene/Solr committers decided with a large majority on the vote to require Java 7 for the next minor release of Apache Lucene and Apache Solr (version 4.8)! Support for Java 6 by Oracle already ended more than a year ago and Java 8 is coming out in a few days. The next

Re: Solr read-only mode with same datadir: commits are not working.

2014-03-12 Thread Luis Cappa Banda
Hi again! I'm diving inside DirectUpdateHandler2 code and it seems that the problem is that when a commit, when core.openNewSercher(true,true) is called it returns a RefCountedSolrIndexSearcher with a new searcher reference that points to an old (probably cached somehow) data dir. I've tried with

IDF maxDocs / numDocs

2014-03-12 Thread Steven Bower
I am noticing the maxDocs between replicas is consistently different and that in the idf calculation it is used which causes idf scores for the same query/doc between replicas to be different. obviously an optimize can normalize the maxDocs scores, but that is only temporary.. is there a way to

RE: IDF maxDocs / numDocs

2014-03-12 Thread Markus Jelsma
Hi Steve - it seems most similarities use CollectionStatistics.maxDoc() in idfExplain but there's also a docCount(). We use docCount in all our custom similarities, also because it allows you to have multiple languages in one index where one is much larger than the other. The small language

More Maintenance Releases?

2014-03-12 Thread Doug Turnbull
Hello Solr community, We have been using Solr to great effect at OpenSource Connections. Occasionally though, we'll hit a bug in say 4.5.1, that gets fixed in 4.6.0. Unfortunately, as 4.6.0 is a release sporting several new features, there's invariably new bugs that get introduced. So while my

Re: More Maintenance Releases?

2014-03-12 Thread Mark Miller
+1 to the idea, I love bug fix releases (which is why I volunteered to do the last couple). The main limiting factor is a volunteer to do it. Users requesting a specific bug fix relese is probably a good way to prompt volunteers though. --  Mark Miller about.me/markrmiller On March 12, 2014

RE: Re[2]: NOT SOLVED searches for single char tokens instead of from 3 uppwards

2014-03-12 Thread Andreas Owen
Hi Jack, do you know how i can use local parameters in my solrconfig? The params are visible in the debugquery-output but solr doesn't parse them. lst name=invariants str name=fq{!q.op=OR} (*:* -organisations:[ TO *] -roles:[ TO *]) (+organisations:($org) +roles:($r)) (-organisations:[

Change replication factor

2014-03-12 Thread Mike Hugo
After a collection has been created in SolrCloud, is there a way to modify the Replication Factor? Say I start with a few nodes in the cluster, and have a replication factor of 2. Over time, the index grows and we add more nodes to the cluster, can I increase the replication factor to 3?

Re: Change replication factor

2014-03-12 Thread Mark Miller
You can simply create a new SolrCore with the same collection and shard id as the colleciton and shard you want to add a replica too. There is also an addReplica command comming to the collections API. Or perhaps it’s in 4.7, I don’t know, this JIRA issue is a little confusing as it’s still

Re: Change replication factor

2014-03-12 Thread Mike Hugo
Thanks Mark! Mike On Wed, Mar 12, 2014 at 12:43 PM, Mark Miller markrmil...@gmail.com wrote: You can simply create a new SolrCore with the same collection and shard id as the colleciton and shard you want to add a replica too. There is also an addReplica command comming to the collections

Re: More Maintenance Releases?

2014-03-12 Thread Furkan KAMACI
Hi; I'm not a committer yet but I want to share my thoughts from a perspective of a user. I've been using SolrCloud since 4.1.0 version of it. I've read nearly all e-mails and I follow mail list too. Solr project has a great development cycle and has a frequent release cycle. In fact, if you

Re: More Maintenance Releases?

2014-03-12 Thread Furkan KAMACI
Hi; I've attached the chart that I've prepared as I mentioned at e-mail. Thanks; Furkan KAMACI 2014-03-12 21:17 GMT+02:00 Furkan KAMACI furkankam...@gmail.com: Hi; I'm not a committer yet but I want to share my thoughts from a perspective of a user. I've been using SolrCloud since 4.1.0

Re: More Maintenance Releases?

2014-03-12 Thread Greg Walters
Furkan, This list tends to eat attachments. Could you post it somewhere like imgur? Thanks, Greg On Mar 12, 2014, at 2:19 PM, Furkan KAMACI furkankam...@gmail.com wrote: Hi; I've attached the chart that I've prepared as I mentioned at e-mail. Thanks; Furkan KAMACI 2014-03-12 21:17

Re: IDF maxDocs / numDocs

2014-03-12 Thread Steven Bower
My problem is that both maxDoc() and docCount() both report documents that have been deleted in their values. Because of merging/etc.. those numbers can be different per replica (or at least that is what I'm seeing). I need a value that is consistent across replicas... I see in the comment it

Delta import throws java heap space exception

2014-03-12 Thread Richard Marquina Lopez
Hi, I have some problems when execute the delta import with 2 million of rows from mysql database: java.lang.OutOfMemoryError: Java heap space at java.nio.HeapCharBuffer.init(HeapCharBuffer.java:57) at java.nio.CharBuffer.allocate(CharBuffer.java:331) at

single node causing cluster-wide outage

2014-03-12 Thread Avishai Ish-Shalom
Hi all! After upgrading to Solr 4.6.1 we encountered a situation where a cluster outage was traced to a single node misbehaving, after restarting the node the cluster immediately returned to normal operation. The bad node had ~420 threads locked on FastLRUCache and most httpshardexecutor threads

Re: Delta import throws java heap space exception

2014-03-12 Thread Ahmet Arslan
Hi Richard, How much ram do you assign to java heap? Try increasing it to 1 gb for example. Please see : https://wiki.apache.org/solr/ShawnHeisey Ahmet  On Wednesday, March 12, 2014 10:53 PM, Richard Marquina Lopez richard.marqu...@gmail.com wrote: Hi, I have some problems when execute the

Re: Solr-Ajax client

2014-03-12 Thread Davis Marques
Shawn; My user name is davismarques on the wiki. Yes, I am aware that its a bad idea to expose Solr directly to the Internet. As you've discovered, we filter all requests to the server so that only select requests make it through. I do not yet have documentation for the Javascript application,

Re: Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-12 Thread Chris W
We decided to go with the latest (it seems to have a lot more bug /performance fixes). The issue i mentioned was a red herring. I was able to successfully upgrade On Tue, Mar 11, 2014 at 2:09 PM, Chris W chris1980@gmail.com wrote: Moving 4 versions ahead may need much additional tests

Re: More Maintenance Releases?

2014-03-12 Thread Furkan KAMACI
Hi; Here is the link: http://i740.photobucket.com/albums/xx43/kamaci/Solr_Releases_Furkan_KAMACI_zps8c0c196c.jpg Thanks; Furkan KAMACI 2014-03-12 21:21 GMT+02:00 Greg Walters greg.walt...@answers.com: Furkan, This list tends to eat attachments. Could you post it somewhere like imgur?

Zookeeper latencies and pending requests - Solr 4.3

2014-03-12 Thread Chris W
Hi I have a 3 node zk ensemble . I see a very high latency for zk responses and also a lot of outstanding requests (in the order of 30-40) I also see that the requests are not going to all zookeeper nodes equally. One node has more requests/connections than the others. I see that CPU/Mem and

Re: Delta import throws java heap space exception

2014-03-12 Thread Richard Marquina Lopez
Hi Ahmet, Thank you for your response, currently I have the next configuration for JVM: -XX:+PrintGCDetails-XX:-UseParallelGC-XX:SurvivorRatio=8-XX:NewRatio=2 -XX:+HeapDumpOnOutOfMemoryError-XX:PermSize=128m-XX:MaxPermSize=256m -Xms1024m-Xmx2048m I have 3.67 GB of physical RAM and 2GB is asigned

Re: Zookeeper latencies and pending requests - Solr 4.3

2014-03-12 Thread Furkan KAMACI
Hi; FAQ page says that: *Q: I'm seeing lot's of session timeout exceptions - what to do?* *A: Try raising the ZooKeeper session timeout by editing solr.xml - see the zkClientTimeout attribute. The minimum session timeout is 2 times your ZooKeeper defined tickTime. The maximum is 20 times the

Re: Delta import throws java heap space exception

2014-03-12 Thread Furkan KAMACI
Hi; Could you send your data-config.xml? Thanks; Furkan KAMACI 2014-03-13 1:01 GMT+02:00 Richard Marquina Lopez richard.marqu...@gmail.com : Hi Ahmet, Thank you for your response, currently I have the next configuration for JVM:

Re: Zookeeper latencies and pending requests - Solr 4.3

2014-03-12 Thread Chris W
Hi Furkan Load on the network is very low when read workload is on the cluster. During indexing, a few of my commits get hung forever and the solr nodes are attempting to get connection from zookeeper. The peer communication between zk is very good and i havent seen any issues. The network

Re: Solr-Ajax client

2014-03-12 Thread Stefan Matheis
Hey Davis I've added you to the Contributors Group :) -Stefan On Wednesday, March 12, 2014 at 11:49 PM, Davis Marques wrote: Shawn; My user name is davismarques on the wiki. Yes, I am aware that its a bad idea to expose Solr directly to the Internet. As you've discovered, we filter

Re: More Maintenance Releases?

2014-03-12 Thread Erick Erickson
Wondering if 4.7 is a natural point to do this. See Uwe's announcement that as of Solr 4.8, Solr/Lucene will _require_ Java 1.7 rather than Java 1.6. I know some organizations will not be able to make this transition easily, thus I suspect we'll see ongoing requests to please back-port XXX to

Re: Migration issues - Solr 4.3.0 to Solr 4.4.0

2014-03-12 Thread Erick Erickson
Glad to hear it! Thanks for bringing closure... Erick On Wed, Mar 12, 2014 at 6:53 PM, Chris W chris1980@gmail.com wrote: We decided to go with the latest (it seems to have a lot more bug /performance fixes). The issue i mentioned was a red herring. I was able to successfully upgrade

Re-index Parent-Child Schema

2014-03-12 Thread Vijay Kokatnur
Hi, I've inherited an Solr application with a Schema that contains parent-child relationship. All child elements are maintained in multi-value fields. So an Order with 3 Order lines will result in an array of size 3 in Solr, This worked fine as long as clients queried only on Order, but with

Re: Support for Numeric DocValues Updates in Solr?

2014-03-12 Thread Gopal Patwa
I tried looking at Solr code but it seems it require more deeper understanding of Solr code to add this support, may be other solr expert can provide some pointers. Did any one else tried Updating Numeric DocValues in Solr but not committed the patch yet? It would be really nice if this feature

Re: Solr-Ajax client

2014-03-12 Thread Davis Marques
Sweet. Thanks Stefan. Davis On Thu, Mar 13, 2014 at 10:37 AM, Stefan Matheis matheis.ste...@gmail.comwrote: Hey Davis I've added you to the Contributors Group :) -Stefan On Wednesday, March 12, 2014 at 11:49 PM, Davis Marques wrote: Shawn; My user name is davismarques on the