Re: unable to facet range query

2013-12-12 Thread Ahmet Arslan
Hi, If you don't use QEC, just remove it from configuration file. If you need it change queryFieldType from integer to text_sw or something like that. http://wiki.apache.org/solr/QueryElevationComponent#queryFieldType The word 'promotions' is not a numeric value, thats why you are getting the

Re: Solr hardware memory question

2013-12-12 Thread Toke Eskildsen
On Thu, 2013-12-12 at 02:46 +0100, Joel Bernstein wrote: Curious how many documents per shard you were planning? 350-500 million, optimized to a single segment as the data are not changing. The number of documents per shard and field type will drive the amount of a RAM needed to sort and

Re: Constantly increasing time of full data import

2013-12-12 Thread michallos
One more stack trace which is active during indexing. This call task is also executed on the same single threaded executor as registering new searcher: searcherExecutor-48-thread-1 prio=10 tid=0x7f24c0715000 nid=0x3de6 runnable [0x7f24b096d000] java.lang.Thread.State: RUNNABLE

Re: Change Velocity Template Directory in Solr 4.6

2013-12-12 Thread Ahmet Arslan
Hi Olson, You are correct v.base_dir parameter is not used at all after SOLR-4882. {corename}/conf/velocity is the only option. solr.allow.unsafe.resourceloading system property does not affect this behavior. Wiki needs update. (confluence does not mention v.base_dir parameter) Do you want to

subscribe for this maillist

2013-12-12 Thread Gabriel Zhang
I want to subscribe for this solr mailing list. Thanks and Best Regards, Gabriel Zhang

Re: subscribe for this maillist

2013-12-12 Thread Rafał Kuć
Hello! To subscribe please send a mail to solr-user-subscr...@lucene.apache.org -- Regards, Rafał Kuć Performance Monitoring * Log Analytics * Search Analytics Solr Elasticsearch Support * http://sematext.com/ I want to subscribe for this solr mailing list. Thanks and Best Regards,

Re: Getting Solr Document Attributes from a Custom Function

2013-12-12 Thread Mukundaraman valakumaresan
Hi Thanks a lot , that helps Regards Mukund On Thu, Dec 12, 2013 at 1:18 AM, Kydryavtsev Andrey werde...@yandex.ruwrote: As I know (not 100% sure actually), function queries don't work with multivalued fields. Why do you need multivalued fields here? Your price and numberOfCities don't

Re: unable to facet range query

2013-12-12 Thread Nutan
I remove the QEC but for facet it still gives this error: Unable to range facet on field:id{type=integer,properties=indexed,stored,omitNorms,required, required=true} -- View this message in context: http://lucene.472066.n3.nabble.com/unable-to-facet-range-query-tp4106305p4106335.html Sent

Re: Cloud graph gone after manually editing clusterstate.json

2013-12-12 Thread Stefan Matheis
Michael that only shows that the http request is a success .. the white page might be caused through a) invalid json structure -- which should be easy to check b) missing information inside the clusterstate -- therefore it would be good to know the difference between the original file and your

RE: Solr hardware memory question

2013-12-12 Thread Hoggarth, Gil
Thanks for this - I haven't any previous experience with utilising SSDs in the way you suggest, so I guess I need to start learning! And thanks for the Danish-webscale URL, looks like very informed reading. (Yes, I think we're working in similar industries with similar constraints and

Re: Equivalent of SQL JOIN in SOLR across multiple cores

2013-12-12 Thread bijalcm
I had gone through link - http://wiki.apache.org/solr/Join and it says there is a Limitation in JOIN, you will be able to get resulting documents containing fields in either of two I have used below query http://localhost:8983/solr/coreTO/select?q={!join from=docId to=id fromIndex=coreFROM}query

Re: Cloud graph gone after manually editing clusterstate.json

2013-12-12 Thread michael.boom
Hi guys, thanks for the replies! The json was valid, i validated it and the only diff between the fiels was my edit. But actually, it got fixed by itself - when i got to work today, everything was working as it should. Maybe it was something on my machine or browser, can't put a finger on the

Re: SolrCloud and MoreLikeThis: SOLR-788

2013-12-12 Thread Furkan KAMACI
Hi; SOLR-4414 has no patch. It's related issue has patches bu it seems fixed since Solr 4.1 Thanks; Furkan KAMACI 2013/12/12 gf80 giuseppe_fe...@hotmail.com Hi guys, could you kindly help me to apply patch for MoreLikeThis on solrcloud. I'm using Solr 4.6 and I'm using solrcloud with 10

RE: SolrCloud and MoreLikeThis: SOLR-788

2013-12-12 Thread gf80
Hi, thanks for the answer, I think that you mean the issue SOLR-788, isn't it? if yes, I think that it's solved as you say, but I see Fix Version/s: 4.1,

RE: Solr hardware memory question

2013-12-12 Thread Toke Eskildsen
On Thu, 2013-12-12 at 11:10 +0100, Hoggarth, Gil wrote: Thanks for this - I haven't any previous experience with utilising SSDs in the way you suggest, so I guess I need to start learning! There's a bit of divide in the Lucene/Solr-world on this. Everybody agrees that SSDs in themselves are

Sudden Solr crush after commit

2013-12-12 Thread Manuel Le Normand
In the last days one of my tomcat servlet, running only a Solr instance, crushed unexpectedly twice. Low memory usage, nothing written in the tomcat log, and the last thing happening in solr log is 'end_commit_flush' followed by 'UnInverted mutli-valued field' for the fields faceted during the

Re: SolrCloud and MoreLikeThis: SOLR-788

2013-12-12 Thread Furkan KAMACI
Hi; Yes, I am talking about SOLR-788. There writes 4.1 so it means that it has fixed at 4.1. On the other hand some patches are applied both for ongoing versions and trunk. 5.0 is the trunk version of Solr. For your other question: what do you mean with: where is document with this id?. If you

Re: [Solr Wiki] Your wiki account data

2013-12-12 Thread tedswiss
Sorry, your first email hit the spam box ! -- View this message in context: http://lucene.472066.n3.nabble.com/Fwd-Solr-Wiki-Your-wiki-account-data-tp4104901p4106383.html Sent from the Solr - User mailing list archive at Nabble.com.

Metrics in monitoring SolrCloud

2013-12-12 Thread michael.boom
Hi, I'm trying to add SolrCloud to out internal monitoring tools and I wonder if anybody else proceeded in this direction and could maybe provide some tips. I would want to be able to get from SolrCloud: 1. The status for each collection - meaning can it serve queries or not. 2. Average query

RE: SolrCloud and MoreLikeThis: SOLR-788

2013-12-12 Thread gf80
great, thanks very much for your kind support, with this query I can perform a sort of workaround to SOLR-4414 issue, what do you think about? I am wrong? Anyway, I am new with solr and solrcloud too, but I am having a full immersion with it from few days to index very large mole of documents.

Re: Configurable collectors for custom ranking

2013-12-12 Thread Peter Keegan
Regarding my original goal, which is to perform a math function using the scaled score and a field value, and sort on the result, how does this fit in? Must I implement another custom PostFilter with a higher cost than the scale PostFilter? Thanks, Peter On Wed, Dec 11, 2013 at 4:01 PM, Peter

Re: SolrCloud and MoreLikeThis: SOLR-788

2013-12-12 Thread Furkan KAMACI
Hi; Yes, you can it with that way. On the other hand you can start a new thread about your second question. I can help you to decide the shard size and other parameters. However you should know that it depends on your system and your needs. Thanks; Furkan KAMACI 2013/12/12 gf80

Re: Sudden Solr crush after commit

2013-12-12 Thread Furkan KAMACI
Hi Manuel; Mutivalued field via un-inverted field is introduced at Solr 1.4 and you can check it from here: https://issues.apache.org/jira/browse/SOLR-475 Could you give more details about your system (i.e. Solr version) and other parameters? Thanks; Furkan KAMACI 2013/12/12 Manuel Le

Re: unable to facet range query

2013-12-12 Thread Ahmet Arslan
Hi, Did you reindex after schema change?  On Thursday, December 12, 2013 11:51 AM, Nutan nutanshinde1...@gmail.com wrote: I remove the QEC but for facet it still gives this error: Unable to range facet on field:id{type=integer,properties=indexed,stored,omitNorms,required, required=true}

Re: Metrics in monitoring SolrCloud

2013-12-12 Thread Ahmet Arslan
Hi Michael, Not sure about collection, solr exposes 2) and 3) via : http://wiki.apache.org/solr/SolrJmx https://cwiki.apache.org/confluence/display/solr/MBean+Request+Handler On Thursday, December 12, 2013 4:47 PM, michael.boom my_sky...@yahoo.com wrote: Hi, I'm trying to add SolrCloud to

Re: CollapsingQParserPlugin scores incorrectly in Solr 4.6.0 when multiple sort criteria are used

2013-12-12 Thread Joel Bernstein
Hi, This is a known issue resolved in SOLR-5408. It's fixed in trunk and 4x and if there is a 4.6.1 it will be in there. If not it will be Solr 4.7. https://issues.apache.org/jira/browse/SOLR-5408 Joel On Wed, Dec 11, 2013 at 11:36 PM, Umesh Prasad umesh.i...@gmail.com wrote: Issue occurs

Re: Configurable collectors for custom ranking

2013-12-12 Thread Joel Bernstein
The sorting is going to happen in the lower level collectors. You need a value source that returns the score of the document being collected. Here is how you can make this happen: 1) Create an object in your PostFilter that simply holds the current score. Place this object in the SearchRequest

Re: Solr hardware memory question

2013-12-12 Thread Michael Della Bitta
Hello, Gil, I'm wondering if you've been in touch with the Hathi Trust people, because I imagine your use cases are somewhat similar. They've done some blogging around getting digitized texts indexed at scale, which I what I assume you're doing:

Re: Solr Profiler

2013-12-12 Thread Michael Della Bitta
I've used VisualVM quite a bit, but not sure that it's going to top any of the other products mentioned in this thread. It's free, though, so there's that! Michael Della Bitta Applications Developer o: +1 646 532 3062 | c: +1 917 477 7906 appinions inc. “The Science of Influence Marketing”

RE: Load existing HDFS files into solr?

2013-12-12 Thread Tim Potter
Hi Chen, I'm not aware of any direct integration between the two at this time. You might ping the Hive user list with this question too. That said, I've been thinking whether it makes sense to build a Hive StorageHandler for Solr? That at least seems like a quick way to go. However, it might

solr OOM Crash

2013-12-12 Thread Sandra Scott
Helllo, We are experiencing unexplained OOM crashes. We have already seen it a few times, over our different solr instances. The crash happens only at a single shard of the collection. Environment details: 1. Solr 4.3, running on tomcat. 2. 24 Shards. 3. Indexing rate of ~800 docs per minute.

Re: Configurable collectors for custom ranking

2013-12-12 Thread Peter Keegan
This is pretty cool, and worthy of adding to Solr in Action (v2) and the other books. With function queries, flexible filter processing and caching, custom collectors, and post filters, there's a lot of flexibility here. Btw, the query times using a custom collector to scale/recompute scores is

Re: Configurable collectors for custom ranking

2013-12-12 Thread Joel Bernstein
Thanks, I agree this powerful stuff. One of the reasons that I haven't gotten back to pluggable collectors is that I've been using PostFilters instead. When you start doing stuff with scores in postfilters you'll run into the bug in SOLR-5416. This will effect you when you use facets in

Re: Metrics in monitoring SolrCloud

2013-12-12 Thread Furkan KAMACI
Hi Michael; I've implemented a management console and dashboard for such kind of purposes. After a time later I want to make it an open source project for the people who needs it. It is a more complicated but very flexible and pluggable management console and dashboard. I suggest you to look at

Re: Metrics in monitoring SolrCloud

2013-12-12 Thread Otis Gospodnetic
Hi Michael, You may want to give http://sematext.com/spm/solr-performance-monitoring a shot. It's got the metrics you need + others + alerts + Ping if you want a Christmas discount. :) Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr Elasticsearch Support *

Re: solr OOM Crash

2013-12-12 Thread Otis Gospodnetic
Hi Sandra, Not a direct answer, but if you are seeing this around merges, have you tried relaxing the merge factor to, say, 10? Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr Elasticsearch Support * http://sematext.com/ On Thu, Dec 12, 2013 at 12:10 PM, Sandra Scott

Re: Solr Cloud error with shard update

2013-12-12 Thread dboychuck
I have created Jira issue here: https://issues.apache.org/jira/browse/SOLR-5551 -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Cloud-error-with-shard-update-tp4106260p4106448.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Change Velocity Template Directory in Solr 4.6

2013-12-12 Thread O. Olson
Thank you very much for the confirmation iorixxx. When I started this thread on Dec. 6, I did not know about the confluence wiki (https://cwiki.apache.org/confluence/display/solr/Apache+Solr+Reference+Guide). I learned about it through another thread I started

Re: Re: LanguageIdentifierUpdateProcessor uses only firstValue() on multivalued fields

2013-12-12 Thread Trey Grainger
Hmm... haven't run into the case where null was returned in a multi-valued scenario yet... I probably just haven't tested that case. I likely need to add a null check there - thanks for pointing it out. -Trey On Fri, Nov 29, 2013 at 6:10 AM, Müller, Stephan muel...@ponton-consulting.de wrote:

Re: Prioritize search returns by URL path?

2013-12-12 Thread Jim Glynn
Thanks Chris. I think you've hit the nail on the head. I understand your concern about prioritizing content simply by content type, and generally I'd agree with you. However, our situation is a bit unusual. We don't use our Wiki feature as true wikis. We publish only authoritative content to

Re: FuzzyLookupFactory fwfsta.bin

2013-12-12 Thread Areek Zillur
This error is misleading. It tries to load the suggester index from the storeDir parameter even on the first run, when the index was not created to begin with, and hence errors. (it will create the index itself when a build command is issued). I believe you will not see the error once the index

Unable to check Solr 4.6 SPLITSHARD command progress

2013-12-12 Thread binit
I have a big index, approx size 350 GB in a single shard, which I want to split. The SPLITSHARD command initiates successfully as I can see in the logs. (It times out but reading the forums here it is the expected behavior). The problem is it never completes even after a full day, and I doubt

custom group sort in solr

2013-12-12 Thread Parvesh Garg
Hi, I want to use solr/lucene's grouping feature with a some customisations like - sorting the groups based on average scores instead of max scores or some other complex computation over scores. - group articles based on some computation instead of a field value. So far it seems like I

Re: custom group sort in solr

2013-12-12 Thread Mukundaraman valakumaresan
Hi You may try to write a custom function and sort your group according to the result of the custom function. If that might work, check out ValueSourceParser, ValueSource and its descendant classes for a better understanding. Thanks Regards Mukund On Fri, Dec 13, 2013 at 10:54 AM, Parvesh

Re: Updating shard range in Zookeeper

2013-12-12 Thread Manuel Le Normand
Zookeeper client for eclipse is the tool you're looking for. You can edit directly the clusterstate. http://www.massedynamic.org/mediawiki/index.php?title=Eclipse_Plug-in_for_ZooKeeper Another option can be using the delivered zkclient (distributed with solr 4.5 and above) and upload a new

Re: Sudden Solr crush after commit

2013-12-12 Thread Manuel Le Normand
Running solr 4.3, sharded collection. Tomcat 7.0.39 Faceting on multivalue fields works perfectly fine, I was describing this log to emphasize the fact the servlet failed right after a new searcher was opened and the event listener finished running a warming faceting query.