Re: problem setting default params for /browse (velocity) queries

2016-09-20 Thread Erick Erickson
I'm not entirely sure about this, but I think you're mixing up useParams and initParams. If I'm reading the docs correctly, useParams is used in conjunction with the "Request Parameters API" and whatever you're setting is stored in a separate file (params.json), not solrconfig.xml. This is

problem setting default params for /browse (velocity) queries

2016-09-20 Thread Matt Work Coarr
Good morning. I'm attempting to set some default query parameters via solrconfig.xml but they are not taking effect. I'm using the /browse interface (e.g. velocity templates). To keep it simple, let's start with "fl". When I specify fl as a url parameter, it does take effect. But when I put it

Re: In cloud mode, using implicit router. Leader changed, not available to index data, and no error occurred.

2016-09-20 Thread Jerome Yang
I'm sure I send documents to that shard. And execute commit. I also use curl to index, but not error occurred and no documents are indexed. On Mon, Sep 19, 2016 at 11:27 PM, Erick Erickson wrote: > Are all the documents in the collection? By using implicit router, you

Re: In cloud mode, using implicit router. Leader changed, not available to index data, and no error occurred.

2016-09-20 Thread Jerome Yang
That shard did receive update request, because it shows in the log. And also commit request. But no documents indexed. On Tue, Sep 20, 2016 at 2:26 PM, Jerome Yang wrote: > I'm sure I send documents to that shard. And execute commit. > > I also use curl to index, but not

Re: I cannot get phrases highlighted correctly without using the Fast Vector highlighter

2016-09-20 Thread Koji Sekiguchi
Hello Panagiotis, I'm sorry but it's a feature. As for hl.usePhraseHighlighter parameter, when you turn off it, you may get only foo or bar highlighted in your snippets. Koji On 2016/09/18 15:55, Panagiotis T wrote: I'm using Solr 6.2 (tried with 6.1 also) I created a new core and the only

How to set NOT clause on Date range query in Solr

2016-09-20 Thread Sandeep Khanzode
Have been trying to understand this for a while ...How can I specify NOT clause in the following query?{!field f=schedule op=Intersects}[2016-08-26T12:30:00Z TO 2016-08-26T18:30:00Z]{!field f=schedule op=Contains}[2016-08-26T12:30:00Z TO 2016-08-26T18:30:00Z]Like, without LocalParams, we can

solr index in hdfs perfomance

2016-09-20 Thread 尚平平
Hi, I am learning solr rencently, and I have some problems. Please help me and I will thank you very much. I stored indexes in HDFS directory, the update performance I got with solrmeter showed that: (1) the perfomance that storing index in local filesystem is about 7

Re: [Rerank Query] Distributed search + pagination

2016-09-20 Thread Alessandro Benedetti
Perfect Joel, keep me updated ! Cheers On Mon, Sep 19, 2016 at 10:26 PM, Joel Bernstein wrote: > Alessandro, I'll be doing some testing with the re-ranker as part of > SOLR-9403 for Solr 6.3. I'll see if I can better understand the issue > you're bringing up during the

Index Size in String Field vs Text Field

2016-09-20 Thread Zheng Lin Edwin Yeo
Hi, Would like to check, will the index size for fields which has been defined as String be generally smaller than fields which has been defined as a Text Field (Eg: KeywordTokenizerFactory)? Assuming that both of them contains the same value in the fields, and there is no additional filters for

Negative Date Query for Local Params in Solr

2016-09-20 Thread Sandeep Khanzode
For Solr 6.1.0 This works .. -{!field f=schedule op=Intersects}2016-08-26T12:00:56Z This works .. {!field f=schedule op=Contains}[2016-08-26T12:00:12Z TO 2016-08-26T15:00:12Z] Why does this not work?-{!field f=schedule op=Contains}[2016-08-26T12:00:12Z TO 2016-08-26T15:00:12Z]  SRK

Re: Solr Special Character Search

2016-09-20 Thread Alexandre Rafalovitch
What's your field definition? What happens when the text goes through the analysis chain as you can test in Admin UI? Regards, Alex On 20 Sep 2016 6:49 PM, "Cheatham, Kevin" wrote: > Hello - Has anyone out there had success with anything similar to our > issue

Solr Special Character Search

2016-09-20 Thread Cheatham, Kevin
Hello - Has anyone out there had success with anything similar to our issue below and be kind enough to share? We posted several files as text and we're able to search for alphanumeric characters, but not able to search for special characters such as @ or © through Solrcloud Admin 5.2 UI.

Re: Negative Date Query for Local Params in Solr

2016-09-20 Thread David Smiley
OH! Ok the moment the query no longer starts with "{!", the query is parsed by defType (for 'q') and will default to lucene QParser. So then it appears we have a clause with a NOT operator. In this parsing mode, embedded "{!" terminates at the "}". This means you can't put the sub-query text

Re: Negative Date Query for Local Params in Solr

2016-09-20 Thread David Smiley
It should, I think... what happens? Can you ascertain the nature of the results? ~ David On Tue, Sep 20, 2016 at 5:35 AM Sandeep Khanzode wrote: > For Solr 6.1.0 > This works .. -{!field f=schedule op=Intersects}2016-08-26T12:00:56Z > > This works .. {!field

Re: Negative Date Query for Local Params in Solr

2016-09-20 Thread Sandeep Khanzode
This is what I get ...  { "responseHeader": { "status": 400, "QTime": 1, "params": { "q": "-{!field f=schedule op=Contains}[2016-08-26T12:00:12Z TO 2016-08-26T15:00:12Z]", "indent": "true", "wt": "json", "_": "1474373612202" } }, "error": { "msg": "Invalid Date in Date Math

How to limit resources in multi-tenant systems

2016-09-20 Thread Georg Sorst
Hi list! I am running a multi-tenant system where the tenants can upload and import their own data into their respective cores. Fortunately, Solr makes it easy to make sure that the search indices don't mix and that clients can only access their "cores". However, isolating the resource

Re: problem setting default params for /browse (velocity) queries

2016-09-20 Thread Erik Hatcher
Matt - Those params (query, facets, and velocity) are defined in params.json as Erick mentioned. See here: https://github.com/apache/lucene-solr/blob/master/solr/server/solr/configsets/data_driven_schema_configs/conf/params.json

Re: problem setting default params for /browse (velocity) queries

2016-09-20 Thread Matt Work Coarr
Thanks Erick. The pre-existing request handler for /browse (the velocity template driven interface) already had this: I just added an entry for "myParams" and added the initParams element in solrconfig.xml. I also tried adding a initParam with a path of /browse (similar to how the existing

Very Slow Commits After Solr Index Optimization

2016-09-20 Thread vsolakhian
We are using Solr Cloud 4.10.3-cdh5.4.5 that is part of CLoudera CDH 5.4.5. Our collection (one shard with three replicas) became really big and we decided to delete some old records to improve performance (tests in staging environment have shown that after reaching 500 million records the index

Month facet - possible bucket values are Jan, Feb, Mar,…. Nov, Dec

2016-09-20 Thread Aswath Srinivasan (TMS)
Hello, How to build a Month facet from a date field? The facet that I’m looking for should have a maximum of only 12 buckets. The possible bucket values are Jan, Feb, Mar,…. Nov, Dec.

Re: problem setting default params for /browse (velocity) queries

2016-09-20 Thread Erik Hatcher
> On Sep 20, 2016, at 5:04 PM, Matt Work Coarr wrote: > > It would be nice to have a link to that films example in the cwiki "Request > Parameters API" page. Done (put at the end). > > Erik H, in your Lucidworks blog post, what is the meaning of the empty > string

Re: Negative Date Query for Local Params in Solr

2016-09-20 Thread Sandeep Khanzode
Wow. Simply awesome! Where can I read more about this? I am not sure whether I understand what is going on behind the scenes ... like which parser is invoked for !field, how can we know which all special local params exist, whether we should prefer edismax over others, when is the LuceneQParser

Re: problem setting default params for /browse (velocity) queries

2016-09-20 Thread Erik Hatcher
And for the curious, there’s examples of this sort of thing here… https://github.com/apache/lucene-solr/tree/master/solr/example/films This is one for Alexandre to take note of ;) #solr_examples_protips (that admittedly

Re: problem setting default params for /browse (velocity) queries

2016-09-20 Thread Matt Work Coarr
It would be nice to have a link to that films example in the cwiki "Request Parameters API" page. Erik H, in your Lucidworks blog post, what is the meaning of the empty string keyed entries in each of the param sets? "":{"v":0} Matt

IOException errors in SolrJ client

2016-09-20 Thread Brent
I'm getting periodic errors when adding documents from a Java client app. It's always a sequence of an error message logged in CloudSolrClient, then an exception thrown from org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143): Error message:

Re: problem setting default params for /browse (velocity) queries

2016-09-20 Thread Matt Work Coarr
Awesome! Thanks Erik and Erick!! To close the loop on this, I was able to create a paramset via the rest api and then use it in a query via ?paramSet=myParams and it's working!! Hopefully this information will help someone else... My dataset has some text fields that should be used in

[ANNOUNCE] Apache Solr 6.2.1 released

2016-09-20 Thread Shalin Shekhar Mangar
20 September 2016, Apache Solr™ 6.2.1 available The Lucene PMC is pleased to announce the release of Apache Solr 6.2.1 Solr is the popular, blazing fast, open source NoSQL search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting,

Re: How to limit resources in multi-tenant systems

2016-09-20 Thread Erick Erickson
There's really no OOB way that I know of to do what you're asking about. I'm not even sure what the "right thing to do" would be if such a limit was encountered. Fail the query? Try to execute it really slowly within the constraints? (Actually I doubt this latter is possible). The way Lucene

Re: Month facet - possible bucket values are Jan, Feb, Mar,…. Nov, Dec

2016-09-20 Thread Erik Hatcher
Two options come to mind - * index a field for just the month names * leverage facet.query… ={!key=Jan}cdate:[2003-01-01 TO 2003-01-31] OR cdate:[2004-01-01 TO 2004-01-31]…. I don’t know a way to select just “January’s” from a date field any more elegantly than that. I’d really

Re: Create collection PeerSync "no frame of reference" warnings

2016-09-20 Thread Pushkar Raste
If you are creating a collection these warnings are harmless. There is patch being worked on under SOLR-9446 (although for a different scen) it would help suppressing this error.

Re: Distributing nodes with the collections API RESTORE command

2016-09-20 Thread Stephen Lewis
Hello Again, I've just submitted a patch on Jira to this issue in the branch "branch_6_2". This is my first time submitting a patch (or even building solr!), so please let me know if there is anything I should change to be more helpful. Thanks! On Mon, Sep 19, 2016 at 4:47 PM, Stephen Lewis

Create collection PeerSync "no frame of reference" warnings

2016-09-20 Thread Brent
Whenver I create a collection that's replicated, I get these warnings in the follower Solr log: WARN [c:test_collection s:shard1 r:core_node1 x:test_collection_shard1_replica1] o.a.s.u.PeerSync no frame of reference to tell if we've missed updates Are these harmless? -- View this message in

JSON Facet API

2016-09-20 Thread Sandeep Khanzode
Hello, How can I specify JSON Facets in SolrJ? The below facet query for example ...  ={  facet1: {  type: query,  q: "field1:value1 AND field2:value2",  facet:  {  facet1sub1: { type: query,  q: "{!field f=mydate op=Intersects}2016-09-08T08:00:00",  facet:  {  id:  {  type: terms, 

Re: Negative Date Query for Local Params in Solr

2016-09-20 Thread Sandeep Khanzode
Thanks, David! Perhaps browsing the Solr sources may be a necessity at some point in time. :) SRK On Wednesday, September 21, 2016 9:08 AM, David Smiley wrote: So that page referenced describes local-params, and describes the special "v" local-param.  But

leader/replica update error + client "expected mime type/stale state" error

2016-09-20 Thread Brent P
I'm running Solr Cloud 6.1.0, with a Java client using SolrJ 5.4.1. Every once in awhile, during a query, I get a pair of messages logged in the client from CloudSolrClient -- an error about a request failing, then a warning saying that it's retrying after a stale state error. For this test, the

Re: Negative Date Query for Local Params in Solr

2016-09-20 Thread David Smiley
So that page referenced describes local-params, and describes the special "v" local-param. But first, see a list of all query parsers (which lists "field"): https://cwiki.apache.org/confluence/display/solr/Other+Parsers and

Re: Negative Date Query for Local Params in Solr

2016-09-20 Thread David Smiley
Personally I learned this by pouring over Solr's source code some time ago. I suppose the only official reference to this stuff is: https://cwiki.apache.org/confluence/display/solr/Local+Parameters+in+Queries But that page doesn't address the implications for when the syntax is a clause of a

Re: [Result Query Solr] How to retrieve the content of pdfs

2016-09-20 Thread Dmitry Kan
Hi Alexandre, Could you add fl=* to your query and check the output? Alternatively, have a look at your schema file and check what could look like content field: text or similar. Dmitry 14 сент. 2016 г. 1:27 AM пользователь "Alexandre Martins" < alexandremart...@gmail.com> написал: > Hi Guys,