Solr - custom ordering

2018-01-04 Thread Vineet Mangla
Hi, We have a Solr cloud core where "jobid" is our primary key. We have a use case where we have a list of 15000 jobids in a particular order in an external system. We are calling solr with these 15000 jobids as filter query and in result, we want all the jobids after filtering in the same

Re: problem with Solr Sorting by score and distance together

2018-01-04 Thread Susheel Kumar
Hi Deepak, As Shawn mentioned, switch your q and fq values above like q=facilityName:"orthodontist"+OR+facilityName:*orthodontist* +OR+facilityName:"paul"+OR+facilityName:*paul*+OR+facilityName:*paul+ orthodontist*+OR+facilityName:"paul+orthodontist"+OR+

Re: CommonGramsFilter

2018-01-04 Thread Nawab Zada Asad Iqbal
After some debugging, it seems that the search works if the query is phrase search (i.e, enclosed in quotes) http://localhost:8983/solr/filesearch/select?q=%22not%20to%20or%20be%22=true This works both in case of sow=true or false. Is it mandatory to use phrase search to properly pass the

CommonGramsFilter

2018-01-04 Thread Nawab Zada Asad Iqbal
Hi, I am looking at this documentation and wondering if it would be better to optionally skip indexing of original stopwords. https://lucene.apache.org/solr/guide/6_6/filter-descriptions.html# FilterDescriptions-CommonGramsFilter

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-04 Thread Erik Hatcher
defType=??? Probably dismax. It doesn’t do *:* like edismax or lucene. > On Jan 4, 2018, at 20:39, Nawab Zada Asad Iqbal wrote: > > Thanks Erik > Here is the output, > > http://localhost:8983/solr/filesearch/select?fq=id:1193=*:*=true > > > - parsedquery:

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-04 Thread Nawab Zada Asad Iqbal
Thanks Erik Here is the output, http://localhost:8983/solr/filesearch/select?fq=id:1193=*:*=true - parsedquery: "+MatchAllDocsQuery(*:*)", http://localhost:8983/solr/filesearch/select?fq=id:1193=*:*=true - parsedquery: "+DisjunctionMaxQuery((user_email:*:* | user_name:*:* |

Re: Solrcloud with Master/Slave

2018-01-04 Thread Erick Erickson
As I said before, you _are_using ZooKeeper by starting your servers with the -cloud option. Just leave that off and you won't be and can use master/slave freely. Best, Erick On Thu, Jan 4, 2018 at 12:21 PM, Sundaram, Dinesh < dinesh.sunda...@mastercard.com> wrote: > Ok thanks for your valuable

Re: trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-04 Thread Erick Erickson
Hmm, seems odd. What happens when you attach =query? I'm curious how the parsed queries differ. On Jan 4, 2018 15:14, "Nawab Zada Asad Iqbal" wrote: > Hi, > > In my SearchHandler solrconfig, i have q.alt=*:* . This allows me to run > queries which only have `fq` filters and no

Re: Negative Core Node Numbers

2018-01-04 Thread Chris Ulicny
Thanks Anshum, They don't seem to be consistently numbered on any particular collection creation, but the same numbers will be reused (eventually). After about 3 or 4 tries, I got the same numbered replica on the same machine, so something is being cleared out. The numbers are never consecutive

RE: problem with Solr Sorting by score and distance together

2018-01-04 Thread Deepak Udapudi
Hi Shawn, Thanks for the response. In the problem example in the below email I had used a hypothetical example for my query. Actually, we are trying to search for the name and specialty combination(for ex:- paul orthodontist) of the dentist sorted by the highest score and distance (in case

trivia question: why q=*:* doesn't return same result as q.alt=*:*

2018-01-04 Thread Nawab Zada Asad Iqbal
Hi, In my SearchHandler solrconfig, i have q.alt=*:* . This allows me to run queries which only have `fq` filters and no `q`. If I remove q.alt from the solrconfig and specify `q=*:*` in the query parameters, it does not give any results. I also tried `q=*` but of no avail. Is there some good

Re: Negative Core Node Numbers

2018-01-04 Thread Anshum Gupta
Hi Chris, The core node numbers should be cleared out when the collection is deleted. Is that something you see consistently ? P.S: I just tried creating a collection with 1 shard and 200 replicas and saw the core node numbers as expected. On deleting and recreating the collection, I saw that

RE: Solrcloud with Master/Slave

2018-01-04 Thread Sundaram, Dinesh
Ok thanks for your valuable reply. I want to see admin console so that I can monitor the collection details, that is the reason going to cloud mode. But here I need replication without zookeeper so had to choose regular master/slave replication. Am I mixing 2 different synchup procedures or

Negative Core Node Numbers

2018-01-04 Thread Chris Ulicny
Hi, In 7.1, how does solr determine the numbers that are assigned to the replicas? I'm familiar with the earlier naming conventions from 6.3, but I wanted to know if there was supposed to be any connection between the "_n##" suffix and the number assigned to the "core_node##" name since they

Re: Solrcloud with Master/Slave

2018-01-04 Thread Erick Erickson
Yes you do use ZooKeeper. Starting Solr with the -cloud option but _without_ ZK_HOST defined (or the -z parameter) starts an internal ZooKeeper on port 9983 (by default). This is evidenced by the fact that the admin UI has a "cloud" link along the left. In essence you have two separate clusters,

RE: Solrcloud with Master/Slave

2018-01-04 Thread Sundaram, Dinesh
I want to keep both collections in sync always. This is really working fine without any issue so far. My problem is pretty straight forward. I'm starting two solr instances on two servers using the below command. I believe this command is for solrcloud mode. If so then I have that shared

Re: Replication Factor Bug in Collections Restore API?

2018-01-04 Thread Shalin Shekhar Mangar
Sounds like a bug. Can you please open a Jira issue? On Thu, Jan 4, 2018 at 8:37 PM, Ansgar Wiechers wrote: > Hi all. > > I'm running Solr 7.1 in SolrCloud mode ona a 3-node cluster and tried > using the backup/restore API for the first time. Backup worked fine, but >

SOLR SSL Java command line properties

2018-01-04 Thread Bob Feider
When I use the provided Apache SOLR startup script (version 6.6.0), the script creates and then executes a java command line that has two sets of SSL properties who's related elements are set to the same values. One set has property names like |javax.net.ssl.*| while the other set has names

Re: Deliver static html content via solr

2018-01-04 Thread Erik Hatcher
All judgements aside on whether this is a preferred way to go, have a look at /browse and the VelocityResponseWriter (wt=velocity). It can serve static resources. I’ve built several prototypes this way that have been effective and business generating. Erik > On Jan 4, 2018, at 11:19,

Re: Json Facet Query Stripping Field Name with Hyphen

2018-01-04 Thread RAUNAK AGRAWAL
Hi Erick/Yonik, Thank you guys. I am going to rename the fields. On Thu, Jan 4, 2018 at 10:04 PM, Yonik Seeley wrote: > The JSON Facet API uses the function query parser for something like > sum(week_-91) so you'll probably have problems with any function that > uses these

Re: Json Facet Query Stripping Field Name with Hyphen

2018-01-04 Thread Yonik Seeley
The JSON Facet API uses the function query parser for something like sum(week_-91) so you'll probably have problems with any function that uses these fields as well. As Erick says, you're better off renaming the fields. There is a workaround for wonky field names via the "field" function:

Re: Deliver static html content via solr

2018-01-04 Thread David Hastings
Its really easy if find for people to start going down this road. Have to always remind myself of the hammer and nail analogy. Use each tool for its purpose. On Thu, Jan 4, 2018 at 11:27 AM, Walter Underwood wrote: > Why would you even consider putting static HTML in a

Re: Deliver static html content via solr

2018-01-04 Thread Walter Underwood
Why would you even consider putting static HTML in a search engine? You don’t want to search it. 1. Filesystems are very fast, and operating systems are very good at caching them. 2. Files can be pre-compressed for some web servers (Apache, at least) saving CPU for compression 3. Solr is not a

Deliver static html content via solr

2018-01-04 Thread Matthias Geiger
Hello, i have a web application that delivers static html content to the user. I have been thinking about the possibility to deliver this content from solr instead of delivering it from the filesystem. This would prevent the "double" stored content (html files on file systems + additional solr

Re: Solrcloud with Master/Slave

2018-01-04 Thread Erick Erickson
Whoa. I don't think you should be doing this at all. This really appears to be an XY problem. You're asking "how to do X" without telling us what the problem you're trying to solve is (the Y). _Why_ do you want to set things up this way? A one-time synchronization or to keep both collections in

RE: Solrcloud with Master/Slave

2018-01-04 Thread Sundaram, Dinesh
Thanks Shawn for your prompt response. Assume I have solrcloud A server with 1 node runs on 8983 port and solrcloud B server with 1 node runs on 8983, here I want to synch up the collection between solrcloud A and B using the below replication handler. Is this advisable to use at the solrcloud

Re: Json Facet Query Stripping Field Name with Hyphen

2018-01-04 Thread Erick Erickson
>From the ref guide: "Field names should consist of alphanumeric or underscore characters only and not start with a digit." While field naming isn't strictly enforced, having field names like week_-1 is also not guaranteed to be supported. You should change your field name. I raised SOLR-11819

Re: Learning to Rank (LTR) with grouping

2018-01-04 Thread Roopa Rao
Hi, Any guidance on this would be helpful. Thank you, Roopa On Tue, Dec 19, 2017 at 8:47 PM, Roopa Rao wrote: > Hi Diego, > > Thank you for looking into it further. > We recently ported over to 6.6 version solely to use LTR feature as it is > critical for us. > > Since its

Replication Factor Bug in Collections Restore API?

2018-01-04 Thread Ansgar Wiechers
Hi all. I'm running Solr 7.1 in SolrCloud mode ona a 3-node cluster and tried using the backup/restore API for the first time. Backup worked fine, but when trying to restore the backed-up collection I ran into an unexpected problem with the replication factor setting. Below command attempts to

Json Facet Query Stripping Field Name with Hyphen

2018-01-04 Thread RAUNAK AGRAWAL
Hi Guys, I am facing issue where I am trying to follow the JSON facet API. I have data in my collection and field names are like "week_0", "week_-1" which means current week and previous week respectively. When I am querying for week_0 summation using the following query I am able to get the

Re: problem with Solr Sorting by score and distance together

2018-01-04 Thread Shawn Heisey
On 1/3/2018 6:16 PM, Deepak Udapudi wrote: Assume that, I am searching for car care centers. Solr collection has the data for all the major car care centers. As an example I search for Firestone car care centers in a 5 miles radius. In the search results I am supposed to receive the

Re: SolrCloud Nodes going to recovery state during indexing

2018-01-04 Thread Emir Arnautović
Hi Sravan, Glad to hear it helped! Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 4 Jan 2018, at 13:36, Sravan Kumar wrote: > > Emir, > 'delete_by_query' is the cause

Re: SolrCloud Nodes going to recovery state during indexing

2018-01-04 Thread Sravan Kumar
Emir, 'delete_by_query' is the cause for the replicas going to recover state. I replaced it with delete_by_id as you suggested. Everything works fine after that. The cluster held for nearly 3 hours without any failures. Thanks Emir. On Wed, Jan 3, 2018 at 8:41 PM, Emir Arnautović <

Re: Replacing \n with using RegexReplaceProcessorFactory

2018-01-04 Thread Zheng Lin Edwin Yeo
Thanks Emir. It is working now. Regards, Edwin On 4 January 2018 at 18:02, Emir Arnautović wrote: > Hi Edwin, > You need to encode as br > > HTH, > Emir > -- > Monitoring - Log Management - Alerting - Anomaly Detection > Solr & Elasticsearch Consulting Support

Re: Query fields with data of certain length

2018-01-04 Thread Zheng Lin Edwin Yeo
Hi Emir, An example of the string in Chinese is 预支款管理及账务处理办法 The number of characters is 12, but the expected length should be 36. Regards, Edwin On 4 January 2018 at 16:21, Emir Arnautović wrote: > Hi Edwin, > I don’t have enough knowledge in eastern languages

Re: Replacing \n with using RegexReplaceProcessorFactory

2018-01-04 Thread Emir Arnautović
Hi Edwin, You need to encode as br HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 4 Jan 2018, at 10:59, Zheng Lin Edwin Yeo wrote: > > Hi, > > I'm using Solr 7.2.0,

Replacing \n with using RegexReplaceProcessorFactory

2018-01-04 Thread Zheng Lin Edwin Yeo
Hi, I'm using Solr 7.2.0, and I'm trying to replace \n with by using RegexReplaceProcessorFactory. However, I could not get the below configuration in solrconfig.xml to be loaded. content \n Understand that is a special character. Can we do some escape sequence to it? I have

Re: Query fields with data of certain length

2018-01-04 Thread Emir Arnautović
Hi Edwin, I don’t have enough knowledge in eastern languages to know what is expected number when you as for sting length. Maybe you can try some of regex unicode settings and see if you’ll get what you need: try setting unicode flag with (?U) or try using regex groups and ranges. If you