Solr Plugins Documentation

2018-02-16 Thread ~$alpha`
I got a basic understanding of how we can create the custom Solr plugin as illustrated in link https://dzone.com/articles/create-custom-solr-queryparser But I don't know the next step as for how can we create a jar. like do we need to import Solr source code ?? It would be of great help if

Re: Getting Error when try to use sql query

2018-02-16 Thread Joel Bernstein
Currently grouping on the Date field is not supported with SQL interface. At Alfresco we've added a time series capability to Solr's SQL engine and plan on contributing it back. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Feb 16, 2018 at 3:10 PM, Jorge Carlos Guedert Junior <

Re: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Erick Erickson
I didn't mean to imply that _you'd_ changed things, the _defaults_ may have changed. So the "string" fieldType may be defined with docValues="true" in your new schema and "false" in your old schema without you intentionally changing anything at _all_. That's why the LukeRequestHandler will

RE: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Howe, David
Hi Erick, I'm 99% sure that I haven't changed the field types between the two snapshots as all of my test runs are completely scripted and build a new Solr server from scratch (both the virtual machine and the Solr software). I can diff the scripts between two runs to make sure I haven't

Re: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Erick Erickson
Well, I'm not entirely sure either ;) What I'm seeing. And, BTW, I'm making a couple of assumptions here. In the one listing, your biggest segment starts with _7l and in the other its _zd. The aggregate size is 2,815M for _7l and 705M for _zd. So multiplying the individual files in _zd by 4

RE: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Howe, David
Hi Erick, Thinking some more about the differences between the two sort orders has suggested another possibility. We also have a geo spatial field defined in the index: echo "$(date) Creating geoLocation field" curl -X POST -H 'Content-type:application/json' --data-binary '{

Getting Error when try to use sql query

2018-02-16 Thread Jorge Carlos Guedert Junior
I'm getting error {"result-set":{"docs":[{"EXCEPTION":"java.util.Date cannot be cast to java.lang.String","EOF":true,"RESPONSE_TIME":68}]}} when i trying to do this query: SELECT `date` as Date, COUNT(deviceSerialNumber) FROM `trip-day-mobile` GROUP BY `date`? this problem occurs only

Re: solrcloud Auto-commit doesn't seem reliable

2018-02-16 Thread Webster Homer
I meant to get back to this sooner. When I say I issued a commit I do issue it as collection/update?commit=true The soft commit interval is set to 3000, but I don't have a problem with soft commits ( I think). I was responding I am concerned that some hard commits don't seem to happen, but I

RE: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Howe, David
Hi Erick, Below is the file listing for when the index is loaded with the table ordered in a way that produces the smaller index. I have checked the console, and we have no deleted docs and we have the same number of docs in the index as there are rows in the staging table that we load from.

RE: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Howe, David
Hi Alessandro, There are 14,061,990 records in the staging table and that is how many documents that we end up with in Solr. I would be surprised if we have a problem with the id, as we use the primary key of the table as the id in Solr so it must be unique. The primary key of the staging

Re: Undefined field deprecated (HTTP 400)

2018-02-16 Thread Deeksha Sharma
Thanks Eric for pointing out. Actually I was sending “fq” parameter with a field name called “deprecated” and that is why it was throwing the exception. Your help is very much appreciated. On 2/16/18, 12:23 PM, "Erick Erickson" wrote: 2> your solrconfig.xml file

Re: Undefined field deprecated (HTTP 400)

2018-02-16 Thread Erick Erickson
What's the _query_ you send? One of two things is happening I'd guess: 1> you are simply forming a different query in the admin UI or via http. 2> your solrconfig.xml file has a field called "deprecated" defined for use with the request handler you use, and you're using a different request handler

Undefined field deprecated (HTTP 400)

2018-02-16 Thread Deeksha Sharma
Hi everyone, I am using solr 5.2.1 and below is my schema.xml file for a core I am trying to query:

Re: Collections Fail to load after Solr Restart

2018-02-16 Thread Erick Erickson
bq: My theory is that the field was changed from a string to text_lowercase, and docValues set to false then data was reloaded That would do it. For most changes in the schema, you should expect to _have_ to completely blow away the index and re-index from scratch. The underlying structures can

Collections Fail to load after Solr Restart

2018-02-16 Thread Webster Homer
Yesterday I restarted a development solrcloud. After the cloud restarted 2 collections failed to come back. I see this in the log: 2018-02-16 15:31:16.684 ERROR (coreLoadExecutor-6-thread-1-processing-n:ae1c-ecomdev-msc02:8983_solr) [ ] o.a.s.c.CachingDirectoryFactory Error closing

Haystack - Search Relevance Conf - Agenda Announced

2018-02-16 Thread Doug Turnbull
Come to the hometown of some Solr gurus like Eric Pugh, Erik Hatcher, and Doug Turnbull for our search relevance conference :) Check out the agenda. Lots of good Solr talks from people doing innovative work at places like Wikimedia Foundation, Elsevier, Snagajob, LexisNexis, Lucidworks, Elastic

Re: Solr search word NOT followed by another word

2018-02-16 Thread Emir Arnautović
Hi Ivan Can you share response from debug query. Here is what I got: { "responseHeader":{ "status":0, "QTime":8, "params":{ "q":"{!complexphrase df=content}\"leonardo -da -Vinci\"", "indent":"on", "fl":"content", "wt":"json", "debugQuery":"on"}},

Re: Solr running on Tomcat

2018-02-16 Thread Ramesh b
Yes, we are running Solr 5.3.1 version in tomcat for our production system.it serves well. Thanks, Ramesh > On Feb 15, 2018, at 10:54 PM, GVK Prasad wrote: > > > I read some posts on setting up Solr to Run on Tomcat. But all these posts > are about Solr version

Re: solr ltr jar is not able to recognize MultipleAdditiveTreesModel

2018-02-16 Thread Alessandro Benedetti
You can not just use the model output from Ranklib. I opened this issue few months ago but I never had the right time/motivation to implement it [1] . You need to convert it in the Apache Solr LTR expected format. I remember a script should be available[2] [1]

Re: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Alessandro Benedetti
It's a silly thing, but to confirm the direction that Erick is suggesting : How many rows in the DB ? If updates are happening on Solr ( causing the deletes), I would expect a greater number of documents in the DB than in the Solr index. Is the DB primary key ( if any) the same of the uniqueKey

RE: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Howe, David
Hi Emir, We have no copy field definitions. To keep things simple, we have a one to one mapping between the columns in our staging table and the fields in our Solr index. Regards, David David Howe Java Domain Architect Postal Systems Level 16, 111 Bourke Street Melbourne VIC 3000 T

Re: Solr search word NOT followed by another word

2018-02-16 Thread ivan
Hi Emir, i'm testing these on the examples that comes with solr (techproducts), i just added some docs to that. Both those queries give the expected results. I'm testing on a TextField (indexed, tokenized, stored). -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr search word NOT followed by another word

2018-02-16 Thread Emir Arnautović
Hi Ivan, Can you share config for that field. It seems to me that it might be caused by your analysis chain. Does queries “Leonardo 1” or “bla Leonardo” result in matches? Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training -

Re: In Place Updates not work as expected

2018-02-16 Thread Emir Arnautović
Hi, Did you confirm that it actually does in place update? In case of in place update, after update (maybe try single) only doc values file should change (if my understanding is right). Do you update a full document or some test doc with a single field? Do you batch updates or send one by one?

Re: Index size increases disproportionately to size of added field when indexed=false

2018-02-16 Thread Emir Arnautović
Hi David, I skimmed through thread and don’t see if already eliminated, so will ask: Can you check if there are some copyField rules that are triggered when new field is added. You mentioned that ordering fixed the size of the index, but might be worth checking. Emir -- Monitoring - Log

Re: Solr search word NOT followed by another word

2018-02-16 Thread ivan
That still does not work for me. I'm not getting results for "Leonardo da vinci bla bla Leonardo" or "Leonardo 1 da vinci bla bla Leonardo". Tried on both solr 6.4.1 and solr 7.2.1 -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

RE: Solr search word NOT followed by another word

2018-02-16 Thread ivan
I'm using solr 6.4.1, i will try your updated version and let you know, thanks! -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr running on Tomcat

2018-02-16 Thread Emir Arnautović
Hi Prasad, Solr comes with embeded Jetty and running Solr on other containers is no longer officially supported. HTH, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > On 16 Feb 2018, at 04:54, GVK