Re: Reload schema or configs failed then drop index, can not recreate that index.

2016-11-22 Thread Erick Erickson
The mail server is pretty heavy-handed at deleting attachments, none of your (presumably) screenshots came through. You also haven't told us what version of Solr you're using. Best, Erick On Tue, Nov 22, 2016 at 6:25 PM, Jerome Yang wrote: > Sorry, wrong message. > To

Re: Comparing a Date value in solr

2016-11-22 Thread Erick Erickson
I wouldn't do it this way, it's far more complex than you need. Try fq=Startdate__D:[NOW/DAY-7DAYS TO NOW/DAY+1DAY]. Why the weird NOW/DAY+1DAY? Well, that makes fq clauses far more likely to be reused, see: https://lucidworks.com/blog/2012/02/23/date-math-now-and-filter-queries/ Best, Erick On

Re: negation search help

2016-11-22 Thread Alexandre Rafalovitch
How do you _know_ it is not 'apparent' ? Is it because it is preceded by the keyword 'no'? Just that keyword? At what maximum distance? Regards, Alex On 23 Nov 2016 2:59 PM, "Hem Naidu" wrote: > Gurus, > > I am new to Solr, I have a requirement to index

negation search help

2016-11-22 Thread Hem Naidu
Gurus, I am new to Solr, I have a requirement to index entire pdf/word documents using Solr Tika. Which was successful and able to get the search results displayed. Now I need to fine tune the results or adjust index so the negative statements should be filtered out the results like my input text

Comparing a Date value in solr

2016-11-22 Thread Sadheera Vithanage
Hi All, I am struggling to get the difference of 2 days and return the matching documents. I got the below function query to work, however I am unable to pass a fieldname for *u *in frange function. {!frange l=0 u=86400}ms(NOW,StartDate__d) What I really want to do is compare the start

Re: Solr 6 Performance Suggestions

2016-11-22 Thread Jerome Yang
Have you run IndexUpgrader? Index Format Changes Solr 6 has no support for reading Lucene/Solr 4.x and earlier indexes. Be sure to run the Lucene IndexUpgrader included with Solr 5.5 if you might still have old 4x formatted segments in your index. Alternatively: fully optimize your index with

Re: Reload schema or configs failed then drop index, can not recreate that index.

2016-11-22 Thread Jerome Yang
Sorry, wrong message. To correct. In cloud mode. 1. I created a collection called "test" and then modified the managed-schemaI, write something wrong, for example "id", then reload collection would failed. 2. Then I drop the collection "test" and delete configs form zookeeper. It

Reload schema or configs failed then drop index, can not recreate that index.

2016-11-22 Thread Jerome Yang
Hi all, Here's my situation: In cloud mode. 1. I created a collection called "test" and then modified the managed-schemaI got an error as shown in picture 2. 2. To get enough error message, I checked solr logs and get message shown in picture 3. 3. If I corrected the

Re: How to support facet values in search term

2016-11-22 Thread shamik
Thanks for the pointer Alex . I'll go through all four articles, thanksgiving will be fun :-) -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-include-facet-fields-in-keyword-search-tp4306967p4307020.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How many versions do you stay behind in production for better stability ?

2016-11-22 Thread Shawn Heisey
On 11/17/2016 12:25 AM, Dorian Hoxha wrote: > I see that there is a new release on every lucene release. Do you > always use the latest version since it may have bugs (ex most > cassandra productions are old compared to latest `stable` version > because they're not stable). How much behind do you

Re: How to support facet values in search term

2016-11-22 Thread Alexandre Rafalovitch
This looks similar to what was discussed by Ted Sullivan at: https://lucidworks.com/blog/author/tedsullivan/ (AutoFilter) There is a repository somewhere linked from an article as well. I'd start from the beginning, as articles get increasingly more esoteric towards the end :-) Regards, Alex.

Re: Solr6 CDCR - indexing doc to source replicates to target, doc not searchable in target

2016-11-22 Thread Erick Erickson
Well, it would be awkard to get right. At what point should a commit be sent? When the queue was empty? That could be after every document when incoming docs were slow. And what about the other shards? CDCR doesn't really know when _all_ the docs in _all_ the shards have been sent. On the

RE: Partial replication blocks subsequent requests when using solrcloud and master/slave replication

2016-11-22 Thread Jeremy Hoy
Thanks for your response Erick. Yes this looks like the issue we're seeing. I'll paste in the relevant parts of my email to the issue. The scenario you're describing is a little different to ours, so I don't think the naïve patch we have necessarily suits. I'll do a bit more research and

Re: Solr6 CDCR - indexing doc to source replicates to target, doc not searchable in target

2016-11-22 Thread gayatri.umesh
Thank you again Erick. Added autoSoftCommit settings in target solrconfig and it works now. As CDCR does not auto-commit on the target upon replication, is there a specific reason for this? Thanks, Gayatri -- View this message in context:

How to support facet values in search term

2016-11-22 Thread Shamik Bandopadhyay
Hi, I'm looking for some suggestions on enabling search terms to include facet fields as well. In my use case, we've a bunch of product and corresponding release fields which are explicitly used as facets. But what we are observing is that end users tend to use the product name as part of the

Re: Partial replication blocks subsequent requests when using solrcloud and master/slave replication

2016-11-22 Thread Erick Erickson
This sounds a lot like: https://issues.apache.org/jira/browse/SOLR-9706 Could you attach your patch to that issue if you think it's the same? And please copy/paste your e-mail in a comment if you would, you've obviously done more research on the cause than I did and that'd save some work

Re: Re-Indexing 143 million rows

2016-11-22 Thread subinalex
Thanks a lot Eric..:-) On 21 Nov 2016 20:09, "Erick Erickson [via Lucene]" < ml-node+s472066n4306659...@n3.nabble.com> wrote: > In a word, "no". Resending the same document will > > 1> delete the old version (based on ID) > 2> index the document just sent. > > When a document comes in, Solr

Partial replication blocks subsequent requests when using solrcloud and master/slave replication

2016-11-22 Thread Jeremy Hoy
Hi All, We're running a fairly non-standard solr configuration. We ingest into named shards in master cores and then replicate out to slaves running solr cloud. So in effect we are using solrcloud only to manage the config files and more importantly to look after the cluster state. Our

A good way to extract "facets" from json.facet response via solrj?

2016-11-22 Thread Michael Joyner
Hello all, It seems I can't find a "getFacets" method for SolrJ when handling a query response from a json.facet call. I see that I can get a top level opaque object via "Object obj = response.getResponse().get("facets");" Is there any code in SolrJ to parse this out as an easy to use

Re: Frequent mismatch in the numDocs between replicas

2016-11-22 Thread Erick Erickson
The autocommit settings on leaders and replicas can be slightly offset in terms of wall clock time so docs that have been committed on one node may not have been committed on the other. Your comment that you can optimize and fix this is evidence that this is what you're seeing. to test this: 1>

Re: Solr6 CDCR - indexing doc to source replicates to target, doc not searchable in target

2016-11-22 Thread Erick Erickson
With those settings, you never commit the documents on the target, thus they are never searchable on the target. No, I do _not_ recommend you issue a manual commit on the target, that was just a manual test to see if your issue was about commits. I'd just either set openSearcher to true in the

Re: compile solr6.2.1

2016-11-22 Thread Erick Erickson
You said "I can't compile" but then showed us the line for _running_ Solr so I'm really confused what your problem is. So: 1> can you compile? IOW, if you execute "ant server dest" from the /solr directory, does it run to completion? You should see "BUILD SUCCESSFUL" after a few minutes

Re: Multilevel sorting in JSON-facet

2016-11-22 Thread Aman Tandon
any help here? With Regards Aman Tandon On Thu, Nov 17, 2016 at 7:16 PM, Wonderful Little Things < amantandon...@gmail.com> wrote: > Hi, > > I want to do the sorting on multiple fields using the JSON-facet API, so > is this available? And if it is, then what would be the syntax? > > Thanks, >

Re: Solr as am html cache

2016-11-22 Thread Erick Erickson
bq: This seems like it might even be a good approach for creating additional cores primarily for the purpose of caching I think you're making it too complex, especially for such a small data set ;) 1> All the data is memory mapped anyway, so what's not in the JVM will be in the OS's memory

Re: Query parser behavior with AND and negative clause

2016-11-22 Thread Erick Erickson
_How_ does it "not work"? You haven't told us what you expect .vs. what you get back. Plus a sample doc that that violates your expectations (just the dateRange field) would also help. Best, Erick On Tue, Nov 22, 2016 at 4:23 AM, Sandeep Khanzode wrote: >

Re: Solr 6 Performance Suggestions

2016-11-22 Thread Yonik Seeley
It depends highly on what your requests look like, and which ones are slower. If you're request mix is heterogeneous, find the types of requests that seem to have the largest slowdown and let us know what they look like. -Yonik On Tue, Nov 22, 2016 at 8:54 AM, Max Bridgewater

RE: Solr 6 Performance Suggestions

2016-11-22 Thread Prateek Jain J
I am not sure but I heard this in one of discussions, that you cant migrate directly from solr 4 to solr 6. It has to be incremental like solr 4 to solr 5 and then to solr 6. I might be wrong but is worth trying. Regards, Prateek Jain -Original Message- From: Max Bridgewater

Solr 6 Performance Suggestions

2016-11-22 Thread Max Bridgewater
I migrated an application from Solr 4 to Solr 6. solrconfig.xml and schema.xml are sensibly the same. The JVM params are also pretty much similar. The indicces have each about 2 million documents. No particular tuning was done to Solr 6 beyond the default settings. Solr 4 is running in Tomcat

Query parser behavior with AND and negative clause

2016-11-22 Thread Sandeep Khanzode
Hi, I have a simple query that should intersect with dateRange1 and NOT be contained within dateRange2. I have tried the following options: WORKS: +{!field f=dateRange1 op=Intersects v='[2016-11-22T12:01:00Z TO 2016-11-22T13:59:00Z]'} +(*:* -{!field f=dateRange2 op=Contains

Re: How many versions do you stay behind in production for better stability ?

2016-11-22 Thread Naresh Yadav
Please let me know about your conclusion ? i am also in same confusion. On Thu, Nov 17, 2016 at 12:55 PM, Dorian Hoxha wrote: > Hi, > > I see that there is a new release on every lucene release. Do you always > use the latest version since it may have bugs (ex most

Re: Wildcard searches with space in TextField/StrField

2016-11-22 Thread Sandeep Khanzode
Hi Erick, I gave this a try.  These are my results. There is a record with "John D. Smith", and another named "John Doe". 1.] {!complexphrase inOrder=true}name:"John D.*" ... does not fetch any results.  2.] {!complexphrase inOrder=true}name:"John D*" ... fetches both results.  Second

Re: Solr/lucene "planet" + recommendations for blogs to follow

2016-11-22 Thread Alexandre Rafalovitch
I tried weekly. I did not have personal bandwidth for that. It actually takes quite a lot of time to do the newsletter, especially since I also try to update the website (a separate messy/hacky story). And since English is not my first language and writing short copy is harder than a long one :-)

Re: Solr/lucene "planet" + recommendations for blogs to follow

2016-11-22 Thread Dorian Hoxha
Thanks Alex, some kind of weekly newsletter would be great (examples I subscribe to are db weekly, postgresql weekly, redis weekly). If it makes sense, to make it weekly, add some sponsor(targeted) to it, and it should be nicer. Maybe even include es,lucene if there's not enough content or

Re: Solr/lucene "planet" + recommendations for blogs to follow

2016-11-22 Thread Alexandre Rafalovitch
I am not aware of any aggregator like that. And I looked, hard. I, myself, publish a newsletter (Solr Start, in signature, every 2 weeks) that usually has a couple of links to cool Solr stuff I found. Subscribing to newsletter also gives access to full archives... To find the links, I have a

Re: Multiple search-queries in 1 http request ?

2016-11-22 Thread Dorian Hoxha
@Alex Yes, that should also support more efficient serialization(binary) like msgpack etc. On Tue, Nov 22, 2016 at 1:33 AM, Alexandre Rafalovitch wrote: > HTTP 2 and whatever that Google's new protocol is are both into > pipelining over the same connection (HTTP 1.1 too, but

Solr/lucene "planet" + recommendations for blogs to follow

2016-11-22 Thread Dorian Hoxha
Hello searcherers, Is there a solr/lucene "planet" like planet.postgresql.org ? If not, what are some blogs/rss/feeds that I should follow to learn what's happening in the solr/lucene worlds ? Thank You

Re: Using solr(cloud) as source-of-truth for data (with no backing external db)

2016-11-22 Thread Dorian Hoxha
Yeah that looks like the _source that elasticsearch has. On Mon, Nov 21, 2016 at 9:20 PM, Michael Joyner wrote: > Have a "store only" text field that contains a serialized (json?) of the > master object for deserilization as part of the results parsing if you are > wanting