Re: Alphanumeric sort with alphabets first

2017-03-16 Thread Srinivasan Narayanan
Can someone please respond? From: Srinivasan Narayanan Date: Monday, March 13, 2017 at 3:51 PM To: "solr-user@lucene.apache.org" Subject: Alphanumeric sort with alphabets first Hello SOLR experts, I am new to SOLR and I am trying to do

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Aman Deep Singh
I also tried in 5.2.1 for the query http://localhost:8984/solr/test/select?q=TITLE_SH:one\%20plus\%20one=xml=true 0 1 TITLE_SH:one\ plus\ one xml true TITLE_SH:one\ plus\ one TITLE_SH:one\ plus\ one *((TITLE_SH:one plus TITLE_SH:one plus one)/no_coord) TITLE_SH:plus one* (TITLE_SH:one

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Shawn Heisey
On 3/16/2017 1:40 PM, Alexandre Rafalovitch wrote: > Oh. Try your query with quotes around the phone phrase: > q="one plus one" That query with the fieldType the user supplied produces this, on 6.3.0 with the lucene parser: "querystring":"test:\"one plus one\"",

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Aman Deep Singh
No it doesn't work On 17-Mar-2017 8:38 AM, "Alexandre Rafalovitch" wrote: > Which is what I believe you had as a working example in your Dropbox > images. > > So, does it work now? > > Regards, >Alex. > > http://www.solr-start.com/ - Resources for Solr users, new

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Alexandre Rafalovitch
Which is what I believe you had as a working example in your Dropbox images. So, does it work now? Regards, Alex. http://www.solr-start.com/ - Resources for Solr users, new and experienced On 16 March 2017 at 22:22, Aman Deep Singh wrote: > If I give query

Re: Finding time of last commit to index from SolrJ?

2017-03-16 Thread Damien Kamerman
I ended up doing something like this: String core = "collection1_shard1_core1"; ModifiableSolrParams p = new ModifiableSolrParams(); p.set("show", "index"); GenericSolrRequest checkRequest = new GenericSolrRequest(POST, "/../" + core + "/admin/luke", p); NamedList checkResult =

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Aman Deep Singh
If I give query in quotes it converted query in to graph query as Graph(cust_sh6:"one plus one" hasBoolean=false hasPhrase=false) On 17-Mar-2017 1:38 AM, "Alexandre Rafalovitch" wrote: > Oh. Try your query with quotes around the phone phrase: > q="one plus one" > > My

Re: Solr 6.3 will not stay connected to zookeeper

2017-03-16 Thread Shawn Heisey
On 3/15/2017 6:45 PM, Walter Underwood wrote: > I have a pretty good guess what happened. I requested a Zookeeper > 3.4.6 cluster, but they built a 3.4.9 cluster. This is the first I've heard of problems with ZK 3.4.9 on the server side. That would be the server version that I would recommend

Re: SQL JOIN eta

2017-03-16 Thread Joel Bernstein
There isn't a jira issue for this yet. FOr Solr 6.6 there are few important features lined up: 1) SELECT COUNT(DISTINCT) 2) Date/Time function support 3) Arithmetic function support 4) SELECT ... INTO ... Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Mar 14, 2017 at 10:53 PM, Damien

Re: block join - search together at parent and childern

2017-03-16 Thread Mikhail Khludnev
Hello Jan, What if you combine child and parent dismaxes like below q={!edismax qf=$parentfields}foo bar {!parent ..}{!dismax qf=$childfields v=$childclauses}=foo bar +type:child=...& parentfields=... On Thu, Mar 16, 2017 at 10:54 PM, Jan Nekuda wrote: > Hello Mikhail, >

Re: block join - search together at parent and childern

2017-03-16 Thread Jan Nekuda
Hello Mikhail, thanks for fast answer. The problem is, that I want to have the dismax on child and parent together - to have the filter evaluated together. I need to have documents: path: car type:car color:red first_country: CZ name:seat path: car\engine type:engine power:63KW

Re: Exact match works only for some of the strings

2017-03-16 Thread Alvaro Cabrerizo
Hello, I've tested on an old solr 4.3 instance and the schema and the field definition are fine. I've also checked that only the query nameExact:"Guardian EU-referendum" gives the result, the other one you have commented (nameExact:"Guardian US") gives 0 hits. Maybe, you forgot to re-index after

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Alexandre Rafalovitch
Oh. Try your query with quotes around the phone phrase: q="one plus one" My hypothesis is: Query parser splits things on whitespace before passing it down into analyzer chain as individual match attempts. The Analysis UI does not take that into account and treats the whole string as phrase sent.

Re: Get handler not working

2017-03-16 Thread Alexandre Rafalovitch
Well, only router.field is the valid parameter as per https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-CREATE:CreateaCollection In the second case the parameter is ignored and the uniqueKey is used instead, which is different for you. But it is the first case that

Re: block join - search together at parent and childern

2017-03-16 Thread Mikhail Khludnev
Hello, It's hard to get into the problem. but you probably want to have dismax on child level: q={!parent ...}{!edismax qf='childF1 childF2' v=$chq}=foo bar It's usually broken because child query might match parents which is not allowed. Thus, it's probably can solved by adding +type:child into

Re: question about function query

2017-03-16 Thread Mikhail Khludnev
Hello, A function query matches all docs. Use {!frange} if you want to select docs with some particular values. On Thu, Mar 16, 2017 at 6:08 PM, Bernd Fehling < bernd.fehl...@uni-bielefeld.de> wrote: > I'm testing some function queries and have some questions. > > original queries: > 1.

Re: Exact match works only for some of the strings

2017-03-16 Thread Mikhail Khludnev
You can try to check debugQuery to understand how this query is parsed: double quotes hardly compatible with KeywordTokenizer. Also you can check which terms are indexed in SchemaBrowser. Also, there is Analysis page at Solr Admin. On Thu, Mar 16, 2017 at 8:55 PM, Gintautas Sulskus <

Re: Solr 6.3 will not stay connected to zookeeper

2017-03-16 Thread Walter Underwood
Still broken with zk 3.4.6. Even the “solr zk” commands can’t fetch the file. It is there. I can list it. $ bin/solr zk ls /configs/tutors Connecting to ZooKeeper at

Exact match works only for some of the strings

2017-03-16 Thread Gintautas Sulskus
Hi All, I am trying to figure out why Solr returns an empty result when searching for the following query: nameExact:"Guardian EU-referendum" The field definition: The type definition: The analysis, as expected, matches the query parameter against the stored value. Please take

Re: Partial Match with DF

2017-03-16 Thread Mark Johnson
Thank you for the heads up! I think in some cases we will want to strip out punctuation but in others we might need it (for example, "liquid courage." should tokenize to "liquid" and "courage", while "1.5 oz liquid courage" should tokenize to "1.5", "oz", "liquid" and "courage"). I'll have to do

Re: Partial Match with DF

2017-03-16 Thread Mark Johnson
Wow, that's really powerful! Thank you! On Thu, Mar 16, 2017 at 11:19 AM, Charlie Hull wrote: > Hi Mark, > > Open Source Connection's excellent www.splainer.io might also be useful to > help you break down exactly what your query is doing. > > Cheers > > Charlie > > P.S.

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Aman Deep Singh
For images dropbox url is https://www.dropbox.com/sh/6dy6a8ajabjtxrt/AAAoxhZQe2vp3sTl3Av71_eHa?dl=0 On Thu, Mar 16, 2017 at 10:29 PM Aman Deep Singh wrote: > Yes I have reloaded the core after config changes > > > On 16-Mar-2017 10:28 PM, "Alexandre Rafalovitch"

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Aman Deep Singh
Yes I have reloaded the core after config changes On 16-Mar-2017 10:28 PM, "Alexandre Rafalovitch" wrote: Images do not come through. But I was wrong too. You use eDismax and pass "cust_shingle" in, so the "df" value is irrelevant. You definitely reloaded the core after

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Alexandre Rafalovitch
Images do not come through. But I was wrong too. You use eDismax and pass "cust_shingle" in, so the "df" value is irrelevant. You definitely reloaded the core after changing definitions? http://www.solr-start.com/ - Resources for Solr users, new and experienced On 16 March 2017 at 12:37,

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Aman Deep Singh
Already check that i am sending sceenshots of various senarios On Thu, Mar 16, 2017 at 7:46 PM Alexandre Rafalovitch wrote: > Sanity check. Is your 'df' pointing at the field you think it is > pointing at? It really does look like all tokens were eaten and > nothing was

Re: Get handler not working

2017-03-16 Thread Chris Ulicny
I think I've figured out where the issue is, at least superficially. It's in what parameter is used to define the field to route on. I set up two collections to use the same configset but slightly altered calls to the Collections API. action=CREATE=CollectionOne=2=compositeId& *router.field*

question about function query

2017-03-16 Thread Bernd Fehling
I'm testing some function queries and have some questions. original queries: 1. q=collection:ftmuenster=* --> numFound="6029" 2. q=collection:ftmuenster+AND+-description:*=* --> numFound="1877" 3. q=collection:ftmuenster+AND+description:*=* --> numFound="4152" This looks good. But now with

Re: Partial Match with DF

2017-03-16 Thread Charlie Hull
Hi Mark, Open Source Connection's excellent www.splainer.io might also be useful to help you break down exactly what your query is doing. Cheers Charlie P.S. planning a blog soon listing 'useful Solr tools' On 16 March 2017 at 14:39, Mark Johnson wrote: >

Re: Partial Match with DF

2017-03-16 Thread Erick Erickson
Yeah, they've saved me on numerous occasions, glad to see they helped. One caution BTW when you start changing fieldTypes is you have to watch punctuation. StandardTokenizerFactory won't pass through most punctuation. WordDelimiterFilterFactory breaks on non alpha-num, including punctuation

Re: Get handler not working

2017-03-16 Thread Yonik Seeley
Ah, yeah, if you're using a different route field it's highly likely that's the issue. I was always against that "feature", and this thread demonstrates part of the problem (complicating clients, including us human clients trying to make sense of what's going on). -Yonik On Thu, Mar 16, 2017 at

Re: Partial Match with DF

2017-03-16 Thread Mark Johnson
You're right! The fields I'm searching are all "string" type. I switched to "text_en" and now it's working exactly as I need it to! I'll do some research to see if "text_en" or another "text" type field is best for our needs. Also, those debug options are amazing! They'll help tremendously in the

Re: Get handler not working

2017-03-16 Thread Chris Ulicny
Speaking of routing, I realized I completely forgot to add the routing setup to the test cloud, so it probably has something to do with the issue. I'll add that in and report back. So the routing and uniqueKey setup is as follows: Schema setup: iqdocid I don't think it's mentioned in the

Re: Get handler not working

2017-03-16 Thread Alexandre Rafalovitch
Does real time get implementation reroutes the request internally to a different shard? If not, then maybe the request is going to a non-primary shard. Regards, Alex. http://www.solr-start.com/ - Resources for Solr users, new and experienced On 16 March 2017 at 09:33, Yonik Seeley

Re: DIH delta import with cache 5.3.1 issue

2017-03-16 Thread Sujay Bawaskar
Thanks Alex. I will test it with 5.4 and 6.4 and let you know. On Thu, Mar 16, 2017 at 7:40 PM, Alexandre Rafalovitch wrote: > You have nested entities and accumulate the content of the inner > entities in the outer one with caching on an inner one. Your > description sounds

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Alexandre Rafalovitch
Sanity check. Is your 'df' pointing at the field you think it is pointing at? It really does look like all tokens were eaten and nothing was left. But you should have seen that in the Analysis screen too, if you have the right field. Try adding echoParams=all to your request to see the full final

Re: DIH delta import with cache 5.3.1 issue

2017-03-16 Thread Alexandre Rafalovitch
You have nested entities and accumulate the content of the inner entities in the outer one with caching on an inner one. Your description sounds like the inner cache is not reset on the next iteration of the outer loop. This may be connected to https://issues.apache.org/jira/browse/SOLR-7843

Re: Partial Match with DF

2017-03-16 Thread Erick Erickson
My guess: Your analysis chain for the fields is different, i.e. they have a different fieldType. In particular, watch out for the "string" type, people are often confused about it. It does _not_ break input into tokens, you need a text-based field type, text_en is one example that is usually in

Re: Solr shingles is not working in solr 6.4.0

2017-03-16 Thread alessandro.benedetti
Hi Aman, are you using stopword in your analysis by any chance ? Can you show us your request handler config ? With the edismax you can configure stopwords to take effect at query parsing stage. Let's try to figure it out first. Cheers - --- Alessandro Benedetti Search

Fwd: block join - search together at parent and childern

2017-03-16 Thread Jan Nekuda
Hi, I have a question for which I wasn't able to find a good solution. I have this structure of documents A |\ | \ B \ \ C \ \ \ D Document type A has fields id_number, date_from, date_to Document type C has fields first_name, surname, birthdate

Re: Partial Match with DF

2017-03-16 Thread Mark Johnson
Oh, great! Thank you! So if I switch over to eDisMax I'd specify the fields to query via the "qf" parameter, right? That seems to have the same result (only matches when I specify the exact phrase in the field, not just certain words from it). On Thu, Mar 16, 2017 at 9:33 AM, Alexandre

Re: Get handler not working

2017-03-16 Thread David Hastings
i still would like to see an experiment where you change the field to id instead of iqdocid, On Thu, Mar 16, 2017 at 9:33 AM, Yonik Seeley wrote: > Something to do with routing perhaps? (the mapping of ids to shards, > by default is based on hashes of the id) > -Yonik > > >

Re: Get handler not working

2017-03-16 Thread Yonik Seeley
Something to do with routing perhaps? (the mapping of ids to shards, by default is based on hashes of the id) -Yonik On Thu, Mar 16, 2017 at 9:16 AM, Chris Ulicny wrote: > iqdocid is already set to be the uniqueKey value. > > I tried reindexing a few documents back into the

Re: Partial Match with DF

2017-03-16 Thread Alexandre Rafalovitch
df is default field - you can only give one. To search over multiple fields, you switch to eDisMax query parser and fl parameter. Then, the question will be what type definition your fields have. When you search text field, you are using its definition because of copyField. Your original fields

RE: Group by range results

2017-03-16 Thread Mikhail Ibraheem
Any help on this please?   From: Mikhail Ibraheem Sent: 15 مارس, 2017 08:53 م To: solr-user@lucene.apache.org Subject: Group by range results   Hi,  Can we group by ranges? something like: facet=true stats=true stats.field={!tag=piv1 min=true max=true}price

Re: Get handler not working

2017-03-16 Thread Alexandre Rafalovitch
If you have the test bed, could you just enable full trace log mode and run two most similar tests. Then look for log difference. It sounds like a bug, but of what kind...? Regards, Alex On 16 Mar 2017 9:16 AM, "Chris Ulicny" wrote: > iqdocid is already set to be the

Re: DIH delta import with cache 5.3.1 issue

2017-03-16 Thread Sujay Bawaskar
This behaviour is for delta import only. One document get field values of all documents. These fields are child entities which maps column to multi valued fields. On Thu, Mar 16, 2017 at 6:35 PM, Alexandre Rafalovitch wrote: > Could you give a

Solr shingles is not working in solr 6.4.0

2017-03-16 Thread Aman Deep Singh
Hi, Recently I migrated from solr 4 to 6 IN solr 4 shinglefilterfactory is working correctly my configration i But after updating to solr 6 shingles is not working

DbVisualizer challenges with a secured solr

2017-03-16 Thread Marvin NotMyRealNameDuh
Hi, I'm working with a product which includes solr under the covers, and this has been secured using a custom authentication scheme. The admin UI on port 8983 works correct once authenticated. I've also hacked the zkcli.sh script thusly:

Re: Get handler not working

2017-03-16 Thread Chris Ulicny
iqdocid is already set to be the uniqueKey value. I tried reindexing a few documents back into the problematic cloud and am getting the same behavior of no document found for get handler. I've also done some testing on standalone instances as well as some quick cloud setups (with embedded zk),

Partial Match with DF

2017-03-16 Thread Mark Johnson
Forgive me if I'm missing something obvious -- I'm new to Solr, but I can't seem to find an explanation for the behavior I'm seeing. If I have a document that looks like this: { field1: "aaa bbb", field2: "ccc ddd", field3: "eee fff" } And I do a search where "q" is "aaa ccc", I get

Re: DIH delta import with cache 5.3.1 issue

2017-03-16 Thread Alexandre Rafalovitch
Could you give a bit more details. Do you mean one document gets the content of multiple documents? And only on delta? Regards, Alex On 16 Mar 2017 8:53 AM, "Sujay Bawaskar" wrote: Hi, We are using DIH with cache(SortedMapBackedCache) with solr 5.3.1. We have

DIH delta import with cache 5.3.1 issue

2017-03-16 Thread Sujay Bawaskar
Hi, We are using DIH with cache(SortedMapBackedCache) with solr 5.3.1. We have around 2.8 million documents in solr and total index size is 4 GB. DIH delta import is dumping all values of mapped columns to their respective multi valued fields. This is causing size of one solr document upto 2 GB.

Re: fq performance

2017-03-16 Thread Shawn Heisey
On 3/16/2017 6:02 AM, Ganesh M wrote: > We have 1 million of documents and would like to query with multiple fq > values. > > We have kept the access_control ( multi value field ) which holds information > about for which group that document is accessible. > > Now to get the list of all the

Re: fq performance

2017-03-16 Thread Michael Kuhlmann
First of all, from what I can see, this won't do what you're expecting. Multiple fq conditions are always combined using AND, so if a user is member of 100 groups, but the document is accessible to only 99 of them, then the user won't find it. Or in other words, if you add a user to some

fq performance

2017-03-16 Thread Ganesh M
Hi, We have 1 million of documents and would like to query with multiple fq values. We have kept the access_control ( multi value field ) which holds information about for which group that document is accessible. Now to get the list of all the documents of an user, we would like to pass

sum multivalued field index with banana

2017-03-16 Thread tkg_cangkul
hi sorry if this a little bit out ouf topic, i've just started to using banana dashboard. and i want to do summarize proccess from data that indexed in solr can i do sum proccess with banana dashboard when i have some multivalued data index on my field? this is my sample data on solr :

Re: Index corruption with replication

2017-03-16 Thread santosh sidnal
Hi Erik/David, Schema is same on both live and stage servers. We are using the same schema files on the stage and live files. - Schema files are included in replication but these are not being changed whenever we are observing schema corruption issue. - My guess is that because of