RE: deep paging in parallel sql

2017-09-06 Thread Imran Rajjad
My only concern is the performance as the cursor moves forward in resultset with approximately 2 billion records Regards, Imran Sent from Mail for Windows 10 From: Joel Bernstein Sent: Wednesday, September 6, 2017 7:04 PM To: solr-user@lucene.apache.org Subject: Re: deep paging in parallel sql

Re: Consecutive calls to a query give different results

2017-09-06 Thread Erick Erickson
bq: and deleted documents are irrelevant to term statistics... Did you mean "relevant"? Or do I have to adjust my thinking _again_? Erick On Wed, Sep 6, 2017 at 7:48 PM, Yonik Seeley wrote: > Different replicas of the same shard can have different numbers of > deleted

Re: Consecutive calls to a query give different results

2017-09-06 Thread Yonik Seeley
Different replicas of the same shard can have different numbers of deleted documents (really just marked as deleted), and deleted documents are irrelevant to term statistics (like the number of documents a term appears in). Documents marked for deletion stop contributing to corpus statistics when

Re: Unified highlighter returns an error when hl.fl param has undefined fields

2017-09-06 Thread Yasufumi Mizoguchi
Hi Shawn, Thank you for your reply. > that sounds like a bug in the argument parser that needs to be fixed. I have created a JIRA about this. https://issues.apache.org/jira/browse/SOLR-11334 Thanks, Yasufumi On 2017/09/06 9:48 PM, Shawn Heisey wrote: On 9/4/2017 9:49 PM, Yasufumi

Re: Customizing JSON response of a query

2017-09-06 Thread Rick Leir
Sarvo, I hope the users do not read JSON. I would have thought you'd have a web app in front of Solr and some Javascript in the browser. Either would be able to transform Solr's output into a display format. But I suspect there is more to the problem, and I do not understand it all. Cheers --

Consecutive calls to a query give different results

2017-09-06 Thread Webster Homer
I am using Solr 6.2.0 configured as a solr cloud with 2 shards and 4 replicas (total of 4 nodes). If I run the query multiple times I see the three different top scoring results. No data load is running, all data has been commited I get these three different hits with their scores:

Re: Bulk query Apache Solr

2017-09-06 Thread Erick Erickson
Yes, but that'll be expensive. Use the TermsQueryParser, that's what it's built for here: https://lucene.apache.org/solr/guide/6_6/other-parsers.html Note the plural, TermQueryParser only takes a single value, TermsQueryParser can take a list. Best, Erick On Wed, Sep 6, 2017 at 1:01 PM, Deeksha

Re: NumberFormatException for multvalue, pint

2017-09-06 Thread Erick Erickson
You're making a common mistake as to the meaning of multiValued. The input doc should look something like (xml format) 1 2 Each "mv_int_field" is a separate, complete single integer. But there can be a many of them. when you specify 1,2,3 you're telling Solr that the

Re: Customizing JSON response of a query

2017-09-06 Thread Sarvothaman Madhavan
Rick, My use case is this : I have a set of documents each of which have "sub documents" associated with it. I have this in the json format and I am able to load this into a solr collection. When I search within this set of documents using solr, I want the response in "grouped" json format i.e

Re: NumberFormatException for multvalue, pint

2017-09-06 Thread Yonik Seeley
On Wed, Sep 6, 2017 at 4:09 PM, Steve Pruitt wrote: > Can't get a multi-valued pint field to update. > > The schema defines the field: multiValued="true" required="false" docValues="true" stored="true"/> > > I get the exception on this input: 7780386,7313483 > > Caused

NumberFormatException for multvalue, pint

2017-09-06 Thread Steve Pruitt
Can't get a multi-valued pint field to update. The schema defines the field: I get the exception on this input: 7780386,7313483 Caused by: java.lang.NumberFormatException: For input string: "7780386, 7313483" at

Bulk query Apache Solr

2017-09-06 Thread Deeksha Sharma
Hi, I indexed documents in Solr using dataImportHandler. Now when I want to query using the below URL, it gives me the results i want. http://localhost:8983/solr/mycore/select?indent=on=id:7fd326e23ffa8d1cb9c0a7b4fc5c4269=json Can Solr handle bulk queries if I send over more than 10,000 ids

RE: Customizing JSON response of a query

2017-09-06 Thread Rick Leir
Sarvo, What are you trying to achieve? Describe the use case. Cheers -- Rick On September 6, 2017 12:36:08 PM EDT, "Davis, Daniel (NIH/NLM) [C]" wrote: >It should be possible with a custom response handler. > >-Original Message- >From: Sarvothaman Madhavan

Solr with Alluxio

2017-09-06 Thread Shashank Pedamallu
Hi, I’m trying to access index files of a core stored in S3 by using Alluxio with Solr. Did anyone try integrating Solr with Alluxio? Can someone give me any pointers? Also, I’ve come across this session in the Solr Conference around next week -

RE: Customizing JSON response of a query

2017-09-06 Thread Davis, Daniel (NIH/NLM) [C]
It should be possible with a custom response handler. -Original Message- From: Sarvothaman Madhavan [mailto:relad...@gmail.com] Sent: Wednesday, September 06, 2017 10:17 AM To: solr-user@lucene.apache.org Subject: Customizing JSON response of a query Hello all, After a week of research

Re: Could not find configName error

2017-09-06 Thread Erick Erickson
Ah, then you don't have the bin/solr scripts. There are zkCli and zkcli scripts that will allow you to get/put the config files, see the manual. I recommend you download the reference guide for 4.10 from here: http://archive.apache.org/dist/lucene/solr/ref-guide/ Best, Erick On Tue, Sep 5, 2017

Re: write.lock file appears and solr wont open

2017-09-06 Thread Erick Erickson
Or only catch the specific exception and only swallow that? But yeah, this is something that should change as I see this "in the field" and a more specific error message would short-circuit a lot of unnecessary pain. see: LUCENE-7959 Erick On Wed, Sep 6, 2017 at 5:49 AM, Shawn Heisey

Re: facet query when using word 'AND'

2017-09-06 Thread Erick Erickson
I typed the below then noticed that the field that has "I have a pen AND an apple" is called "body" and you're faceting and searching on a field called "suggest". The below is still relevant if there is still a problem though ;) Your problem isn't faceting, right? It's that you aren't matching

Re: Solr list operator

2017-09-06 Thread Erick Erickson
You'll have to split up the input on commas if you don't just do it the multiValued way Walter suggests, perhaps one of the pattern tokenizers mentioned here: https://cwiki.apache.org/confluence/display/solr/Tokenizers Best, Erick On Wed, Sep 6, 2017 at 6:29 AM, Walter Underwood

Customizing JSON response of a query

2017-09-06 Thread Sarvothaman Madhavan
Hello all, After a week of research I've come to the conclusion that there is no mechanism within solr where I can create a nested json response like this: https://pastebin.com/XavvUP94 . I am able to get something like this https://pastebin.com/FeXRqG59. 1. Am I right in assuming that within solr

Re: deep paging in parallel sql

2017-09-06 Thread Joel Bernstein
Parallel SQL supports unlimited SELECT statements which return the entire result set. The documentation discusses the differences between the limited and unlimited SELECT statements. Other then the LIMIT clause there is not yet support for paging. Joel Bernstein http://joelsolr.blogspot.com/ On

Re: Streaming expression API innerJoin on multi-valued field

2017-09-06 Thread Joel Bernstein
The cartesianProduct Stream can be wrapped around the stream with the multi-value field. The cartesianProduct function is available in Solr 6.6 but since this was a late addition the documentation does not appear to Solr 7.0. Here is a link to the docs in github:

Re: Solr list operator

2017-09-06 Thread Walter Underwood
Use a multivalued field. Search for listOfIds:1. Or search for listOfIds:33. This is one of the simplest things that Solr can do. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Sep 6, 2017, at 6:07 AM, Susheel Kumar wrote:

Re: facet query when using word 'AND'

2017-09-06 Thread Shawn Heisey
On 9/6/2017 3:48 AM, Noriyuki TAKEI wrote: > I use facet query,but I found it dose not work when using 'AND'. > > I woud like to use facet query using 'AND' as not Operator but simple word. With the standard or edismax parser, AND in all uppercase is interpreted as an operator.  There are two

deep paging in parallel sql

2017-09-06 Thread Imran Rajjad
Dear list, Is it possible to enable deep paging when querying data through Parallel SQL? Regards, Imran Sent from Mail for Windows 10

Re: Solr list operator

2017-09-06 Thread Susheel Kumar
Nick, checkout terms query parser http://lucene.apache.org/solr/guide/6_6/other-parsers.html or streaming expressions. Thnx On Wed, Sep 6, 2017 at 8:33 AM, alex goretoy wrote: > https://www.youtube.com/watch?v=pNe1wWeaHOU= > PLYI8318YYdkCsZ7dsYV01n6TZhXA6Wf9i=1 >

Re: Solr6.6 Issue/Bug

2017-09-06 Thread Susheel Kumar
Try to utilize the steps mentioned here at http://lucene.apache.org/solr/guide/6_6/taking-solr-to-production.html On Wed, Sep 6, 2017 at 3:52 AM, Michael Kuhlmann wrote: > Why would you need to start Solr as root? You should definitely not do > this, there's no reason for that.

Re: write.lock file appears and solr wont open

2017-09-06 Thread Shawn Heisey
On 9/4/2017 5:53 PM, Erick Erickson wrote: > Gah, thanks for letting us know. I can't tell you how often > permissions issues have tripped me up. You're right, it does seem like > there could be a better error message though. I see this code in NativeFSLockFactory, code that completely ignores

Re: Unified highlighter returns an error when hl.fl param has undefined fields

2017-09-06 Thread Shawn Heisey
On 9/4/2017 9:49 PM, Yasufumi Mizoguchi wrote: > I understood what you are saying. However, at least, I think it > strange that UnifiedSolrHighlighter > returns the same error when choosing ", " as the field delimiter in > hl.fl (e.g. hl.fl=name,%20manu). > This is because UnifiedSolrHighlighter

Re: Solr list operator

2017-09-06 Thread alex goretoy
https://www.youtube.com/watch?v=pNe1wWeaHOU=PLYI8318YYdkCsZ7dsYV01n6TZhXA6Wf9i=1 https://www.youtube.com/watch?v=pNe1wWeaHOU=PLYI8318YYdkCsZ7dsYV01n6TZhXA6Wf9i=1 http://audiobible.life CHECK IT OUT! On Wed, Sep 6, 2017 at 5:57 PM, Nick Way wrote: > Hi, I have a

Solr list operator

2017-09-06 Thread Nick Way
Hi, I have a custom field "listOfIDs" = "1,2,4,33" I want the equivalent of: select * where '1' IN (listOfIDs) --> should get a match select * where '33' IN (listOfIDs) --> should get a match select * where '3' IN (listOfIDs) --> should NOT get a match Can anyone help me out please as I

facet query when using word 'AND'

2017-09-06 Thread Noriyuki TAKEI
Hi,all I use facet query,but I found it dose not work when using 'AND'. I woud like to use facet query using 'AND' as not Operator but simple word. At first,Solr Config is as below. suggest_dict solr.Suggester AnalyzingLookupFactory suggest suggest_ja

Streaming expression API innerJoin on multi-valued field

2017-09-06 Thread Marc Röttig
Dear SOLR users, I want to use streaming expression innerJoin using a multi-valued field to do the join by equality, that is having any child documents (of type "child") and one parent document (of type "parent") join these according to equality of id_s and children_ids Parent * id_s = "p123"

Re: Phrase boosting on multiple fields

2017-09-06 Thread ANNAMANENI RAVEENDRA
Just pass qf=field1,field2,field3=field1,firld2,field3 Like that you can add as many field as you want On Wed, 6 Sep 2017 at 2:41 AM, ritesh kumar wrote: > I have a situation where I have to apply phrase boosting on multiple > fields. I am using Edismax as query

Re: Solr6.6 Issue/Bug

2017-09-06 Thread Michael Kuhlmann
Why would you need to start Solr as root? You should definitely not do this, there's no reason for that. And even if you *really* want this: What's so bad about the -force option? -Michael Am 06.09.2017 um 07:26 schrieb Kasim Jinwala: > Dear team, > I am using solr 5.0 last 1 year,

Re: Could not find configName error

2017-09-06 Thread Wael Kader
i am using SOLR 4.10.3 I am not sure I have them in source control. I don't actually know what that is. I am using SOLR on a pre-setup VM. On Tue, Sep 5, 2017 at 5:26 PM, Erick Erickson wrote: > What version of Solr? > > bin/solr zk -help > > In particular upconfig

Phrase boosting on multiple fields

2017-09-06 Thread ritesh kumar
I have a situation where I have to apply phrase boosting on multiple fields. I am using Edismax as query parser. For instance, I am accepting a keyword (phrase) from the user and I want the doc with the exact phrase to be on the top of the resultant list. The problem is, there are multiple

Solr6.6 Issue/Bug

2017-09-06 Thread Kasim Jinwala
Dear team, I am using solr 5.0 last 1 year, now we are planning to upgrade solr 6.6. While trying to start solr using root user, we need to pass -force parameter to start solr forcefully, please help to start solr using root user without -force command. Regards Kasim J.