Re: Question regarding the SQL interface

2016-05-19 Thread Joel Bernstein
I just reviewed the testPredicate method in the test cases: https://github.com/apache/lucene-solr/blob/master/solr/core/src/test/org/apache/solr/handler/TestSQLHandler.java All the test cases in testPredicate() are formatted like regular SQL. I don't think the way things are designed you could

Re: Stemming nouns ending in 'y'

2016-05-19 Thread Erick Erickson
Mark: Just a sanity check, was the indexing porter stemmer defined when you indexed your _first_ document? The admin/analysis page will tell you what the term is stemmed to at both query and index time. I'm puzzled by this statement: bq: As example, the term 'osteopathy' stemmed with the

calculate average memory per document

2016-05-19 Thread vitaly bulgakov
Hi, I have solr 4.2 I am wondering if it is possible to compute an average memory per document in my index. -- View this message in context: http://lucene.472066.n3.nabble.com/calculate-average-memory-per-document-tp4277865.html Sent from the Solr - User mailing list archive at Nabble.com.

Fw: Select distinct multiple fields

2016-05-19 Thread thiaga rajan
Thanks Joel for the response. In our requirement there is some logic that needs to be implemented after fetching the results from solr which might have an impact in working out the pagination ie, we have data structures like(nested structure is flattened) we need to have this kind of

Question regarding the SQL interface

2016-05-19 Thread Vachon , Jean-Sébastien
Hi all, I am planning into migrating our application from SolrJ to the SQL interface and I have some questions regarding some of Solr features… * How can we specify multiple search fields on a keyword. Do we have to handle everything by ourselves like in regular SQL? SELECT x,y,z FROM

RE: Stemming nouns ending in 'y'

2016-05-19 Thread Markus Jelsma
Hello - try the KStem filter. It is better suited for english and doesn't show this behaviour. Markus -Original message- > From:Mark Vega > Sent: Thursday 19th May 2016 19:55 > To: solr-user@lucene.apache.org > Subject: Stemming nouns ending in 'y' > > I am using

Re: puzzling StemmerOverrideFilterFactory

2016-05-19 Thread Shawn Heisey
On 5/19/2016 5:26 AM, Dmitry Kan wrote: > On query side, right above SOF there is SynonymFilter (SF is not present on > indexing). It does the following: > organization -> organization, organisation > > SOF turns this pair into: organiz, organis. Can you put the field and fieldType definitions,

Re: Inconsistent Solr document count on Target clouds when replicating data in Solr6 CDCR

2016-05-19 Thread Renaud Delbru
Hi Dmitry, You can activate debug log and see more information, such as the number of documents replicated by the cdcr replicator thread, etc. However, I think that the issue is that indexes on the target instances are not refreshed, and therefore some of the documents indexed not yet

Stemming nouns ending in 'y'

2016-05-19 Thread Mark Vega
I am using Apache Nutch v1.10 and SOLR v.5.2.1 to index and search a medical website and am trying to find out why every stemmer I've tried on certain nouns in medical terminology ending in 'y' merely replaces the ending 'y' with an 'I'. As example, the term 'osteopathy' stemmed with the

Re: Select distinct multiple fields

2016-05-19 Thread Joel Bernstein
https://cwiki.apache.org/confluence/display/solr/Parallel+SQL+Interface?focusedCommentId=62697742#ParallelSQLInterface-SELECTDISTINCTQueries Joel Bernstein http://joelsolr.blogspot.com/ On Thu, May 19, 2016 at 1:10 PM, Joel Bernstein wrote: > The SQL interface and Streaming

Re: Select distinct multiple fields

2016-05-19 Thread Joel Bernstein
The SQL interface and Streaming Expressions support selecting multiple distinct fields. The SQL interface can use the JSON facet API or MapReduce to provide the results. You the facet function and unique function are the Streaming Expressions that the SQL interface calls. Joel Bernstein

Inconsistent Solr document count on Target clouds when replicating data in Solr6 CDCR

2016-05-19 Thread dmitry.medvedev
I've come across a weird problem which I'm trying to debug at the moment, and was just wondering if anyone has stumbled across it too: I have an active-passive-passive configuration (1 Source cloud, 2 targets), and NOT all the documents are being replicated to the target clouds. Example: 3

Select distinct multiple fields

2016-05-19 Thread thiaga rajan
Hi Team - I have seen select distinct multiple fields is not possible in Solr and i have seen suggestions coming up on faceting and grouping. I have some questions. Is there any with any kind of plugins/custom implementation we can achieve the same 1. Using any plugin or through custom

Re: SolrCloud replicas consistently out of sync

2016-05-19 Thread Jeff Wartes
That case related to consistency after a ZK outage or network connectivity issue. Your case is standard operation, so I’m not sure that’s really the same thing. I’m aware of a few issues that cam happen if ZK connectivity goes wonky, that I hope are fixed in SOLR-8697. This one might be a

Re: SolrCloud replicas consistently out of sync

2016-05-19 Thread Aleksey Mezhva
Bump. this thread is with someone having a similar issue: https://mail-archives.apache.org/mod_mbox/lucene-solr-user/201601.mbox/%3c09fdab82-7600-49e0-b639-9cb9db937...@yahoo.com%3E It seems like this is not really fixed in 5.4/6.0? Aleksey From: Steve Weiss Date:

Solr join between documents

2016-05-19 Thread elisabeth benoit
Hello all, I was wondering if there was a solr solution for a problem I have (and I'm not the only one I guess) We use solr as a search engine for addresses. We sometimes have requests with let's say for instance street A close to street B City postcode I was wondering if some kind of join

Re: Solrj 4.7.2 - slowing down over time

2016-05-19 Thread Ahmet Arslan
Hi, EmbeddedSolrServer bypass the servlet container. Please see : http://find.searchhub.org/document/a88f669d38513a76 On Thursday, May 19, 2016 6:23 PM, Roman Slavik wrote: Hi Ahmet, thanks for your response, I appreciate it. I thought that EmbeddedSolrServer is just

Re: Solrj 4.7.2 - slowing down over time

2016-05-19 Thread Roman Slavik
Hi Ahmet, thanks for your response, I appreciate it. I thought that EmbeddedSolrServer is just wrapper around Solr core functionality. Solr 4.7.2 is (was?) distributed as war file and I didn't found any mention about compatibility problem with Tomcat. Maybe with jetty it would work slightly

Get documents having a boolean field:false or not having the field at all

2016-05-19 Thread Sebastian Riemer
Hi, I've introduced a new boolean field "is_deleted_b_ns" on my objects which I index with Solr. I am using dynamic field definitions ("b" indicating Boolean, "ns" for "not stored"). Since the field did not exist while the index was built, none of my documents currently has that field

Re: Solrj 4.7.2 - slowing down over time

2016-05-19 Thread Roman Slavík
Hi, thanks for your response! We use javamelody for some basic statistics about app. Here are some graphs from last 24 hours: http://imgur.com/a/OQxnb First graph is memory used by application. Second graph shows how seach time rapidly increased. At 13:40 there was neccessary app restart and at

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-05-19 Thread Abdel Belkasri
Hi Renaud, I was not reloading the collection, but I just did. It didn't help. The error is always the same: - *gettingstarted_shard1_replica2:* org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error Instantiating Update Handler, solr.DirectUpdateHandler2 failed

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-05-19 Thread Abdel Belkasri
Thanks Renaud. For me I did this: 1) I created solr cloud using the interactive mode (accepting most default): $ bin/solr -e cloud I do that for both the DataCenter1 (DC1) and DataCenter2 (DC2) (in fact both are on the same machine, just different ports) By now both clouds have a collection

Re: Specifying dynamic field type without polluting actual field names with type indicators

2016-05-19 Thread Steve Rowe
Peter, It’s an interesting idea. Could you make a Solr JIRA? I don’t know where the field type specification would go, but providing a mechanism to specify field type for previously non-existent fields, outside of the field names themselves, seems useful. In the meantime, do you know about

Re: Sorting on child document field.

2016-05-19 Thread Pranaya Behera
Example would be: Lets say that I have a product document with regular fields as name, price, desc, is_parent. it has child documents such as CA:: fields as a,b,c,rank and another child document as CB:: fields as x,y,z. I am using the query where {!parent which="is_parent:true"}a:some AND

Re: Need Help with Solr 6.0 Cross Data Center Replication

2016-05-19 Thread Renaud Delbru
Hi Abdel, have you reloaded the collection [1] after uploading the configuration to zookeeper ? [1] https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-api2 -- Renaud Delbru On 16/05/16 17:29, Abdel Belkasri wrote: Thanks Renaud. Here is my setup: 1- I have

Creating dynamic field, but strip the type indicator postfix from the name

2016-05-19 Thread Horváth Péter Gergely
Hi Everyone, I am wondering if it is possible to store dynamic fields without the type indicator postfix. In our Solr environment, I would like to 1.) use dynamic fields ("data drivern collections" with no fixed fields specified in advance) 2.) be able to specify the field type, but without

RE: Need Help with Solr 6.0 Cross Data Center Replication

2016-05-19 Thread Satvinder Singh
Hi, So this is what I did: I created solr as a service. Below are the steps I followed for that:-- $ tar xzf solr-X.Y.Z.tgz solr-X.Y.Z/bin/install_solr_service.sh --strip-components=2 $ sudo bash ./install_solr_service.sh solr-X.Y.Z.tgz -i /opt/solr1 -d /var/solr1 -u solr -s solr1 -p

Re: SolrCloud 6 Join Stream and pagination

2016-05-19 Thread Joel Bernstein
Currently there isn't a way to page the results. There is a jira ticket to support this for SQL: https://issues.apache.org/jira/browse/SOLR-9078 This will be implemented first as a Streaming Expression, so it's likely to be available soon. It should be straightforward to implement the offset()

Determine Containing Handler

2016-05-19 Thread Max Bridgewater
Hi, I am implementing a component that needs to redirect calls to the handler that originally called it. Say the call comes to handler /search, the component would then do some processing and, alter the query and then send the query back to /search again. It works great. The only issue is that

Re: puzzling StemmerOverrideFilterFactory

2016-05-19 Thread Dmitry Kan
On query side, right above SOF there is SynonymFilter (SF is not present on indexing). It does the following: organization -> organization, organisation SOF turns this pair into: organiz, organis. On Thu, May 19, 2016 at 2:18 PM, Markus Jelsma wrote: > Hello - is

RE: puzzling StemmerOverrideFilterFactory

2016-05-19 Thread Markus Jelsma
Hello - is there a KeywordRepeatFilterFactory above the StemmrOverride? That would explain it. M. -Original message- > From:Dmitry Kan > Sent: Thursday 19th May 2016 13:08 > To: solr-user@lucene.apache.org > Subject: Re: puzzling StemmerOverrideFilterFactory >

Suspicious message with attachment

2016-05-19 Thread help
The following message addressed to you was quarantined because it likely contains a virus: Subject: Re: Need Help with Solr 6.0 Cross Data Center Replication From: Renaud Delbru However, if you know the sender and are expecting an attachment, please reply to this

Re: puzzling StemmerOverrideFilterFactory

2016-05-19 Thread Dmitry Kan
Hi, Yes, I have checked the analysis page and there everything is logical, stemming is done as expected. So by analysis page the search should not return anything. On Thu, May 19, 2016 at 12:14 PM, Markus Jelsma wrote: > Hello - that sounds odd indeed. Did you check

Re: Sorting on child document field.

2016-05-19 Thread Pranaya Behera
While searching in the lucene code base I found /ToParentBlockJoinSortField /but its not in the solr or even in solrj as well. How would I use it with solrj as I can't find anything to query it through the UI. On Thursday 19 May 2016 11:29 AM, Pranaya Behera wrote: Hi, How can I sort

Re: Highlighting phone numbers

2016-05-19 Thread marotosg
Thanks. Using the debug query returns the info I need. -- View this message in context: http://lucene.472066.n3.nabble.com/Highlighting-phone-numbers-tp4277491p4277712.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: [scottchu] How to specify multiple zk nodes using solrstartcommand under Windows

2016-05-19 Thread scott.chu
I find a way to stop zk nodes peacefully under Windows. If you start zk nodes in order of 1,2,3 then you should stop them in reverse order, i.e. 3,2,1 Thus you can stop process peacefully without any errors. Hope this help people! scott.chu,scott@udngroup.com 2016/5/19 (週四) - Original

Hostname of Solr server in Velocity template?

2016-05-19 Thread Alex Ott
Hello I have the code that need to work with multiple Solr instances. Code receives the REST API call initiated from the UI generated by Solr from Velocity template, and I need to specify the hostname of the server that initiated this call. But I can't find what parameter I can use to get the

RE: puzzling StemmerOverrideFilterFactory

2016-05-19 Thread Markus Jelsma
Hello - that sounds odd indeed. Did you check query and indexing analysis? M. -Original message- > From:Dmitry Kan > Sent: Thursday 19th May 2016 9:36 > To: solr-user@lucene.apache.org > Subject: puzzling StemmerOverrideFilterFactory > > Hello! > > Puzzling

Re: Specifying dynamic field type without polluting actual field names with type indicators

2016-05-19 Thread Horváth Péter Gergely
Hi Steve, Yes, I know the schema API, however I do not want to specify the field type problematically for every single field. I would like to be able to specify the field type when it is being added (similar to the name postfixes, but without affecting the field names). Thanks, Peter

Re: Hierarchial Support - Solr

2016-05-19 Thread Charlie Hull
On 18/05/2016 17:55, thiaga rajan wrote: Hi Team, We are exploring solr for one of our project as a search engine. It was a really a great tool around indexing and response time. While we are exploring we got the below questions and understandings. Kindly confirm the same. We are

puzzling StemmerOverrideFilterFactory

2016-05-19 Thread Dmitry Kan
Hello! Puzzling case: there is a on query side, but not indexing. One rule is mapping organization onto organiz (on query). On indexing SnowballPorterFilterFactory will stem organization to organ. Still searching with organization finds it in the index. Anybody has an idea why this happens?

SolrCloud 6 Join Stream and pagination

2016-05-19 Thread Roshan Kamble
Hello, I am using Solr 6 in cloud mode. In order to search within different collections I am using InnerJoinStream. (using qt=export in order to get correct result) Is there any way to get paginated result? Regards, Roshan The information in this email is

How to stop searches to solr while full data import is going in SOLR

2016-05-19 Thread preeti kumari
Hi, I am using solr 5.2.1. I have two clusters Primary A and Primary B. I was pinging servers to check whether they are up or not to route the searches to working cluster A or B. But while I am running Full data import in Primary cluster A , There is not all the data and pinging servers will not

Re: Sub faceting on string field using json facet runs extremly slow

2016-05-19 Thread Vijay Tiwary
Can somebody confirm whether the jira SOLR-8096 will affect json facet also as I see sub faceting using term facet on string field is ruuning 5x slower than on integer field for same number of hits and unique terms. On 17-May-2016 3:33 pm, "Vijay Tiwary" wrote: > Below

Sorting on child document field.

2016-05-19 Thread Pranaya Behera
Hi, How can I sort the results i.e. from a block join parent query using the field from child document field ? Thanks & Regards Pranaya Behera