Re: Configuring shardhandler factory for select handler

2020-03-30 Thread Jay Potharaju
figured out referred to the docs here https://github.com/apache/lucene-solr/commit/0ce635ec01e9d3ce04a5fbf5d472ea9d5d28bfee?short_path=421a323#diff-421a323f596319f0485e0b03070d94e6 Thanks Jay On Mon, Mar 30, 2020 at 3:38 PM Jay Potharaju wrote: > Hi, > I am trying to update the conn

Configuring shardhandler factory for select handler

2020-03-30 Thread Jay Potharaju
Hi, I am trying to update the connection & sockettime out value for my `select` handler. After updating the configs i do not see that value being set and it defaults to 60 sec. How can i update these values? Also looks like the docs have sockeTimeout & connectionTimeout values swapped. https://gi

Re: cdcr replicator NPE errors

2019-10-25 Thread Jay Potharaju
Thanks Shawn! Can any of the committers comment about the CDCR error that I posted above? Thanks Jay On Fri, Oct 25, 2019 at 2:56 PM Shawn Heisey wrote: > On 10/25/2019 3:22 PM, Jay Potharaju wrote: > > Is there a solr slack channel? > > People with @apache.org email addres

Re: cdcr replicator NPE errors

2019-10-25 Thread Jay Potharaju
Is there a solr slack channel? Thanks Jay Potharaju On Fri, Oct 25, 2019 at 9:00 AM Jay Potharaju wrote: > Hi, > I am frequently seeing cdcr-replicator null pointer exception errors in > the logs. > Any suggestions on how to address this? > *Solr version: 7.7.2* > > Ex

cdcr replicator NPE errors

2019-10-25 Thread Jay Potharaju
Hi, I am frequently seeing cdcr-replicator null pointer exception errors in the logs. Any suggestions on how to address this? *Solr version: 7.7.2* ExecutorUtil Uncaught exception java.lang.NullPointerException thrown by thread: cdcr-replicator-773-thread-3 java.lang.Exception: Submitter stack tra

Solr field auditing

2019-09-09 Thread Jay Potharaju
Hi, I am trying to implement some auditing fields in solr to track when was the last time a document was updated. Basically when a document is updated, I would like to store when the last time updated + the current timestamp. example : *First time indexing* Doc1 : {id:1, category:shoes, update_date

Re: Relevance by term position

2019-07-08 Thread Jay Potharaju
boost for earlier matches. > The other approach suggested was to use Payloads (which got better > since the original thread). > > Regards, > Alex. > >> On Thu, 27 Jun 2019 at 22:01, Jay Potharaju wrote: >> >> Hi, >> I am trying to implement autocomplete f

Relevance by term position

2019-06-27 Thread Jay Potharaju
Hi, I am trying to implement autocomplete feature that should rank documents based on term position in the search field. Example- Doc1- hello world Doc2- blue sky hello Doc3 - John hello Searching for hello should return Hello world John hello Blue sky hello I am currently using ngram to do a

Autocomplete results from multiple fields

2019-05-09 Thread Jay Potharaju
Hi I am trying to implement autocomplete feature from two fields, name & attribute1. I have setup ngram for both the fields and have copyfield that stores the ngrams results. fl only contains name which is used by ui. Is it possible to display records that match on values from attribute1? The

CDCR - shards not in sync

2019-04-15 Thread Jay Potharaju
Hi, I have a collection with 8 shards. 6 out of the shards are in sync but the other 2 are lagging behind by more than 10 plus hours. The tlog is only 0.5 GB in size. I have tried stopping and starting CDCR number of times but it has not helped. >From what i have noticed there is always a shard tha

Solr 7.7 - group faceting errors

2019-03-29 Thread Jay Potharaju
pleFacets.java:721) at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:497) at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:426) at org.apache.solr.request.SimpleFacets.lambda$getFacetFieldCounts$0(SimpleFacets.java:826) ... 46 more Thanks Jay Potharaju

Re: Re: solr _route_ key now working

2019-03-26 Thread Jay Potharaju
I was reading the debug info incorrectly it is working as expected ...thanks for the help. Thanks Jay Potharaju On Tue, Mar 26, 2019 at 10:58 PM Jay Potharaju wrote: > Edwin, I tried escaping the special characters but it does not seems to > work. I am using 7.7 > Thanks Jerem

Re: Re: solr _route_ key now working

2019-03-26 Thread Jay Potharaju
the shard. fq=fieldB:456&shards=shard1. Any suggestions why that would not be working when using _route_ to query the documents. Thanks Jay Potharaju On Tue, Mar 26, 2019 at 5:58 AM Branham, Jeremy (Experis) < jb...@allstate.com> wrote: > Jay – > I’m not familiar with the docume

Re: Java 9 & solr 7.7.0

2019-03-25 Thread Jay Potharaju
I just learnt that java 11 is . Is anyone using open jdk11 in production? Thanks > On Mar 23, 2019, at 5:15 PM, Jay Potharaju wrote: > > I have not kept up with jdk versions ...will try with jdk 11 and see if it > addresses the high cpu issue. Thanks > > >> On M

Re: solr _route_ key now working

2019-03-25 Thread Jay Potharaju
, so it requires escaping during > the search. > You can try to search with query _route_="a\:b!". > > Regards, > Edwin > >> On Mon, 25 Mar 2019 at 07:59, Jay Potharaju wrote: >> >> Hi, >> My document id has a format of a:b!c, when I query _route_=&

solr _route_ key now working

2019-03-24 Thread Jay Potharaju
Hi, My document id has a format of a:b!c, when I query _route_="a:b!" it does not return any values. Any suggestions? Thanks Jay Potharaju

Re: Java 9 & solr 7.7.0

2019-03-23 Thread Jay Potharaju
I have not kept up with jdk versions ...will try with jdk 11 and see if it addresses the high cpu issue. Thanks > On Mar 23, 2019, at 11:48 AM, Jay Potharaju wrote: > > Thanks for that info Tim > >> On Mar 23, 2019, at 11:26 AM, Tim Underwood wrote: >> >> We

Re: Java 9 & solr 7.7.0

2019-03-23 Thread Jay Potharaju
Finally, there was one issue with JDK 9 and Kerberos that I’m unsure what >> the resolution is, if there is any. If you use Kerberos, be sure to test >> that first. >> >> Best, >> Erick >> >>> On Mar 23, 2019, at 9:47 AM, Jay Potharaju >> wrot

Re: Java 9 & solr 7.7.0

2019-03-23 Thread Jay Potharaju
Thanks I missed that info. Will try running with jdk9 and see if it addresses the issue. Jay > On Mar 23, 2019, at 9:00 AM, Shawn Heisey wrote: > >> On 3/23/2019 8:12 AM, Jay Potharaju wrote: >> Can I use java 9 with 7.7.0. I am planning to test if fixes issue with high

Java 9 & solr 7.7.0

2019-03-23 Thread Jay Potharaju
Hi Can I use java 9 with 7.7.0. I am planning to test if fixes issue with high cpu that I am running into. https://bugs.openjdk.java.net/browse/JDK-8129861 Was solr 7.7 tested with java 9? Thanks Jay

Re: CDCR issues

2019-03-22 Thread Jay Potharaju
This might be causing the high CPU in 7.7.x. https://github.com/apache/lucene-solr/commit/eb652b84edf441d8369f5188cdd5e3ae2b151434#diff-e54b251d166135a1afb7938cfe152bb5 That is related to this JDK bug https://bugs.openjdk.java.net/browse/JDK-8129861. Thanks Jay Potharaju On Thu, Mar 21, 2019

CDCR issues

2019-03-21 Thread Jay Potharaju
Hi, I just enabled CDCR for one collection. I am seeing high CPU usage and the high number of tlog files and increasing. The collection does not have lot of data , just started reindexing of data. . Solr 7.7.0 , implicit sharding 8 shards I have enabled buffer on source side and disabled buffer

Re: copyfield not working

2019-01-14 Thread Jay Potharaju
or by an > UpdateRequestProcessor). > > Cheers, > Andrea > > On 14/01/2019 08:46, Jay Potharaju wrote: > > Hi, > > I have a copy field in which i am copying the contents of text_en field > to > > another custom field. > > After indexing i was expecting

Re: copyfield not working

2019-01-13 Thread Jay Potharaju
copyfield syntax from my schema file... Thanks Jay On Sun, Jan 13, 2019 at 11:46 PM Jay Potharaju wrote: > Hi, > I have a copy field in which i am copying the contents of text_en field to > another custom field. > After indexing i was expecting any of the special chara

copyfield not working

2019-01-13 Thread Jay Potharaju
Hi, I have a copy field in which i am copying the contents of text_en field to another custom field. After indexing i was expecting any of the special characters in the paragraph to be removed, but it does not look like that is happening. The copied content is same as the what is there in the sourc

Re: Search query with & without question mark

2019-01-13 Thread Jay Potharaju
0.5)) from: 32.0 = docFreq 275.0 = docCount 0.82538307 = tfNorm, computed as (freq * (k1 + 1)) / (freq + k1 * (1 - b + b * fieldLength / avgFieldLength)) from: 1.0 = termFreq=1.0 1.2 = parameter k1 0.75 = parameter b 3.4436364 = avgFieldLength 5.22

Search query with & without question mark

2019-01-13 Thread Jay Potharaju
Hi, When searching I get different results when the query contains question mark vs without question mark . The field i am searching on does not have any question marks. Any suggestions? < tokenizer class="solr.StandardTokenizerFactory"/> < filter class="solr.LowerCaseFilterFactory"/> T

Re: CDCR Custom Document Routing

2018-07-02 Thread Jay Potharaju
Solr cdcr : https://issues.apache.org/jira/browse/SOLR-12380 deletebyid: https://issues.apache.org/jira/browse/SOLR-8889 Thanks Jay Potharaju On Mon, Jul 2, 2018 at 5:41 PM Jay Potharaju wrote: > Hi Amrit, > I am using a curl command to send a request to solr for deleting > docume

Re: CDCR Custom Document Routing

2018-07-02 Thread Jay Potharaju
"delete": {"id":"documentid13123123"} }' The deletes doesn't seem to propagate correctly to the target side. Thanks Jay Potharaju On Mon, Jul 2, 2018 at 5:37 PM Amrit Sarkar wrote: > Jay, > > Can you sample delete command you are firing at the sourc

CDCR Custom Document Routing

2018-07-02 Thread Jay Potharaju
Setup: 8 shards : 2 on each node Solr:6.6.4 Thanks Jay Potharaju

Re: deletebyQuery vs deletebyId

2018-05-24 Thread Jay Potharaju
houghts > on > >>> DBQ: http://www.od-bits.com/2018/03/dbq-or-delete-by-query.html < > >>> http://www.od-bits.com/2018/03/dbq-or-delete-by-query.html> > >>> > >>> Thanks, > >>> Emir > >>> -- > >>> Monitoring - Log Management - Alerting - Anomaly Detection > >>> Solr & Elasticsearch Consulting Support Training - > http://sematext.com/ > >>> > >>> > >>> > >>> > On 23 May 2018, at 02:35, Jay Potharaju > wrote: > >>> > > >>> > Hi, > >>> > I have a quick question about deletebyQuery vs deleteById. When using > >>> > deleteByQuery, if query is id:123 is that same as deleteById in > terms of > >>> > performance. > >>> > > >>> > > >>> > Thanks > >>> > Jay > >>> > >>> >

Re: deletebyQuery vs deletebyId

2018-05-23 Thread Jay Potharaju
> Thanks, > Emir > -- > Monitoring - Log Management - Alerting - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > > > On 23 May 2018, at 02:35, Jay Potharaju wrote: > > > > Hi, > > I have a quick question

deletebyQuery vs deletebyId

2018-05-22 Thread Jay Potharaju
Hi, I have a quick question about deletebyQuery vs deleteById. When using deleteByQuery, if query is id:123 is that same as deleteById in terms of performance. Thanks Jay

Re: Async exceptions during distributed update

2018-05-14 Thread Jay Potharaju
would explain about inner working of solrcloud networking? Thanks Jay org.apache.solr.update.StreamingSolrClients > > org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException: > Async exception during > On May 13, 2018, at 9:21 PM, Jay Poth

Re: Async exceptions during distributed update

2018-05-13 Thread Jay Potharaju
nitoring - Log Management - Alerting - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > > > On 8 May 2018, at 17:53, Jay Potharaju wrote: > > > > Hi Emir, > > I was seeing this error as long as the indexing was

Re: Async exceptions during distributed update

2018-05-08 Thread Jay Potharaju
work blip and there are a few errors for streaming solr client...but have never seen this error before. Thanks Jay Thanks Jay Potharaju On Tue, May 8, 2018 at 12:56 AM, Emir Arnautović < emir.arnauto...@sematext.com> wrote: > Hi Jay, > This is low ingestion rate. What is the size of

Re: Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
I have about 3-5 updates per second. > On May 7, 2018, at 5:02 PM, Shawn Heisey wrote: > >> On 5/7/2018 5:05 PM, Jay Potharaju wrote: >> There are some deletes by query. I have not had any issues with DBQ, >> currently have 5.3 running in production. > > H

Re: Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
Thanks for explaining that Shawn! Emir, I use php library called solarium to do updates/deletes to solr. The request is sent to any of the available nodes in the cluster. > On May 7, 2018, at 5:02 PM, Shawn Heisey wrote: > >> On 5/7/2018 5:05 PM, Jay Potharaju wrote: >> Ther

Re: Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
There are some deletes by query. I have not had any issues with DBQ, currently have 5.3 running in production. Thanks Jay Potharaju On Mon, May 7, 2018 at 4:02 PM, Jay Potharaju wrote: > The updates are pushed in real time not batched. No complex analysis and > everything is committed

Re: Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
The updates are pushed in real time not batched. No complex analysis and everything is committed using autocommit settings in solr. Thanks Jay Potharaju On Mon, May 7, 2018 at 4:00 PM, Emir Arnautović < emir.arnauto...@sematext.com> wrote: > How do you send documents? Large batches

Re: Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
I didn't see any OOM errors in the logs on either of the nodes. I saw GC pause of 1 second on the box that was throwing error ...but nothing on the other node. Any other recommendations? Thanks Thanks Jay Potharaju On Mon, May 7, 2018 at 9:48 AM, Jay Potharaju wrote: > Ah th

Re: Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
Ah thanks for explaining that! Thanks Jay Potharaju On Mon, May 7, 2018 at 9:45 AM, Emir Arnautović < emir.arnauto...@sematext.com> wrote: > Node A receives batch of documents to index. It forwards documents to > shards that are on the node B. Node B is having issues with GC so

Re: Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
. thanks Thanks Jay Potharaju On Mon, May 7, 2018 at 9:34 AM, Emir Arnautović < emir.arnauto...@sematext.com> wrote: > Hi Jay, > My first guess would be that there was some major GC on other box so it > did not respond on time. Are your nodes well balanced - do they serve equal &

Async exceptions during distributed update

2018-05-07 Thread Jay Potharaju
Hi, I am seeing the following lines in the error log. My setup has 2 nodes in the solrcloud cluster, each node has 3 shards with no replication. From the error log it seems like all the shards on this box are throwing async exception errors. Other node in the cluster does not have any errors in the

Re: How to ptotect middile initials during search

2018-04-18 Thread Jay Potharaju
A is part of stopwords ...that is why it got dropped. Protected words will only stop it from stemming https://lucene.apache.org/solr/guide/6_6/language-analysis.html Thanks Jay Potharaju On Wed, Apr 18, 2018 at 11:35 AM, Wendy2 wrote: > Hi fellow Users, > > Why did Solr return &

Re: solr 6.6.3 intermittent group faceting errors(Lucene54DocValuesProducer)

2018-04-18 Thread Jay Potharaju
LR-7867>. Thanks Jay Potharaju On Tue, Apr 17, 2018 at 8:17 PM, Shawn Heisey wrote: > On 4/17/2018 8:44 PM, Erick Erickson wrote: > >> The other possibility is that you have LuceneMatchVersion set to >> 5-something in solrconfig.xml. >> > > It's my understa

Re: solr 6.6.3 intermittent group faceting errors(Lucene54DocValuesProducer)

2018-04-17 Thread Jay Potharaju
(SimpleFacets.java:803) Thanks Jay Potharaju On Tue, Apr 17, 2018 at 8:10 AM, Jay Potharaju wrote: > Hi > Has anyone seen issues with group faceting on multivalued fields in solr > 6x? Can any of the committers comment? > Thanks > Jay > > On Apr 16, 2018, at 1:44 PM,

Re: solr 6.6.3 intermittent group faceting errors

2018-04-17 Thread Jay Potharaju
Hi Has anyone seen issues with group faceting on multivalued fields in solr 6x? Can any of the committers comment? Thanks Jay > On Apr 16, 2018, at 1:44 PM, Jay Potharaju wrote: > > I deleted my collection and rebuilt it to check if there are any issues with > indexing. I di

Re: solr 6.6.3 intermittent group faceting errors

2018-04-16 Thread Jay Potharaju
time but rather on small subset of data, which is fixed by reindexing. Any suggestions on what else to check for?? Thanks Jay Potharaju On Mon, Apr 16, 2018 at 10:20 AM, Jay Potharaju wrote: > Hi, > I am testing solr 6.6.3 and have been running into intermittent group > faceting error

solr 6.6.3 intermittent group faceting errors

2018-04-16 Thread Jay Potharaju
Hi, I am testing solr 6.6.3 and have been running into intermittent group faceting errors. I did some bulk indexing to initially setup the collection I have multiple facet fields it only throws error on one of the fields. The issue goes away when I reindex the data. I am upgrading from solr 5.

this IndexWriter is closed

2018-04-09 Thread Jay Potharaju
Hi, I am getting Indexwriter is closed error only on some of my shards in the collection. This seems to be happening on leader shards only. There is are other shards on the box and they are not throwing any error. Also there is enough disc space on the box available at this time. Solr: 5.3.0. Any

Re: Solr 6.6.3: Errors when using facet.field

2018-03-16 Thread Jay Potharaju
This is my query: facet=true&group=true&group.ngroups=true&group.field=product_id&group.facet=true&facet.field=category_id Field def: Tried adding both docvalues & without docvalues. Shards: 2 Has anyone else experienced this error? Thanks Thanks Jay Potharaju O

Re: Solr 6.6.3: Errors when using facet.field

2018-03-16 Thread Jay Potharaju
It looks like it was fixed as part of 6.6.3 : SOLR-6160 <http://issues.apache.org/jira/browse/SOLR-6160>. FYI: I have 2 shards in my test environment. Thanks Jay Potharaju On Fri, Mar 16, 2018 at 2:07 PM, Jay Potharaju wrote: > Hi, > I am running a simple query with group b

Solr 6.6.3: Errors when using facet.field

2018-03-16 Thread Jay Potharaju
ker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 500 The above query worked in solr 5.3. Any suggestions ? Thanks Jay Potharaju

Re: Solr 6.6.3: Cant create shard name with hyphen

2018-03-14 Thread Jay Potharaju
nvm i see the first comment on the ticket ...that hypens are allowed but not when it is the first character. It looks like 5.5 was the last version where it was supported. Thanks Jay Thanks Jay Potharaju On Wed, Mar 14, 2018 at 9:29 PM, Jay Potharaju wrote: > Thanks for the reply Sh

Re: Solr 6.6.3: Cant create shard name with hyphen

2018-03-14 Thread Jay Potharaju
Thanks for the reply Shawn. Was this a recent change ? As per the ticket it was fixed in 6.0. Is this change(no hyphens as starting of name ) applicable to all 6x versions. Thanks > On Mar 14, 2018, at 6:25 PM, Shawn Heisey wrote: > >> On 3/14/2018 6:20 PM, Jay Potharaju wr

Re: Solr 6.6.3: Cant create shard name with hyphen

2018-03-14 Thread Jay Potharaju
I tested in solr 6.5.1 and there also it is broken. Any recommendation which version of 6 is that feature functioning. At this time the shard name cant be changed because of dependency with other applications. Thanks Thanks Jay Potharaju On Wed, Mar 14, 2018 at 5:20 PM, Jay Potharaju wrote

Solr 6.6.3: Cant create shard name with hyphen

2018-03-14 Thread Jay Potharaju
Hi , I am creating a new collection in solr 6.6.3 and it wont allow me create a shard with hyphen. This ticket( https://issues.apache.org/jira/browse/SOLR-8725) was closed earlier. But it is not working for me in 6.6.3. Upgrading from 5.3 to 6.6.3. Thanks Jay

Re: SynonymGraphFilterFactory with WordDelimiterGraphFilterFactory usage

2018-03-14 Thread Jay Potharaju
Thanks Jay Potharaju On Wed, Mar 14, 2018 at 1:02 PM, Rick Leir wrote: > Jay > Did you try using text_en_splitting copied out of another release? > Though if someone went to the trouble of removing it from the example, > there could be something broken in it. > Cheers -- Rick > --

Re: SynonymGraphFilterFactory with WordDelimiterGraphFilterFactory usage

2018-03-13 Thread Jay Potharaju
I am upgrading to solr 6.6.3 and one of my fields uses text_en_splitting. Are there any recommendations on how to adjust the fieldtype definition for these fields. Thanks Thanks Jay Potharaju On Wed, Feb 7, 2018 at 5:09 AM, Steve Rowe wrote: > Thanks Webster, > > I crea

book on solr

2017-10-12 Thread Jay Potharaju
scaling would also be great. Thanks Jay Potharaju

Best practices for backup & restore

2017-05-16 Thread Jay Potharaju
Hi, I was wondering if there are any best practices for doing solr backup & restore. In the past when running backup, I stopped indexing during the backup process. I am looking at this documentation and it says that indexing can continue when backup is in progress. https://cwiki.apache.org/conflue

Re: solrcloud load balancing

2016-10-22 Thread Jay Potharaju
rote: > On 10/22/2016 6:19 PM, Jay Potharaju wrote: > > I am trying to understand how load balancing works in solrcloud. > > > > As per my understanding solrcloud provides load balancing when querying > > using an http endpoint. When a query is sent to any of the node

Re: solrcloud load balancing

2016-10-22 Thread Jay Potharaju
I really > have no idea whether the QTime includes the decision process for > selecting nodes, but I've also never heard of it being significant. > > 3) I guess, although I'm not quite sure I understand the question. > Slow queries will include (roughly) the max of the

solrcloud load balancing

2016-10-22 Thread Jay Potharaju
Hi, I am trying to understand how load balancing works in solrcloud. As per my understanding solrcloud provides load balancing when querying using an http endpoint. When a query is sent to any of the nodes , solr will intelligently decide which server can fulfill the request and will be processed

Re: json facet - date range & interval

2016-06-28 Thread Jay Potharaju
start : "NOW/DAY%2D10DAYS", > end : "NOW/DAY", > gap : "%2B1DAY" > > } > } > > > On 06/28/2016 01:19 PM, Jay Potharaju wrote: > >> json.facet={daterange : {type : range, field : datefield, start : >> &q

Re: json facet - date range & interval

2016-06-28 Thread Jay Potharaju
rickson wrote: > First thing I'd do is escape the plus. It's probably being interpreted > as a space. > > Best, > Erick > > On Mon, Jun 27, 2016 at 9:24 AM, Jay Potharaju > wrote: > > Hi, > > I am trying to use the json range facet with a tdate fiel

json facet - date range & interval

2016-06-27 Thread Jay Potharaju
Hi, I am trying to use the json range facet with a tdate field. I tried the following but get an error. Any suggestions on how to fix the following error /examples for date range facets. json.facet={daterange : {type : range, field : datefield, start :"NOW-10DAYS", end : "NOW/DAY", gap : "+1DAY" }

Re: Sorting & searching on the same field

2016-06-24 Thread Jay Potharaju
> Alex. > > Newsletter and resources for Solr beginners and intermediates: > http://www.solr-start.com/ > > >> On 24 June 2016 at 13:42, Jay Potharaju wrote: >> Any ideas on how to handle case insensitive search, string fields and >> docvalues in 1 field? &g

Re: Sorting & searching on the same field

2016-06-23 Thread Jay Potharaju
Alex > On 24 Jun 2016 9:01 AM, "Jay Potharaju" wrote: > > > yes, that is what i thought. but was checking to see if there was > something > > I was missing. > > Thanks > > > > On Thu, Jun 23, 2016 at 12:55 PM, Ahmet Arslan > > > wrote

clarification on using docvalues for sorting

2016-06-23 Thread Jay Potharaju
Hi, I am trying to do a case insensitive sorting on couple of fields. For this I am doing the following Above would not allow using this datatype with docvalues. Docvalues can only be used with string & trie fields. And also docvalues are recommended for sorting & f

Slow facet range performance

2016-06-23 Thread Jay Potharaju
Hi, I am running facet query on a date field and the results are coming back on an avg 500ms. The field is set to use docvalues & field type is tdate. SOLR - 5.5 &facet=true&facet.interval=date_field&f.date_field.facet.interval=date_field&f.date_field.facet.interval.set=[NOW-7DAY,NOW]&f.date_fie

Re: Sorting & searching on the same field

2016-06-23 Thread Jay Potharaju
uires a single value (token) to be meaningful. > > Ahmet > > > > On Thursday, June 23, 2016 7:43 PM, Jay Potharaju > wrote: > Hi, > I would like to have 1 field that can used for both searching and case > insensitive sorting. As far as i know the only way to do is to have tw

Sorting & searching on the same field

2016-06-23 Thread Jay Potharaju
Hi, I would like to have 1 field that can used for both searching and case insensitive sorting. As far as i know the only way to do is to have two fields one for searching (text_en) and one for sorting(lowercase & string). Any ideas how the two can be combined into 1 field. -- Thanks

Re: result grouping in sharded index

2016-06-15 Thread Jay Potharaju
ction. " On Wed, Jun 15, 2016 at 3:03 AM, Tom Evans wrote: > Do you have to group, or can you collapse instead? > > > https://cwiki.apache.org/confluence/display/solr/Collapse+and+Expand+Results > > Cheers > > Tom > > On Tue, Jun 14, 2016 at 4:57 PM, Jay Pothar

Re: result grouping in sharded index

2016-06-14 Thread Jay Potharaju
Any suggestions on how to handle result grouping in sharded index? On Mon, Jun 13, 2016 at 1:15 PM, Jay Potharaju wrote: > Hi, > I am working on a functionality that would require me to group documents > by a id field. I read that the ngroups feature would not work in a sharded >

result grouping in sharded index

2016-06-13 Thread Jay Potharaju
Hi, I am working on a functionality that would require me to group documents by a id field. I read that the ngroups feature would not work in a sharded index. Can someone recommend how to handle this in a sharded index? Solr Version: 5.5 https://cwiki.apache.org/confluence/display/solr/Result+Gr

Re: Slow date filter query

2016-05-30 Thread Jay Potharaju
> That does seem long, but you haven't provided many details > > about the fields. Are there 100 docs in your index? 100M docs? 500M docs? > > > > Are you using NOW in appropriately? See: > > > > On Fri, May 27, 2016 at 1:32 PM, Jay Potharaju > wrote: > &g

Slow date filter query

2016-05-27 Thread Jay Potharaju
Hi, I am running filter query(range query) on date fields(high cardinality) and the performance is really bad ...it takes about 2-5 seconds for it to come back with response. I am rebuilding the index to have docvalues & tdates instead of "date" field. But not sure if that will alleviate the proble

Re: debugging solr query

2016-05-27 Thread Jay Potharaju
&fq=fieldA:abc > &sort=dt1 asc,field2 asc, fieldC desc > > Play with the caches. > Also consider disabling caching, and/or supplying execution order for the > filer queries. > Please see : > https://lucidworks.com/blog/2012/02/10/advanced-filter-caching-in-solr/ > &

Re: debugging solr query

2016-05-27 Thread Jay Potharaju
suggestions on how handle filtering/querying/sorting on high cardinality date fields? Index size: 30Million Solr: 4.3.1 Thanks On Thu, May 26, 2016 at 6:04 AM, Jay Potharaju wrote: > Hi, > Thanks for the feedback. The queries I run are very basic filter queries > with some sorting. > >

Re: debugging solr query

2016-05-26 Thread Jay Potharaju
uery provide performance benefits. - Would there be a performance penalty because majority of the documents(!fieldA:abc) dont have values in the new columns? Thanks On Wed, May 25, 2016 at 8:40 PM, Jay Potharaju wrote: > Any links that illustrate and talk about solr internals and

Re: debugging solr query

2016-05-25 Thread Jay Potharaju
Any links that illustrate and talk about solr internals and how indexing/querying works would be a great help. Thanks Jay On Wed, May 25, 2016 at 6:30 PM, Jay Potharaju wrote: > Hi, > Thanks for the feedback. The queries I run are very basic filter queries > with some sorting. > >

Re: How to save index data to other place? [scottchu]

2016-05-25 Thread Jay Potharaju
l/solr-5.4.1/server/solr/cugna. > Index data is also saved there. But wish to save index data on other > folder, say /var/sc_data/cugna. How can I dothis? > > scott.chu,scott@udngroup.com > 2016/5/26 (週四) > -- Thanks Jay Potharaju

Re: How to perform a contains query

2016-05-25 Thread Jay Potharaju
quot;: >> "java/org/apache/catalina/core/AsyncContextImpl.java in >> : > Apache Tomcat 7.x before 7.0.40 does not properly handle the throwing >> of a >> : > RuntimeException in an AsyncListener in an application, which allows >> : > context-dependent attackers to obtain sensitive request information >> intended >> : > for other applications in opportunistic circumstances via an >> application >> : > that records the requests that it processes.", >> : > >> : > "summary": "Session fixation vulnerability in Apache Tomcat >> 7.x >> : > before 7.0.66, 8.x before 8.0.30, and 9.x before 9.0.0.M2, when >> different >> : > session settings are used for deployments of multiple versions of the >> same >> : > web application, might allow remote attackers to hijack web sessions >> by >> : > leveraging use of a requestedSessionSSL field for an unintended >> request, >> : > related to CoyoteAdapter.java and Request.java.", >> : > >> : > "summary": "The (1) Manager and (2) Host Manager applications >> in >> : > Apache Tomcat 7.x before 7.0.68, 8.x before 8.0.31, and 9.x before >> 9.0.0.M2 >> : > establish sessions and send CSRF tokens for arbitrary new requests, >> which >> : > allows remote attackers to bypass a CSRF protection mechanism by >> using a >> : > token.", >> : > >> : > "summary": "The setGlobalContext method in >> : > org/apache/naming/factory/ResourceLinkFactory.java in Apache Tomcat >> 7.x >> : > before 7.0.68, 8.x before 8.0.31, and 9.x before 9.0.0.M3 does not >> consider >> : > whether ResourceLinkFactory.setGlobalContext callers are authorized, >> which >> : > allows remote authenticated users to bypass intended SecurityManager >> : > restrictions and read or write to arbitrary application data, or >> cause a >> : > denial of service (application disruption), via a web application >> that sets >> : > a crafted global context.", >> : >> : >> >> -Hoss >> http://www.lucidworks.com/ >> > > -- Thanks Jay Potharaju

Re: debugging solr query

2016-05-25 Thread Jay Potharaju
; On Tue, May 24, 2016 at 4:52 PM, Ahmet Arslan > wrote: > > > > > > Hi, > > > > Is it QueryComponent taking time? > > Ot other components? > > > > Also make sure there is plenty of RAM for OS cache. > > > > Ahmet > > > >

debugging solr query

2016-05-24 Thread Jay Potharaju
Hi, I am trying to debug solr performance problems on an old version of solr, 4.3.1. The queries are taking really long -in the range of 2-5 seconds!!. Running filter query with only one condition also takes about a second. There is memory available on the box for solr to use. I have been looking

Re: Filter queries & caching

2016-05-09 Thread Jay Potharaju
) > q=filter(A) > q=filter(B) > > would only require two. Yet all of them would be satisfied only by > looking at the filterCache. > > Aside from the example immediately above, which one you use is largely > a matter of taste. > > Best, > Erick > > On Mon, Ma

Error on creating new collection with existing configs

2016-05-09 Thread Jay Potharaju
Hi, I created a new config and uploaded it to zk with the name test_conf. And then created a collection which uses this config. CREATE COLLECTION: /solr/admin/collections?action=CREATE&name=test2&numShards=1&replicationFactor=2&collection.configName=test_conf When indexing the data using DIH I g

Re: Filter queries & caching

2016-05-09 Thread Jay Potharaju
gt; As I understand it useful incase you use an OR operator between two > restricting clauses. > Recall that multiple fq means implicit AND. > > ahmet > > > > On Monday, May 9, 2016 4:02 AM, Jay Potharaju > wrote: > As mentioned above adding filter() will add the fi

Re: Filter queries & caching

2016-05-08 Thread Jay Potharaju
rom the filter cache. Since scores are not cached, all documents that match the filter produce the same score (0 by default). Cached filters will be extremely fast when they are used again in another query. Thanks On Fri, May 6, 2016 at 9:46 AM, Jay Potharaju wrote: > We have high query loa

Re: understanding phonetic matching

2016-05-07 Thread Jay Potharaju
, > Susheel > > On Sat, May 7, 2016 at 2:13 PM, Jay Potharaju > wrote: > > > Thanks for the feedback, I was getting correct results when searching for > > jon & john. But when I tried other names like 'khloe' it matched on > > 'collier' b

Re: understanding phonetic matching

2016-05-07 Thread Jay Potharaju
e text and the query text in the > > two boxes in the UI? I am not sure what "look at my solr data" means > > in this particular context. > > > > Regards, > >Alex. > > > > Newsletter and resources for Solr beginners and intermediates: &g

Re: Filter queries & caching

2016-05-06 Thread Jay Potharaju
e simple filters running simultaneously. For low to > medium query loads on a server with a whole bunch of CPUs, where there > is plenty of spare CPU power, this can be a real gain in performance ... > but if the query load is really high, it might be a bad thing. > > Thanks, > Shawn > > -- Thanks Jay Potharaju

Re: Filter queries & caching

2016-05-06 Thread Jay Potharaju
Thanks Shawn,Erick & Ahmet , this was very helpful. > On May 6, 2016, at 6:19 AM, Shawn Heisey wrote: > >> On 5/5/2016 2:44 PM, Jay Potharaju wrote: >> Are you suggesting rewriting it like this ? >> fq=filter(fromfield:[* TO NOW/DAY+1DAY]&& tofield:[NOW/DA

Re: Filter queries & caching

2016-05-05 Thread Jay Potharaju
AY-7DAY TO *] ) fq=filter(type:abc) Is this something that I would need to determine by running some test Thanks On Thu, May 5, 2016 at 1:44 PM, Jay Potharaju wrote: > Are you suggesting rewriting it like this ? > fq=filter(fromfield:[* TO NOW/DAY+1DAY]&& tofield:[NOW/DAY-7DAY TO

Re: Filter queries & caching

2016-05-05 Thread Jay Potharaju
tly. > > Also consider disabling caching (using cost) in expensive queries: > http://yonik.com/advanced-filter-caching-in-solr/ > > Ahmet > > > > On Thursday, May 5, 2016 8:25 PM, Jay Potharaju > wrote: > Hi, > I have a filter query that gets documents based on da

Filter queries & caching

2016-05-05 Thread Jay Potharaju
Hi, I have a filter query that gets documents based on date ranges from last n days to anytime in future. The objective is to get documents between a date range, but the start date and end date values are stored in different fields and that is why I wrote the filter query as below fq=fromfield:[

Re: query action with wrong result size zero

2016-05-05 Thread Jay Potharaju
t; i found a strange thing with solr query,when i set the value of query > field like "brand:amd",the size of query result is zero,but the real data > is not zero,can some body tell me why,thank you very much!! > my english is not very good,wish some body understand my words! > -- Thanks Jay Potharaju

Using updateRequest Processor with DIH

2016-05-01 Thread Jay Potharaju
Hi, I was wondering if it is possible to use Update Request Processor with DIH. I would like to update an index_time field whenever documents are added/updated in the collection. I know that I could easily pass a time stamp which would update the field in my collection but I was trying to do it usi

  1   2   >