Custom replica placement possible during collection restore

2020-10-16 Thread Kommu, Vinodh K.
Hi, Would it be possible to restore a collection with replica placement into specific nodes/VMs in the cluster? I guess by default restore feature may not work in such custom way so by any chance can we modify those code details in collection_state.json file in backup directory to place

RE: Time-out errors while indexing (Solr 7.7.1)

2020-07-07 Thread Kommu, Vinodh K.
Hi Eric, Toke, Can you please look at the details shared in my trail email & respond with your suggestions/feedback? Thanks & Regards, Vinodh From: Kommu, Vinodh K. Sent: Monday, July 6, 2020 4:58 PM To: solr-user@lucene.apache.org Subject: RE: Time-out errors while indexing (So

RE: Time-out errors while indexing (Solr 7.7.1)

2020-07-06 Thread Kommu, Vinodh K.
t;> timeout errors while indexing” >>>>> >>>>> So have you been continually adding more documents to your >>>>> collections for more than the 2-3 weeks? If so you may have just >>>>> put so much data on the same boxes that you’ve gone

RE: Time-out errors while indexing (Solr 7.7.1)

2020-07-03 Thread Kommu, Vinodh K.
Anyone has any thoughts or suggestions on this issue? Thanks & Regards, Vinodh From: Kommu, Vinodh K. Sent: Thursday, July 2, 2020 4:46 PM To: solr-user@lucene.apache.org Subject: Time-out errors while indexing (Solr 7.7.1) Hi, We are performing QA performance testing on couple of collect

Time-out errors while indexing (Solr 7.7.1)

2020-07-02 Thread Kommu, Vinodh K.
Hi, We are performing QA performance testing on couple of collections which holds 2 billion and 3.5 billion docs respectively. Indexing happens from a separate client using solrJ which uses 10 thread and batch size 1000. From last 2-3 weeks we have been noticing either slow indexing or timeout

RE: Solr cloud backup/restore not working

2020-06-17 Thread Kommu, Vinodh K.
Hi, What is the log level defined for solr nodes? Did you used requestid in restore command? If so, check the status of the requestid if that points to any errors. Thanks & Regards, Vinodh -Original Message- From: yaswanth kumar Sent: Wednesday, June 17, 2020 4:33 PM To:

RE: Timeout issue while doing update operations from clients (using SolrJ)

2020-06-12 Thread Kommu, Vinodh K.
I feel the mentioned issue is more or less relavant to following JIRA. Any idea on this? https://issues.apache.org/jira/browse/SOLR-13458 Thanks & Regards, Vinodh From: Kommu, Vinodh K. Sent: Wednesday, June 10, 2020 10:43 PM To: solr-user@lucene.apache.org Subject: RE: Timeout issue w

RE: Timeout issue while doing update operations from clients (using SolrJ)

2020-06-11 Thread Kommu, Vinodh K.
Hi, Can someone shed some light on this issue please? Regards, Vinodh Kumar K Middleware Cache and Search Engineering DTCC Chennai [cid:image006.png@01D2A70B.AF8789E0] From: Kommu, Vinodh K. Sent: Wednesday, June 10, 2020 10:43 PM To: solr-user@lucene.apache.org Subject: RE: Timeout issue

RE: Timeout issue while doing update operations from clients (using SolrJ)

2020-06-10 Thread Kommu, Vinodh K.
:83) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:542) Thanks & Regards, Vinodh From: Kommu, Vinodh K. Sent: Wednesday, June 10, 2020 3:41 PM To:

Timeout issue while doing update operations from clients (using SolrJ)

2020-06-10 Thread Kommu, Vinodh K.
Hi, Need some help in fixing intermittent timeout issue please. Recently we came across this timeout issue during QA performance testing when a streaming expression query which runs on a larger set of data (~60-80 million) from a client using solrJ, was timing out exactly in 2mins. Later this

RE: How to restore deleted collection from filesystem

2020-05-26 Thread Kommu, Vinodh K.
olr-user@lucene.apache.org Subject: Re: How to restore deleted collection from filesystem ATTENTION: External Email – Be Suspicious of Attachments, Links and Requests for Login Information. See inline. > On May 21, 2020, at 10:13 AM, Kommu, Vinodh K. wrote: > > Thanks Eric for quick respo

RE: How to restore deleted collection from filesystem

2020-05-21 Thread Kommu, Vinodh K.
ay 21, 2020, at 8:17 AM, Kommu, Vinodh K. wrote: > > Hi, > > One of our largest collection which holds 3.2 billion docs was deleted > accidentally in QA environment. Unfortunately we don't have latest solr > backup for this collection either to restore. The only option left for us is

How to restore deleted collection from filesystem

2020-05-21 Thread Kommu, Vinodh K.
Hi, One of our largest collection which holds 3.2 billion docs was deleted accidentally in QA environment. Unfortunately we don't have latest solr backup for this collection either to restore. The only option left for us is to restore deleted replica directories under data directory using

Different indexing times for two different collections with different data sizes

2020-05-20 Thread Kommu, Vinodh K.
Hi, Recently we had noticed that one of the largest collection (shards = 6 ; replication factor =3) which holds up to 1TB of data & nearly 3.2 billion of docs is taking longer time to index than it used to before. To see the indexing time difference, we created another collection using largest

RE: IdleTimeout setting in Jetty (Solr 7.7.1)

2020-04-29 Thread Kommu, Vinodh K.
Solr 7.7.1) ATTENTION: External Email – Be Suspicious of Attachments, Links and Requests for Login Information. Try starting like this. bin/solr start -Dsolr.jetty.threads.idle.timeout=2000 -z localhost:2181 Hope this helps Raji On Sun, Apr 26, 2020 at 11:24 PM Kommu, Vinodh K. w

RE: IdleTimeout setting in Jetty (Solr 7.7.1)

2020-04-27 Thread Kommu, Vinodh K.
Can someone shed some idea on below requirement? Thanks & Regards, Vinodh From: Kommu, Vinodh K. Sent: Friday, April 24, 2020 11:34 PM To: solr-user@lucene.apache.org Subject: IdleTimeout setting in Jetty (Solr 7.7.1) Hi, Our clients are running streaming expressions on 140M docs collec

IdleTimeout setting in Jetty (Solr 7.7.1)

2020-04-24 Thread Kommu, Vinodh K.
Hi, Our clients are running streaming expressions on 140M docs collection which has relatively huge data however query is not completing through & timing out after 120secs (which is default timeout in jetty*.xml files). We had changed the default timeout from 120s to 300s which worked fine. To

RE: Unable to delete zookeeper queue

2020-04-01 Thread Kommu, Vinodh K.
Hi, Does anyone know a working solution to delete zookeeper queue data? Please help!! Regards, Vinodh From: Kommu, Vinodh K. Sent: Tuesday, March 31, 2020 12:55 PM To: solr-user@lucene.apache.org Subject: Unable to delete zookeeper queue All, For some reason one of our zookeeper queue

Unable to delete zookeeper queue

2020-03-31 Thread Kommu, Vinodh K.
All, For some reason one of our zookeeper queue was filled with way bigger number so when I tried to delete queues with "rmr /overseer/queue" command, it's throwing - Packet len19029055 is out of range! exception. Later I have increased maxbuffer size to 50M and tried the same rmr command but

RE: Solr 6.3 with Open JDK

2020-02-26 Thread Kommu, Vinodh K.
, Kommu, Vinodh K. wrote: > Hi Team, > > Anyone using Solr 6.3 version with Open JDK? If so, what version of > open JDK you are using? And can we use open JDK 1.8.0_242 or later > version with Solr 6.3 version? > > > Regards, > Vinodh > > DTCC DISCLAIMER: Thi

Solr 6.3 with Open JDK

2020-02-26 Thread Kommu, Vinodh K.
Hi Team, Anyone using Solr 6.3 version with Open JDK? If so, what version of open JDK you are using? And can we use open JDK 1.8.0_242 or later version with Solr 6.3 version? Regards, Vinodh DTCC DISCLAIMER: This email and any files transmitted with it are confidential and intended solely

RE: Active directory integration in Solr

2019-11-20 Thread Kommu, Vinodh K.
Thanks for responding Wood. Since we are running on Solr cloud not in HDFS, perhaps there is no viable solution for solr cloud I think. Regards, Vinodh -Original Message- From: Mark H. Wood Sent: Wednesday, November 20, 2019 9:44 PM To: solr-user@lucene.apache.org Subject: Re:

RE: Active directory integration in Solr

2019-11-19 Thread Kommu, Vinodh K.
-on-authorizations-for-manifold-cf-and-solr%2Fdata=02%7C01%7Cvkommu%40dtcc.com%7C2e17e1feef78432502e008d76cd26635%7C0465519d7f554d47998b55e2a86f04a8%7C0%7C0%7C637097523245319858sdata=iYiKRDJKYBZaxUd%2F%2BIddFBwxB2RhSqih2KZc26aZlRU%3Dreserved=0 Best Charlie On 18/11/2019 15:08, Kommu, Vinodh K. wrote: >

Active directory integration in Solr

2019-11-18 Thread Kommu, Vinodh K.
Hi, Does anyone know that Solr has any out of the box capability to integrate Active directory (using LDAP) when security is enabled? Instead of creating users in security.json file, planning to use users who already exists in active directory so they can use their individual credentials

RE: Anyway to encrypt admin user plain text password in Solr

2019-11-15 Thread Kommu, Vinodh K.
ing beyond security theater. Best, Jason On Thu, Nov 14, 2019 at 9:49 AM Mark H. Wood wrote: > > On Thu, Nov 14, 2019 at 11:35:47AM +0000, Kommu, Vinodh K. wrote: > > We store the plain text password in basicAuth.conf file. This is a normal > > file & we are securing it o

RE: Anyway to encrypt admin user plain text password in Solr

2019-11-15 Thread Kommu, Vinodh K.
password in Solr ATTENTION! This email originated outside of DTCC; exercise caution. Use Kerberos or JWT token. > Am 11.11.2019 um 11:41 schrieb Kommu, Vinodh K. : > > Hi, > > After creating admin user in Solr when security is enabled, we have to store > the admin user's credent

RE: Anyway to encrypt admin user plain text password in Solr

2019-11-14 Thread Kommu, Vinodh K.
ve much bigger problems. If you can be more specific about the exposure you're concerned about, we can discuss whether there's an actual security concern there and how to work around it. Best, Jason On Wed, Nov 13, 2019 at 11:22 AM Kommu, Vinodh K. wrote: > > Does anyone have an any idea on

RE: Anyway to encrypt admin user plain text password in Solr

2019-11-13 Thread Kommu, Vinodh K.
Does anyone have an any idea on this? If so, please help. Thanks From: Kommu, Vinodh K. Sent: Monday, November 11, 2019 4:11 PM To: solr-user@lucene.apache.org Subject: Anyway to encrypt admin user plain text password in Solr Hi, After creating admin user in Solr when security is enabled, we

Anyway to encrypt admin user plain text password in Solr

2019-11-11 Thread Kommu, Vinodh K.
Hi, After creating admin user in Solr when security is enabled, we have to store the admin user's credentials in plain text format. Is there any option or a way to encrypt the plain text password? Thanks, Vinodh DTCC DISCLAIMER: This email and any files transmitted with it are confidential