Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread Hrishikesh Gadre
, John Bickerstaff < > j...@johnbickerstaff.com> > wrote: > > > A quick search of the code's imports suggests we aren't actually using > it. > > However I see it explicitly mentioned in the POM. > > > > I'll have to do more digging to be sure... > > >

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread Hrishikesh Gadre
Hi John, The map-reduce contrib module is removed as part of SOLR-9221 . Are you using this contrib module? Thanks Hrishikesh On Tue, Aug 29, 2017 at 2:39 PM, John Bickerstaff wrote: > All, > > I'm looking at

Re: Solr config upgrade tool

2017-08-11 Thread Hrishikesh Gadre
. -Hrishikesh On Fri, Aug 11, 2017 at 1:29 PM, Davis, Daniel (NIH/NLM) [C] < daniel.da...@nih.gov> wrote: > Hrishikesh Gadre, > > I'm interested in how that might integrate with continuous integration. I > briefly worked on a tool to try a configuration out with SolrCloud, e.g. > uplo

Solr config upgrade tool

2017-08-11 Thread Hrishikesh Gadre
Hi, I am currently working on a tool to identify (and in some cases fix) the incompatibilities in the Solr configuration (e.g. schema.xml, solrconfig.xml etc.) between major versions of Solr. My goal is to simplify the Solr upgrade process by providing upgrade instructions tailored to your

Re: Limiting the number of queries/updates to Solr

2017-08-02 Thread Hrishikesh Gadre
At one point I was working on SOLR-7344 (but it fell off the radar due to various reasons). Specifically I built a servlet request filter which implements a customizable queuing mechanism using asynchronous servlet API (Servlet 3 spec). This way

Re: SOLR as nosql database store

2017-05-08 Thread Hrishikesh Gadre
Hi Bharath, In general its not a good idea to use Solr as the *primary data store* for various reasons listed here, https://wiki.apache.org/solr/HowToReindex But if you design your system such that at-least one copy of the raw data is stored in some

Re: Solr6.3.0 SolrJ API for Basic Authentication

2017-02-16 Thread Hrishikesh Gadre
Hey, The other alternative would be to implement a HttpClientConfigurer which can perform preemptive basic authentication (just the same way SolrRequest is sending the credentials). The code is available in the branch_6x here,

Re: creating collection using collection API with SSL enabled SolrCloud

2017-02-09 Thread Hrishikesh Gadre
Hi Sean, Have you configured the "urlScheme" cluster property (i.e. urlScheme=https) ? https://cwiki.apache.org/confluence/display/solr/Collections+API#CollectionsAPI-CLUSTERPROP:ClusterProperties Thanks Hrishikesh On Thu, Feb 9, 2017 at 8:23 AM, Xie, Sean wrote: > Hi

Re: Solrcloud backup delete

2017-01-26 Thread Hrishikesh Gadre
Hi Johan, Once the backup is created successfully, Solr does not play any role in managing the backup copies and it is left up to the user. You may want to build a script which maintains last N backup copies (and delete old ones). If you end up building such script, see if you can submit a patch

Re: Can't create collection

2017-01-16 Thread Hrishikesh Gadre
Based on the stack trace, it looks like the Solr collection create request was not processed (or in-progress) on the overseer node. Can you check if the Solr server hosting the overseer role is healthy and is connected to Zookeeper ? If there are no issues with the cluster, you can try using the

Re: Rolling backups of a collection

2016-11-09 Thread Hrishikesh Gadre
Hi Mike, I filed SOLR-9744 <https://issues.apache.org/jira/browse/SOLR-9744> to track this work. Please comment on this jira if you have any suggestions. Thanks Hrishikesh On Wed, Nov 9, 2016 at 11:07 AM, Hrishikesh Gadre <gadre.s...@gmail.com> wrote: > Hi Mike, > > Cu

Re: Rolling backups of a collection

2016-11-09 Thread Hrishikesh Gadre
Hi Mike, Currently we don't have capability to take rolling backups for the Solr collections. I think it should be fairly straightforward to write a script that implements this functionality outside of Solr. If you post that script, may be we can even ship it as part of Solr itself (for the

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-11-08 Thread Hrishikesh Gadre
e sense that the collection is created, but the initialized cores are > blank and the logs contain errors about "incomplete segments". I will try > to research further and get back with more data soon. > > > > On Mon, Sep 26, 2016 at 11:26 AM, Hrishikesh Gadre <gadre.s...@gm

Re: Backup to HDFS while running cluster on local disk

2016-11-08 Thread Hrishikesh Gadre
Hi Mike, Thanks for bringing this up. You can certainly backup the index data stored on local file-system to HDFS. The HDFS backup repository implementation uses the same configuration properties as expected by the HDFS directory factory. Here is the description of the parameters, - location

Re: Public/Private data in Solr :: Metadata or ?

2016-10-19 Thread Hrishikesh Gadre
As part of Cloudera Search, we have integrated with Apache Sentry for document level authorization. Currently we are using custom search component to implement filtering. Please refer to this blog post for details,

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-09-26 Thread Hrishikesh Gadre
estore API (with all data on one node), we see the > same, so I think it's more a problem in the backup process than the restore > process. > > If there's any kind of debugging output we can provide that can help solve > this, let me know. > > -- > Steve > > On Sun,

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-09-25 Thread Hrishikesh Gadre
Hi Steve, Regarding the 2nd issue, a JIRA is already created and patch is uploaded (SOLR-9527). Can someone review and commit the patch? Regarding 1st issue, does backup command succeeds? Also do you see any warning/error log messages? How about the restore command? Thanks Hrishikesh On Sat,

Re: Distributing nodes with the collections API RESTORE command

2016-09-16 Thread Hrishikesh Gadre
Hi Stephen, Thanks for the update. I filed SOLR-9527 for tracking purpose. I will take a look and get back to you. Thanks Hrishikesh On Fri, Sep 16, 2016 at 2:56 PM, Stephen Lewis wrote: > Hello, > > I've tried this on both

Re: Issues with Solr 6.2 Backup/Restore feature

2016-09-13 Thread Hrishikesh Gadre
Hi Georg, It looks like "_2ag9.si" file is missing in the snapshot.shard1 folder of the backup. Can you try running Lucene CheckIndex tool on the snapshot.shard1 folder ? Also can you post the logs during the backup creation as well? Thanks Hrishikesh On Tue, Sep 13, 2016 at 7:12 PM,

Re: proper routing (from non-Java client) in solr cloud 5.0.0

2015-04-14 Thread Hrishikesh Gadre
Hi Ian, As per my understanding, Solrj does not use Zookeeper watches but instead caches the information (along with a TTL). You can find more information here, https://issues.apache.org/jira/browse/SOLR-5473 https://issues.apache.org/jira/browse/SOLR-5474 Regards Hrishikesh On Tue, Apr 14,

Re: Collections API - HTTP verbs

2015-02-19 Thread Hrishikesh Gadre
are trying to specify the name, I'm guessing something about the command is not working. You might try just shoving it in a browser url bar as well. - Mark On Wed Feb 18 2015 at 8:56:26 PM Hrishikesh Gadre gadre.s...@gmail.com wrote: Hi, Can we please document which HTTP method

Collections API - HTTP verbs

2015-02-18 Thread Hrishikesh Gadre
Hi, Can we please document which HTTP method is supposed to be used with each of these APIs? https://cwiki.apache.org/confluence/display/solr/Collections+API I am trying to invoke following API curl http:// hostname:8983/solr/admin/collections?action=CLUSTERPROPname=urlSchemeval=https This

Re: Checkout the source Code to the Release Version of Solr?

2015-02-17 Thread Hrishikesh Gadre
Hi, You can get the released code base here https://github.com/apache/lucene-solr/releases Thanks Hrishikesh On Tue, Feb 17, 2015 at 2:20 PM, O. Olson olson_...@yahoo.it wrote: At this time the latest released version of Solr is 4.10.3. Is there anyway we can get the source code for this

Re: Checkout the source Code to the Release Version of Solr?

2015-02-17 Thread Hrishikesh Gadre
Also the version number is encoded (at least) in the build file https://github.com/apache/lucene-solr/blob/817303840fce547a1557e330e93e5a8ac0618f34/lucene/common-build.xml#L32 Hope this helps. Thanks Hrishikesh On Tue, Feb 17, 2015 at 2:25 PM, Hrishikesh Gadre gadre.s...@gmail.com wrote: Hi

Re: SolrCloud - Enable SSL

2015-01-15 Thread Hrishikesh Gadre
OK. I think I have figured this out. https://issues.apache.org/jira/browse/SOLR-5610 On Thu, Jan 15, 2015 at 6:00 PM, Hrishikesh Gadre gadre.s...@gmail.com wrote: Hi, If we need to enable SSL configuration for an existing Solr cluster (hosting one or more collections), do we need

SolrCloud - Enable SSL

2015-01-15 Thread Hrishikesh Gadre
Hi, If we need to enable SSL configuration for an existing Solr cluster (hosting one or more collections), do we need to manually update the clusterstate.json file? Or is there any API available which would serve the purpose? As per the Solr wiki, we need to set the urlScheme property to https