Re: How to restore an index from a backup over HTTP

2014-09-04 Thread Greg Solovyev
Thanks Jeff! Thanks, Greg - Original Message - From: Jeff Wartes jwar...@whitepages.com To: solr-user@lucene.apache.org Sent: Wednesday, August 20, 2014 10:36:07 AM Subject: Re: How to restore an index from a backup over HTTP Here’s the repo:

Re: How to restore an index from a backup over HTTP

2014-08-20 Thread Jeff Wartes
Here’s the repo: https://github.com/whitepages/solrcloud_manager Comments/Issues/Patches welcome. On 8/18/14, 11:28 AM, Greg Solovyev g...@zimbra.com wrote: Thanks Jeff, I'd be interested in taking a look at the code for this tool. My github ID is grishick. Thanks, Greg - Original

Re: How to restore an index from a backup over HTTP

2014-08-18 Thread Jeff Wartes
I¹m able to do cross-solrcloud-cluster index copy using nothing more than careful use of the ³fetchindex² replication handler command. I¹m using this as a build/deployment tool, so I manually create a collection in two clusters, index into one, test, and then ask the other cluster to fetchindex

Re: How to restore an index from a backup over HTTP

2014-08-18 Thread Greg Solovyev
Thanks Jeff, I'd be interested in taking a look at the code for this tool. My github ID is grishick. Thanks, Greg - Original Message - From: Jeff Wartes jwar...@whitepages.com To: solr-user@lucene.apache.org Sent: Monday, August 18, 2014 9:49:28 PM Subject: Re: How to restore an index

Re: How to restore an index from a backup over HTTP

2014-08-18 Thread Greg Solovyev
Shawn, the format that I am referencing is filestream, which starts with 2 bytes carrying file size, then 4 bytes carrying checksum (optional) and then the actual bits of the file. Thanks, Greg - Original Message - From: Shawn Heisey s...@elyograg.org To: solr-user@lucene.apache.org

Re: How to restore an index from a backup over HTTP

2014-08-16 Thread Greg Solovyev
Thanks Shawn, this is a pretty cool idea. Adding the handler seems pretty straight forward, but the main concern I have is the internal data format that ReplicationHandler and SnapPuller use. This new handler as well as the code that I've already written to download the index files from Solr

Re: How to restore an index from a backup over HTTP

2014-08-16 Thread Shawn Heisey
On 8/16/2014 4:03 AM, Greg Solovyev wrote: Thanks Shawn, this is a pretty cool idea. Adding the handler seems pretty straight forward, but the main concern I have is the internal data format that ReplicationHandler and SnapPuller use. This new handler as well as the code that I've already

How to restore an index from a backup over HTTP

2014-08-15 Thread Greg Solovyev
Hello, I am looking for advice on implementing the following backup/restore scenario. We are using Solr to index email. Each mailbox has it's own Collection. We do not store emails in Solr, the emails are stored on disk in a blob store, meta data is stored in a database and Solr is used only

Re: How to restore an index from a backup over HTTP

2014-08-15 Thread Shawn Heisey
On 8/15/2014 5:51 AM, Greg Solovyev wrote: What I want to achieve is being able to send the backed up index to Solr (either standalone or with ZooKeeper) in a way similar to creating a new Collection. I.e. create a new collection and upload an exiting index directly into that Collection.