[Dspace-tech] How to back up Solr data?

2015-05-29 Thread Alan Orth
I currently back up PostgreSQL and assetstore data via nightly snapshots
and syncing offsite (S3, whatever), but as far as I know there's no way to
atomically snapshot DSpace's Solr; ie, during the time it takes to `cp` my
8GB of Solr data, the data has changed, so the backup is not atomic and
likely inconsistent. I can shut down Tomcat of course, but... that seems a
bit excessive.

Upstream Solr has some discussion of backing up from read-only slaves[0],
but I wanted to know if anyone had a solution for this. We're using DSpace
4.3.

Cheers,

[0] https://cwiki.apache.org/confluence/display/solr/Backing+Up

-- 
Alan Orth
alan.o...@gmail.com
https://alaninkenya.org
https://mjanja.ch
In heaven all the interesting people are missing. -Friedrich Nietzsche
GPG public key ID: 0x8cb0d0acb5cd81ec209c6cdfbd1a0e09c2f836c0
--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

Re: [Dspace-tech] How to back up Solr data?

2015-05-29 Thread Hilton Gibson
Hi Alan

With DSpace 5.2 there are scripts to do SOLR stats export/import.
See:
https://github.com/DSpace/DSpace/blob/master/dspace/config/launcher.xml#L248-L280

So the sooner you upgrade to 5.2, the better ;-)

Cheers

hg

*Hilton Gibson*
Ubuntu Linux Systems Administrator
Stellenbosch University Library
http://staff.lib.sun.ac.za/~hgibson/docs/cv/cv.html


On 29 May 2015 at 10:20, Alan Orth alan.o...@gmail.com wrote:

 I currently back up PostgreSQL and assetstore data via nightly snapshots
 and syncing offsite (S3, whatever), but as far as I know there's no way to
 atomically snapshot DSpace's Solr; ie, during the time it takes to `cp` my
 8GB of Solr data, the data has changed, so the backup is not atomic and
 likely inconsistent. I can shut down Tomcat of course, but... that seems a
 bit excessive.

 Upstream Solr has some discussion of backing up from read-only slaves[0],
 but I wanted to know if anyone had a solution for this. We're using DSpace
 4.3.

 Cheers,

 [0] https://cwiki.apache.org/confluence/display/solr/Backing+Up

 --
 Alan Orth
 alan.o...@gmail.com
 https://alaninkenya.org
 https://mjanja.ch
 In heaven all the interesting people are missing. -Friedrich Nietzsche
 GPG public key ID: 0x8cb0d0acb5cd81ec209c6cdfbd1a0e09c2f836c0


 --

 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech
 List Etiquette:
 https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette

--
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette