Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Jason Pickering
One way of solving the problem of backups and disk space, is to push your backups to Amazon Glacier. That way, you can be sure that you have a "secure" offsite backup some place. Once it is on Glacier, then you can download the backup to your backup machine. From a security standpoint, it might be

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Bob Jolliffe
I think Steffen put his finger on it when he said that the backup should be restored (and hence tested) as part of the same scripted operation. But you make a good point about not having a dhis2 instance running live against that database as it would disturb the integrity of the backup. Its also

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Dan Cocos
Hi All, I think there are two concerns being discussed here. 1) Making sure there is a reliable backup in case something goes wrong. The first problem is pretty straight forward, one can create another instance in another region, another provider or locally. Then schedule a regular backup to t

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Steffen Tengesdal
Hi Gerald, As Bob pointed out, filezilla is a GUI tool and it does not support scheduling of downloads. Your local server should not have a GUI on it if it is a production system. If your local host a Linux system? If so, you can create a simple bash script on the localhost system that uses s

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread gerald thomas
Bob, My Suggestion: All local servers must be on 2.15 war file then we create a SFTP account on cloud server then we can use filezilla from the local server to download the backup from the cloud server. I know it is crude but that help for now. What is your take Bob. On 12/18/14, Bob Jolliffe wro

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Bob Jolliffe
Hi Steffen That makes sense and is pretty close to what I am suggesting as well. Do you have any thoughts about taking incremental backups of the datavalues tables? Even with the analytics and the like removed, some of these databases start to get quite big. Bob On 18 December 2014 at 12:27, S

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Steffen Tengesdal
We’ve set it up for clients where we can script a DB moving automatically from one server to another and it is automated entirely. Typically we have scripts that will do a dump without analytics (e.g. pg_dump -T analytics* -T completeness* dhis2 | /usr/bin/gzip -c > /tmp/dhis2.backup.gz), so

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Bob Jolliffe
I wouldn't do it that way. I think filezilla is a gui app. You need to have something automated if you are to rely on the offsite backup. If you want to use a gui now you could already use winscp on windows for example or an ssh location in nautilus file browser on linux so no need for sftp. On

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread gerald thomas
Bob, My Suggestion: All local servers must be on 2.15 war file then we create a SFTP account on cloud server then we can use filezilla from the local server to download the backup from the cloud server. I know it is crude but that help for now. What is your take Bob. On 12/18/14, Bob Jolliffe wro

Re: [Dhis2-users] [Dhis2-devs] Creating Sync between Linode(External Server) and Local Server

2014-12-18 Thread Bob Jolliffe
Hi Gerald We tested this when I was in Sierra Leone and we were finding serious problems with bandwidth getting the data back to Sierra Leone. So you are going to have to think carefully about when and how often to synch. Currently your database files are very small as you don't have much data o