Re: Need help in Subversion migration
On Mon, May 17, 2021 at 8:26 PM Daniel Shahaf wrote: > Mark Phippard wrote on Mon, 17 May 2021 12:24 +00:00: > > > > > On May 17, 2021, at 8:21 AM, jackson wrote: > > > > > > > > > Hello Everyone > > > > > > We are using subversion 1.7 running in LInux 6.9. > > > we are working on subversion migration along with OS upgrade > > > > > > Currently we have built RHEL 8.3 OS with subversion 1.10 and did all > the configuration , the 1.10 setup is up and working as expected . > > > > > > We need help in migrating the repo from current setup (v1.7 to the new > setup > > > > > > The current setup (v1.7) has the repo size of 500GB. we are using svn > load and svn dump method to migrate the repos from current setup (v1.7) to > new setup(v1.10) , but it takes a lot of time due to the size of the repo > (500GB) , Also the current setup (v1.7 is being currently used by the > customer ,soo even after taking the dump of one particular repo and loading > it in new setup , a newer revision is being made in the current setup > (v1.7 by the customer , thus making us to do the svn dump and lsvn load > again. > > > > > > now we need your help in identifying an efficient way in migrating the > repo from the current setup (v1.7 to the ew setup(v1.10) , Need your > expert advise on this please > > > > > > > > > Also let us know we can do rsync for this? > > > > > > Thanks & Regards, > > > Jackson J > > > > You do not have to do anything. Just point the new server at the > > existing repositories or move them to new location. > > That's not necessarily correct for BDB repositories. > > > You can use rsync, tar or whatever method you prefer. > > That's not correct for live repositories. > > Bo and David covered the svnsync and «svnadmin hotcopy» approaches; all > I have to add is that for «svnadmin dump», the --deltas, --incremental, > and -r options should be used as necessary. I'll add that several subsections of "Repository Maintenance" of Chapter 5 of the Subversion book are relevant, especially [1] and [2]. [1] Migrating Repository Data Elsewhere: http://svnbook.red-bean.com/en/1.7/svn.reposadmin.maint.html#svn.reposadmin.maint.migrate [2] Repository Replication: http://svnbook.red-bean.com/en/1.7/svn.reposadmin.maint.html#svn.reposadmin.maint.replication (In this case I think [1] is the more relevant of these.) Cheers, Nathan
Re: Need help in Subversion migration
Mark Phippard wrote on Mon, 17 May 2021 12:24 +00:00: > > > On May 17, 2021, at 8:21 AM, jackson wrote: > > > > > > Hello Everyone > > > > We are using subversion 1.7 running in LInux 6.9. > > we are working on subversion migration along with OS upgrade > > > > Currently we have built RHEL 8.3 OS with subversion 1.10 and did all the > > configuration , the 1.10 setup is up and working as expected . > > > > We need help in migrating the repo from current setup (v1.7 to the new setup > > > > The current setup (v1.7) has the repo size of 500GB. we are using svn load > > and svn dump method to migrate the repos from current setup (v1.7) to new > > setup(v1.10) , but it takes a lot of time due to the size of the repo > > (500GB) , Also the current setup (v1.7 is being currently used by the > > customer ,soo even after taking the dump of one particular repo and loading > > it in new setup , a newer revision is being made in the current setup > > (v1.7 by the customer , thus making us to do the svn dump and lsvn load > > again. > > > > now we need your help in identifying an efficient way in migrating the repo > > from the current setup (v1.7 to the ew setup(v1.10) , Need your expert > > advise on this please > > > > > > Also let us know we can do rsync for this? > > > > Thanks & Regards, > > Jackson J > > You do not have to do anything. Just point the new server at the > existing repositories or move them to new location. That's not necessarily correct for BDB repositories. > You can use rsync, tar or whatever method you prefer. That's not correct for live repositories. Bo and David covered the svnsync and «svnadmin hotcopy» approaches; all I have to add is that for «svnadmin dump», the --deltas, --incremental, and -r options should be used as necessary. Cheers, Daniel
Re: Need help in Subversion migration
On 5/17/21 10:03 AM, Bo Berglund wrote: > On Mon, 17 May 2021 08:24:55 -0400, Mark Phippard wrote: > >>> The current setup (v1.7) has the repo size of 500GB. we are using svn load >>> and svn dump method to migrate the repos from current setup (v1.7) to new >>> setup(v1.10) , but it takes a lot of time due to the size of the repo >>> (500GB) , Also the current setup (v1.7 is being currently used by the >>> customer ,soo even after taking the dump of one particular repo and loading >>> it in new setup , a newer revision is being made in the current setup >>> (v1.7 by the customer , thus making us to do the svn dump and lsvn load >>> again. >>> >>> now we need your help in identifying an efficient way in migrating the repo >>> from the current setup (v1.7 to the ew setup(v1.10) , Need your expert >>> advise on this please >>> >>> >>> Also let us know we can do rsync for this? >>> >>> Thanks & Regards, >>> Jackson J >> >> You do not have to do anything. Just point the new server at the existing >> repositories or move them to new location. You can use rsync, tar or >> whatever method you prefer. > > By the description it looks like the repository is *in use*, so there must be > two different Linux machines involved here. Not so easy to point the new > server > at tyhe same physical repo then. > And Jackson says that commits are also done during the migration process, > seems > like a not so good solution... > > A few years back I replicated our live SVN repository, to get a backup, by > using > a dump followed by a load on the replication server. The dump files were moved > over the Internet in tgz files before being used to load onto the new server. > > Then I set up svnsync to get the replica fully updated. That worked even over > the Internet, but my repo size was not as huge as here, only some 15 GB... > > Now the live server has a nightly svnsync script that keeps the two repos in > sync. If some network issues happen so that such a sync cannot be done then > the > following will catch up and make the replica current again. > > Something like that but running on the local LAN (for speed) would surely be > possible to migrate. > > A faster method of copying the repository than dump while being read consistent would be svnadmin hotcopy. This allows the repository to be open while being copied. If possible you can NFS mount the destination location and hotcopy straight to it. Then you can use incremental dump/restore from the source to the destination to pick up changes until you are ready to do the final cutover. I've used this method many times. -- Dave
Re: Need help in Subversion migration
On Mon, 17 May 2021 08:24:55 -0400, Mark Phippard wrote: >> The current setup (v1.7) has the repo size of 500GB. we are using svn load >> and svn dump method to migrate the repos from current setup (v1.7) to new >> setup(v1.10) , but it takes a lot of time due to the size of the repo >> (500GB) , Also the current setup (v1.7 is being currently used by the >> customer ,soo even after taking the dump of one particular repo and loading >> it in new setup , a newer revision is being made in the current setup (v1.7 >> by the customer , thus making us to do the svn dump and lsvn load again. >> >> now we need your help in identifying an efficient way in migrating the repo >> from the current setup (v1.7 to the ew setup(v1.10) , Need your expert >> advise on this please >> >> >> Also let us know we can do rsync for this? >> >> Thanks & Regards, >> Jackson J > >You do not have to do anything. Just point the new server at the existing >repositories or move them to new location. You can use rsync, tar or whatever >method you prefer. By the description it looks like the repository is *in use*, so there must be two different Linux machines involved here. Not so easy to point the new server at tyhe same physical repo then. And Jackson says that commits are also done during the migration process, seems like a not so good solution... A few years back I replicated our live SVN repository, to get a backup, by using a dump followed by a load on the replication server. The dump files were moved over the Internet in tgz files before being used to load onto the new server. Then I set up svnsync to get the replica fully updated. That worked even over the Internet, but my repo size was not as huge as here, only some 15 GB... Now the live server has a nightly svnsync script that keeps the two repos in sync. If some network issues happen so that such a sync cannot be done then the following will catch up and make the replica current again. Something like that but running on the local LAN (for speed) would surely be possible to migrate. -- Bo Berglund Developer in Sweden
Re: Need help in Subversion migration
> On May 17, 2021, at 8:21 AM, jackson wrote: > > > Hello Everyone > > We are using subversion 1.7 running in LInux 6.9. > we are working on subversion migration along with OS upgrade > > Currently we have built RHEL 8.3 OS with subversion 1.10 and did all the > configuration , the 1.10 setup is up and working as expected . > > We need help in migrating the repo from current setup (v1.7 to the new setup > > The current setup (v1.7) has the repo size of 500GB. we are using svn load > and svn dump method to migrate the repos from current setup (v1.7) to new > setup(v1.10) , but it takes a lot of time due to the size of the repo (500GB) > , Also the current setup (v1.7 is being currently used by the customer ,soo > even after taking the dump of one particular repo and loading it in new setup > , a newer revision is being made in the current setup (v1.7 by the customer > , thus making us to do the svn dump and lsvn load again. > > now we need your help in identifying an efficient way in migrating the repo > from the current setup (v1.7 to the ew setup(v1.10) , Need your expert > advise on this please > > > Also let us know we can do rsync for this? > > Thanks & Regards, > Jackson J You do not have to do anything. Just point the new server at the existing repositories or move them to new location. You can use rsync, tar or whatever method you prefer. Mark
Need help in Subversion migration
Hello Everyone We are using subversion 1.7 running in LInux 6.9. we are working on subversion migration along with OS upgrade Currently we have built RHEL 8.3 OS with subversion 1.10 and did all the configuration , the 1.10 setup is up and working as expected . We need help in migrating the repo from current setup (v1.7 to the new setup The current setup (v1.7) has the repo size of 500GB. we are using svn load and svn dump method to migrate the repos from current setup (v1.7) to new setup(v1.10) , but it takes a lot of time due to the size of the repo (500GB) , Also the current setup (v1.7 is being currently used by the customer ,soo even after taking the dump of one particular repo and loading it in new setup , a newer revision is being made in the current setup (v1.7 by the customer , thus making us to do the svn dump and lsvn load again. now we need your help in identifying an efficient way in migrating the repo from the current setup (v1.7 to the ew setup(v1.10) , Need your expert advise on this please Also let us know we can do rsync for this? Thanks & Regards, Jackson J
