Re: revisioning mysql server

[Shlomi Fish]

Hi Shimi and Erez,

On Wed, Mar 23, 2016 at 12:53 PM, shimi  wrote:

>
>
> On Wed, Mar 23, 2016 at 9:22 AM, Erez D  wrote:
>
>> hi
>>
>> i have a running mysql server, and want to be able to restore it to any
>> day, with as little backup space as needed
>>
>> i do mysqldump to the same file every day then commit the file with "svn
>> ci"
>> the idea is that if there are no changes, it takes no space
>>
>> it works well if i just append entries to a database, as svn will just
>> save the changes
>>
>> however, if i insert a record, and for instance the dump file has 5
>> record at every line
>> then the change is big and actually svn will save most of the file though
>> there is a very small change actually.
>>
>> another issue - if the records hold changing info like timestamps etc.
>>
>> any idea ?
>>
>>
> What about xdelta[1] and saving the .xdelta files ? (from last copy or
> original copy - your choice, but the cost of choosing the former to save
> space would be that you'll have to roll the opposite operation in sequence
> for any recovery)
>
>
Subversion already uses xdelta (or its alternative vdelta) internally for
keeping track of binary diffs, so this will likely not buy you much (and
add a lot of complexity to the process). I believe git and mercurial/hg can
handle binary diffs well in a similar manner. As a result, one cannot rely
on the textual "diff -u" output to accurately indicate the change size
(e.g: changing one byte in a line of thousands of bytes will yield a
thousands-bytes diff -u , but be a very small binary change).

Regards,

— Shlomi Fish


> -- Shimi
>
> [1] http://xdelta.org/
>
> ___
> Linux-il mailing list
> Linux-il@cs.huji.ac.il
> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
>
>


-- 
--
Shlomi Fish http://www.shlomifish.org/

Chuck Norris helps the gods that help themselves.

Please reply to list if it's a mailing list post - http://shlom.in/reply .
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il

Re: revisioning mysql server

[shimi]

On Wed, Mar 23, 2016 at 9:22 AM, Erez D  wrote:

> hi
>
> i have a running mysql server, and want to be able to restore it to any
> day, with as little backup space as needed
>
> i do mysqldump to the same file every day then commit the file with "svn
> ci"
> the idea is that if there are no changes, it takes no space
>
> it works well if i just append entries to a database, as svn will just
> save the changes
>
> however, if i insert a record, and for instance the dump file has 5 record
> at every line
> then the change is big and actually svn will save most of the file though
> there is a very small change actually.
>
> another issue - if the records hold changing info like timestamps etc.
>
> any idea ?
>
>
What about xdelta[1] and saving the .xdelta files ? (from last copy or
original copy - your choice, but the cost of choosing the former to save
space would be that you'll have to roll the opposite operation in sequence
for any recovery)

-- Shimi

[1] http://xdelta.org/
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il

Re: revisioning mysql server

[Efraim Flashner]

On Wed, 23 Mar 2016 09:22:06 +0200
Erez D  wrote:

> hi
> 
> i have a running mysql server, and want to be able to restore it to any
> day, with as little backup space as needed
> 
> i do mysqldump to the same file every day then commit the file with "svn ci"
> the idea is that if there are no changes, it takes no space
> 
> it works well if i just append entries to a database, as svn will just save
> the changes
> 
> however, if i insert a record, and for instance the dump file has 5 record
> at every line
> then the change is big and actually svn will save most of the file though
> there is a very small change actually.
> 
> another issue - if the records hold changing info like timestamps etc.
> 
> any idea ?

Is there a program like mysql-diff that will compare two dumps and spit out a 
diff file? Or is it possible to copy the incoming commands to the database and 
write them to a separate file and back that up with a weekly snapshot of the 
database?

-- 
Efraim Flashner      אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted


pgpfni4gYy8N0.pgp
Description: OpenPGP digital signature
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il

Re: revisioning mysql server

[Evgeniy Ginzburg]

You can try to switch to BUP https://bup.github.io/
This is GIT  based backup system, works fine in small scale scenarios.
It works OK with big files cause of chunk deduplication.


On Wed, Mar 23, 2016 at 9:22 AM, Erez D  wrote:

> hi
>
> i have a running mysql server, and want to be able to restore it to any
> day, with as little backup space as needed
>
> i do mysqldump to the same file every day then commit the file with "svn
> ci"
> the idea is that if there are no changes, it takes no space
>
> it works well if i just append entries to a database, as svn will just
> save the changes
>
> however, if i insert a record, and for instance the dump file has 5 record
> at every line
> then the change is big and actually svn will save most of the file though
> there is a very small change actually.
>
> another issue - if the records hold changing info like timestamps etc.
>
> any idea ?
>
>
>
>
>
> ___
> Linux-il mailing list
> Linux-il@cs.huji.ac.il
> http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il
>
>


-- 
So long, and thanks for all the fish.
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il

revisioning mysql server

[Erez D]

hi

i have a running mysql server, and want to be able to restore it to any
day, with as little backup space as needed

i do mysqldump to the same file every day then commit the file with "svn ci"
the idea is that if there are no changes, it takes no space

it works well if i just append entries to a database, as svn will just save
the changes

however, if i insert a record, and for instance the dump file has 5 record
at every line
then the change is big and actually svn will save most of the file though
there is a very small change actually.

another issue - if the records hold changing info like timestamps etc.

any idea ?
___
Linux-il mailing list
Linux-il@cs.huji.ac.il
http://mailman.cs.huji.ac.il/mailman/listinfo/linux-il