Re: Announcing btrfs-dedupe 1.1.0

2017-01-26 Thread James Pharaoh
some large top level directories. Unfortunately it doesn't list which directory it has a problem with. Wouldn't it be better if btrfs-dedupe simply ignores directories it has a problem with, and continues with the rest? On 13.01.2017 20:08, James Pharaoh wrote: Did you try the binaries? I can buil

Re: Announcing btrfs-dedupe 1.1.0

2017-01-13 Thread James Pharaoh
you include some build instructions for people that are unfamiliar with compiling rust code? On 08.01.2017 17:57, James Pharaoh wrote: Hi everyone, I'm pleased to announce a new version of my btrfs-dedupe tool, written in rust, available here: http://btrfs-dedupe.com/ Binary packages built

Re: Announcing btrfs-dedupe 1.1.0

2017-01-08 Thread James Pharaoh
It's supposed to be public! Will have to look into that In any case, it's also on github here: https://github.com/wellbehavedsoftware/btrfs-dedupe James On 08/01/17 22:22, j...@mailb.org wrote: hey, On 01/08/2017 05:57 PM, James Pharaoh wrote: As normal for open source where

Announcing btrfs-dedupe 1.1.0

2017-01-08 Thread James Pharaoh
Hi everyone, I'm pleased to announce a new version of my btrfs-dedupe tool, written in rust, available here: http://btrfs-dedupe.com/ Binary packages built on ubuntu (probably will work elsewhere, but haven't tried this), are available at:

Re: Announcing btrfs-dedupe

2016-11-14 Thread James Pharaoh
On 14/11/16 20:51, Zygo Blaxell wrote: On Mon, Nov 14, 2016 at 01:39:02PM -0500, Austin S. Hemmelgarn wrote: On 2016-11-14 13:22, James Pharaoh wrote: One thing I am keen to understand is if BTRFS will automatically ignore a request to deduplicate a file if it is already deduplicated? Given

Re: Announcing btrfs-dedupe

2016-11-14 Thread James Pharaoh
On 14/11/16 19:07, Zygo Blaxell wrote: On Mon, Nov 07, 2016 at 07:49:51PM +0100, James Pharaoh wrote: Annoyingly I can't find this now, but I definitely remember reading someone, apparently someone knowledgable, claim that the latest version of the kernel which I was using at the time, still

Re: Announcing btrfs-dedupe

2016-11-13 Thread James Pharaoh
On 08/11/16 23:36, Saint Germain wrote: On Sun, 6 Nov 2016 14:30:52 +0100, James Pharaoh <ja...@wellbehavedsoftware.com> wrote : Hi all, I'm pleased to announce my btrfs deduplication utility, written in Rust. This operates on whole files, is fast, and I believe complements the existing uti

Re: Announcing btrfs-dedupe

2016-11-08 Thread James Pharaoh
Yes, everything you have described here is something I intend to create, and might as well include in the tool itself. I'll add it to the roadmap ;-) James On 08/11/16 17:57, Niccolò Belli wrote: On martedì 8 novembre 2016 12:38:48 CET, James Pharaoh wrote: You can't deduplicate a read-only

Re: Announcing btrfs-dedupe

2016-11-08 Thread James Pharaoh
On 08/11/16 12:06, Niccolò Belli wrote: Nice, you should probably update the btrfs wiki as well, because there is no mention of btrfs-dedupe. I am planning to, I had to apply for an account, which has now been approved. First question, why this name? Don't you plan to support xfs as well?

Re: Announcing btrfs-dedupe

2016-11-07 Thread James Pharaoh
Perhaps the complexity of doing this efficiently makes it inappropriate for inclusion in the tool itself, whereas I believe the core implementation's focus is on in-band deduplication, automatic and behind the scenes. On 08/11/16 03:40, Christoph Anton Mitterer wrote: On Mon, 2016-11-07 at

Re: Announcing btrfs-dedupe

2016-11-07 Thread James Pharaoh
FWIW I have updated my comments about duperemove and also the "caveat" section you mentioned in your other mail in the readme. http://btrfs-dedupe.com James On 07/11/16 19:49, James Pharaoh wrote: Annoyingly I can't find this now, but I definitely remember reading someone, apparent

Re: Announcing btrfs-dedupe

2016-11-07 Thread James Pharaoh
omepage for more information: http://btrfs-dedupe.com James Pharaoh -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe fro

Announcing btrfs-dedupe

2016-11-06 Thread James Pharaoh
Hi all, I'm pleased to announce my btrfs deduplication utility, written in Rust. This operates on whole files, is fast, and I believe complements the existing utilities (duperemove, bedup), which exist currently. Please visit the homepage for more information: http://btrfs-dedupe.com James

Re: Rust library for BTRFS

2016-10-19 Thread James Pharaoh
On 15/10/16 19:41, Hans van Kranenburg wrote: On 10/15/2016 04:31 PM, James Pharaoh wrote: >> I've basically reimplemented what I find in other tools because, as far as I can tell, there is no C library for BTRFS at this point. For code operating on an online filesystem, using the

Rust library for BTRFS

2016-10-15 Thread James Pharaoh
Hi all, I have created a BTRFS library for Rust - very incomplete so far, but possibly of interest to someone. https://gitlab.wellbehavedsoftware.com/well-behaved-software/rust-btrfs I've basically reimplemented what I find in other tools because, as far as I can tell, there is no C library

Re: BTRFS backup questions

2014-09-29 Thread James Pharaoh
On 27/09/14 18:59, Hugo Mills wrote: 2. Duplicating NOCOW files Are you trying to cross a mount-point with that? It works for me: Here's a script which replicates what I'm doing: https://gist.github.com/jamespharaoh/d693067ffd203689ebea And here's the output when I run it:

BTRFS backup questions

2014-09-27 Thread James Pharaoh
Hi, I'm trying to build a backup solution for a highly virtualized server environment, based on BTRFS. I have a lot of questions which I can't find the answers to, and have included some of the most important ones here. 1. Simultaneous snapshots I would really like to snapshot multiple

Re: BTRFS backup questions

2014-09-27 Thread James Pharaoh
On 27/09/14 18:17, Hugo Mills wrote: On Sat, Sep 27, 2014 at 05:39:07PM +0200, James Pharaoh wrote: 2. Duplicating NOCOW files This is obviously possible, since it takes place when you make a snapshot. So why can't I create a clone of a snapshot of a NOCOW file? I am hoping the answer