Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-12 Thread Edward Ned Harvey
I don't think retransmissions of b0rken packets is a problem anymore, most people use ssh which provides good error detection at a fine grain. It is rare that one would need to resend an entire ZFS dump stream when using ssh (or TLS or ...) Archival tape systems are already designed to

Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-11 Thread Daniel Carosone
On Wed, Mar 10, 2010 at 02:54:18PM +0100, Svein Skogen wrote: Are there any good options for encapsulating/decapsulating a zfs send stream inside FEC (Forward Error Correction)? This could prove very useful both for backup purposes, and for long-haul transmissions. I used par2 for this for

Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-11 Thread Daniel Carosone
On Thu, Mar 11, 2010 at 07:23:43PM +1100, Daniel Carosone wrote: You have reminded me to go back and look again, and either find that whatever issue was at fault last time was transient and now gone, or determine what it actually was and get it resolved. In case you want to:

Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-11 Thread Svein Skogen
I can't help but keep wondering if not some sort of FEC wrapper (optional of course) might solve both the backup and some of the long-distance-transfer (where retransmissions really isn't wanted) issues. Reason I'm saying long-distance, is this is where latency-on-the-link starts rearing its

Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-11 Thread Richard Elling
On Mar 11, 2010, at 2:00 AM, Svein Skogen wrote: I can't help but keep wondering if not some sort of FEC wrapper (optional of course) might solve both the backup and some of the long-distance-transfer (where retransmissions really isn't wanted) issues. I don't think retransmissions of

Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-11 Thread Daniel Carosone
On Thu, Mar 11, 2010 at 02:00:41AM -0800, Svein Skogen wrote: I can't help but keep wondering if not some sort of FEC wrapper (optional of course) might solve both the backup and some of the long-distance-transfer (where retransmissions really isn't wanted) issues. Retransmissions aren't

[zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-10 Thread Svein Skogen
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Are there any good options for encapsulating/decapsulating a zfs send stream inside FEC (Forward Error Correction)? This could prove very useful both for backup purposes, and for long-haul transmissions. If there are any good options for simply

Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-10 Thread David Dyer-Bennet
On Wed, March 10, 2010 07:54, Svein Skogen wrote: Are there any good options for encapsulating/decapsulating a zfs send stream inside FEC (Forward Error Correction)? This could prove very useful both for backup purposes, and for long-haul transmissions. I don't know of anything that would

Re: [zfs-discuss] zfs send and receive ... any ideas for FEC?

2010-03-10 Thread Wes Felter
Svein Skogen wrote: Are there any good options for encapsulating/decapsulating a zfs send stream inside FEC (Forward Error Correction)? This could prove very useful both for backup purposes, and for long-haul transmissions. http://www.s.netic.de/gfiala/dvbackup.html