On Sun, 23 Aug 2009, Daniel Carosone wrote:

Userland tools to read and verify a stream, without having to play it into a pool (seek and io overhead) could really help here.

This assumes that the problem is data corruption of the stream, which could occur anywhere, even on the originating host. The system where the data is stored may not support zfs-specific tools so portable OS-independent tools are desirable.

A simple way to create a self-validating stream is to pipe the data through gzip (or lzop) on the originating host. Gzip (or lzop) can then be used to verify that the data received/read is correct. This offers the additional benefit of some compression as well. In particular, lzop is quite fast and the compressor may actually help send or write performance.

Bob
--
Bob Friesenhahn
bfrie...@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/
GraphicsMagick Maintainer,    http://www.GraphicsMagick.org/
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to