Re: zfs send/recv: STILL invalid Backup Stream

2014-07-25 Thread Mark Martinec
On 2014-07-24 19:56, Allan Jude wrote: or better yet: ssh r...@tbh.lerctr.org zfs send ... | mbuffer -m 16M | zfs recv ... (The misc/mbuffer compensates for bursty zfs reads and writes. A note to myself: I should suggest to Allan to add mbuffer in a pipe as used in sysutils/zxfer, instead

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-25 Thread Larry Rosenman
On 2014-07-25 08:41, Larry Rosenman wrote: On Fri, Jul 25, 2014 at 11:58:48AM +0200, Mark Martinec wrote: Don't know, I'd guess some network-related memory limit is being hit on the sending site. Why not try to decouple the 'zfs send' from a network copy and ssh: Login to a remote side, do a

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-25 Thread Allan Jude
On 2014-07-25 09:49, Larry Rosenman wrote: On 2014-07-25 08:41, Larry Rosenman wrote: On Fri, Jul 25, 2014 at 11:58:48AM +0200, Mark Martinec wrote: Don't know, I'd guess some network-related memory limit is being hit on the sending site. Why not try to decouple the 'zfs send' from a network

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-25 Thread Larry Rosenman
On 2014-07-25 09:03, Allan Jude wrote: On 2014-07-25 09:49, Larry Rosenman wrote: On 2014-07-25 08:41, Larry Rosenman wrote: On Fri, Jul 25, 2014 at 11:58:48AM +0200, Mark Martinec wrote: Don't know, I'd guess some network-related memory limit is being hit on the sending site. Why not try to

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-25 Thread Mark Martinec
2014-07-25 15:41, Larry Rosenman wrote: On Fri, Jul 25, 2014 at 11:58:48AM +0200, Mark Martinec wrote: Don't know, I'd guess some network-related memory limit is being hit on the sending site. Why not try to decouple the 'zfs send' from a network copy and ssh: Login to a remote side, do a 'zfs

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Allan Jude
On 2014-07-24 13:33, Larry Rosenman wrote: TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT system, and receive the non-descript invalid backup stream. borg.lerctr.org /home/ler $ sudo bin/backup-TBH-ZFS-initial.sh Password: receiving full stream of zroot@2014-07-24 into

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 12:38, Allan Jude wrote: On 2014-07-24 13:33, Larry Rosenman wrote: TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT system, and receive the non-descript invalid backup stream. borg.lerctr.org /home/ler $ sudo bin/backup-TBH-ZFS-initial.sh Password: receiving

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 12:43, Larry Rosenman wrote: On 2014-07-24 12:38, Allan Jude wrote: On 2014-07-24 13:33, Larry Rosenman wrote: TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT system, and receive the non-descript invalid backup stream. borg.lerctr.org /home/ler $ sudo

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Allan Jude
On 2014-07-24 14:25, Larry Rosenman wrote: On 2014-07-24 12:43, Larry Rosenman wrote: On 2014-07-24 12:38, Allan Jude wrote: On 2014-07-24 13:33, Larry Rosenman wrote: TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT system, and receive the non-descript invalid backup

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 13:45, Allan Jude wrote: On 2014-07-24 14:25, Larry Rosenman wrote: On 2014-07-24 12:43, Larry Rosenman wrote: On 2014-07-24 12:38, Allan Jude wrote: On 2014-07-24 13:33, Larry Rosenman wrote: TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT system, and receive

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 13:46, Larry Rosenman wrote: I notice you are doing a deduplicated stream. Does it work without deduplication (zfs send -D)? I will try that after this zxfer test I'm running finishes, but IIRC it doesn't matter.. borg.lerctr.org /home/ler # zxfer -dFkPvs -g 376 -O

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Mark Martinec
2014-07-24 21:31, Larry Rosenman wrote: borg.lerctr.org /home/ler # zxfer -dFkPvs -g 376 -O r...@tbh.lerctr.org -R zroot zroot/backups/TBH Creating recursive snapshot zroot@zxfer_26699_20140724135840. Checking grandfather status of all snapshots marked for deletion... Grandfather check passed.

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 14:53, Mark Martinec wrote: 2014-07-24 21:31, Larry Rosenman wrote: borg.lerctr.org /home/ler # zxfer -dFkPvs -g 376 -O r...@tbh.lerctr.org -R zroot zroot/backups/TBH Creating recursive snapshot zroot@zxfer_26699_20140724135840. Checking grandfather status of all snapshots marked

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Allan Jude
On 2014-07-24 15:57, Larry Rosenman wrote: On 2014-07-24 14:53, Mark Martinec wrote: 2014-07-24 21:31, Larry Rosenman wrote: borg.lerctr.org /home/ler # zxfer -dFkPvs -g 376 -O r...@tbh.lerctr.org -R zroot zroot/backups/TBH Creating recursive snapshot zroot@zxfer_26699_20140724135840.

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 15:07, Allan Jude wrote: On 2014-07-24 15:57, Larry Rosenman wrote: On 2014-07-24 14:53, Mark Martinec wrote: 2014-07-24 21:31, Larry Rosenman wrote: borg.lerctr.org /home/ler # zxfer -dFkPvs -g 376 -O r...@tbh.lerctr.org -R zroot zroot/backups/TBH Creating recursive snapshot

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Mark Martinec
2014-07-24 21:57, Larry Rosenman wrote: Sending zroot/home@zxfer_26699_20140724135840 to zroot/backups/TBH/zroot/home. Write failed: Cannot allocate memory cannot receive new filesystem stream: invalid backup stream Error when zfs send/receiving.

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 15:26, Mark Martinec wrote: 2014-07-24 21:57, Larry Rosenman wrote: Sending zroot/home@zxfer_26699_20140724135840 to zroot/backups/TBH/zroot/home. Write failed: Cannot allocate memory cannot receive new filesystem stream: invalid backup

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 15:44, Larry Rosenman wrote: On 2014-07-24 15:26, Mark Martinec wrote: 2014-07-24 21:57, Larry Rosenman wrote: Sending zroot/home@zxfer_26699_20140724135840 to zroot/backups/TBH/zroot/home. Write failed: Cannot allocate memory cannot

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Allan Jude
On 2014-07-24 16:11, Larry Rosenman wrote: On 2014-07-24 15:07, Allan Jude wrote: On 2014-07-24 15:57, Larry Rosenman wrote: On 2014-07-24 14:53, Mark Martinec wrote: 2014-07-24 21:31, Larry Rosenman wrote: borg.lerctr.org /home/ler # zxfer -dFkPvs -g 376 -O r...@tbh.lerctr.org -R zroot

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 18:56, Allan Jude wrote: On 2014-07-24 16:11, Larry Rosenman wrote: On 2014-07-24 15:07, Allan Jude wrote: On 2014-07-24 15:57, Larry Rosenman wrote: On 2014-07-24 14:53, Mark Martinec wrote: 2014-07-24 21:31, Larry Rosenman wrote: borg.lerctr.org /home/ler # zxfer -dFkPvs -g

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Mark Martinec
2014-07-25 01:36 Larry Rosenman wrote: #!/bin/sh DATE=`date +%Y-%m-%d` #DATE2=2013-03-24 #DATE2=`date -v -1d +%Y-%m-%d` # snap the source ssh r...@tbh.lerctr.org zfs snapshot -r zroot@${DATE} # zfs copy the source to here. ssh r...@tbh.lerctr.org zfs send -v -R zroot@${DATE} | \ ssh

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Allan Jude
On 2014-07-24 20:46, Mark Martinec wrote: 2014-07-25 01:36 Larry Rosenman wrote: #!/bin/sh DATE=`date +%Y-%m-%d` #DATE2=2013-03-24 #DATE2=`date -v -1d +%Y-%m-%d` # snap the source ssh r...@tbh.lerctr.org zfs snapshot -r zroot@${DATE} # zfs copy the source to here. ssh

Re: zfs send/recv: STILL invalid Backup Stream

2014-07-24 Thread Larry Rosenman
On 2014-07-24 19:56, Allan Jude wrote: On 2014-07-24 20:46, Mark Martinec wrote: 2014-07-25 01:36 Larry Rosenman wrote: #!/bin/sh DATE=`date +%Y-%m-%d` #DATE2=2013-03-24 #DATE2=`date -v -1d +%Y-%m-%d` # snap the source ssh r...@tbh.lerctr.org zfs snapshot -r zroot@${DATE} # zfs copy the