[zfs-discuss] zfs pool replication over removable hard ?

2011-08-01 Thread MMY
Hello
I need full copy of server zfs pool on removable hard with zfs file system 
.(auto sync)
and how to use removable hard on my laptop ?
i am looking solution with zfs features .
-- 
This message posted from opensolaris.org
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] zfs pool replication over removable hard ?

2011-08-01 Thread MMY
i found some solution for part 2:
zpool export Backup
remove usb storage and on laptop : zpool import Backup .
but i need removable device take all data from other pool like replication .
like one pool with two replicated hard or mirrored pool or raidz pool .
please help ?
-- 
This message posted from opensolaris.org
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


[zfs-discuss] ZFS Fragmentation issue - examining the ZIL

2011-08-01 Thread Josh Simon

Hello,

One of my coworkers was sent the following explanation from Oracle as to 
why one of backup systems was conducting a scrub so slow. I figured I 
would share it with the group.


http://wildness.espix.org/index.php?post/2011/06/09/ZFS-Fragmentation-issue-examining-the-ZIL

PS: Thought it was kind of odd that Oracle would direct us to a blog, 
but the post is very thorough.


Thanks,

Josh Simon

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] booting from ashift=12 pool..

2011-08-01 Thread Hans Rosenfeld
On Mon, Aug 01, 2011 at 11:22:36AM +1000, Daniel Carosone wrote:
  If you want to try it, the patch can be found at
  http://cr.illumos.org/view/6qc99xkh/illumos-1303-webrev/illumos-1303-webrev.patch
 
 Any chance of providing an alternate stage1/stage2 binary I can feed
 to installgrub?  When you're ready..

There is already an updated patch that also works with mirrored pools:
http://cr.illumos.org/view/77bat2me/illumos-1303-webrev-2/illumos-1303-webrev-2.patch

We track this issue at https://www.illumos.org/issues/1303, so if I have
to update the patch again, you can find it there.


Hans


-- 
%SYSTEM-F-ANARCHISM, The operating system has been overthrown
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] ZFS Fragmentation issue - examining the ZIL

2011-08-01 Thread Neil Perrin
In general the blogs conclusion is correct . When file systems get full 
there is

fragmentation (happens to all file systems) and for ZFS the pool uses gang
blocks of smaller blocks when there are insufficient large blocks.
However, the ZIL never allocates or uses gang blocks. It directly allocates
blocks (outside of the zio pipeline) using zio_alloc_zil() - 
metaslab_alloc().

Gang blocks are only used by the main pool when the pool transaction
group (txg) commit occurs.  Solutions to the problem include:
   - add a separate intent log
   - add more top level devices (hopefully replicated)
   - delete unused files/snapshots etc with in the poll...

Neil.


On 08/01/11 08:29, Josh Simon wrote:

Hello,

One of my coworkers was sent the following explanation from Oracle as 
to why one of backup systems was conducting a scrub so slow. I figured 
I would share it with the group.


http://wildness.espix.org/index.php?post/2011/06/09/ZFS-Fragmentation-issue-examining-the-ZIL 



PS: Thought it was kind of odd that Oracle would direct us to a blog, 
but the post is very thorough.


Thanks,

Josh Simon

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] ZFS Fragmentation issue - examining the ZIL

2011-08-01 Thread Brandon High
On Mon, Aug 1, 2011 at 2:16 PM, Neil Perrin neil.per...@oracle.com wrote:
 In general the blogs conclusion is correct . When file systems get full
 there is
 fragmentation (happens to all file systems) and for ZFS the pool uses gang
 blocks of smaller blocks when there are insufficient large blocks.

The blog doesn't mention how full the pool was. It's pretty well
documented that performance takes a nosedive at a certain point.

A slow scrub is actually not related to the problems in the blog post,
since there's not a lot of writes during (or at least caused by) a
scrub. Fragmentation is a real issue with pools that are (or have
been) very full. The data gets written out in fragments and has to be
read back in the same order.

If the mythical bp_rewrite code ever shows up, it will be possible to
defrag a pool. But not yet.

-B

-- 
Brandon High : bh...@freaks.com
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] ZFS Fragmentation issue - examining the ZIL

2011-08-01 Thread Richard Elling
On Aug 1, 2011, at 2:16 PM, Neil Perrin wrote:

 In general the blogs conclusion is correct . When file systems get full there 
 is
 fragmentation (happens to all file systems) and for ZFS the pool uses gang
 blocks of smaller blocks when there are insufficient large blocks.
 However, the ZIL never allocates or uses gang blocks. It directly allocates
 blocks (outside of the zio pipeline) using zio_alloc_zil() - 
 metaslab_alloc().
 Gang blocks are only used by the main pool when the pool transaction
 group (txg) commit occurs.  Solutions to the problem include:
   - add a separate intent log

Yes, I thought that it was odd that someone who is familiar with Oracle 
databases,
and their redo logs, didn't use separate intent logs.

   - add more top level devices (hopefully replicated)
   - delete unused files/snapshots etc with in the poll…

If gang activity is the root cause of the performance, then they must be at the
edge of effective space utilization.
 -- richard

 
 Neil.
 
 
 On 08/01/11 08:29, Josh Simon wrote:
 Hello,
 
 One of my coworkers was sent the following explanation from Oracle as to why 
 one of backup systems was conducting a scrub so slow. I figured I would 
 share it with the group.
 
 http://wildness.espix.org/index.php?post/2011/06/09/ZFS-Fragmentation-issue-examining-the-ZIL
  
 
 PS: Thought it was kind of odd that Oracle would direct us to a blog, but 
 the post is very thorough.
 
 Thanks,
 
 Josh Simon
 
 ___
 zfs-discuss mailing list
 zfs-discuss@opensolaris.org
 http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
 
 ___
 zfs-discuss mailing list
 zfs-discuss@opensolaris.org
 http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss