Re: [zfs-discuss] slow zfs send

2012-05-07 Thread Karl Rossing
On 12-05-07 8:45 PM, Bob Friesenhahn wrote: I see that there are a huge number of reads and hardy any reads. Are you SURE that deduplication was not enabled for this pool? This is the sort of behavior that one might expect if deduplication was enabled without enough RAM or L2 read cache. Bo

Re: [zfs-discuss] slow zfs send

2012-05-07 Thread Bob Friesenhahn
On Mon, 7 May 2012, Karl Rossing wrote: On 12-05-07 12:18 PM, Jim Klimov wrote: During the send you can also monitor "zpool iostat 1" and usual "iostat -xnz 1" in order to see how busy the disks are and how many IO requests are issued. The snapshots are likely sent in the order of block age (TX

Re: [zfs-discuss] slow zfs send

2012-05-07 Thread Karl Rossing
On 12-05-07 12:18 PM, Jim Klimov wrote: During the send you can also monitor "zpool iostat 1" and usual "iostat -xnz 1" in order to see how busy the disks are and how many IO requests are issued. The snapshots are likely sent in the order of block age (TXG number), which for a busy pool may mean

Re: [zfs-discuss] slow zfs send

2012-05-07 Thread Cindy Swearingen
Hi Karl, Someone sitting across the table from me (who saw my posting) informs me that CR 7060894 would not impact Solaris 10 releases, so kindly withdrawn my comment about CR 7060894. Thanks, Cindy On 5/7/12 11:35 AM, Cindy Swearingen wrote: Hi Karl, I like to verify that no dead or dying d

Re: [zfs-discuss] slow zfs send

2012-05-07 Thread Cindy Swearingen
Hi Karl, I like to verify that no dead or dying disk is killing pool performance and your zpool status looks good. Jim has replied with some ideas to check your individual device performance. Otherwise, you might be impacted by this CR: 7060894 zfs recv is excruciatingly slow This CR covers bo

Re: [zfs-discuss] slow zfs send

2012-05-07 Thread Jim Klimov
2012-05-07 20:45, Karl Rossing цкщеу: I'm wondering why the zfs send could be so slow. Could the other server be slowing down the sas bus? I hope other posters would have more relevant suggestions, but you can see if the buses are contended by dd'ing from the drives. At least that would give yo

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-17 Thread Richard Elling
On Nov 16, 2011, at 7:35 AM, David Dyer-Bennet wrote: > > On Tue, November 15, 2011 17:05, Anatoly wrote: >> Good day, >> >> The speed of send/recv is around 30-60 MBytes/s for initial send and >> 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk >> to 100+ disks in pool. Bu

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-16 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Anatoly > > I've just made clean test for sequential data read. System has 45 mirror > vdevs. 90 disks in the system... I bet you have a lot of ram? > 2. Read file normally: > # time dd if=

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-16 Thread Eric D. Mudama
On Wed, Nov 16 at 9:35, David Dyer-Bennet wrote: On Tue, November 15, 2011 17:05, Anatoly wrote: Good day, The speed of send/recv is around 30-60 MBytes/s for initial send and 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk to 100+ disks in pool. But the speed doesn't v

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-16 Thread Paul Kraus
On Wed, Nov 16, 2011 at 11:07 AM, Anatoly wrote: > I've just made clean test for sequential data read. System has 45 mirror > vdevs. > > 1. Create 160GB random file. > 2. Read it to /dev/null. > 3. Do Snaspshot and send it to /dev/null. > 4. Compare results. What OS? The following is under Sola

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-16 Thread Anatoly
Good day, I've just made clean test for sequential data read. System has 45 mirror vdevs. 1. Create 160GB random file. 2. Read it to /dev/null. 3. Do Snaspshot and send it to /dev/null. 4. Compare results. 1. Write speed is slow due to 'urandom

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-16 Thread David Dyer-Bennet
On Tue, November 15, 2011 17:05, Anatoly wrote: > Good day, > > The speed of send/recv is around 30-60 MBytes/s for initial send and > 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk > to 100+ disks in pool. But the speed doesn't vary in any degree. As I > understand 'zfs se

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-16 Thread David Dyer-Bennet
On Tue, November 15, 2011 20:08, Edward Ned Harvey wrote: >> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- >> boun...@opensolaris.org] On Behalf Of Anatoly >> >> The speed of send/recv is around 30-60 MBytes/s for initial send and >> 17-25 MBytes/s for incremental. I have seen lot

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-15 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Anatoly > > The speed of send/recv is around 30-60 MBytes/s for initial send and > 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk I suggest watching zpool iostat before

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-15 Thread Ian Collins
On 11/16/11 01:01 PM, Eric D. Mudama wrote: On Wed, Nov 16 at 3:05, Anatoly wrote: Good day, The speed of send/recv is around 30-60 MBytes/s for initial send and 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk to 100+ disks in pool. But the speed doesn't vary in any degr

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-15 Thread Andrew Gabriel
On 11/15/11 23:40, Tim Cook wrote: On Tue, Nov 15, 2011 at 5:17 PM, Andrew Gabriel mailto:andrew.gabr...@oracle.com>> wrote: On 11/15/11 23:05, Anatoly wrote: Good day, The speed of send/recv is around 30-60 MBytes/s for initial send and 17-25 MBytes/s for increm

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-15 Thread Eric D. Mudama
On Wed, Nov 16 at 3:05, Anatoly wrote: Good day, The speed of send/recv is around 30-60 MBytes/s for initial send and 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk to 100+ disks in pool. But the speed doesn't vary in any degree. As I understand 'zfs send' is a limiti

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-15 Thread Tim Cook
On Tue, Nov 15, 2011 at 5:17 PM, Andrew Gabriel wrote: > On 11/15/11 23:05, Anatoly wrote: > >> Good day, >> >> The speed of send/recv is around 30-60 MBytes/s for initial send and >> 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk to >> 100+ disks in pool. But the speed do

Re: [zfs-discuss] slow zfs send/recv speed

2011-11-15 Thread Andrew Gabriel
On 11/15/11 23:05, Anatoly wrote: Good day, The speed of send/recv is around 30-60 MBytes/s for initial send and 17-25 MBytes/s for incremental. I have seen lots of setups with 1 disk to 100+ disks in pool. But the speed doesn't vary in any degree. As I understand 'zfs send' is a limiting fa