Re: [zfs-discuss] Zfs send speed. Was: User quota design discussion..

2009-04-10 Thread Vladimir Kotal
Jorgen Lundman wrote: We finally managed to upgrade the production x4500s to Sol 10 10/08 (unrelated to this) but with the hope that it would also make zfs send usable. Exactly how does build 105 translate to Solaris 10 10/08? My current There is no easy/obvious mapping of Solaris

Re: [zfs-discuss] ZIL SSD performance testing... -IOzone works great, others not so great

2009-04-10 Thread Patrick Skerrett
Thanks for the explanation folks. So if I cannot get Apache/Webdav to write synchronously, (and it does not look like I can), then is it possible to tune the ARC to be more write-buffered heavy? My biggest problem is with very quick spikes in writes periodically throughout the day. If I

Re: [zfs-discuss] vdev_disk_io_start() sending NULL pointer in ldi_ioctl()

2009-04-10 Thread Mark J Musante
On Thu, 9 Apr 2009, shyamali.chakrava...@sun.com wrote: Hi All, I have corefile where we see NULL pointer de-reference PANIC as we have sent (deliberately) NULL pointer for return value. vdev_disk_io_start() error = ldi_ioctl(dvd-vd_lh, zio-io_cmd,

Re: [zfs-discuss] vdev_disk_io_start() sending NULL pointer in ldi_ioctl()

2009-04-10 Thread George Wilson
shyamali.chakrava...@sun.com wrote: Hi All, I have corefile where we see NULL pointer de-reference PANIC as we have sent (deliberately) NULL pointer for return value. vdev_disk_io_start() ... ... error = ldi_ioctl(dvd-vd_lh, zio-io_cmd,

Re: [zfs-discuss] Efficient backup of ZFS filesystems?

2009-04-10 Thread Gary Mills
On Thu, Apr 09, 2009 at 04:25:58PM +0200, Henk Langeveld wrote: Gary Mills wrote: I've been watching the ZFS ARC cache on our IMAP server while the backups are running, and also when user activity is high. The two seem to conflict. Fast response for users seems to depend on their data being

Re: [zfs-discuss] ZFS Panic

2009-04-10 Thread Miles Nordin
r == Rince rincebr...@gmail.com writes: r *ZFS* shouldn't panic under those conditions. The disk layer, r perhaps, but not ZFS. well, yes, but panicing brings down the whole box anyway so there is no practical difference, just a difference in blame. I would rather say, the fact

Re: [zfs-discuss] Data size grew.. with compression on

2009-04-10 Thread Harry Putnam
David Magda dma...@ee.ryerson.ca writes: On Apr 7, 2009, at 16:43, OpenSolaris Forums wrote: if you have a snapshot of your files and rsync the same files again, you need to use --inplace rsync option , otherwise completely new blocks will be allocated for the new files. that`s because rsync

[zfs-discuss] Can zfs snapshot nfs mounts

2009-04-10 Thread Harry Putnam
I'm sorry if this either obvious or has beaten to death... I'm looking for ways to backup data on a linux server that has been using rsync with the script `rsnapshot'. Some of you may know how that works... I won't explain it here other than to say only changed data gets rsynced to the backup

Re: [zfs-discuss] Can zfs snapshot nfs mounts

2009-04-10 Thread Kees Nuyt
On Fri, 10 Apr 2009 13:18:05 -0500, Harry Putnam rea...@newsguy.com wrote: I'm sorry if this either obvious or has beaten to death... I'm looking for ways to backup data on a linux server that has been using rsync with the script `rsnapshot'. Some of you may know how that works... I won't

Re: [zfs-discuss] ZIL SSD performance testing... -IOzone works great, others not so great

2009-04-10 Thread Eric D. Mudama
On Fri, Apr 10 at 8:07, Patrick Skerrett wrote: Thanks for the explanation folks. So if I cannot get Apache/Webdav to write synchronously, (and it does not look like I can), then is it possible to tune the ARC to be more write-buffered heavy? My biggest problem is with very quick spikes

Re: [zfs-discuss] ZIL SSD performance testing... -IOzone works great, others not so great

2009-04-10 Thread Patrick Skerrett
More than that :) It's very very short duration, but we have the potential for 10's of thousands of clients doing writes all at the same time. I have the farm spread out over 16 servers, each with 2x 4GB fiber cards into big disk arrays, but my reads do get slow (resulting in end user

Re: [zfs-discuss] ZIL SSD performance testing... -IOzone works great, others not so great

2009-04-10 Thread Mark J Musante
On Fri, 10 Apr 2009, Patrick Skerrett wrote: degradation) when these write bursts come in, and if I could buffer them even for 60 seconds, it would make everything much smoother. ZFS already batches up writes into a transaction group, which currently happens every 30 seconds. Have you

Re: [zfs-discuss] ZIL SSD performance testing... -IOzone works great, others not so great

2009-04-10 Thread Patrick Skerrett
Yes, we are currently running ZFS, just without L2 ARC, or offloaded ZIL. Mark J Musante wrote: On Fri, 10 Apr 2009, Patrick Skerrett wrote: degradation) when these write bursts come in, and if I could buffer them even for 60 seconds, it would make everything much smoother. ZFS already

Re: [zfs-discuss] Can zfs snapshot nfs mounts

2009-04-10 Thread A Darren Dunham
On Fri, Apr 10, 2009 at 01:18:05PM -0500, Harry Putnam wrote: I'm looking for ways to backup data on a linux server that has been using rsync with the script `rsnapshot'. Some of you may know how that works... I won't explain it here other than to say only changed data gets rsynced to the

Re: [zfs-discuss] Can zfs snapshot nfs mounts

2009-04-10 Thread Harry Putnam
[...] Mount the nfs share on osol server, inside a zpool. Do whatever is the correct way on zfs to create a snapshot of that mounted data and write it onto another directory also inside the zpool. A week later mount the same nfs share from remote linux machine and create a second

Re: [zfs-discuss] Data size grew.. with compression on

2009-04-10 Thread Toby Thain
On 10-Apr-09, at 2:03 PM, Harry Putnam wrote: David Magda dma...@ee.ryerson.ca writes: On Apr 7, 2009, at 16:43, OpenSolaris Forums wrote: if you have a snapshot of your files and rsync the same files again, you need to use --inplace rsync option , otherwise completely new blocks will be

Re: [zfs-discuss] vdev_disk_io_start() sending NULL pointer in ldi_ioctl()

2009-04-10 Thread Shyamali . Chakravarty
Hi Mark, Thanks for responding. In my case cdev_ioctl() is going through vxdmp:dmpioctl() pc: 0x134ccb8 vxdmp:dmpioctl+0x8: stw%g0, [%i5] ( clr [%i5] ) npc: 0x134ccbc vxdmp:dmpioctl+0xc: or %g0, %i0, %o0 ( mov %i0, %o0 ) trapvxdmp:dmpioctl+0x8(, 0x422,

Re: [zfs-discuss] Can zfs snapshot nfs mounts

2009-04-10 Thread Fajar A. Nugraha
On Sat, Apr 11, 2009 at 4:41 AM, Harry Putnam rea...@newsguy.com wrote: Thanks for the input... I guess I'll have to wait and see what is resolved in the other thread about what happens when you rsync data to a zfs filesystem and how that inter plays with zfs snapshots going on too. Is there

Re: [zfs-discuss] ZIL SSD performance testing... -IOzone works great, others not so great

2009-04-10 Thread Toby Thain
On 10-Apr-09, at 5:05 PM, Mark J Musante wrote: On Fri, 10 Apr 2009, Patrick Skerrett wrote: degradation) when these write bursts come in, and if I could buffer them even for 60 seconds, it would make everything much smoother. ZFS already batches up writes into a transaction group,

Re: [zfs-discuss] ZIL SSD performance testing... -IOzone works great, others not so great

2009-04-10 Thread Neil Perrin
On 04/10/09 20:15, Toby Thain wrote: On 10-Apr-09, at 5:05 PM, Mark J Musante wrote: On Fri, 10 Apr 2009, Patrick Skerrett wrote: degradation) when these write bursts come in, and if I could buffer them even for 60 seconds, it would make everything much smoother. ZFS already batches up