[zfs-discuss] Unknown Space Gain

2010-10-20 Thread Krunal Desai
Hi all, I've got an interesting (I think) thing happening with my storage pool (tank, 8x1.5TB RAID-Z2)...namely that I seem to gain free-space without deleting files. I noticed this happening awhile ago, so I set up a cron script that ran every night and does: pfexec ls -alR /tank

Re: [zfs-discuss] Unknown Space Gain

2010-10-20 Thread Krunal Desai
Huh, I don't actually ever recall enabling that. Perhaps that is connected to the message I started getting every minute recently in the kernel buffer, Oct 20 12:20:49 megatron pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 3 irq 0xf vector 0x45 ioapic 0x2 intin 0xf is bound to cpu

Re: [zfs-discuss] Unknown Space Gain

2010-10-20 Thread Krunal Desai
Argh, yes, lots of snapshots sitting around...apparently time-slider got activated somehow awhile back. Disabled the services and am now cleaning out the snapshots! On Wed, Oct 20, 2010 at 12:41 PM, Tomas Ögren st...@acc.umu.se wrote: On 20 October, 2010 - Krunal Desai sent me these 1,5K bytes

Re: [zfs-discuss] Unknown Space Gain

2010-10-20 Thread Krunal Desai
Where would that log be located? Tried poking around in /var/svc/log and /var/adm, but I've found just the snapshot-service logs (while useful, they don't seem to have logged the auto-deletion of snapshots). Also, that 'pcplusmp' is triggering every minute, on the minute. It's probably one of my

Re: [zfs-discuss] hardware going bad

2010-10-27 Thread Krunal Desai
I believe he meant a memory stress test, i.e. booting with a memtest86+ CD and seeing if it passed. Even if the memory is OK, the stress from that test may expose defects in the power supply or other components. Your CPU temperature is 56C, which is not out-of-line for most modern CPUs (you

Re: [zfs-discuss] hardware going bad

2010-10-27 Thread Krunal Desai
supplies? removing unnecessary add-on cards? Swapping mobos? On Wed, Oct 27, 2010 at 4:45 PM, Harry Putnam rea...@newsguy.com wrote: Toby Thain t...@telegraphics.com.au writes: On 27/10/10 4:21 PM, Krunal Desai wrote: I believe he meant a memory stress test, i.e. booting with a memtest86+ CD

Re: [zfs-discuss] ashift and vdevs

2010-11-23 Thread Krunal Desai
Interesting, I didn't realize that Soracle was working on/had a solution somewhat in place for 4K-drives. I wonder what will happen first for me, Hitachi 7K2000s hitting a reasonable price, or 4K/variable-size sector support hiting so I can use Samsung F4s or Barracuda LPs. On Tue, Nov 23, 2010

Re: [zfs-discuss] ashift and vdevs

2010-11-23 Thread Krunal Desai
On Tue, Nov 23, 2010 at 9:59 AM, taemun tae...@gmail.com wrote: I'm currently populating a pool with a 9-wide raidz vdev of Samsung HD204UI 2TB (5400rpm, 4KB sector) and a 9-wide raidz vdev of Seagate LP ST32000542AS 2TB (5900 rpm, 4KB sector) which was created with that binary, and haven't

Re: [zfs-discuss] ashift and vdevs

2010-11-26 Thread Krunal Desai
I'd also note that in the future at some point, we won't be able to purchase 512B drives any more. In particular, I think that 3TB drives will all be 4KB formatted. So it isn't inadvisable for a pool that you plan on expanding to have ashift=12 (imo). One new thought occurred to me; I know

Re: [zfs-discuss] Ext. UPS-backed SATA SSD ZIL?

2010-11-26 Thread Krunal Desai
What about powering the X25-E by an external power source, one that is also solid-state and backed by a UPS? In my experience, smaller power supplies tend to be much more reliable than typical ATX supplies. I don't think the different PSU would be an issue, The supply you've linked doesn't

Re: [zfs-discuss] ashift and vdevs

2010-11-26 Thread Krunal Desai
On Nov 26, 2010, at 20:09 , taemun wrote: If you consider that for a 4KB internal drive, with a 512B external interface, a request for a 512B write will result in the drive reading 4KB, modifying it (putting the new 512B in) and then writing the 4KB out again. This is terrible from a

Re: [zfs-discuss] OCZ RevoDrive ZFS support

2010-11-28 Thread Krunal Desai
There are problems with Sandforce controllers, according to forum posts. Buggy firmware. And in practice, Sandforce is far below it's theoretical values. I expect Intel to have fewer problems. I believe it's more the firmware (and pace of firmware updates) from companies making

Re: [zfs-discuss] Seagate ST32000542AS and ZFS perf

2010-11-29 Thread Krunal Desai
I'm using these drives for one of the vdevs in my pool. The pool was created with ashift=12 (zpool binary from http://digitaldj.net/2010/11/03/zfs-zpool-v28-openindiana-b147-4k-drives-and-you/), which limits the minimum block size to 4KB, the same as the physical block size on these drives. I

Re: [zfs-discuss] Seagate ST32000542AS and ZFS perf

2010-11-29 Thread Krunal Desai
On Mon, Nov 29, 2010 at 10:59 AM, Krunal Desai mov...@gmail.com wrote: The Seagate datasheet for those parts report 512-byte sectors. What is the deal with the ST32000542AS: native 512-byte sectors, native 4k-byte sector with selectable emulation, or native 4k-byte sectors with 512-byte sector

Re: [zfs-discuss] Seagate ST32000542AS and ZFS perf

2010-11-30 Thread Krunal Desai
Not sure where you got this figure from, the Barracuda Green (http://www.seagate.com/docs/pdf/datasheet/disc/ds1720_barracuda_green.pdf) is a different drive to the one we've been talking about in this thread (http://www.seagate.com/docs/pdf/datasheet/disc/ds_barracuda_lp.pdf). I would note

Re: [zfs-discuss] Large Drives

2010-12-10 Thread Krunal Desai
can I use any 2TB drive?  Even the WD that lie about their sector size?   Speed is not really of any importance here. Yes, you can. The WD will lie and say it's 512-byte sectors, and you'll get misaligned reads/writes and performance will suffer but it will work. I also need another vdev to

Re: [zfs-discuss] Looking for 3.5 SSD for ZIL

2010-12-22 Thread Krunal Desai
As of yet, I have only found 3.5 models with the Sandforce 1200, which was not recommended on this list. I actually bought a SF-1200 based OCZ Agility 2 (60G) for use as a ZIL/L2ARC (haven't installed it yet however, definitely jumped the gun on this purchase...) based on some recommendations

Re: [zfs-discuss] Looking for 3.5 SSD for ZIL

2010-12-22 Thread Krunal Desai
The ZIL accelerator's requirements differ from the L2ARC, as it's very purpose is to guarantee *all* data written to the log can be replayed (on next reboot) in case of host failure. Ah, so this would be why say a super-capacitor backed SSD can be very helpful, as it will have some backup

[zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-01 Thread Krunal Desai
I recently discovered a drive failure (either that or a loose cable, I need to investigate further) on my home fileserver. 'fmadm faulty' returns no output, but I can clearly see a failure when I do zpool status -v: pool: tank state: DEGRADED status: One or more devices has been removed by the

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-01 Thread Krunal Desai
On Tue, Feb 1, 2011 at 1:29 PM, Cindy Swearingen cindy.swearin...@oracle.com wrote: I agree that we need to get email updates for failing devices. Definitely! See if fmdump generated an error report using the commands below. Unfortunately not, see below: movax@megatron:/root# fmdump TIME

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-01 Thread Krunal Desai
On Tue, Feb 1, 2011 at 6:11 PM, Cindy Swearingen cindy.swearin...@oracle.com wrote: I misspoke and should clarify: 1. fmdump identifies fault reports that explain system issues 2. fmdump -eV identifies errors or problem symptoms Gotcha; fmdump -eV gives me the information I need. It appears

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-01 Thread Krunal Desai
The output of fmdump is explicit. I am interested to know if you saw aborts and timeouts or some other errors. I have the machine off atm while I install new disks (18x ST32000542AS), but IIRC they appeared as transport errors (scsi.something.transport, I can paste the exact errors in a

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-01 Thread Krunal Desai
On Tue, Feb 1, 2011 at 11:34 PM, Richard Elling richard.ell...@gmail.com wrote: There is a failure going on here.  It could be a cable or it could be a bad disk or firmware. The actual fault might not be in the disk reporting the errors (!) It is not a media error. Errors were as follows:

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-02 Thread Krunal Desai
This error code means the device is gone. The command got the bus, but could not access the target. Thanks for that! I updated firmware on both of my USAS-L8i (LSI1068E based), and while controller numbering has shifted around in Solaris (went from c10/c11 to c11/c12, not a big deal I think),

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-02 Thread Krunal Desai
# uname -a SunOS gandalf.taltos.org 5.11 snv_151a i86pc i386 i86pc movax@megatron:~# uname -a SunOS megatron 5.11 snv_151a i86pc i386 i86pc # /usr/local/sbin/smartctl -H -i -d sat /dev/rdsk/c7t0d0                                       smartctl 5.40 2010-10-16 r3189 [i386-pc-solaris2.11]

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-02 Thread Krunal Desai
So build the current version of smartmontools. As you should have seen in my original response, I'm using 5.40. Bugs in 5.36 are unlikely to be interesting to the maintainers of the package ;-) Oops, missed that in your log. Will try compiling from source and see what happens. Also,

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-02 Thread Krunal Desai
If you search for 'lsiutil solaris' on lsi.com, it'll direct you to zipfile that includes a solaris binary for x86 solaris. Yep, that worked, grabbed it off some other adapter's page. Thanks! ___ zfs-discuss mailing list zfs-discuss@opensolaris.org

Re: [zfs-discuss] kernel messages question

2011-02-06 Thread Krunal Desai
On Sat, Feb 5, 2011 at 5:44 PM, Roy Sigurd Karlsbakk r...@karlsbakk.net wrote: Hi I keep getting these messages on this one box. There are issues with at least one of the drives in it, but since there are some 80 drives in it, that's not really an issue. I just want to know, if anyone

[zfs-discuss] CPU Limited on Checksums?

2011-02-08 Thread Krunal Desai
Hi all, My system is powered by an Intel Core 2 Duo (E6600) with 8GB of RAM. Running into some very heavy CPU usage. First, a copy from one zpool to another (cp -aRv /oldtank/documents* /tank/documents/*), both in the same system. Load averages are around ~4.8. I think I used lockstat correctly,

Re: [zfs-discuss] Very bad ZFS write performance. Ok Read.

2011-02-14 Thread Krunal Desai
On Sat, Feb 12, 2011 at 3:14 AM, ian W dropbears...@yahoo.com.au wrote: Thanks for the responses.. I found the issue. It was due to power management, and a probably bug with event driven power management states, changing cpupm enable to cpupm enable poll-mode in /etc/power.conf fixed

Re: [zfs-discuss] CPU Limited on Checksums?

2011-02-16 Thread Krunal Desai
On Wed, Feb 9, 2011 at 12:02 AM, Richard Elling richard.ell...@gmail.com wrote: The data below does not show heavy CPU usage. Do you have data that does show heavy CPU usage?  mpstat would be a good start. Here is mpstat output during a network copy; I think one of the CPUs disappeared due to a

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-16 Thread Krunal Desai
On Wed, Feb 2, 2011 at 8:38 PM, Carson Gaspar car...@taltos.org wrote: Works For Me (TM). c7t0d0 is hanging off an LSI SAS3081E-R (SAS1068E chip) rev B3 MPT rev 105 Firmware rev 011d (1.29.00.00) (IT FW) This is a SATA disk - I don't have any SAS disks behind a LSI1068E to test. When I

Re: [zfs-discuss] fmadm faulty not showing faulty/offline disks?

2011-02-17 Thread Krunal Desai
On Thu, Feb 17, 2011 at 10:52 AM, Carson Gaspar car...@taltos.org wrote: Please give the _exact_ command you are running. I see the same thing, but only if I tray and retrieve some of the extended info (-x...). I don't see it with -a. Sure, here it is (apologies in advance if GMail applies its

Re: [zfs-discuss] External SATA drive enclosures + ZFS?

2011-02-27 Thread Krunal Desai
On Feb 27, 2011, at 10:48 , taemun wrote: eSATA has no need for any interposer chips between a modern SATA chipset on the motherboard and a SATA hard drive. You can buy cables with appropriate ends for this. There is no reason why the data side of an eSATA drive should be any more likely

Re: [zfs-discuss] GPU acceleration of ZFS

2011-05-10 Thread Krunal Desai
On Tue, May 10, 2011 at 11:29 AM, Anatoly legko...@fastmail.fm wrote: Good day, I think ZFS can take advantage of using GPU for sha256 calculation, encryption and maybe compression. Modern video card, like 5xxx or 6xxx ATI HD Series can do calculation of sha256 50-100 times faster than modern

Re: [zfs-discuss] 350TB+ storage solution

2011-05-16 Thread Krunal Desai
On Mon, May 16, 2011 at 1:20 PM, Brandon High bh...@freaks.com wrote: The 1TB and 2TB are manufactured in China, and have a very high failure and DOA rate according to Newegg. The 3TB drives come off the same production line as the Ultrastar 5K3000 in Thailand and may be more reliable.

Re: [zfs-discuss] 350TB+ storage solution

2011-05-16 Thread Krunal Desai
On Mon, May 16, 2011 at 2:29 PM, Paul Kraus p...@kraus-haus.org wrote: What Newegg was doing is buying drives in the 20-pack from the manufacturer and packing them individually WRAPPED IN BUBBLE WRAP and then stuffed in a box. No clamshell. I realized *something* was up when _every_ drive I

Re: [zfs-discuss] # disks per vdev

2011-06-15 Thread Krunal Desai
On Wed, Jun 15, 2011 at 8:20 AM, Lanky Doodle lanky_doo...@hotmail.com wrote: That's how I understood autoexpand, about not doing so until all disks have been done. I do indeed rip from disc rather than grab torrents - to VIDEO_TS folders and not ISO - on my laptop then copy the whole

Re: [zfs-discuss] Finding disks [was: # disks per vdev]

2011-07-05 Thread Krunal Desai
On Tue, Jul 5, 2011 at 7:47 AM, Lanky Doodle lanky_doo...@hotmail.com wrote: Thanks. I ruled out the SAS2008 controller as my motherboard is only PCIe 1.0 so would not have been able to make the most of the difference in increased bandwidth. Only PCIe 1.0? What chipset is that based on?

Re: [zfs-discuss] bad seagate drive?

2011-09-11 Thread Krunal Desai
On Sep 11, 2011, at 13:01 , Richard Elling wrote: The removed state can be the result of a transport issue. If this is a Solaris-based OS, then look at fmadm faulty for a diagnosis leading to a removal. If none, then look at fmdump -eV for errors relating to the disk. Last, check the

Re: [zfs-discuss] remove wrongly added device from zpool

2011-09-19 Thread Krunal Desai
On Mon, Sep 19, 2011 at 9:29 AM, Fred Liu fred_...@issi.com wrote: Yes. I have connected them back to server. But it does not help. I am really sad now... I cringed a little when I read the thread title. I did this on accident once as well, but lucky for me, I had enough scratch storage around

Re: [zfs-discuss] ZFS on Dell with FreeBSD

2011-10-19 Thread Krunal Desai
On Wed, Oct 19, 2011 at 10:14 AM, Albert Shih albert.s...@obspm.fr wrote: When we buy a MD1200 we need a RAID PERC H800 card on the server so we have two options :        1/ create a LV on the PERC H800 so the server see one volume and put        the zpool on this unique volume and let the

Re: [zfs-discuss] ZFS on Dell with FreeBSD

2011-10-20 Thread Krunal Desai
On Thu, Oct 20, 2011 at 5:49 AM, Albert Shih albert.s...@obspm.fr wrote: I'm not sure what you mean when you say «H200 flashed with IT firmware» ? IT is Initiator Target, and many LSI chips have a version of their firmware available that will put them into this mode, which is desirable for ZFS.

Re: [zfs-discuss] SAS HBA's with No Raid

2011-12-06 Thread Krunal Desai
to flash the controller with that firmware. Here is a guide that explains how to flash a LSI2008 that is on-board on a motherboard; adapt to your situation as needed: http://www.servethehome.com/howto-flash-supermicro-x8si6f-lsi-sas-2008-controller-lsi-firmware/ Regards, Krunal Desai Hardware

Re: [zfs-discuss] ZFS Pool Unavailable

2012-08-01 Thread Krunal Desai
On Aug 1, 2012, at 11:06, Jesse Jamez jesse.jam...@gmail.com wrote: Hello, I recently rebooted my workstation and the disk names changed causing my ZFS pool to be unavailable. I did not make any hardware changes? My first question is the obvious? Did I loose my data? Can I recover it?

Re: [zfs-discuss] Has anyone used a Dell with a PERC H310?

2013-01-08 Thread Krunal Desai
On Mon, Jan 7, 2013 at 4:16 PM, Sašo Kiselkov skiselkov...@gmail.comwrote: PERC H200 are well behaved cards that are easy to reflash and work well (even in JBOD mode) on Illumos - they are essentially a LSI SAS 9211. If you can get them, they're one heck of a reliable beast, and cheap too!