Re: [zfs-macos] RAIDZ1 running slow =(

2014-06-22 Thread James Hoyt
Hi guys! What a journey. So with school and work I finally was able to get 
everything pulled off my ZFS pool and ready to rebuild it.

Except I can't find the developer version...

I'm at downloads.maczfs.org and checked current and all downloads and the last 
release seems to be MacZFS-74.3.3.pkg, which I have installed:
collect-maczfs-state.sh v maczfs_74-3-3-68-ga26cd63


Determining system version
# uname -a
Darwin Jamess-iMac.local 13.2.0 Darwin Kernel Version 13.2.0: Thu Apr 17 
23:03:13 PDT 2014; root:xnu-2422.100.13~1/RELEASE_X86_64 x86_64

Looking for ZFS packages
# -v pkgs -sl Found %d packages pkgutil --pkgs | grep -e zfs -e ZFS -e ZEVO -e 
zevo
com.getgreenbytes.community.zfs.pkg
com.getgreenbytes.community.ZFSDriver.pkg
com.getgreenbytes.community.ZFSFilesystem.pkg
org.maczfs.zfs.106.pkg
Found 4 packages

So where is the developer version? Everything else is marked as depreciated. 
Please help D: I want to use the latest build experimental or not.

I'm going to use this line once I get the new version installed:
zpool create -f -O compression=lz4 -O casesensitivity=insensitive -O 
normalization=formD -O atime=off -o ashift=12 deathstar raidz disk1 disk2 disk3 
disk5

Do I need to delete the pool first or format the drives in any way special 
before doing this?

Thanks,

James

On May 20, 2014, at 4:21 PM, Bjoern Kahl googlelo...@bjoern-kahl.de wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 
 Hi James,
 
 Am 20.05.14 21:32, schrieb James Hoyt:
 So it sounds like I need to recreate my zpool ...
 
 Logical Block Size = 512 Physical Block Size = 4096
 
 So I should use the following command on my next zpool to help
 finder performance and make it compatible for 4k drives?
 
 zfs create -o normalization=formD atime=off murr ashift=12 (let me
 know if I have any errors in this)
 
 Almost.
 
 As said in my other mail an hour ago, normalization doesn't exist in
 the stable MacZFS version.  Also each option needs its own -o and
 ashift is a pool option, not a file system option.
 
 You do zpool create -o ashift=12 -O atime=off murr _devices_ ...
 
 Note the capital -O and the small letter -o.
 
 And for subsequent file systems (datasets in ZFS language) you use
 
  zfs create -o atime=off _pool_name/fs_name_
 
 If you used the development version, then you would add a
 -O normalization=formD in the zpool command and a
 -o normalization=formD in the zfs command.
 
 
 Best regards
 
Björn
 
 
 As for the slowness in a VM, Mac file sharing would affect it
 because Windows 8 accesses the drives with Fusion by mounting 
 \\jamess-imac\Volumes\murr as the Z drive so it technically is a
 file share if that's what you mean. But it could also be because
 the slowness of not using a 4k compatible zpool is compounded with
 a virtual machine. (Could someone updated the getting started guide
 to have you create a 4k zpool by default?)
 
 Thanks for the advice on Songbird! I may try it if it can organize
 via masks and support custom ID3 fields. I saw it's discontinued
 though but it's still on SourceForge.
 
 I'm at work so can't give a better reply but I have a lot more to
 look into and read now =)
 
 - James
 
 
 On Tue, May 20, 2014 at 2:07 PM, 'Busty' via zfs-macos 
 zfs-macos@googlegroups.com wrote:
 James,
 
 I use my 15TB pool mainly for flac files too, so I thought I'd
 throw in my two cents (even if some is not zfs related):
 
 regarding iTunes recognizing flac: There is a quicktime component
 that will enable flac in quicktime, iirc it also works in itunes,
 at least you can get it too. But it will not play gapless, there
 is an amount of silence between songs.
 
 Another thing is called TwistedFlac, which in a folder you can
 specify shows all flac files as wave files. These can be imported
 into iTunes, the downside is that the tags are not recognized.
 
 Just in case that helps with your library. I use songbird, which
 can about anything you want, but is not as stable as iTunes.
 
 Regarding your files showing up very slow, I experience that when
 I access my files on the pool from a remote machine which has to
 do with AFP (Apple filesharing protocol), so I have set up a NFS
 share. But you don'T writ eabout accessing the files from a a
 remote machine, so this should not be your issue.
 
 I kinda went the way you did. I had no knowledge of zfs but
 really wanted the features for data safety. That was roughly 3-4
 years ago. As I set up my pool (and my backup, by the way), I
 came across all kinds of problems (drives vanishing, kernel
 panics, slow file browsing, scripts to automate backups and
 scrubs, you name it) which had to be solved, so I had a lot of
 reading and googling to do. I kinda was fooled by the MacZFS
 tutorial into thinking that this will be completely easy like
 you describe.
 
 These guys, in the front row Jason and Alex Blewitt and Bjoern
 helped me a lot to get on the way (so thanks again guys)
 
 Sebastian
 
 
 On 20.05.14 20:28, James Hoyt wrote:
 Hi Bjorn 

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread James Hoyt
 a scrub on this 
 pool? Clean?

 The type of drives you have is not an issue, the make and known issues with 
 said drives might be, but you didn't provide that info.

 Using a raidcard and macJournaled terms, thrown out will not help you, your 
 either ZFS or not. That said, you will not get the same speed from ZFS as 
 from other raid setups, but you will get peace of mind on data integrity. I 
 do hope you are also backing up data from the pool as well or eventually 
 you will be in tears like so many others. A little forum searching under 
 old and new versions of mac zfs will be helpful.

 Since your getting started, once this is resolved it might be better to 
 build/run this under the latest (yes its in development) Mac ZFS rather 
 than the old tired version. It is quite a bit different, modern and makes 
 many things a lot easier. (Insert legal disclaimer here) ;)

 Interesting aside:
 Dave mentioned an interesting point about wearing out SSDs, and I must 
 admit I've had two such occurrences but only with a hackintosh and only 
 with less than stellar drives. Seems that here around the mad science lab 
 Intel SSDs are the most reliable long term. I have two of their originals 
 still outlasting several other brands.

 --
 Jason Belec
 Sent from my iPad

 On May 19, 2014, at 10:05 AM, James Hoyt djnati...@gmail.com wrote:

 Thanks for all the replies guys =D

 Sorry for lack of information. I'm running a Hackintosh with a 256 GB
 SSD and I sometimes run Windows 8.1 in a virtual machine via VmWare
 Fusion. The virtual image file is also located on the SSD. The only
 files I have on my zpool are data files. I don't run an OS or VM image
 from it. I have 12 GBs of RAM and a four core i5 processor. On the VM,
 I dedicate 6 GBs of RAM and 2 cores to it. It should be noted that I
 experience the slow down even when vmware is off it's just the drives
 act the slowest when the VM is running.

 As for how I created the zpool, I followed the Getting Started guide with

 zpool create murr raidz disk3s2 disk1s2 disk2s2 disk4s2

 Please help... I really hope I don't have to recreate it, but it's
 looking that way.

 Would it be better if I bought a RAID card and use Mac OS Journaled?
 Cost is an issue... the other issue is these are regular desktop 7200
 RPM drives.. not NAS drives.

 Thanks,

 James

 On Mon, May 19, 2014 at 7:43 AM, Jason Belec jasonbe...@belecmartin.com 
 wrote:
 Dave has posted some good info. Reminds me why I prefer Virtualbox. ;) We 
 do seem to need more detail though to really help the original OP.


 Jason
 Sent from my iPhone 5S

 On May 19, 2014, at 4:00 AM, Dave Cottlehuber d...@jsonified.com wrote:


 From: James Hoyt djnati...@gmail.com(mailto:djnati...@gmail.com)
 Reply: zfs-macos@googlegroups.com 
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Date: 19. Mai 2014 at 02:27:36
 To: zfs-macos@googlegroups.com 
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Subject: [zfs-macos] RAIDZ1 running slow =(

 So I setup a MacZFS RaidZ rather easily and was happy with myself. I 
 had four 3 TB internal SATA drives in a zpool giving me around 9 TB of 
 space.

 jamess-imac:~ sangie$ zpool status murr
 pool: murr
 state: ONLINE
 scrub: none requested
 config:

 NAME STATE READ WRITE CKSUM
 murr ONLINE 0 0 0
 raidz1 ONLINE 0 0 0
 disk3s2 ONLINE 0 0 0
 disk1s2 ONLINE 0 0 0
 disk2s2 ONLINE 0 0 0
 disk4s2 ONLINE 0 0 0

 errors: No known data errors

 So I Filled it up with about 5 GBs of data, mainly images and 
 FLAC/music files and everything just drags on it. It takes a long time 
 for files to be listed in finder and when I try to save an image from 
 Firefox, it will just grind and grind while I try to navigate to a 
 folder. I have vmware Fusion setup on my SSD (my main Mac drive) and 
 doing anything on my zpool from Windows (like using MediaMonkey to 
 organize FLAC files on it) uses up 100% of the CPU, freezing up my 
 computer until the moves are done, even when moving around 30 files.

 It’s not clear from this what your actual physical / virtual setup is. 
 Are you booting to OSX, and running Windows in a VM? Is the entire VM 
 then living on the raidz pool?

 Is my zpool okay? What's going on? Is this type of slowness normal or 
 do I have a bad drive? How will MacZFS report to me if a drive in the 
 array goes bad? I installed SMARTReporter Lite and it shows all drives 
 as green. If I have some drives on SATA II and others on SATA III would 
 that affect anything?

 If you want me to run any tests on it, I will do so gladly. Just let me 
 know.

 Thanks!

 I’ve seen precisely this sort of behaviour with vmware fusion when:

 1. my SSD was getting worn down (really, I trashed it in 1 year, it was 
 the default apple one coming with early 2011 MBP)
 2. the host OS  VM doesn’t have sufficient memory to run correctly 
 without swapping
 3. the additional memory within the VM is pulled from a disk swap file, 
 which is by default in the same disk location

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread James Hoyt
 the folders show, but they do in the Finder. So I wonder if this is an
 issue with programs not getting along with ZFS but the finder being
 fine with it.

 Other things to note, I did disable Spotlight on the drive to make
 sure that isn't running, but I do have QuickSilver. Originally, I had
 QuickSilver indexing the drive, but the computer was practically
 unusable when it did that so I disabled that.

 I look forward to any advice you guys may have.

 Thanks,

 James

 On Tue, May 20, 2014 at 6:14 AM, Jason Belec jasonbe...@belecmartin.com 
 wrote:
 OK, doesn't look like RAM, processor etc., are the issue Let's work 
 with that in mind for now.

 When the pool and the associated drives are not connected, is the 
 computer back to your expectation of normal? If so, you have one or more 
 bad cables, one or more bad drives, or a bit of both, perhaps a bad or 
 not quite capable power supply (solves 90% of all issues I come across). 
 Maybe even an issue with the motherboard. Simplest thing, have you run a 
 scrub on this pool? Clean?

 The type of drives you have is not an issue, the make and known issues 
 with said drives might be, but you didn't provide that info.

 Using a raidcard and macJournaled terms, thrown out will not help you, 
 your either ZFS or not. That said, you will not get the same speed from 
 ZFS as from other raid setups, but you will get peace of mind on data 
 integrity. I do hope you are also backing up data from the pool as well 
 or eventually you will be in tears like so many others. A little forum 
 searching under old and new versions of mac zfs will be helpful.

 Since your getting started, once this is resolved it might be better to 
 build/run this under the latest (yes its in development) Mac ZFS rather 
 than the old tired version. It is quite a bit different, modern and makes 
 many things a lot easier. (Insert legal disclaimer here) ;)

 Interesting aside:
 Dave mentioned an interesting point about wearing out SSDs, and I must 
 admit I've had two such occurrences but only with a hackintosh and only 
 with less than stellar drives. Seems that here around the mad science lab 
 Intel SSDs are the most reliable long term. I have two of their originals 
 still outlasting several other brands.

 --
 Jason Belec
 Sent from my iPad

 On May 19, 2014, at 10:05 AM, James Hoyt djnati...@gmail.com wrote:

 Thanks for all the replies guys =D

 Sorry for lack of information. I'm running a Hackintosh with a 256 GB
 SSD and I sometimes run Windows 8.1 in a virtual machine via VmWare
 Fusion. The virtual image file is also located on the SSD. The only
 files I have on my zpool are data files. I don't run an OS or VM image
 from it. I have 12 GBs of RAM and a four core i5 processor. On the VM,
 I dedicate 6 GBs of RAM and 2 cores to it. It should be noted that I
 experience the slow down even when vmware is off it's just the drives
 act the slowest when the VM is running.

 As for how I created the zpool, I followed the Getting Started guide with

 zpool create murr raidz disk3s2 disk1s2 disk2s2 disk4s2

 Please help... I really hope I don't have to recreate it, but it's
 looking that way.

 Would it be better if I bought a RAID card and use Mac OS Journaled?
 Cost is an issue... the other issue is these are regular desktop 7200
 RPM drives.. not NAS drives.

 Thanks,

 James

 On Mon, May 19, 2014 at 7:43 AM, Jason Belec 
 jasonbe...@belecmartin.com wrote:
 Dave has posted some good info. Reminds me why I prefer Virtualbox. ;) 
 We do seem to need more detail though to really help the original OP.


 Jason
 Sent from my iPhone 5S

 On May 19, 2014, at 4:00 AM, Dave Cottlehuber d...@jsonified.com 
 wrote:


 From: James Hoyt djnati...@gmail.com(mailto:djnati...@gmail.com)
 Reply: zfs-macos@googlegroups.com 
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Date: 19. Mai 2014 at 02:27:36
 To: zfs-macos@googlegroups.com 
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Subject: [zfs-macos] RAIDZ1 running slow =(

 So I setup a MacZFS RaidZ rather easily and was happy with myself. I 
 had four 3 TB internal SATA drives in a zpool giving me around 9 TB 
 of space.

 jamess-imac:~ sangie$ zpool status murr
 pool: murr
 state: ONLINE
 scrub: none requested
 config:

 NAME STATE READ WRITE CKSUM
 murr ONLINE 0 0 0
 raidz1 ONLINE 0 0 0
 disk3s2 ONLINE 0 0 0
 disk1s2 ONLINE 0 0 0
 disk2s2 ONLINE 0 0 0
 disk4s2 ONLINE 0 0 0

 errors: No known data errors

 So I Filled it up with about 5 GBs of data, mainly images and 
 FLAC/music files and everything just drags on it. It takes a long 
 time for files to be listed in finder and when I try to save an image 
 from Firefox, it will just grind and grind while I try to navigate to 
 a folder. I have vmware Fusion setup on my SSD (my main Mac drive) 
 and doing anything on my zpool from Windows (like using MediaMonkey 
 to organize FLAC files on it) uses up 100% of the CPU, freezing up my 
 computer until the moves are done

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread Daniel Becker
  To: zfs-macos@googlegroups.com zfs-macos@googlegroups.com(mailto:
 zfs-macos@googlegroups.com)
  Subject: [zfs-macos] RAIDZ1 running slow =(
 
  So I setup a MacZFS RaidZ rather easily and was happy with
 myself. I had four 3 TB internal SATA drives in a zpool giving me around 9
 TB of space.
 
  jamess-imac:~ sangie$ zpool status murr
  pool: murr
  state: ONLINE
  scrub: none requested
  config:
 
  NAME STATE READ WRITE CKSUM
  murr ONLINE 0 0 0
  raidz1 ONLINE 0 0 0
  disk3s2 ONLINE 0 0 0
  disk1s2 ONLINE 0 0 0
  disk2s2 ONLINE 0 0 0
  disk4s2 ONLINE 0 0 0
 
  errors: No known data errors
 
  So I Filled it up with about 5 GBs of data, mainly images and
 FLAC/music files and everything just drags on it. It takes a long time for
 files to be listed in finder and when I try to save an image from Firefox,
 it will just grind and grind while I try to navigate to a folder. I have
 vmware Fusion setup on my SSD (my main Mac drive) and doing anything on my
 zpool from Windows (like using MediaMonkey to organize FLAC files on it)
 uses up 100% of the CPU, freezing up my computer until the moves are done,
 even when moving around 30 files.
 
  It’s not clear from this what your actual physical / virtual
 setup is. Are you booting to OSX, and running Windows in a VM? Is the
 entire VM then living on the raidz pool?
 
  Is my zpool okay? What's going on? Is this type of slowness
 normal or do I have a bad drive? How will MacZFS report to me if a drive in
 the array goes bad? I installed SMARTReporter Lite and it shows all drives
 as green. If I have some drives on SATA II and others on SATA III would
 that affect anything?
 
  If you want me to run any tests on it, I will do so gladly. Just
 let me know.
 
  Thanks!
 
  I’ve seen precisely this sort of behaviour with vmware fusion
 when:
 
  1. my SSD was getting worn down (really, I trashed it in 1 year,
 it was the default apple one coming with early 2011 MBP)
  2. the host OS  VM doesn’t have sufficient memory to run
 correctly without swapping
  3. the additional memory within the VM is pulled from a disk swap
 file, which is by default in the same disk location as the VM itself
 
  Anything less than 8GB of RAM is likely to be tight, VMs will of
 course make this more complicated. Some notes on
 http://artykul8.com/2012/06/vmware-performance-enhancing/ may help.
 
  I found that my SSDs were being worn out with constant running of
 VMs; I use them heavily in my work. The solution I found was to get max RAM
 in my laptop + imac (16 vs 32 respectively), make a zfs based ramdisk with
 lz4 compression, and copy the entire VM into the ramdisk before running it.
 The copy phase only takes a few seconds from SSD, and it gives me a very
 nice way to “roll back” to the previous image when required. I can
 comfortably run Windows in a 20GiB ramdisk that fits inside a 10GiB zpool
 with compression, even on the 16GiB laptop, and allocating 2GiB of ram for
 the VM itself (10 + 2 for virtualisation  leave 4 for all of OSX stuff).
 
  Here’s the zsh functions I use for this.
 
  # create a 1GiB ramdisk
  ramdisk-1g () {
  ramdisk-create 2097152
  }
 
  # the generic function for the specific one above
  ramdisk-create () {
  diskutil eject /Volumes/ramdisk  /dev/null 21
  diskutil erasevolume HFS+ 'ramdisk' `hdiutil attach -nomount
 ram://$1`
  cd /ramdisk
  }
 
  # make a zpool backed ramdisk instead of the HFS+ ones above.
 Main advantage is compression. I get at least 2x more “disk” for RAM with
 this approach.
  zdisk () {
  sudo zpool create -O compression=lz4 -fm /zram zram `hdiutil
 attach -nomount ram://20971520`
  sudo chown -R $USER /zram
  cd /zram
  }
 
  # self explanatory
  zdisk-destroy () {
  sudo zpool export -f zram
  }
 
  —
  Dave Cottlehuber
  d...@jsonified.com
  Sent from my Couch
 
 
 
  --
 
  ---
  You received this message because you are subscribed to the
 Google Groups zfs-macos group.
  To unsubscribe from this group and stop receiving emails from it,
 send an email to zfs-macos+unsubscr...@googlegroups.com.
  For more options, visit https://groups.google.com/d/optout.
 
  --
 
  ---
  You received this message because you are subscribed to a topic in
 the Google Groups zfs-macos group.
  To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/zfs-macos/78gD-0OzKMQ/unsubscribe.
  To unsubscribe from this group and all its topics, send an email
 to zfs-macos+unsubscr...@googlegroups.com.
  For more options, visit https://groups.google.com/d/optout.
 
  --
 
  ---
  You received this message because you are subscribed to the Google
 Groups zfs-macos group.
  To unsubscribe from this group and stop receiving emails from it,
 send an email to zfs-macos+unsubscr...@googlegroups.com.
  For more options, visit https://groups.google.com/d/optout.
 
  --
 
  ---
  You received this message because you are subscribed to a topic in
 the Google Groups zfs-macos group.
  To unsubscribe from this topic, visit
 https://groups.google.com/d/topic

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread Bjoern Kahl
 this is resolved it might be
 better to build/run this under the latest (yes its in
 development) Mac ZFS rather than the old tired version. It is
 quite a bit different, modern and makes many things a lot
 easier. (Insert legal disclaimer here) ;)
 
 Interesting aside: Dave mentioned an interesting point about
 wearing out SSDs, and I must admit I've had two such
 occurrences but only with a hackintosh and only with less
 than stellar drives. Seems that here around the mad science
 lab Intel SSDs are the most reliable long term. I have two of
 their originals still outlasting several other brands.
 
 -- Jason Belec Sent from my iPad
 
 On May 19, 2014, at 10:05 AM, James Hoyt
 djnati...@gmail.com wrote:
 
 Thanks for all the replies guys =D
 
 Sorry for lack of information. I'm running a Hackintosh
 with a 256 GB SSD and I sometimes run Windows 8.1 in a
 virtual machine via VmWare Fusion. The virtual image file
 is also located on the SSD. The only files I have on my
 zpool are data files. I don't run an OS or VM image from
 it. I have 12 GBs of RAM and a four core i5 processor. On
 the VM, I dedicate 6 GBs of RAM and 2 cores to it. It
 should be noted that I experience the slow down even when
 vmware is off it's just the drives act the slowest when the
 VM is running.
 
 As for how I created the zpool, I followed the Getting
 Started guide with
 
 zpool create murr raidz disk3s2 disk1s2 disk2s2 disk4s2
 
 Please help... I really hope I don't have to recreate it,
 but it's looking that way.
 
 Would it be better if I bought a RAID card and use Mac OS
 Journaled? Cost is an issue... the other issue is these are
 regular desktop 7200 RPM drives.. not NAS drives.
 
 Thanks,
 
 James
 
 On Mon, May 19, 2014 at 7:43 AM, Jason Belec
 jasonbe...@belecmartin.com wrote: Dave has posted some
 good info. Reminds me why I prefer Virtualbox. ;) We do
 seem to need more detail though to really help the
 original OP.
 
 
 Jason Sent from my iPhone 5S
 
 On May 19, 2014, at 4:00 AM, Dave Cottlehuber
 d...@jsonified.com wrote:
 
 
 From: James Hoyt
 djnati...@gmail.com(mailto:djnati...@gmail.com) Reply:
 zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)

 
Date: 19. Mai 2014 at 02:27:36
 To: zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)

 
Subject: [zfs-macos] RAIDZ1 running slow =(
 
 So I setup a MacZFS RaidZ rather easily and was happy
 with myself. I had four 3 TB internal SATA drives in
 a zpool giving me around 9 TB of space.
 
 jamess-imac:~ sangie$ zpool status murr pool: murr 
 state: ONLINE scrub: none requested config:
 
 NAME STATE READ WRITE CKSUM murr ONLINE 0 0 0 raidz1
 ONLINE 0 0 0 disk3s2 ONLINE 0 0 0 disk1s2 ONLINE 0 0
 0 disk2s2 ONLINE 0 0 0 disk4s2 ONLINE 0 0 0
 
 errors: No known data errors
 
 So I Filled it up with about 5 GBs of data, mainly
 images and FLAC/music files and everything just drags
 on it. It takes a long time for files to be listed in
 finder and when I try to save an image from Firefox,
 it will just grind and grind while I try to navigate
 to a folder. I have vmware Fusion setup on my SSD (my
 main Mac drive) and doing anything on my zpool from
 Windows (like using MediaMonkey to organize FLAC
 files on it) uses up 100% of the CPU, freezing up my
 computer until the moves are done, even when moving
 around 30 files.
 
 It’s not clear from this what your actual physical /
 virtual setup is. Are you booting to OSX, and running
 Windows in a VM? Is the entire VM then living on the
 raidz pool?
 
 Is my zpool okay? What's going on? Is this type of
 slowness normal or do I have a bad drive? How will
 MacZFS report to me if a drive in the array goes bad?
 I installed SMARTReporter Lite and it shows all
 drives as green. If I have some drives on SATA II and
 others on SATA III would that affect anything?
 
 If you want me to run any tests on it, I will do so
 gladly. Just let me know.
 
 Thanks!
 
 I’ve seen precisely this sort of behaviour with vmware
 fusion when:
 
 1. my SSD was getting worn down (really, I trashed it
 in 1 year, it was the default apple one coming with
 early 2011 MBP) 2. the host OS  VM doesn’t have
 sufficient memory to run correctly without swapping 3.
 the additional memory within the VM is pulled from a
 disk swap file, which is by default in the same disk
 location as the VM itself
 
 Anything less than 8GB of RAM is likely to be tight,
 VMs will of course make this more complicated. Some
 notes on
 http://artykul8.com/2012/06/vmware-performance-enhancing/
 may help.
 
 I found that my SSDs were being worn out with constant
 running of VMs; I use them heavily in my work. The
 solution I found was to get max RAM in my laptop + imac
 (16 vs 32 respectively), make a zfs based ramdisk with
 lz4 compression, and copy the entire VM into the
 ramdisk before running it. The copy phase only takes a
 few seconds from SSD, and it gives me a very nice way
 to “roll back” to the previous image

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread James Hoyt
 other raid setups, but you will get peace of mind on data
  integrity. I do hope you are also backing up data from the pool as 
  well or
  eventually you will be in tears like so many others. A little forum
  searching under old and new versions of mac zfs will be helpful.
 
  Since your getting started, once this is resolved it might be better
  to build/run this under the latest (yes its in development) Mac ZFS 
  rather
  than the old tired version. It is quite a bit different, modern and 
  makes
  many things a lot easier. (Insert legal disclaimer here) ;)
 
  Interesting aside:
  Dave mentioned an interesting point about wearing out SSDs, and I
  must admit I've had two such occurrences but only with a hackintosh 
  and only
  with less than stellar drives. Seems that here around the mad science 
  lab
  Intel SSDs are the most reliable long term. I have two of their 
  originals
  still outlasting several other brands.
 
  --
  Jason Belec
  Sent from my iPad
 
  On May 19, 2014, at 10:05 AM, James Hoyt djnati...@gmail.com
  wrote:
 
  Thanks for all the replies guys =D
 
  Sorry for lack of information. I'm running a Hackintosh with a 256
  GB
  SSD and I sometimes run Windows 8.1 in a virtual machine via VmWare
  Fusion. The virtual image file is also located on the SSD. The only
  files I have on my zpool are data files. I don't run an OS or VM
  image
  from it. I have 12 GBs of RAM and a four core i5 processor. On the
  VM,
  I dedicate 6 GBs of RAM and 2 cores to it. It should be noted that
  I
  experience the slow down even when vmware is off it's just the
  drives
  act the slowest when the VM is running.
 
  As for how I created the zpool, I followed the Getting Started
  guide with
 
  zpool create murr raidz disk3s2 disk1s2 disk2s2 disk4s2
 
  Please help... I really hope I don't have to recreate it, but it's
  looking that way.
 
  Would it be better if I bought a RAID card and use Mac OS
  Journaled?
  Cost is an issue... the other issue is these are regular desktop
  7200
  RPM drives.. not NAS drives.
 
  Thanks,
 
  James
 
  On Mon, May 19, 2014 at 7:43 AM, Jason Belec
  jasonbe...@belecmartin.com wrote:
  Dave has posted some good info. Reminds me why I prefer
  Virtualbox. ;) We do seem to need more detail though to really help 
  the
  original OP.
 
 
  Jason
  Sent from my iPhone 5S
 
  On May 19, 2014, at 4:00 AM, Dave Cottlehuber d...@jsonified.com
  wrote:
 
 
  From: James Hoyt djnati...@gmail.com(mailto:djnati...@gmail.com)
  Reply: zfs-macos@googlegroups.com
  zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
  Date: 19. Mai 2014 at 02:27:36
  To: zfs-macos@googlegroups.com
  zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
  Subject: [zfs-macos] RAIDZ1 running slow =(
 
  So I setup a MacZFS RaidZ rather easily and was happy with
  myself. I had four 3 TB internal SATA drives in a zpool giving me 
  around 9
  TB of space.
 
  jamess-imac:~ sangie$ zpool status murr
  pool: murr
  state: ONLINE
  scrub: none requested
  config:
 
  NAME STATE READ WRITE CKSUM
  murr ONLINE 0 0 0
  raidz1 ONLINE 0 0 0
  disk3s2 ONLINE 0 0 0
  disk1s2 ONLINE 0 0 0
  disk2s2 ONLINE 0 0 0
  disk4s2 ONLINE 0 0 0
 
  errors: No known data errors
 
  So I Filled it up with about 5 GBs of data, mainly images and
  FLAC/music files and everything just drags on it. It takes a long 
  time for
  files to be listed in finder and when I try to save an image from 
  Firefox,
  it will just grind and grind while I try to navigate to a folder. 
  I have
  vmware Fusion setup on my SSD (my main Mac drive) and doing 
  anything on my
  zpool from Windows (like using MediaMonkey to organize FLAC files 
  on it)
  uses up 100% of the CPU, freezing up my computer until the moves 
  are done,
  even when moving around 30 files.
 
  It’s not clear from this what your actual physical / virtual
  setup is. Are you booting to OSX, and running Windows in a VM? Is 
  the entire
  VM then living on the raidz pool?
 
  Is my zpool okay? What's going on? Is this type of slowness
  normal or do I have a bad drive? How will MacZFS report to me if a 
  drive in
  the array goes bad? I installed SMARTReporter Lite and it shows 
  all drives
  as green. If I have some drives on SATA II and others on SATA III 
  would that
  affect anything?
 
  If you want me to run any tests on it, I will do so gladly. Just
  let me know.
 
  Thanks!
 
  I’ve seen precisely this sort of behaviour with vmware fusion
  when:
 
  1. my SSD was getting worn down (really, I trashed it in 1 year,
  it was the default apple one coming with early 2011 MBP)
  2. the host OS  VM doesn’t have sufficient memory to run
  correctly without swapping
  3. the additional memory within the VM is pulled from a disk swap
  file, which is by default in the same disk location as the VM itself
 
  Anything less than 8GB of RAM is likely to be tight, VMs will of
  course make this more complicated. Some notes on
  http://artykul8.com/2012

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread Jason Belec
 and the associated drives are not connected, is the
 computer back to your expectation of normal? If so, you have one or 
 more bad
 cables, one or more bad drives, or a bit of both, perhaps a bad or not 
 quite
 capable power supply (solves 90% of all issues I come across). Maybe 
 even an
 issue with the motherboard. Simplest thing, have you run a scrub on 
 this
 pool? Clean?
 
 The type of drives you have is not an issue, the make and known
 issues with said drives might be, but you didn't provide that info.
 
 Using a raidcard and macJournaled terms, thrown out will not help
 you, your either ZFS or not. That said, you will not get the same 
 speed from
 ZFS as from other raid setups, but you will get peace of mind on data
 integrity. I do hope you are also backing up data from the pool as 
 well or
 eventually you will be in tears like so many others. A little forum
 searching under old and new versions of mac zfs will be helpful.
 
 Since your getting started, once this is resolved it might be better
 to build/run this under the latest (yes its in development) Mac ZFS 
 rather
 than the old tired version. It is quite a bit different, modern and 
 makes
 many things a lot easier. (Insert legal disclaimer here) ;)
 
 Interesting aside:
 Dave mentioned an interesting point about wearing out SSDs, and I
 must admit I've had two such occurrences but only with a hackintosh 
 and only
 with less than stellar drives. Seems that here around the mad science 
 lab
 Intel SSDs are the most reliable long term. I have two of their 
 originals
 still outlasting several other brands.
 
 --
 Jason Belec
 Sent from my iPad
 
 On May 19, 2014, at 10:05 AM, James Hoyt djnati...@gmail.com
 wrote:
 
 Thanks for all the replies guys =D
 
 Sorry for lack of information. I'm running a Hackintosh with a 256
 GB
 SSD and I sometimes run Windows 8.1 in a virtual machine via VmWare
 Fusion. The virtual image file is also located on the SSD. The only
 files I have on my zpool are data files. I don't run an OS or VM
 image
 from it. I have 12 GBs of RAM and a four core i5 processor. On the
 VM,
 I dedicate 6 GBs of RAM and 2 cores to it. It should be noted that
 I
 experience the slow down even when vmware is off it's just the
 drives
 act the slowest when the VM is running.
 
 As for how I created the zpool, I followed the Getting Started
 guide with
 
 zpool create murr raidz disk3s2 disk1s2 disk2s2 disk4s2
 
 Please help... I really hope I don't have to recreate it, but it's
 looking that way.
 
 Would it be better if I bought a RAID card and use Mac OS
 Journaled?
 Cost is an issue... the other issue is these are regular desktop
 7200
 RPM drives.. not NAS drives.
 
 Thanks,
 
 James
 
 On Mon, May 19, 2014 at 7:43 AM, Jason Belec
 jasonbe...@belecmartin.com wrote:
 Dave has posted some good info. Reminds me why I prefer
 Virtualbox. ;) We do seem to need more detail though to really help 
 the
 original OP.
 
 
 Jason
 Sent from my iPhone 5S
 
 On May 19, 2014, at 4:00 AM, Dave Cottlehuber d...@jsonified.com
 wrote:
 
 
 From: James Hoyt djnati...@gmail.com(mailto:djnati...@gmail.com)
 Reply: zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Date: 19. Mai 2014 at 02:27:36
 To: zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Subject: [zfs-macos] RAIDZ1 running slow =(
 
 So I setup a MacZFS RaidZ rather easily and was happy with
 myself. I had four 3 TB internal SATA drives in a zpool giving me 
 around 9
 TB of space.
 
 jamess-imac:~ sangie$ zpool status murr
 pool: murr
 state: ONLINE
 scrub: none requested
 config:
 
 NAME STATE READ WRITE CKSUM
 murr ONLINE 0 0 0
 raidz1 ONLINE 0 0 0
 disk3s2 ONLINE 0 0 0
 disk1s2 ONLINE 0 0 0
 disk2s2 ONLINE 0 0 0
 disk4s2 ONLINE 0 0 0
 
 errors: No known data errors
 
 So I Filled it up with about 5 GBs of data, mainly images and
 FLAC/music files and everything just drags on it. It takes a long 
 time for
 files to be listed in finder and when I try to save an image from 
 Firefox,
 it will just grind and grind while I try to navigate to a folder. 
 I have
 vmware Fusion setup on my SSD (my main Mac drive) and doing 
 anything on my
 zpool from Windows (like using MediaMonkey to organize FLAC files 
 on it)
 uses up 100% of the CPU, freezing up my computer until the moves 
 are done,
 even when moving around 30 files.
 
 It’s not clear from this what your actual physical / virtual
 setup is. Are you booting to OSX, and running Windows in a VM? Is 
 the entire
 VM then living on the raidz pool?
 
 Is my zpool okay? What's going on? Is this type of slowness
 normal or do I have a bad drive? How will MacZFS report to me if a 
 drive in
 the array goes bad? I installed SMARTReporter Lite and it shows 
 all drives
 as green. If I have some drives on SATA II and others on SATA III 
 would that
 affect anything?
 
 If you want me to run any tests on it, I will do so gladly. Just
 let me know.
 
 Thanks!
 
 I’ve

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread 'Busty' via zfs-macos
 it will take 1-3 minutes to just list the files in the directory).
 Also when I'm saving images from Firefox (no virtual machine running)
 it takes awhile to navigate the folder structure and sometimes not
 all
 the folders show, but they do in the Finder. So I wonder if this is
 an
 issue with programs not getting along with ZFS but the finder being
 fine with it.

 Other things to note, I did disable Spotlight on the drive to make
 sure that isn't running, but I do have QuickSilver. Originally, I had
 QuickSilver indexing the drive, but the computer was practically
 unusable when it did that so I disabled that.

 I look forward to any advice you guys may have.

 Thanks,

 James

 On Tue, May 20, 2014 at 6:14 AM, Jason Belec
 jasonbe...@belecmartin.com wrote:
 OK, doesn't look like RAM, processor etc., are the issue Let's
 work with that in mind for now.

 When the pool and the associated drives are not connected, is the
 computer back to your expectation of normal? If so, you have one or 
 more bad
 cables, one or more bad drives, or a bit of both, perhaps a bad or not 
 quite
 capable power supply (solves 90% of all issues I come across). Maybe 
 even an
 issue with the motherboard. Simplest thing, have you run a scrub on 
 this
 pool? Clean?

 The type of drives you have is not an issue, the make and known
 issues with said drives might be, but you didn't provide that info.

 Using a raidcard and macJournaled terms, thrown out will not help
 you, your either ZFS or not. That said, you will not get the same 
 speed from
 ZFS as from other raid setups, but you will get peace of mind on data
 integrity. I do hope you are also backing up data from the pool as 
 well or
 eventually you will be in tears like so many others. A little forum
 searching under old and new versions of mac zfs will be helpful.

 Since your getting started, once this is resolved it might be better
 to build/run this under the latest (yes its in development) Mac ZFS 
 rather
 than the old tired version. It is quite a bit different, modern and 
 makes
 many things a lot easier. (Insert legal disclaimer here) ;)

 Interesting aside:
 Dave mentioned an interesting point about wearing out SSDs, and I
 must admit I've had two such occurrences but only with a hackintosh 
 and only
 with less than stellar drives. Seems that here around the mad science 
 lab
 Intel SSDs are the most reliable long term. I have two of their 
 originals
 still outlasting several other brands.

 --
 Jason Belec
 Sent from my iPad

 On May 19, 2014, at 10:05 AM, James Hoyt djnati...@gmail.com
 wrote:

 Thanks for all the replies guys =D

 Sorry for lack of information. I'm running a Hackintosh with a 256
 GB
 SSD and I sometimes run Windows 8.1 in a virtual machine via VmWare
 Fusion. The virtual image file is also located on the SSD. The only
 files I have on my zpool are data files. I don't run an OS or VM
 image
 from it. I have 12 GBs of RAM and a four core i5 processor. On the
 VM,
 I dedicate 6 GBs of RAM and 2 cores to it. It should be noted that
 I
 experience the slow down even when vmware is off it's just the
 drives
 act the slowest when the VM is running.

 As for how I created the zpool, I followed the Getting Started
 guide with

 zpool create murr raidz disk3s2 disk1s2 disk2s2 disk4s2

 Please help... I really hope I don't have to recreate it, but it's
 looking that way.

 Would it be better if I bought a RAID card and use Mac OS
 Journaled?
 Cost is an issue... the other issue is these are regular desktop
 7200
 RPM drives.. not NAS drives.

 Thanks,

 James

 On Mon, May 19, 2014 at 7:43 AM, Jason Belec
 jasonbe...@belecmartin.com wrote:
 Dave has posted some good info. Reminds me why I prefer
 Virtualbox. ;) We do seem to need more detail though to really help 
 the
 original OP.


 Jason
 Sent from my iPhone 5S

 On May 19, 2014, at 4:00 AM, Dave Cottlehuber d...@jsonified.com
 wrote:


 From: James Hoyt djnati...@gmail.com(mailto:djnati...@gmail.com)
 Reply: zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Date: 19. Mai 2014 at 02:27:36
 To: zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Subject: [zfs-macos] RAIDZ1 running slow =(

 So I setup a MacZFS RaidZ rather easily and was happy with
 myself. I had four 3 TB internal SATA drives in a zpool giving me 
 around 9
 TB of space.

 jamess-imac:~ sangie$ zpool status murr
 pool: murr
 state: ONLINE
 scrub: none requested
 config:

 NAME STATE READ WRITE CKSUM
 murr ONLINE 0 0 0
 raidz1 ONLINE 0 0 0
 disk3s2 ONLINE 0 0 0
 disk1s2 ONLINE 0 0 0
 disk2s2 ONLINE 0 0 0
 disk4s2 ONLINE 0 0 0

 errors: No known data errors

 So I Filled it up with about 5 GBs of data, mainly images and
 FLAC/music files and everything just drags on it. It takes a long 
 time for
 files to be listed in finder and when I try to save an image from 
 Firefox,
 it will just grind and grind while I try to navigate to a folder. 
 I

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread James Hoyt

 On May 19, 2014, at 4:00 AM, Dave Cottlehuber d...@jsonified.com
 wrote:


 From: James Hoyt djnati...@gmail.com(mailto:djnati...@gmail.com)
 Reply: zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Date: 19. Mai 2014 at 02:27:36
 To: zfs-macos@googlegroups.com
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Subject: [zfs-macos] RAIDZ1 running slow =(

 So I setup a MacZFS RaidZ rather easily and was happy with
 myself. I had four 3 TB internal SATA drives in a zpool giving me 
 around 9
 TB of space.

 jamess-imac:~ sangie$ zpool status murr
 pool: murr
 state: ONLINE
 scrub: none requested
 config:

 NAME STATE READ WRITE CKSUM
 murr ONLINE 0 0 0
 raidz1 ONLINE 0 0 0
 disk3s2 ONLINE 0 0 0
 disk1s2 ONLINE 0 0 0
 disk2s2 ONLINE 0 0 0
 disk4s2 ONLINE 0 0 0

 errors: No known data errors

 So I Filled it up with about 5 GBs of data, mainly images and
 FLAC/music files and everything just drags on it. It takes a long 
 time for
 files to be listed in finder and when I try to save an image from 
 Firefox,
 it will just grind and grind while I try to navigate to a folder. 
 I have
 vmware Fusion setup on my SSD (my main Mac drive) and doing 
 anything on my
 zpool from Windows (like using MediaMonkey to organize FLAC files 
 on it)
 uses up 100% of the CPU, freezing up my computer until the moves 
 are done,
 even when moving around 30 files.

 It’s not clear from this what your actual physical / virtual
 setup is. Are you booting to OSX, and running Windows in a VM? Is 
 the entire
 VM then living on the raidz pool?

 Is my zpool okay? What's going on? Is this type of slowness
 normal or do I have a bad drive? How will MacZFS report to me if 
 a drive in
 the array goes bad? I installed SMARTReporter Lite and it shows 
 all drives
 as green. If I have some drives on SATA II and others on SATA III 
 would that
 affect anything?

 If you want me to run any tests on it, I will do so gladly. Just
 let me know.

 Thanks!

 I’ve seen precisely this sort of behaviour with vmware fusion
 when:

 1. my SSD was getting worn down (really, I trashed it in 1 year,
 it was the default apple one coming with early 2011 MBP)
 2. the host OS  VM doesn’t have sufficient memory to run
 correctly without swapping
 3. the additional memory within the VM is pulled from a disk swap
 file, which is by default in the same disk location as the VM 
 itself

 Anything less than 8GB of RAM is likely to be tight, VMs will of
 course make this more complicated. Some notes on
 http://artykul8.com/2012/06/vmware-performance-enhancing/ may help.

 I found that my SSDs were being worn out with constant running of
 VMs; I use them heavily in my work. The solution I found was to 
 get max RAM
 in my laptop + imac (16 vs 32 respectively), make a zfs based 
 ramdisk with
 lz4 compression, and copy the entire VM into the ramdisk before 
 running it.
 The copy phase only takes a few seconds from SSD, and it gives me 
 a very
 nice way to “roll back” to the previous image when required. I can
 comfortably run Windows in a 20GiB ramdisk that fits inside a 
 10GiB zpool
 with compression, even on the 16GiB laptop, and allocating 2GiB of 
 ram for
 the VM itself (10 + 2 for virtualisation  leave 4 for all of OSX 
 stuff).

 Here’s the zsh functions I use for this.

 # create a 1GiB ramdisk
 ramdisk-1g () {
 ramdisk-create 2097152
 }

 # the generic function for the specific one above
 ramdisk-create () {
 diskutil eject /Volumes/ramdisk  /dev/null 21
 diskutil erasevolume HFS+ 'ramdisk' `hdiutil attach -nomount
 ram://$1`
 cd /ramdisk
 }

 # make a zpool backed ramdisk instead of the HFS+ ones above.
 Main advantage is compression. I get at least 2x more “disk” for 
 RAM with
 this approach.
 zdisk () {
 sudo zpool create -O compression=lz4 -fm /zram zram `hdiutil
 attach -nomount ram://20971520`
 sudo chown -R $USER /zram
 cd /zram
 }

 # self explanatory
 zdisk-destroy () {
 sudo zpool export -f zram
 }

 —
 Dave Cottlehuber
 d...@jsonified.com
 Sent from my Couch



 --

 ---
 You received this message because you are subscribed to the
 Google Groups zfs-macos group.
 To unsubscribe from this group and stop receiving emails from it,
 send an email to zfs-macos+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.

 --

 ---
 You received this message because you are subscribed to a topic in
 the Google Groups zfs-macos group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/zfs-macos/78gD-0OzKMQ/unsubscribe.
 To unsubscribe from this group and all its topics, send an email
 to zfs-macos+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.

 --

 ---
 You received this message because you are subscribed to the Google
 Groups zfs-macos group.
 To unsubscribe from this group and stop receiving emails from it,
 send an email to zfs-macos+unsubscr...@googlegroups.com.
 For more options, visit https

Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-20 Thread Philip Robar
On Tue, May 20, 2014 at 1:28 PM, James Hoyt djnati...@gmail.com wrote:


 I tried searching if my drives are 4k with no luck. I saw an article
 back from 2010 stating hard drives were planning to all be 4k in
 2011... this leads me to believe that they are 4k since I purchased
 them new last year. Crap D: Is there a for sure way I can see if they
 are 4k? Could this be my performance issue or is it just because my
 directories have large amounts of folders/files in them?


A search on HDS723030BLE640 4k shows that these are 4k drives with
emulated 512 sectors. I didn't even need to follow any links,
just skimmed through the Google results:

Hi, I bought 2x 3TB model HDS723030BLE640. ... A6  E6 are both SATA
6GB/s, but A6 is block size 512 native mode while B6 is 512 emulation with
4K block

The poster gets which letters he's talking about a little confused, but
it's clear that the HDS723030*A*... are 512 sector drives and the HDS723030
*B*... are 4K. (https://www.facebook.com/HGSTStorage/posts/225105534286344)


Phil

-- 

--- 
You received this message because you are subscribed to the Google Groups 
zfs-macos group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to zfs-macos+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-19 Thread James Hoyt
Thanks for all the replies guys =D

Sorry for lack of information. I'm running a Hackintosh with a 256 GB
SSD and I sometimes run Windows 8.1 in a virtual machine via VmWare
Fusion. The virtual image file is also located on the SSD. The only
files I have on my zpool are data files. I don't run an OS or VM image
from it. I have 12 GBs of RAM and a four core i5 processor. On the VM,
I dedicate 6 GBs of RAM and 2 cores to it. It should be noted that I
experience the slow down even when vmware is off it's just the drives
act the slowest when the VM is running.

As for how I created the zpool, I followed the Getting Started guide with

zpool create murr raidz disk3s2 disk1s2 disk2s2 disk4s2

Please help... I really hope I don't have to recreate it, but it's
looking that way.

Would it be better if I bought a RAID card and use Mac OS Journaled?
Cost is an issue... the other issue is these are regular desktop 7200
RPM drives.. not NAS drives.

Thanks,

James

On Mon, May 19, 2014 at 7:43 AM, Jason Belec jasonbe...@belecmartin.com wrote:
 Dave has posted some good info. Reminds me why I prefer Virtualbox. ;) We do 
 seem to need more detail though to really help the original OP.


 Jason
 Sent from my iPhone 5S

 On May 19, 2014, at 4:00 AM, Dave Cottlehuber d...@jsonified.com wrote:


 From: James Hoyt djnati...@gmail.com(mailto:djnati...@gmail.com)
 Reply: zfs-macos@googlegroups.com 
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Date: 19. Mai 2014 at 02:27:36
 To: zfs-macos@googlegroups.com 
 zfs-macos@googlegroups.com(mailto:zfs-macos@googlegroups.com)
 Subject: [zfs-macos] RAIDZ1 running slow =(

 So I setup a MacZFS RaidZ rather easily and was happy with myself. I had 
 four 3 TB internal SATA drives in a zpool giving me around 9 TB of space.

 jamess-imac:~ sangie$ zpool status murr
 pool: murr
 state: ONLINE
 scrub: none requested
 config:

 NAME STATE READ WRITE CKSUM
 murr ONLINE 0 0 0
 raidz1 ONLINE 0 0 0
 disk3s2 ONLINE 0 0 0
 disk1s2 ONLINE 0 0 0
 disk2s2 ONLINE 0 0 0
 disk4s2 ONLINE 0 0 0

 errors: No known data errors

 So I Filled it up with about 5 GBs of data, mainly images and FLAC/music 
 files and everything just drags on it. It takes a long time for files to be 
 listed in finder and when I try to save an image from Firefox, it will just 
 grind and grind while I try to navigate to a folder. I have vmware Fusion 
 setup on my SSD (my main Mac drive) and doing anything on my zpool from 
 Windows (like using MediaMonkey to organize FLAC files on it) uses up 100% 
 of the CPU, freezing up my computer until the moves are done, even when 
 moving around 30 files.

 It’s not clear from this what your actual physical / virtual setup is. Are 
 you booting to OSX, and running Windows in a VM? Is the entire VM then 
 living on the raidz pool?

 Is my zpool okay? What's going on? Is this type of slowness normal or do I 
 have a bad drive? How will MacZFS report to me if a drive in the array goes 
 bad? I installed SMARTReporter Lite and it shows all drives as green. If I 
 have some drives on SATA II and others on SATA III would that affect 
 anything?

 If you want me to run any tests on it, I will do so gladly. Just let me 
 know.

 Thanks!

 I’ve seen precisely this sort of behaviour with vmware fusion when:

 1. my SSD was getting worn down (really, I trashed it in 1 year, it was the 
 default apple one coming with early 2011 MBP)
 2. the host OS  VM doesn’t have sufficient memory to run correctly without 
 swapping
 3. the additional memory within the VM is pulled from a disk swap file, 
 which is by default in the same disk location as the VM itself

 Anything less than 8GB of RAM is likely to be tight, VMs will of course make 
 this more complicated. Some notes on 
 http://artykul8.com/2012/06/vmware-performance-enhancing/ may help.

 I found that my SSDs were being worn out with constant running of VMs; I use 
 them heavily in my work. The solution I found was to get max RAM in my 
 laptop + imac (16 vs 32 respectively), make a zfs based ramdisk with lz4 
 compression, and copy the entire VM into the ramdisk before running it. The 
 copy phase only takes a few seconds from SSD, and it gives me a very nice 
 way to “roll back” to the previous image when required. I can comfortably 
 run Windows in a 20GiB ramdisk that fits inside a 10GiB zpool with 
 compression, even on the 16GiB laptop, and allocating 2GiB of ram for the VM 
 itself (10 + 2 for virtualisation  leave 4 for all of OSX stuff).

 Here’s the zsh functions I use for this.

 # create a 1GiB ramdisk
 ramdisk-1g () {
ramdisk-create 2097152
 }

 # the generic function for the specific one above
 ramdisk-create () {
diskutil eject /Volumes/ramdisk  /dev/null 21
diskutil erasevolume HFS+ 'ramdisk' `hdiutil attach -nomount ram://$1`
cd /ramdisk
 }

 # make a zpool backed ramdisk instead of the HFS+ ones above. Main advantage 
 is compression. I get at least 2x more “disk” for RAM with this approach.
 zdisk

[zfs-macos] RAIDZ1 running slow =(

2014-05-18 Thread James Hoyt
So I setup a MacZFS RaidZ rather easily and was happy with myself. I had 
four 3 TB internal SATA drives in a zpool giving me around 9 TB of space.

jamess-imac:~ sangie$ zpool status murr
  pool: murr
 state: ONLINE
 scrub: none requested
config:

NAME STATE READ WRITE CKSUM
murr ONLINE   0 0 0
  raidz1 ONLINE   0 0 0
disk3s2  ONLINE   0 0 0
disk1s2  ONLINE   0 0 0
disk2s2  ONLINE   0 0 0
disk4s2  ONLINE   0 0 0

errors: No known data errors

So I Filled it up with about 5 GBs of data, mainly images and FLAC/music 
files and everything just drags on it. It takes a long time for files to be 
listed in finder and when I try to save an image from Firefox, it will just 
grind and grind while I try to navigate to a folder. I have vmware Fusion 
setup on my SSD (my main Mac drive) and doing anything on my zpool from 
Windows (like using MediaMonkey to organize FLAC files on it) uses up 100% 
of the CPU, freezing up my computer until the moves are done, even when 
moving around 30 files.

Is my zpool okay? What's going on? Is this type of slowness normal or do I 
have a bad drive? How will MacZFS report to me if a drive in the array goes 
bad? I installed SMARTReporter Lite and it shows all drives as green. If I 
have some drives on SATA II and others on SATA III would that affect 
anything? 

If you want me to run any tests on it, I will do so gladly. Just let me 
know.

Thanks!

-- 

--- 
You received this message because you are subscribed to the Google Groups 
zfs-macos group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to zfs-macos+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [zfs-macos] RAIDZ1 running slow =(

2014-05-18 Thread Daniel Becker
How much memory do you have on that machine, if you're running ZFS and VMs?

 On May 18, 2014, at 5:27 PM, James Hoyt djnati...@gmail.com wrote:
 
 So I setup a MacZFS RaidZ rather easily and was happy with myself. I had four 
 3 TB internal SATA drives in a zpool giving me around 9 TB of space.
 
 jamess-imac:~ sangie$ zpool status murr
   pool: murr
  state: ONLINE
  scrub: none requested
 config:
 
 NAME STATE READ WRITE CKSUM
 murr ONLINE   0 0 0
   raidz1 ONLINE   0 0 0
 disk3s2  ONLINE   0 0 0
 disk1s2  ONLINE   0 0 0
 disk2s2  ONLINE   0 0 0
 disk4s2  ONLINE   0 0 0
 
 errors: No known data errors
 
 So I Filled it up with about 5 GBs of data, mainly images and FLAC/music 
 files and everything just drags on it. It takes a long time for files to be 
 listed in finder and when I try to save an image from Firefox, it will just 
 grind and grind while I try to navigate to a folder. I have vmware Fusion 
 setup on my SSD (my main Mac drive) and doing anything on my zpool from 
 Windows (like using MediaMonkey to organize FLAC files on it) uses up 100% of 
 the CPU, freezing up my computer until the moves are done, even when moving 
 around 30 files.
 
 Is my zpool okay? What's going on? Is this type of slowness normal or do I 
 have a bad drive? How will MacZFS report to me if a drive in the array goes 
 bad? I installed SMARTReporter Lite and it shows all drives as green. If I 
 have some drives on SATA II and others on SATA III would that affect 
 anything? 
 
 If you want me to run any tests on it, I will do so gladly. Just let me know.
 
 Thanks!
 -- 
 
 --- 
 You received this message because you are subscribed to the Google Groups 
 zfs-macos group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to zfs-macos+unsubscr...@googlegroups.com.
 For more options, visit https://groups.google.com/d/optout.


smime.p7s
Description: S/MIME cryptographic signature