Re: [zfs-discuss] ZFS on OS X port now on macosforge
As soon as I get in to work and can backup my sparsebundle to a spare MBP, I'm going to start banging on it. Sweet deal :) So, do you have all of /Users on zfs, just one account, have you tried a FileVaulted account too? Or is that just crazy talk? :-) I currently just have one account, my personal one, to use ZFS. Then I just have another local admin account that uses HFS+ that I don't really use for anything except occasional testing. In my current setup, I created a pool, and I have 2 filesystems in it, one of which is my home directory. Then I just created my account and pointed it to use that directory for my home dir. I haven't experimented with File Vault yet at all, so feel free to have at it. Hopefully when we get encryption for ZFS then we'll be able to just offer it natively that way. Noel On Jan 8, 2008, at 9:17 PM, Joe Block wrote: Thanks for the pointer. I had just checked ADC for a new download this morning, actually. As soon as I get in to work and can backup my sparsebundle to a spare MBP, I'm going to start banging on it. So, do you have all of /Users on zfs, just one account, have you tried a FileVaulted account too? Or is that just crazy talk? :-) On Jan 8, 2008 2:09 PM, Noël Dellofano [EMAIL PROTECTED] wrote: Hey everyone, This is just a quick announcement to say that the ZFS on OS X port is now posted for your viewing fun at: http://zfs.macosforge.org/ The page is also linked off of the ZFS Open Solaris page under ZFS Ports: http://opensolaris.org/os/community/zfs/porting/ This page holds the status for the ZFS on OSX port and includes a small FAQ, some known bugs, announcements, and will include more as time goes on. It also holds the latest source code and binaries that you can download to your hearts content. So if you have a Mac, are running Leopard, and are feeling bleeding edge please try it out. Comments, questions, suggestions and feedback are all very welcome. I also want to point out this is BETA. We're still working on getting some features going, as well as fleshing out issues with Finder, Disk Util, iTunes, and other parts of the system. So when I say bleeding, I'm not kidding :) However I'm excited to say that I'm happily running ZFS as my home directory on my MacBook Pro which is what I work off of every day, and am running weekly snapshots which I 'zfs send' to my external drive. Oh happy day. thanks! Noel Dellofano ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- Joe Block [EMAIL PROTECTED] Macintosh System Administrator +1.650.253.7264 Information is the currency of democracy. -Thomas Jefferson ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS on OS X port now on macosforge
Heh, good point :)However, ZFS is only available on Leopard, since it requires some changes and symbols that are only part of the Leopard kernel. On the plus side ZFS and Dtrace are really freakin cool so maybe that will help mitigate the ouch factor on the upgrade; just think of all the glorious hours of engineering you're getting for one upgrade :) Noel On Jan 9, 2008, at 2:19 AM, Darren J Moffat wrote: Noël Dellofano wrote: Hey everyone, This is just a quick announcement to say that the ZFS on OS X port is now posted for your viewing fun at: http://zfs.macosforge.org/ The page is also linked off of the ZFS Open Solaris page under ZFS Ports: http://opensolaris.org/os/community/zfs/porting/ This page holds the status for the ZFS on OSX port and includes a small FAQ, some known bugs, announcements, and will include more as time goes on. It also holds the latest source code and binaries that you can download to your hearts content. So if you have a Mac, are running Leopard, and are feeling bleeding edge please try it out. Does it need Leopard or can it work on Tiger ? Just curious as ZFS and DTrace are the only things in Leopard that are of interest to me and I just can't bring myself to pay (again) to upgrade MacOS X for two features that were developed for Solaris and are open source :-) Thanks. -- Darren J Moffat ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS on OS X port now on macosforge
As I mentioned, ZFS is still BETA, so there are (and likely will be) some issues turn up with compatibility with the upper layers of the system if that's what you're referring to. But we're working hard on fixing these as they come up. So end goal is there shouldn't be any weird compatibility issues with the rest system. Noel On Jan 9, 2008, at 2:38 PM, Scott Laird wrote: On Jan 9, 2008 11:26 AM, Noël Dellofano [EMAIL PROTECTED] wrote: As soon as I get in to work and can backup my sparsebundle to a spare MBP, I'm going to start banging on it. Sweet deal :) So, do you have all of /Users on zfs, just one account, have you tried a FileVaulted account too? Or is that just crazy talk? :-) I currently just have one account, my personal one, to use ZFS. Then I just have another local admin account that uses HFS+ that I don't really use for anything except occasional testing. In my current setup, I created a pool, and I have 2 filesystems in it, one of which is my home directory. Then I just created my account and pointed it to use that directory for my home dir. I haven't experimented with File Vault yet at all, so feel free to have at it. Hopefully when we get encryption for ZFS then we'll be able to just offer it natively that way. So Leopard is able to use ZFS without any of the weird compatibility problems that used to plague UFS users? Scott ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS on OS X port now on macosforge
Yep, these issues are known and I've listed them with explanations on on our website under The State of the ZFS on OS X World: http://zfs.macosforge.org/ We're working on them. The Trash and iTunes bugs should be fixed soon. The your non-replicated drive just went MIA panic will take a little longer as it requires a more complex fix that will need to involve diskutil and friends while also preserving the integrity of your pool and all the data therin. This is also a problem the Solaris ZFS team is working on as well, it's just not as common that people rip out live drives from a Thumper :) Noel On Jan 9, 2008, at 2:45 PM, Shawn Ferry wrote: Noël, To try and get regular use out of ZFS on OS X I moved all of my Music directory a mirrored pool implemented as a slice of my internal disk and a FW enclosure. There are a few issues I see in using ZFS for end user applications at the moment. 1) Trash doesn't work You adding files to the trash seems to work but you can't empty it without manually going to the .Trashes directory and manually removing files 2) You can't download new iTunes Store music through iTunes iTunes can download podcasts and add new music from local files even using the consolidate music option 3) It was somewhat prone to causing panics mainly bringing devices back online or rudely disconnecting them 4) once the kext is loaded it appears that any user can perform any action e.g. anybody can create or delete a snapshot or a pool Shawn On Jan 9, 2008, at 2:26 PM, Noël Dellofano wrote: As soon as I get in to work and can backup my sparsebundle to a spare MBP, I'm going to start banging on it. Sweet deal :) So, do you have all of /Users on zfs, just one account, have you tried a FileVaulted account too? Or is that just crazy talk? :-) I currently just have one account, my personal one, to use ZFS. Then I just have another local admin account that uses HFS+ that I don't really use for anything except occasional testing. In my current setup, I created a pool, and I have 2 filesystems in it, one of which is my home directory. Then I just created my account and pointed it to use that directory for my home dir. I haven't experimented with File Vault yet at all, so feel free to have at it. Hopefully when we get encryption for ZFS then we'll be able to just offer it natively that way. Noel On Jan 8, 2008, at 9:17 PM, Joe Block wrote: Thanks for the pointer. I had just checked ADC for a new download this morning, actually. As soon as I get in to work and can backup my sparsebundle to a spare MBP, I'm going to start banging on it. So, do you have all of /Users on zfs, just one account, have you tried a FileVaulted account too? Or is that just crazy talk? :-) On Jan 8, 2008 2:09 PM, Noël Dellofano [EMAIL PROTECTED] wrote: Hey everyone, This is just a quick announcement to say that the ZFS on OS X port is now posted for your viewing fun at: http://zfs.macosforge.org/ The page is also linked off of the ZFS Open Solaris page under ZFS Ports: http://opensolaris.org/os/community/zfs/porting/ This page holds the status for the ZFS on OSX port and includes a small FAQ, some known bugs, announcements, and will include more as time goes on. It also holds the latest source code and binaries that you can download to your hearts content. So if you have a Mac, are running Leopard, and are feeling bleeding edge please try it out. Comments, questions, suggestions and feedback are all very welcome. I also want to point out this is BETA. We're still working on getting some features going, as well as fleshing out issues with Finder, Disk Util, iTunes, and other parts of the system. So when I say bleeding, I'm not kidding :) However I'm excited to say that I'm happily running ZFS as my home directory on my MacBook Pro which is what I work off of every day, and am running weekly snapshots which I 'zfs send' to my external drive. Oh happy day. thanks! Noel Dellofano ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- Joe Block [EMAIL PROTECTED] Macintosh System Administrator +1.650.253.7264 Information is the currency of democracy. -Thomas Jefferson ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- Shawn Ferry shawn.ferry at sun.com Senior Primary Systems Engineer Sun Managed Operations 571.291.4898 ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] ZFS on OS X port now on macosforge
Hey everyone, This is just a quick announcement to say that the ZFS on OS X port is now posted for your viewing fun at: http://zfs.macosforge.org/ The page is also linked off of the ZFS Open Solaris page under ZFS Ports: http://opensolaris.org/os/community/zfs/porting/ This page holds the status for the ZFS on OSX port and includes a small FAQ, some known bugs, announcements, and will include more as time goes on. It also holds the latest source code and binaries that you can download to your hearts content. So if you have a Mac, are running Leopard, and are feeling bleeding edge please try it out. Comments, questions, suggestions and feedback are all very welcome. I also want to point out this is BETA. We're still working on getting some features going, as well as fleshing out issues with Finder, Disk Util, iTunes, and other parts of the system. So when I say bleeding, I'm not kidding :) However I'm excited to say that I'm happily running ZFS as my home directory on my MacBook Pro which is what I work off of every day, and am running weekly snapshots which I 'zfs send' to my external drive. Oh happy day. thanks! Noel Dellofano ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What is touching my filesystems?
It's also worth it to note that I recently added a '-F' flag to zfs receive for precisely this sort of annoying problem :) I meant to send a heads up to everyone about it but had not gotten to it yet. Basically, when you specify '-F' flag to receive, a zfs rollback and a receive are done at one time, without mounting the filesystem in between, so you shouldn't have any trouble receiving if you use the '- F'. #zfs send -i /tank/[EMAIL PROTECTED] /tank/[EMAIL PROTECTED] | ssh host2 zfs receive -F / newtank/recvfs This was putback into build snv_48 so if you're running(or can run) Opensolaris bits then you'll have this new feature. The man pages and sysadmin guide should be updated to reflect this and if they aren't yet, they should be quite soon. Note also that along with that flag I added the capability (for those of us that are lazy and hate to type) to abbreviate the first argument in zfs send and also the second argument to a zfs rename. So you only need to specify the snapshot name (i.e. the part after the '@'). A la: #zfs rename /tank/[EMAIL PROTECTED] newsnap and #zfs send -i /snap1 /tank/[EMAIL PROTECTED] backup.out As always, backward compatibility has been maintained for your snapshoting convenience so fear not if you have scripts set up already to do that sort of thing. happy snapshoting, Noel On Oct 17, 2006, at 3:10 AM, Niclas Sodergard wrote: Hi everyone, I have a very strange problem. I've written a simple script that uses zfs send/recv to send a filesystem between two hosts using ssh. Works like a charm - most of the time. As you know we need a two snapshots when we do a incremental send. But the problem is something is touching my filesystems on the receiving side so they are no longer identical. I'm doing a rollback and a couple of seconds later they are different again. This has happened on a number of machines but not always. Real example # zfs list -r data/appservers/appsvr2-zone NAME USED AVAIL REFER MOUNTPOINT data/appservers/appsvr2-zone 11.7G 77.1G 11.7G /data/appservers/appsvr2-zonedata/appservers/appsvr2- [EMAIL PROTECTED] 100K - 11.7G - # zfs rollback data/appservers/[EMAIL PROTECTED] # zfs list -r data/appservers/appsvr2-zone NAME USED AVAIL REFER MOUNTPOINT data/appservers/appsvr2-zone 11.7G 77.1G 11.7G /data/appservers/appsvr2-zonedata/appservers/appsvr2- [EMAIL PROTECTED] 0 - 11.7G - ... then wait a couple of seconds # zfs list -r data/appservers/appsvr2-zone NAME USED AVAIL REFER MOUNTPOINT data/appservers/appsvr2-zone 11.7G 77.1G 11.7G /data/appservers/appsvr2-zonedata/appservers/appsvr2- [EMAIL PROTECTED] 100K - 11.7G - As you can see the snapshot is no longer identical to the filesystem and I can't see anything touching the filesystem. My workaround for this problem right now is to do a zfs umount before I do the rollback and then I do zfs send/recv. The only problem is once the changes are received zfs is mounting the filesystem again (I assume this is a bug). I'm running this on Solaris 10u2 sparc but I've seen this on x86 as well. Does anyone have any pointers, ideas, suggestions? Regards, Nickus ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] What is touching my filesystems?
typo:thereshouldn'tbealeading'/'beforesnap1intheexamplebelow.apologies.NoelOnOct23,2006,at2:10PM,NoëlDellofanowrote:#zfs send -i /snap1 /tank/[EMAIL PROTECTED] backup.out ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: Re[2]: [zfs-discuss] What is touching my filesystems?
Hey Robert, No, all the code fixes and features I mentioned before I developed and putback before I left Sun, so no active development is happening or anything. I still like to hang out on the zfs alias though just because I still luv ZFS and want to keep tabs on it even if I'm not at Sun :) Noel On Oct 23, 2006, at 2:46 PM, Robert Milkowski wrote: Hello Noël, I've just had to ask this - your email address is @apple.com and looks like you are actively developing ZFS - does that mean Apple is looking into porting/using ZFS for real? -- Best regards, Robertmailto:[EMAIL PROTECTED] http://milek.blogspot.com ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Zfs Performance with millions of small files in Sendmail messaging environment]
The zap is really speedy when it comes to file lookups in a directory. If you're really concerned about performance, and depending on your system you're running on, I'd probably recommend staying below 10 million or so files per directory. Just since you'll get fastest results when we can fit most of zap blocks in the ARC as opposed to having to go and fetch them from disk. *(disclaimer: this was a benchmark i ran on bits from February on an opteron box with 3 GB of memory with a single scsi disk in the pool. So you may want to rerun with current bits for better numbers if this is very important to you expect to be storing millions of files per directory on a regular basis). You can also go nuts on creating filesystems. I believe the only thing to be forewarned of is that upon reboot, you'll be mounting all these filesystems so this might slow down the reboot process somewhat when you get to *many thousands(due to the way the automounter behaves). I believe that a fix is being worked on (may already be back? ) to make this process much quicker, however I'm not sure. Anybody know what the status of that is? Noel On Oct 15, 2006, at 11:08 PM, Ramneek Sethi wrote: Thanks for your feedback.. any comments on VxFS.. Also is there any limit of files within filesystem or within directory for optimal performance.. Thanks Robert Milkowski wrote On 10/14/06 04:19,: Hello Ramneek, Friday, October 13, 2006, 6:07:22 PM, you wrote: RS Hello Experts RS Would appreciate if somebody can comment on sendmail environment on RS solaris 10. RS How will Zfs perform if one has millions of files in sendmail message RS store directory under zfs filesystem compared to UFS or VxFS.. Actually not sendmail but also MTA and ZFS is about 5% better in real production than UFS+SVM. -- Thanks Regards, *** _/_/_/ _/_/ _/ _/ Ramneek Sethi _/ _/_/ _/_/ _/ Systems Support Engineer _/_/_/ _/_/ _/ _/ _/Sun Microsystems India Pvt. Ltd. _/ _/_/ _/ _/_/ 5th Floor,Right Wing , _/_/_/ _/_/_/ _/ _/ The Capital Court,Munirka New Delhi - 110067,INDIA Phone : 91--11-42191029 Fax : 91-11-26160928 Support SERVICESE-mail : [EMAIL PROTECTED] *** For any Support Queries pls dial the Toll Free Number 1600-4254-786 *** ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Configuring a 3510 for ZFS
youmayalsowanttocheckoutEricKustarz'sblog,whichisgoodtonoteifyour'reusingstoragearrays:http://blogs.sun.com/erickustarz/entry/vq_max_pendingNoelOnOct16,2006,at11:21AM,TorreyMcMahonwrote:Ciaran Johnston (AT/LMI) wrote: [SNIP]With our current filesystem, we create two 5-disk RAID5 arrays andexport these as two logical devices, with two spare disks. In a ZFSscenario, is it worth us letting the 3510 do RAID5 in the way wecurrently do, or should we let ZFS manage all the RAID using raid-z andtreat the 3510 as 12 discrete devices? What about spare disks in a ZFSpool? Any advice is greatly appreciated. You might want to troll through the discussion list on the opensolaris site to get some more info on your situation but, as always, it depends. Is this the only host that will be using the array? Other systems running ZFS? Are you migrating at some point?If you want to do a simple speed check then I'd create some R0 stripes, server those to the system running ZFS, and then put RAIDZ or mirrors on top of it. I'm pretty sure it isn't possible to farm out the individual drives from the 3510. You have to overlay some sort of RAID first.___zfs-discuss mailing listzfs-discuss@opensolaris.orghttp://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
