Re: [zfs-discuss] zfs + iscsi target + vmware esx server
i don`t have a solution for you - but at least some comments: - i have read several complaints that esx iscsi is broken to some degree. there are some known incompatibilities and at least one ceo of a somewhat popular iscsi software vendor recently gave such statement. - i have read more than once that software iscsi in ESX is slow. using iscsi directly from inside a windows VM would be faster than using a virtual-disk on iscsi-storage connected via ESX iscsi-initiator. i can try giving you a pointer to some postings. - try reposting in storage-discuss , i think that forum is more iscsi related and it maybe rather an iscsi-target issue than a zfs issue. also see http://opensolaris.org/os/project/iscsitgt/ Rick McNeal is your man here :) - consider using NFS ! - http://storagefoo.blogspot.com/2007/09/vmware-over-nfs.html This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs + iscsi target + vmware esx server
take a look at this one http://www.opensolaris.org/jive/thread.jspa?messageID=98176 This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Adding my own compression to zfs
any news on additional compression-schemes for zfs ? this is interesting research-topic, imho :) so, some more real-world tests with zfs-fuse + lzo patch : -LZO zfs set compression=lzo mypool time cp /vmware/vserver1/vserver1.vmdk /mypool real7m8.540s user0m0.708s sys 0m24.839s zfs get compressratio mypool NAMEPROPERTY VALUE SOURCE mypool compressratio 1.74x - 1.7Gvserver1.vmdk compressed 3.0Gvserver1.vmdk uncompressed -LZJB zfs set compression=lzjb mypool time cp /vmware/vserver1/vserver1.vmdk /mypool real7m16.392s user0m0.709s sys 0m25.107s zfs get compressratio mypool NAMEPROPERTY VALUE SOURCE mypool compressratio 1.47x - 2.0Gvserver1.vmdk compressed 3.0Gvserver1.vmdk uncompressed -GZIP zfs set compression=gzip mypool time cp /vmware/vserver1/vserver1.vmdk /mypool/ real12m54.183s user0m0.653s sys 0m24.933s zfs get compressratio NAMEPROPERTY VALUE SOURCE mypool compressratio 2.02x - 1.5Gvserver1.vmdkcompressed 3.0Gvserver1.vmdkuncompressed btw - lzo-patch for zfs-fuse (does apply to latest zfs-fuse sources) is at http://groups.google.com/group/zfs-fuse/attach/a489f630aa4aa189/zfs-lzo.diff.bz2?part=4 This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] VFSTAB mounting for ProFTPD
I have ProFTPD successfully installed and running, though I would like to virtually mount some directory's from my ZFS configurations. In a previous ProFTPD install on Ubuntu, I had in my /etc/fstab directory an entry like this: /HDD ID/directory /home/FTP-shared/information vfat bind 0 0 Though I am not able to do this with my /etc/vfstab. This is my entry in my vfstab config file: /tank/information /ftp/information ufs defaults 0 0 It is not mounting ... could someone guide me in what my config file is supposed to look like. Thanks This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] [osol-help] VFSTAB mounting for ProFTPD
christopher wrote: I have ProFTPD successfully installed and running, though I would like to virtually mount some directory's from my ZFS configurations. No need for /etc/vfstab for ZFS filesystems[1] - Just run this command to change the mountpoint for that ZFS filesystem. It will persist across reboots: # zfs set mountpoint=/ftp/information tank/information Does this do the trick ? cheers, tim [1] though you can still use them if you really want to. This is well documented in the ZFS Administration guide at (pointing to the google cache, since docs.sun.com seems a bit sluggish at the mo) http://64.233.183.104/search?q=cache:vPL5YJPV2GIJ:docs.sun.com/app/docs/doc/819-5461/6n7ht6qs6%3Fa%3Dview+zfs+legacy+filesystemshl=enct=clnkcd=2client=firefox-a -- Tim Foster, Sun Microsystems Inc, Solaris Engineering Ops http://blogs.sun.com/timf ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Adding my own compression to zfs
Hi, No news. I received some very good suggestions, but unfortunately I didn't get as much discussion as I had hoped it would. I'm sending the project proposal again. I think that there are a lot of interesting things to research and develop regarding the subject and I hope this time we discuss a bit more about it. I would like to point out the Adam Leventhal's suggestion of an adaptive compression scheme: I think it would be a challenging and interesting direction to take. Besides, there are some new results about BWT that I'm sure would be of interest in this context. Kind Regards, Domingos. Follows the text of my original proposal: - Bellow, follows a proposal for a new opensolaris project. Of course, this is open to change since I just wrote down some ideas I had months ago, while researching the topic as a graduate student in Computer Science, and since I'm not an opensolaris/ZFS expert at all. I would really appreciate any suggestion or comments. PROJECT PROPOSAL: ZFS Compression Algorithms. The main purpose of this project is the development of new compression schemes for the ZFS file system. We plan to start with the development of a fast implementation of a Burrows Wheeler Transform based algorithm (BWT). BWT is an outstanding tool and the currently known lossless compression algorithms based on it outperform the compression ratio of algorithms derived from the well known Ziv-Lempel algorithm, while being a little more time and space expensive. Therefore, there is space for improvement: recent results show that the running time and space needs of such algorithms can be significantly reduced and the same results suggests that BWT is likely to become the new standard in compression algorithms[1]. Suffixes Sorting (i.e. the problem of sorting suffixes of a given string) is the main bottleneck of BWT and really significant progress has been made in this area since the first algorithms of Manbers and Myers[2] and Larsson and Sadakane[3], notably the new linear time algorithms of Karkkainen and Sanders[4]; Kim, Sim and Park[5] and Ko e aluru[6] and also the promising O(nlogn) algorithm of Karkkainen and Burkhardt[7]. As a conjecture, we believe that some intrinsic properties of ZFS and file systems in general (e.g. sparseness and data entropy in blocks) could be exploited in order to produce brand new and really efficient compression algorithms, as well as the adaptation of existing ones to the task. The study might be extended to the analysis of data in specific applications (e.g. web servers, mail servers and others) in order to develop compression schemes for specific environments and/or modify the existing Ziv-Lempel based scheme to deal better with such environments. [1] The Burrows-Wheeler Transform: Theory and Practice. Manzini, Giovanni. Proc. 24th Int. Symposium on Mathematical Foundations of Computer Science [2] Suffix Arrays: A New Method for On-Line String Searches. Manber, Udi and Myers, Eugene W.. SIAM Journal on Computing, Vol. 22 Issue 5. 1990 [3] Faster suffix sorting. Larsson, N Jasper and Sadakane, Kunihiko. TECHREPORT, Department of Computer Science, Lund University, 1999 [4] Simple Linear Work Suffix Array Construction. Karkkainen, Juha and Sanders,Peter. Proc. 13th International Conference on Automata, Languages and Programming, 2003 [5]Linear-time construction of suffix arrays D.K. Kim, J.S. Sim, H. Park, K. Park, CPM, LNCS, Vol. 2676, 2003 [6]Space ecient linear time construction of sux arrays,P. Ko and S. Aluru, CPM 2003. [7]Fast Lightweight Suffix Array Construction and Checking. Burkhardt, Stefan and Kärkkäinen, Juha. 14th Annual Symposium, CPM 2003, Domingos Soares Neto University of Sao Paulo Institute of Mathematics and Statistics and IBM Software Group. __ On 10/7/07, roland [EMAIL PROTECTED] wrote: any news on additional compression-schemes for zfs ? this is interesting research-topic, imho :) so, some more real-world tests with zfs-fuse + lzo patch : -LZO zfs set compression=lzo mypool time cp /vmware/vserver1/vserver1.vmdk /mypool real7m8.540s user0m0.708s sys 0m24.839s zfs get compressratio mypool NAMEPROPERTY VALUE SOURCE mypool compressratio 1.74x - 1.7Gvserver1.vmdk compressed 3.0Gvserver1.vmdk uncompressed -LZJB zfs set compression=lzjb mypool time cp /vmware/vserver1/vserver1.vmdk /mypool real7m16.392s user0m0.709s sys 0m25.107s zfs get compressratio mypool NAMEPROPERTY VALUE SOURCE mypool compressratio 1.47x - 2.0Gvserver1.vmdk compressed 3.0Gvserver1.vmdk uncompressed -GZIP zfs set compression=gzip
Re: [zfs-discuss] VFSTAB mounting for ProFTPD
what you`re looking for is called a bind-mount, and that`s a linux kernel feature. i don`t know if solaris has a perfect equivalent for this - maybe lofs is what you need. see man lofs This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] Raid Edition drive with RAIDZ
seems that standard drives are ok. sun is using Hitachi Deskstar 7K500 for it`s Sunfire x4500/thumper. This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] zfs boot issue, changing device id
Hi, Given two disk c1t0d0 (DISK A) and c1t1d0 (DISK B)... 1/ Standard install on DISK A. 2/ zfs boot install on DISK B. 3/ I change the boot order and my zfs boot works fine. 4/ I install grub on the mbr of DISK B 5/ I disconnect and replace DISK A with DISK B 6/ Reboot, get the grub menu select Solaris ZFS and it panics that it cannot mount root path @ device XXX... This is not a ZFS specific issue since even the UFS install will fail to boot if I don't put back the disks in the exact order they were in during the initial install. What am I missing? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs boot issue, changing device id
Did some googling, I guess the culprit is the bootpath in /boot/ solaris/bootenv.rc setprop bootpath '/[EMAIL PROTECTED],0/pci1000,[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a' I have to touch /reconfigure and reboot. I hope it works. On 08/10/2007, at 7:26 AM, Kugutsumen wrote: Hi, Given two disk c1t0d0 (DISK A) and c1t1d0 (DISK B)... 1/ Standard install on DISK A. 2/ zfs boot install on DISK B. 3/ I change the boot order and my zfs boot works fine. 4/ I install grub on the mbr of DISK B 5/ I disconnect and replace DISK A with DISK B 6/ Reboot, get the grub menu select Solaris ZFS and it panics that it cannot mount root path @ device XXX... This is not a ZFS specific issue since even the UFS install will fail to boot if I don't put back the disks in the exact order they were in during the initial install. What am I missing? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs boot issue, changing device id
What driver are you using? The SATA framework has a bug that prevents ldi_open_by_devid() from working early in boot. ZFS is trying to do the right thing, but has to fall back on the physical device path, which in this case is the wrong value. - Eric On Mon, Oct 08, 2007 at 07:26:39AM +0700, Kugutsumen wrote: Hi, Given two disk c1t0d0 (DISK A) and c1t1d0 (DISK B)... 1/ Standard install on DISK A. 2/ zfs boot install on DISK B. 3/ I change the boot order and my zfs boot works fine. 4/ I install grub on the mbr of DISK B 5/ I disconnect and replace DISK A with DISK B 6/ Reboot, get the grub menu select Solaris ZFS and it panics that it cannot mount root path @ device XXX... This is not a ZFS specific issue since even the UFS install will fail to boot if I don't put back the disks in the exact order they were in during the initial install. What am I missing? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- Eric Schrock, Solaris Kernel Development http://blogs.sun.com/eschrock ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs boot issue, changing device id
I just tried.. mount -o rw,remount / zpool import -f tank mount -F zfs tank/rootfs /a zpool status ls -l /dev/dsk/c1t0d0s0 # /[EMAIL PROTECTED],0/pci1000,[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a csh setenv TERM vt100 vi /a/boot/solaris/bootenv.rc # the bootpath was actually set to the proper device. cp /etc/path_to_inst /a/etc/path_to_inst touch /a/reconfigure rm /a/etc/devices/* bootadm update-archive -R /a zpool export tank reboot After all this.. It still fails... I think I am really missing something. panic[cpu0]/thread=fbc257a0: cannot mount root path /[EMAIL PROTECTED],0/ pci1000,30@ 10/[EMAIL PROTECTED],0:a fbc467b0 genunix:rootconf+11f () fbc46800 genunix:vfs_mountroot+65 () fbc46830 genunix:main+ce () fbc46840 unix:_locore_start+92 () panic: entering debugger (no dump device, continue to reboot) Welcome to kmdb kmdb: unable to determine terminal type: assuming `vt100' Loaded modules: [ scsi_vhci uppc unix zfs krtld genunix specfs pcplusmp random cpu.AuthenticAMD.15 ] Again if I put back that disk in the order it was before, it doesn't fail. Why does it have to be so complicated? On 08/10/2007, at 7:48 AM, Kugutsumen wrote: Did some googling, I guess the culprit is the bootpath in /boot/ solaris/bootenv.rc setprop bootpath '/[EMAIL PROTECTED],0/pci1000,[EMAIL PROTECTED]/[EMAIL PROTECTED],0:a' I have to touch /reconfigure and reboot. I hope it works. On 08/10/2007, at 7:26 AM, Kugutsumen wrote: Hi, Given two disk c1t0d0 (DISK A) and c1t1d0 (DISK B)... 1/ Standard install on DISK A. 2/ zfs boot install on DISK B. 3/ I change the boot order and my zfs boot works fine. 4/ I install grub on the mbr of DISK B 5/ I disconnect and replace DISK A with DISK B 6/ Reboot, get the grub menu select Solaris ZFS and it panics that it cannot mount root path @ device XXX... This is not a ZFS specific issue since even the UFS install will fail to boot if I don't put back the disks in the exact order they were in during the initial install. What am I missing? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs boot issue, changing device id
It is the vmware lsi scsi controller... I managed to fix the UFS disk (DISK A) using the procedure describe here (https://www.opensolaris.org/jive/thread.jspa?threadID=7615) but I am still struggling with the ZFS boot disk (DISK B). On 08/10/2007, at 7:53 AM, Eric Schrock wrote: What driver are you using? The SATA framework has a bug that prevents ldi_open_by_devid() from working early in boot. ZFS is trying to do the right thing, but has to fall back on the physical device path, which in this case is the wrong value. - Eric On Mon, Oct 08, 2007 at 07:26:39AM +0700, Kugutsumen wrote: Hi, Given two disk c1t0d0 (DISK A) and c1t1d0 (DISK B)... 1/ Standard install on DISK A. 2/ zfs boot install on DISK B. 3/ I change the boot order and my zfs boot works fine. 4/ I install grub on the mbr of DISK B 5/ I disconnect and replace DISK A with DISK B 6/ Reboot, get the grub menu select Solaris ZFS and it panics that it cannot mount root path @ device XXX... This is not a ZFS specific issue since even the UFS install will fail to boot if I don't put back the disks in the exact order they were in during the initial install. What am I missing? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -- Eric Schrock, Solaris Kernel Development http://blogs.sun.com/ eschrock ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] ZFS Mountroot and Bootroot Comparison
Is it possible to create a pool called rootpool made up for example of mirror c1t0d0 c2t0d0 then add 4 disks in raidz2 to the same pool and create a /usr filesystem using only the raidz2 portion of the pool? Not usefully. You cannot segregate the location of data or datasets within pools they way they are. -- Darren Dunham [EMAIL PROTECTED] Senior Technical Consultant TAOShttp://www.taos.com/ Got some Dr Pepper? San Francisco, CA bay area This line left intentionally blank to confuse you. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] zfs boot issue, changing device id
On Mon, Oct 08, 2007 at 09:09:39AM +0700, Kugutsumen wrote: It is the vmware lsi scsi controller... I managed to fix the UFS disk (DISK A) using the procedure describe here (https://www.opensolaris.org/jive/thread.jspa?threadID=7615) but I am still struggling with the ZFS boot disk (DISK B). Does this use the mpt driver bundled with Solaris, or a third party driver? A recent regression in the mpt driver broke devid lookup early in boot, though it does manage to work if you have a proper devid cache. An interesting RFE would be to have ZFS attempt to use the boot devicepath if all else fails, though that will only work for a single device. It would be better to get device IDs working like they're supposed to. - Eric -- Eric Schrock, Solaris Kernel Development http://blogs.sun.com/eschrock ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
