[zfs-discuss] VXFS to ZFS
Is there a documented way or suggestion on how to migrate data from VXFS to ZFS? Thanks Morris___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS
Hi Morris, I hope someone has done this recently and can comment, but the process is mostly manual and it will depend on how much gear you have. For example, if you have some extra disks, you can build a minimal ZFS storage pool to hold the bulk of your data. Then, you can do a live migration of data from the existing VxFS config to the new ZFS pool by using rsync or your favorite tool. After the data migration is complete, you can tear down the VxFS config and add the disks to expand the minimal ZFS storage pool. If you don't have enough disks to do live data migration, then the steps are backup the data, tear down the VxFS config, create the ZFS storage pool, restore the data. In the Solaris 11 release, I think you could live migrate the data by using shadow migration. Thanks, Cindy On 12/05/12 15:11, Morris Hooten wrote: Is there a documented way or suggestion on how to migrate data from VXFS to ZFS? Thanks Morris ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS
On 2012-12-05 23:11, Morris Hooten wrote: Is there a documented way or suggestion on how to migrate data from VXFS to ZFS? Off the top of my head, I think this would go like any other migration - create the new pool on new disks and use rsync for simplicity (if your VxFS setup does not utilize extended attributes or anything similarly special), or use Solaris tar or cpio of such attributes are used (IIRC VxFS was a prime citizen in Solaris, so native tools - unlike GNU ones and rsync - should support the intimate details). Also note that if you have VxFS, then you likely come from a clustered setup, which may be quite native and safe to VxFS. ZFS does not support simultaneous pool-imports by several hosts, so you'd have to set up the clusterware to make sure only one host controls the pool at any time. HTH, //Jim ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS
On Thu, Dec 6, 2012 at 5:11 AM, Morris Hooten mhoo...@us.ibm.com wrote: Is there a documented way or suggestion on how to migrate data from VXFS to ZFS? Not zfs-specific, but this should work for solaris: http://docs.oracle.com/cd/E23824_01/html/E24456/filesystem-3.html#filesystem-15 For illumos-based distros, you'd probably just use rsync/tar/whatever -- Fajar ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS Quota
- Original Message - Hi Currently I have 400+ users with quota set to 500MB limit. Currently the file system is using veritas file system. I am planning to migrate all these home directory to a new server with ZFS. How can i migrate the quotas. I can create 400+ file system for each users, but will this affect my system performance during the system boot up? Is this recommanded or any alternate is available for this issue. There's a lot of info in a thread I started quite recently One dataset per user?. Take a look in there. Vennlige hilsener / Best regards roy -- Roy Sigurd Karlsbakk (+47) 97542685 r...@karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et elementært imperativ for alle pedagoger å unngå eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer på norsk. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] VXFS to ZFS Quota
Hi Currently I have 400+ users with quota set to 500MB limit. Currently the file system is using veritas file system. I am planning to migrate all these home directory to a new server with ZFS. How can i migrate the quotas. I can create 400+ file system for each users, but will this affect my system performance during the system boot up? Is this recommanded or any alternate is available for this issue. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS Quota
On Fri, June 18, 2010 08:29, Sendil wrote: I can create 400+ file system for each users, but will this affect my system performance during the system boot up? Is this recommanded or any alternate is available for this issue. You can create a dataset for each user, and then set a per-dataset quota for each one: quota=size | none Limits the amount of space a dataset and its descendents can consume. This property enforces a hard limit on the amount of space used. This includes all space consumed by descendents, including file systems and snapshots. Setting a quota on a descendent of a dataset that already has a quota does not override the ancestor's quota, but rather imposes an additional limit. Or, on newer revisions of ZFS, you can have one big data set and put all your users in there, and then set per-user quotas: userqu...@user=size | none Limits the amount of space consumed by the specified user. Similar to the refquota property, the userquota space calculation does not include space that is used by descendent datasets, such as snapshots and clones. User space consumption is identified by the usersp...@user property. There's also a groupquota. See zfs(1M) for details: http://docs.sun.com/app/docs/doc/819-2240/zfs-1m Availability of userquota depends on the version of (Open)Solaris that you have; don't recall when it was introduced. As for which one is better, that depends: per-user adds flexibility, but a bit of overhead. Best to test things out for yourself to see if it works in your environment. You could always split things up into groups of (say) 50. A few jobs ago, I was in an environment where we have a /home/students1/ and /home/students2/, along with a separate faculty/ (using Solaris and UFS). This had more to do with IOps than anything else. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS Quota
David Magda wrote: On Fri, June 18, 2010 08:29, Sendil wrote: I can create 400+ file system for each users, but will this affect my system performance during the system boot up? Is this recommanded or any alternate is available for this issue. You can create a dataset for each user, and then set a per-dataset quota for each one: quota=size | none as a side note, you do not need to worry about creating 400 filesystems. A few thousand are no problem. --Arne ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS Quota
On Fri, Jun 18, 2010 at 8:09 AM, David Magda dma...@ee.ryerson.ca wrote: You could always split things up into groups of (say) 50. A few jobs ago, I was in an environment where we have a /home/students1/ and /home/students2/, along with a separate faculty/ (using Solaris and UFS). This had more to do with IOps than anything else. A decade or so ago when I managed similar environments and had (I think) 6 file systems handling about 5000 students. Each file system had about 1/6 of the students. Challenges I found in this were: - Students needed to work on projects together. The typical way to do this was for them to request a group, then create a group writable directory in one of their home directories. If all students in the group had home directories on the same file system, there was nothing special to consider. If they were on different file systems then at least one would need to have a non-zero quota (that is, not 0 blocks soft, 1 block hard) quota on the file system where the group directory resides. - Despite your best efforts things will get imbalanced. If you are tight on space, this means that you will need to migrate users. This will become apparent only at the times of the semester where even per-user outages are most inconvenient (i.e. at 6 and 13 weeks when big projects tend to be due). Its probably a good idea to consider these types of situations in the transition plan, or at least determine they don't apply. I was working in a college of engineering where group projects were common and CAD, EDA, and simulation tools could generate big files very quickly. -- Mike Gerdts http://mgerdts.blogspot.com/ ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] VXFS to ZFS Quota
P.S. User/group quotas are available in the Solaris 10 release, starting in the Solaris 10 10/09 release: http://docs.sun.com/app/docs/doc/819-5461/gazvb?l=ena=view Thanks, Cindy On 06/18/10 07:09, David Magda wrote: On Fri, June 18, 2010 08:29, Sendil wrote: I can create 400+ file system for each users, but will this affect my system performance during the system boot up? Is this recommanded or any alternate is available for this issue. You can create a dataset for each user, and then set a per-dataset quota for each one: quota=size | none Limits the amount of space a dataset and its descendents can consume. This property enforces a hard limit on the amount of space used. This includes all space consumed by descendents, including file systems and snapshots. Setting a quota on a descendent of a dataset that already has a quota does not override the ancestor's quota, but rather imposes an additional limit. Or, on newer revisions of ZFS, you can have one big data set and put all your users in there, and then set per-user quotas: userqu...@user=size | none Limits the amount of space consumed by the specified user. Similar to the refquota property, the userquota space calculation does not include space that is used by descendent datasets, such as snapshots and clones. User space consumption is identified by the usersp...@user property. There's also a groupquota. See zfs(1M) for details: http://docs.sun.com/app/docs/doc/819-2240/zfs-1m Availability of userquota depends on the version of (Open)Solaris that you have; don't recall when it was introduced. As for which one is better, that depends: per-user adds flexibility, but a bit of overhead. Best to test things out for yourself to see if it works in your environment. You could always split things up into groups of (say) 50. A few jobs ago, I was in an environment where we have a /home/students1/ and /home/students2/, along with a separate faculty/ (using Solaris and UFS). This had more to do with IOps than anything else. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
[zfs-discuss] vxfs and zfs
Hi, I have been given the task to research converting our vxfs/vm file systems and volumes to zfs. The volumes are attached to an EMC Clariion running raid-5, and raid 1_0. I have no test machine, just a migration machine that currently hosts other things. It is possible to setup a zfs file system while vxfs/vm are still running and controlling other file systems and volumes, or is it all or nothing. I searched many blogs and web docs and cannot find the answer to this question. This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Re: [zfs-discuss] vxfs and zfs
benita ulisano wrote: Hi, I have been given the task to research converting our vxfs/vm file systems and volumes to zfs. The volumes are attached to an EMC Clariion running raid-5, and raid 1_0. I have no test machine, just a migration machine that currently hosts other things. It is possible to setup a zfs file system while vxfs/vm are still running and controlling other file systems and volumes, or is it all or nothing. I searched many blogs and web docs and cannot find the answer to this question. I'm not quite sure what you're asking here: do you want to set up zpools/zfs on the same disks as vxvm/vxfs is running on *while* vxvm/vxfs is still running on them? that won't work. If you're asking can I set up zfs on free disks while vxvm is still set up on others I don't see why not. As long as there's no contention around actual disks, there shouldn't be an issue here. If you expand a bit on this, I'm sure our zfs experts can give you a more precise answer than this :-) HTH -- Michael Schuster Recursion, n.: see 'Recursion' ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
