[Ocfs2-users] why does mkfs.ocfs2 take so long?
Hi, Why does mkfs.ocfs2 take so long compared to gfs2 (pretty fast iirc), xfs (almost instantaneous), or ext3 (slow but still ok)? I'm using: # mkfs.ocfs2 -F -b 4k -C 4k -L san1 -T mail /dev/vg/san1 mkfs.ocfs2 1.3.9 Overwriting existing ocfs2 partition. WARNING: Cluster check disabled. Proceed (y/N): y Filesystem Type of mail Filesystem label=san1 Block size=4096 (bits=12) Cluster size=4096 (bits=12) Volume size=16789027160064 (4098883584 clusters) (4098883584 blocks) 127074 cluster groups (tail covers 16896 clusters, rest cover 32256 clusters) Journal size=268435456 Initial number of node slots: 4 Creating bitmaps: done Initializing superblock: done Writing system files: done Writing superblock: done Writing backup superblock: Perhaps some kind of inode done/total counter would be nice as is shown while doing mkfs.ext3? Thanks, Sabuj Pattanayek ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
Re: [Ocfs2-users] why does mkfs.ocfs2 take so long?
Two inits take time. 1. Cluster group init. 2. Journal init. Considering this is a 16TB volume being formatted with 4K/4K block/cluster sizes, means it has 127074 cluster groups to initialize. So 127074 4K blocks to initialize. But this bit should be somewhat similar to ext3. Journal initialization involves more work than ext3 as not only do we have to initialize more journals (one per slot to account for each mounting node), but the journal sizes are larger. File an enhancement for the counter. We had a spinning wheel for the journal init but was removed for some reason I do not recall. Sunil Sabuj Pattanayek wrote: Hi, Why does mkfs.ocfs2 take so long compared to gfs2 (pretty fast iirc), xfs (almost instantaneous), or ext3 (slow but still ok)? I'm using: # mkfs.ocfs2 -F -b 4k -C 4k -L san1 -T mail /dev/vg/san1 mkfs.ocfs2 1.3.9 Overwriting existing ocfs2 partition. WARNING: Cluster check disabled. Proceed (y/N): y Filesystem Type of mail Filesystem label=san1 Block size=4096 (bits=12) Cluster size=4096 (bits=12) Volume size=16789027160064 (4098883584 clusters) (4098883584 blocks) 127074 cluster groups (tail covers 16896 clusters, rest cover 32256 clusters) Journal size=268435456 Initial number of node slots: 4 Creating bitmaps: done Initializing superblock: done Writing system files: done Writing superblock: done Writing backup superblock: Perhaps some kind of inode done/total counter would be nice as is shown while doing mkfs.ext3? Thanks, Sabuj Pattanayek ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
Re: [Ocfs2-users] why does mkfs.ocfs2 take so long?
On Mon, Jul 28, 2008 at 10:23:14AM -0700, Sunil Mushran wrote: Two inits take time. 1. Cluster group init. 2. Journal init. Also, joining the cluster takes time. You are overwriting an existing volume. mkfs.ocfs2 will start up the cluster software to ensure another node is not using the volume. This takes time. Joel -- Life's Little Instruction Book #313 Never underestimate the power of love. Joel Becker Principal Software Developer Oracle E-mail: [EMAIL PROTECTED] Phone: (650) 506-8127 ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
[Ocfs2-users] OCFS2 and VMware ESX
Hi, We are haing some serious issues trying to configure an OCFS2 cluster on 3 SLES 10 SP2 boxes running in VMware ESX 3.0.1. Before I go into any of the detailed errors we are experiencing I first wanted to ask everyone if they have successfully configured this solution? We would be interested to find out what needs to be set at the VMware level (RDM, VMFS, NICS etc) and what needs to be configured at the O/S level. We have a LUN on our SAN that we have presented to our VMware hosts that we are using for this. Any help would be greatly appreciated! ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
Re: [Ocfs2-users] OCFS2 and VMware ESX
We run a similar set up, SLES 10 SP1, we were ESX 3.0.x and are now 3.5. We're running the version of ocfs2 that shipped with SLES 10 SP1. 4 nodes accessing raw mapped LUNs via ESX from an HP SAN on HP Blade Servers. Qlogic HBAs, standard NICs; nothing special. The biggest hurdle we ran into was time synch on the individual hosts (VMWare ESX + some variants of Linux have an interesting clock tick relationship which I still don't understand) that was causing some ugly fencing. It's been running well for about 8 months. Overall we're pretty happy with it thus far. That said, we don't let ESX VMotion the cluster nodes via DRS, but that's more because we haven't tested it. The cluster is used for Apache web hosting. web7:~:%1003#rpm -qa | grep -i ocfs ocfs2-tools-1.2.3-0.7 ocfs2console-1.2.3-0.7 ocfs2-tools-devel-1.2.3-0.7 web7:~:%1004#uname -a Linux web7 2.6.16.53-0.16-smp #1 SMP Tue Oct 2 16:57:49 UTC 2007 i686 athlon i386 GNU/Linux web7:~:%1005#cat /etc/SuSE-release SUSE Linux Enterprise Server 10 (i586) VERSION = 10 PATCHLEVEL = 1 web7:~:%1006# --mark Mark Sedlock Network and System Services Rowan University -Original Message- From: [EMAIL PROTECTED] [mailto:ocfs2-users- [EMAIL PROTECTED] On Behalf Of Haydn Cahir Sent: Monday, July 28, 2008 9:49 PM To: ocfs2-users@oss.oracle.com Subject: [Ocfs2-users] OCFS2 and VMware ESX Hi, We are haing some serious issues trying to configure an OCFS2 cluster on 3 SLES 10 SP2 boxes running in VMware ESX 3.0.1. Before I go into any of the detailed errors we are experiencing I first wanted to ask everyone if they have successfully configured this solution? We would be interested to find out what needs to be set at the VMware level (RDM, VMFS, NICS etc) and what needs to be configured at the O/S level. We have a LUN on our SAN that we have presented to our VMware hosts that we are using for this. Any help would be greatly appreciated! ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
Re: [Ocfs2-users] OCFS2 and VMware ESX
SLES10 SP2 is shipping OCFS2 1.4. We will releasing the same for (RH)EL in the coming weeks. -Original Message- From Haydn Cahir [EMAIL PROTECTED] Sent Mon 7/28/2008 8:07 PM To ocfs2-users@oss.oracle.com Subject Re: [Ocfs2-users] OCFS2 and VMware ESX Hi Mark, Thanks for your reply. How did you configure your RDM mappings? We have tried a few combinations already. We have three nodes and are trying to use a single OCFS2 volume. We are encountering a range of errors like VM's not starting when another node is already started (goes back to the RDM configurations we think), two of the nodes are able to edit files in the OCFS2 volumes but the third doesn't see any changes made by the other nodes and the OCFS2 volume switching to read-only due to errors on the volume. We have tried running just two nodes and still get the problem where the volume will switch over to read-only. I will look into the time differences on the server, we normally have to make changes in the grub config and NTP settings to keep the time in synch. FYI the version of OCFS2 on SLES 10 SP2 is completely different: HIT-TCN1:~ # rpm -qa | grep -i ocfs ocfs2-tools-1.4.0-0.3 ocfs2console-1.4.0-0.3 I can't even find reference to this version on the Oracle web site. Cheers Sedlock, Mark A. [EMAIL PROTECTED] 07/29/08 12:42 PM We run a similar set up, SLES 10 SP1, we were ESX 3.0.x and are now 3.5. We're running the version of ocfs2 that shipped with SLES 10 SP1. 4 nodes accessing raw mapped LUNs via ESX from an HP SAN on HP Blade Servers. Qlogic HBAs, standard NICs; nothing special. The biggest hurdle we ran into was time synch on the individual hosts (VMWare ESX + some variants of Linux have an interesting clock tick relationship which I still don't understand) that was causing some ugly fencing. It's been running well for about 8 months. Overall we're pretty happy with it thus far. That said, we don't let ESX VMotion the cluster nodes via DRS, but that's more because we haven't tested it. The cluster is used for Apache web hosting. web7:~:%1003#rpm -qa | grep -i ocfs ocfs2-tools-1.2.3-0.7 ocfs2console-1.2.3-0.7 ocfs2-tools-devel-1.2.3-0.7 web7:~:%1004#uname -a Linux web7 2.6.16.53-0.16-smp #1 SMP Tue Oct 2 16:57:49 UTC 2007 i686 athlon i386 GNU/Linux web7:~:%1005#cat /etc/SuSE-release SUSE Linux Enterprise Server 10 (i586) VERSION = 10 PATCHLEVEL = 1 web7:~:%1006# --mark Mark Sedlock Network and System Services Rowan University ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users ___ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
