Ok, different thing. On ext4 partition my folder size is 14Gb On ocfs2 partition it's ... 645Gb! How is it possible?!
-----Исходное сообщение----- From: ocfs2-users-requ...@oracle.com Sent: Thursday, June 02, 2011 10:59 PM To: ocfs2-users@oss.oracle.com Subject: Ocfs2-users Digest, Vol 90, Issue 2 Send Ocfs2-users mailing list submissions to ocfs2-users@oss.oracle.com To subscribe or unsubscribe via the World Wide Web, visit http://oss.oracle.com/mailman/listinfo/ocfs2-users or, via email, send a message with subject or body 'help' to ocfs2-users-requ...@oss.oracle.com You can reach the person managing the list at ocfs2-users-ow...@oss.oracle.com When replying, please edit your Subject line so it is more specific than "Re: Contents of Ocfs2-users digest..." Today's Topics: 1. Problems with descriptions. (Vasyl S. Kostroma) 2. Re: Problems with descriptions. (S?rgio Surkamp) 3. Re: Problems with descriptions. (Sunil Mushran) ---------------------------------------------------------------------- Message: 1 Date: Thu, 2 Jun 2011 09:37:37 +0400 From: "Vasyl S. Kostroma" <ad...@v-sf.info> Subject: [Ocfs2-users] Problems with descriptions. To: <ocfs2-users@oss.oracle.com> Message-ID: <4B669AA1916A4A56A3D63CE75CE69142@VasylD> Content-Type: text/plain; charset="utf-8" Hi guys! I can?t find an answer in google, so my last hope is this mailing list. Story. I have two servers with same arrays. Servers connected by DRBD. I used ocfs2 as file system, also I used NFS4 to access to the ocfs2 drive. I do not have any idea, but the allocated descriptors in /proc/sys/fs/file-nr increasing every time while drive accessed. So after some time allocated descriptions over max value and all processes make error ?To much opened files? (something like this). I do not see any error messages in log files... Any idea? I haven?t sleep two days Thank you all in advance. Configs: cat /etc/drbd.conf # You can find an example in /usr/share/doc/drbd.../drbd.conf.example include "drbd.d/global_common.conf"; include "drbd.d/*.res"; resource nfs { protocol C; handlers { split-brain "/usr/lib/drbd/notify-split-brain.sh root"; pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f"; pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f"; local-io-error "echo o > /proc/sysrq-trigger ; halt -f"; } startup { become-primary-on both; degr-wfc-timeout 120; } disk { on-io-error detach; } net { cram-hmac-alg sha1; shared-secret "password"; allow-two-primaries; after-sb-0pri discard-zero-changes; after-sb-1pri discard-secondary; after-sb-2pri disconnect; rr-conflict disconnect; } syncer { rate 500M; verify-alg sha1; al-extents 257; } on st01 { device /dev/drbd0; disk /dev/sdb; address 192.168.3.151:7788; meta-disk internal; } on st02 { device /dev/drbd0; disk /dev/sdb; address 192.168.3.152:7788; meta-disk internal; } } --- cat /etc/ocfs2/cluster.conf #/etc/ocfs2/cluster.conf node: ip_port = 7777 ip_address = 192.168.1.151 number = 1 name = st01 cluster = ocfs2 node: ip_port = 7777 ip_address = 192.168.1.152 number = 2 name = st02 cluster = ocfs2 cluster: node_count = 2 name = ocfs2 --- cat /etc/exports # /etc/exports: the access control list for filesystems which may be exported # to NFS clients. See exports(5). /snfs 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check,fsid=0) /snfs/projects 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/configs 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/variables 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/backups 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) --- -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/2ee78406/attachment-0001.html -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 1088 bytes Desc: not available Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/2ee78406/attachment-0001.png ------------------------------ Message: 2 Date: Thu, 2 Jun 2011 11:28:07 -0300 From: S?rgio Surkamp <ser...@gruposinternet.com.br> Subject: Re: [Ocfs2-users] Problems with descriptions. To: ocfs2-users@oss.oracle.com Message-ID: <20110602112807.398b3...@icedearth.corp.grupos.com.br> Content-Type: text/plain; charset=utf-8 Maybe some problem with NFSv4, as OCFS2 officially support only NFSv2 and NFSv3. Try to export the volume with NFSv3 only. Also note that DRDB isn't officially supported too. Regards, S?rgio Em Thu, 2 Jun 2011 09:37:37 +0400 "Vasyl S. Kostroma" <ad...@v-sf.info> escreveu: > Hi guys! > I can?t find an answer in google, so my last hope is this mailing > list. > > Story. > I have two servers with same arrays. Servers connected by DRBD. > I used ocfs2 as file system, also I used NFS4 to access to the > ocfs2 drive. I do not have any idea, but the allocated descriptors in > /proc/sys/fs/file-nr increasing every time while drive accessed. > So after some time allocated descriptions over max value and all > processes make error ?To much opened files? (something like > this). I do not see any error messages in log files... Any idea? > I haven?t sleep two days > > Thank you all in advance. > > Configs: > cat /etc/drbd.conf > # You can find an example in /usr/share/doc/drbd.../drbd.conf.example > > include "drbd.d/global_common.conf"; > include "drbd.d/*.res"; > > > resource nfs { > > protocol C; > > handlers { > split-brain "/usr/lib/drbd/notify-split-brain.sh > root"; pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f"; > pri-lost-after-sb "echo o > /proc/sysrq-trigger ; > halt -f"; local-io-error "echo o > /proc/sysrq-trigger ; halt -f"; > } > > startup { > become-primary-on both; > degr-wfc-timeout 120; > } > > disk { > on-io-error detach; > } > > net { > cram-hmac-alg sha1; > shared-secret "password"; > allow-two-primaries; > after-sb-0pri discard-zero-changes; > after-sb-1pri discard-secondary; > after-sb-2pri disconnect; > rr-conflict disconnect; > } > > syncer { > rate 500M; > verify-alg sha1; > al-extents 257; > } > > on st01 { > device /dev/drbd0; > disk /dev/sdb; > address 192.168.3.151:7788; > meta-disk internal; > } > > on st02 { > device /dev/drbd0; > disk /dev/sdb; > address 192.168.3.152:7788; > meta-disk internal; > } > } > > --- > cat /etc/ocfs2/cluster.conf > #/etc/ocfs2/cluster.conf > node: > ip_port = 7777 > ip_address = 192.168.1.151 > number = 1 > name = st01 > cluster = ocfs2 > > node: > ip_port = 7777 > ip_address = 192.168.1.152 > number = 2 > name = st02 > cluster = ocfs2 > > cluster: > node_count = 2 > name = ocfs2 > --- > cat /etc/exports > # /etc/exports: the access control list for filesystems which may be > exported # to NFS clients. See exports(5). > /snfs > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check,fsid=0) > /snfs/projects > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/configs > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/variables > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) /snfs/backups > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check) --- -- .:''''':. .:' ` S?rgio Surkamp | Gerente de Rede :: ........ ser...@gruposinternet.com.br `:. .:' `:, ,.:' *Grupos Internet S.A.* `: :' R. Lauro Linhares, 2123 Torre B - Sala 201 : : Trindade - Florian?polis - SC :.' :: +55 48 3234-4109 : ' http://www.gruposinternet.com.br ------------------------------ Message: 3 Date: Thu, 02 Jun 2011 11:59:13 -0700 From: Sunil Mushran <sunil.mush...@oracle.com> Subject: Re: [Ocfs2-users] Problems with descriptions. To: ocfs2-users@oss.oracle.com Message-ID: <4de7dd81.2000...@oracle.com> Content-Type: text/plain; charset="utf-8" That's the number of files open on the system. So this looks like an app problem. Some app has many files open. On 06/01/2011 10:37 PM, Vasyl S. Kostroma wrote: > Hi guys! > I can?t find an answer in google, so my last hope is this mailing list. > Story. > I have two servers with same arrays. Servers connected by DRBD. > I used ocfs2 as file system, also I used NFS4 to access to the > ocfs2 drive. I do not have any idea, but the allocated descriptors in > /proc/sys/fs/file-nr increasing every time while drive accessed. > So after some time allocated descriptions over max value and all > processes make error ?To much opened files? (something like > this). I do not see any error messages in log files... Any idea? > I haven?t sleep two days ????????? ?????? > Thank you all in advance. > Configs: > /cat /etc/drbd.conf/ > /# You can find an example in /usr/share/doc/drbd.../drbd.conf.example/ > // > /include "drbd.d/global_common.conf";/ > /include "drbd.d/*.res";/ > // > // > /resource nfs {/ > // > / protocol C;/ > // > / handlers {/ > / split-brain "/usr/lib/drbd/notify-split-brain.sh root";/ > / pri-on-incon-degr "echo o > /proc/sysrq-trigger ; > halt -f";/ > / pri-lost-after-sb "echo o > /proc/sysrq-trigger ; > halt -f";/ > / local-io-error "echo o > /proc/sysrq-trigger ; halt -f";/ > / }/ > // > / startup {/ > / become-primary-on both;/ > / degr-wfc-timeout 120;/ > / }/ > // > / disk {/ > / on-io-error detach;/ > / }/ > // > / net {/ > / cram-hmac-alg sha1;/ > / shared-secret "password";/ > // > / allow-two-primaries;/ > / after-sb-0pri discard-zero-changes;/ > / after-sb-1pri discard-secondary;/ > / after-sb-2pri disconnect;/ > / rr-conflict disconnect;/ > / }/ > // > / syncer {/ > / rate 500M;/ > / verify-alg sha1;/ > / al-extents 257;/ > / }/ > // > / on st01 {/ > / device /dev/drbd0;/ > / disk /dev/sdb;/ > / address 192.168.3.151:7788;/ > / meta-disk internal;/ > / }/ > // > / on st02 {/ > / device /dev/drbd0;/ > / disk /dev/sdb;/ > / address 192.168.3.152:7788;/ > / meta-disk internal;/ > / }/ > /}/ > --- > /cat /etc/ocfs2/cluster.conf/ > /#/etc/ocfs2/cluster.conf/ > /node:/ > / ip_port = 7777/ > / ip_address = 192.168.1.151/ > / number = 1/ > / name = st01/ > / cluster = ocfs2/ > // > /node:/ > / ip_port = 7777/ > / ip_address = 192.168.1.152/ > / number = 2/ > / name = st02/ > / cluster = ocfs2/ > // > /cluster:/ > / node_count = 2/ > / name = ocfs2/ > /---/ > /cat /etc/exports/ > /# /etc/exports: the access control list for filesystems which may be > exported/ > /# to NFS clients. See exports(5)./ > //snfs > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check,fsid=0)/ > //snfs/projects > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/ > //snfs/configs > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/ > //snfs/variables > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/ > //snfs/backups > 192.168.1.0/24(rw,sync,no_root_squash,no_subtree_check)/ > --- > > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/d4a74063/attachment.html -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: image/png Size: 1088 bytes Desc: not available Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20110602/d4a74063/attachment.png ------------------------------ _______________________________________________ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users End of Ocfs2-users Digest, Vol 90, Issue 2 ****************************************** _______________________________________________ Ocfs2-users mailing list Ocfs2-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs2-users
