It seems this has come up before. Is there a bug associated with NFS OOM errors?
If not - Jens, could you file one? -JM On Fri, Mar 21, 2014 at 7:46 AM, Jens Laas <[email protected]> wrote: > (14.03.20 kl.14:42) Paul Robert Marino skrev följande till Jens Laas: > > > you ran out of ram > > tune your box or take stuff off of it if its running any thing else. > > when you run out of memory the kernel just kills whatever process it > > happens to find first it may or may not be the actuall process at > > fault. > > True. > > But the memory consumtion seems somewhat excessive. > > By copying 4GB of data to the volume, glusterfs/nfs process grows by 6GB. > > To work around this, we now do a native glusterfs-mount and export it via > "standard" linux nfs. Which does not exhibit this behaviour. > > I just wanted to point out that a memory leak might be present. > > The data copied consists of a lot of small files and directories. > > Best regards, > Jens > > > > > On Thu, Mar 20, 2014 at 9:42 AM, Jens Laas <[email protected]> wrote: > > > > > > 4GB server (RHEL6). > > > glusterfs-3.4.2-1.el6.x86_64 etc from gluster site. > > > > > > Copying files via NFS to gluster. > > > > > > Out of memory: Kill process 18225 (glusterfs) score 660 or sacrifice > child > > > Killed process 18225, UID 0, (glusterfs) total-vm:3675904kB, > anon-rss:3422940kB, > > > file-rss:2072kB > > > > > > [2014-03-20 13:19:24.951428] D > [nfs3-helpers.c:1618:nfs3_log_common_call] > > > 0-nfs-nfsv3: XID: 9fd2b6b3, ACCESS: args: FH: exportid > > > c172abbc-6cc8-4b65-ad35-c34f10b53869, gfid > cc40b980-8a77-4cbb-ba23-147e37059a2d > > > [2014-03-20 13:19:24.951550] D [mem-pool.c:422:mem_get] > > > > (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3svc_access+0x7c) > > > [0x7ffff3110b8c] > > > (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_access+0xfd) > > > [0x7ffff311082d] > > > > (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_call_state_init+0x45) > > > [0x7ffff310b535]))) 0-mem-pool: Mem pool is full. Callocing mem > > > [2014-03-20 13:19:24.951684] D [afr-common.c:745:afr_get_call_child] > > > 0-gv0-replicate-0: Returning 0, call_child: 1, last_index: -1 > > > [2014-03-20 13:19:24.952050] D > [nfs3-helpers.c:3380:nfs3_log_common_res] > > > 0-nfs-nfsv3: XID: 9fd2b6b3, ACCESS: NFS: 0(Call completed > successfully.), POSIX: > > > 7(Argument list too long) > > > [2014-03-20 13:19:24.952458] D > [nfs3-helpers.c:1675:nfs3_log_create_call] > > > 0-nfs-nfsv3: XID: a0d2b6b3, CREATE: args: FH: exportid > > > c172abbc-6cc8-4b65-ad35-c34f10b53869, gfid > cc40b980-8a77-4cbb-ba23-147e37059a2d, > > > name: 1.0, mode: EXCLUSIVE > > > [2014-03-20 13:19:24.952522] D [mem-pool.c:422:mem_get] > > > > (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3svc_create+0xa7) > > > [0x7ffff3115e27] > > > (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_create+0x38b) > > > [0x7ffff3115c5b] > > > > (-->/usr/lib64/glusterfs/3.4.2/xlator/nfs/server.so(nfs3_call_state_init+0x45) > > > [0x7ffff310b535]))) 0-mem-pool: Mem pool is full. Callocing mem > > > [2014-03-20 13:19:24.954278] D > > > [afr-transaction.c:1144:afr_post_nonblocking_entrylk_cbk] > 0-gv0-replicate-0: Non > > > blocking entrylks done. Proceeding to FOP > > > [2014-03-20 13:19:24.966742] D [afr-lk-common.c:447:transaction_lk_op] > > > 0-gv0-replicate-0: lk op is for a transaction > > > [2014-03-20 13:19:24.967190] D > > > [afr-transaction.c:1094:afr_post_nonblocking_inodelk_cbk] > 0-gv0-replicate-0: Non > > > blocking inodelks done. Proceeding to FOP > > > [2014-03-20 13:19:24.967324] D > [client-rpc-fops.c:2789:client_fdctx_destroy] > > > 0-gv0-client-0: sending release on fd > > > [2014-03-20 13:19:24.967362] D > [client-rpc-fops.c:2789:client_fdctx_destroy] > > > 0-gv0-client-1: sending release on fd > > > [2014-03-20 13:19:24.967485] D [nfs3-helpers.c:3449:nfs3_log_newfh_res] > > > 0-nfs-nfsv3: XID: a0d2b6b3, CREATE: NFS: 0(Call completed > successfully.), POSIX: > > > 0(Success), FH: exportid c172abbc-6cc8-4b65-ad35-c34f10b53869, gfid > > > be79d2ff-0339-435f-ac36-b313e089e245 > > > [Thread 0x7ffff0e27700 (LWP 18236) exited] > > > [Thread 0x7ffff4852700 (LWP 18231) exited] > > > [Thread 0x7ffff568a700 (LWP 18230) exited] > > > [Thread 0x7ffff608b700 (LWP 18229) exited] > > > [Thread 0x7ffff6a8c700 (LWP 18228) exited] > > > > > > Program terminated with signal SIGKILL, Killed. > > > The program no longer exists. > > > (gdb) > > > > > > Regards, > > > Jens > > > _______________________________________________ > > > Gluster-users mailing list > > > [email protected] > > > http://supercolony.gluster.org/mailman/listinfo/gluster-users > > > > ----------------------------------------------------------------------- > 'In theory, there is no difference between theory and practice. > But, in practice, there is.' > ----------------------------------------------------------------------- > Jens Låås Email: [email protected] > ITS Phone: +46 18 471 77 03 > SWEDEN > ----------------------------------------------------------------------- > _______________________________________________ > Gluster-users mailing list > [email protected] > http://supercolony.gluster.org/mailman/listinfo/gluster-users >
_______________________________________________ Gluster-users mailing list [email protected] http://supercolony.gluster.org/mailman/listinfo/gluster-users
