[
http://jira.codehaus.org/browse/WAGON-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=159573#action_159573
]
Richard Gomes commented on WAGON-254:
-------------------------------------
Hi,
I'm following directions on this article:
https://support.bea.com/application_content/product_portlets/support_patterns/wls/TooManyOpenFilesPattern.html
$ cat /etc/security/limits.conf
# /etc/security/limits.conf
#
#Each line describes a limit for a user in the form:
#
#<domain> <type> <item> <value>
#
#Where:
#<domain> can be:
# - an user name
# - a group name, with @group syntax
# - the wildcard *, for default entry
# - the wildcard %, can be also used with %group syntax,
# for maxlogin limit
#
#<type> can have the two values:
# - "soft" for enforcing the soft limits
# - "hard" for enforcing hard limits
#
#<item> can be one of the following:
# - core - limits the core file size (KB)
# - data - max data size (KB)
# - fsize - maximum filesize (KB)
# - memlock - max locked-in-memory address space (KB)
# - nofile - max number of open files
# - rss - max resident set size (KB)
# - stack - max stack size (KB)
# - cpu - max CPU time (MIN)
# - nproc - max number of processes
# - as - address space limit
# - maxlogins - max number of logins for this user
# - maxsyslogins - max number of logins on the system
# - priority - the priority to run user process with
# - locks - max number of file locks the user can hold
# - sigpending - max number of pending signals
# - msgqueue - max memory used by POSIX message queues (bytes)
# - nice - max nice priority allowed to raise to
# - rtprio - max realtime priority
#
#<domain> <type> <item> <value>
#
#* soft core 0
#* hard rss 10000
#...@student hard nproc 20
#...@faculty soft nproc 20
#...@faculty hard nproc 50
#ftp hard nproc 0
#...@student - maxlogins 4
# End of file
$ cat /proc/sys/fs/file-max
371153
$ cat /proc/sys/fs/file-nr
1920 0 371153
$ cat /proc/sys/fs/inode-nr
225525 3991
$ # the command below counts how many files where generated by "mvn clean
site-deploy"
$ find maven2/ -print | wc -l
6585
# This is the user configuration in LDAP
dn: uid=continuum,ou=People,dc=jquantlib,dc=org
objectClass: account
objectClass: posixAccount
objectClass: PureFTPdUser
objectClass: simpleSecurityObject
objectClass: top
cn: continuum
gidNumber: 33
homeDirectory: /srv/users/continuum
uid: continuum
uidNumber: 1003
userPassword:: secret
description: continuum
FTPDownloadBandwidth: -1
FTPDownloadRatio: -1
FTPgid: 33
FTPHomeDirectory: /srv/users/continuum
FTPQuotaFiles: -1
FTPQuotaMBytes: -1
FTPStatus: enabled
FTPuid: 1003
FTPUploadBandwidth: -1
FTPUploadRatio: -1
gecos: continuum
loginShell: /bin/bash
and finally, as you requested:
$ netstat -a
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 *:kshell *:* LISTEN
tcp 0 0 localhost:2208 *:* LISTEN
tcp 0 0 localhost:ldap *:* LISTEN
tcp 0 0 localhost:8005 *:* LISTEN
tcp 0 0 localhost:47943 *:* LISTEN
tcp 0 0 *:8009 *:* LISTEN
tcp 0 0 localhost:mysql *:* LISTEN
tcp 0 0 localhost:11211 *:* LISTEN
tcp 0 0 *:kerberos-adm *:* LISTEN
tcp 0 0 localhost:34861 *:* LISTEN
tcp 0 0 localhost:5038 *:* LISTEN
tcp 0 0 *:www *:* LISTEN
tcp 0 0 *:webcache *:* LISTEN
tcp 0 0 *:ftp *:* LISTEN
tcp 0 0 *:ssh *:* LISTEN
tcp 0 0 *:ipp *:* LISTEN
tcp 0 0 www.jquantlib.:kerberos *:* LISTEN
tcp 0 0 localhost:kerberos *:* LISTEN
tcp 0 0 *:omniorb *:* LISTEN
tcp 0 0 localhost:postgresql *:* LISTEN
tcp 0 0 localhost:smtp *:* LISTEN
tcp 0 0 localhost:6010 *:* LISTEN
tcp 0 0 localhost:6011 *:* LISTEN
tcp 0 0 *:https *:* LISTEN
tcp 0 0 localhost:6012 *:* LISTEN
tcp 0 0 *:ldaps *:* LISTEN
tcp 0 0 localhost:35548 localhost:11211 TIME_WAIT
tcp 0 0 localhost:5038 localhost:49752 ESTABLISHED
tcp 0 0 localhost:49752 localhost:5038 ESTABLISHED
tcp 0 0 localhost:6010 localhost:38531 ESTABLISHED
tcp 0 0 localhost:38531 localhost:6010 ESTABLISHED
tcp 0 640 www.jquantlib.org:ssh developer.jquantl:40815 ESTABLISHED
tcp 0 0 www.jquantlib.org:ssh developer.jquantl:43801 ESTABLISHED
tcp 0 0 www.jquantlib.org:ssh developer.jquantl:51500 ESTABLISHED
tcp 0 0 www.jquantlib.org:www llf520184.crawl.y:48821 TIME_WAIT
tcp 0 0 www.jquantlib.org:ldaps developer.jquantl:53911 ESTABLISHED
udp 0 0 localhost:32768 localhost:32768 ESTABLISHED
udp 0 0 www.jquantlib.org:13972 *:*
udp 0 0 *:13973 *:*
udp 0 0 www.jquantlib.org:15776 *:*
udp 0 0 *:15777 *:*
udp 0 0 *:44345 *:*
udp 0 0 www.jquantlib.org:sip *:*
udp 0 0 www.jquantlib.o:kpasswd *:*
udp 0 0 localhost:kpasswd *:*
udp 0 0 www.jquantlib.org:15700 *:*
udp 0 0 *:15701 *:*
udp 0 0 www.jquantlib.:kerberos *:*
udp 0 0 localhost:kerberos *:*
udp 0 0 *:iax *:*
udp 0 0 *:mdns *:*
udp 0 0 *:ipp *:*
Active UNIX domain sockets (servers and established)
Proto RefCnt Flags Type State I-Node Path
unix 13 [ ] DGRAM 3721493 /dev/log
unix 2 [ ACC ] STREAM LISTENING 8074 public/cleanup
unix 2 [ ACC ] STREAM LISTENING 8081 private/tlsmgr
unix 2 [ ACC ] STREAM LISTENING 8085 private/rewrite
unix 2 [ ACC ] STREAM LISTENING 8089 private/bounce
unix 2 [ ACC ] STREAM LISTENING 8093 private/defer
unix 2 [ ACC ] STREAM LISTENING 8097 private/trace
unix 2 [ ACC ] STREAM LISTENING 8101 private/verify
unix 2 [ ACC ] STREAM LISTENING 8105 public/flush
unix 2 [ ACC ] STREAM LISTENING 8109 private/proxymap
unix 2 [ ACC ] STREAM LISTENING 8113 private/smtp
unix 2 [ ACC ] STREAM LISTENING 8117 private/relay
unix 2 [ ACC ] STREAM LISTENING 8121 public/showq
unix 2 [ ACC ] STREAM LISTENING 8125 private/error
unix 2 [ ACC ] STREAM LISTENING 8129 private/discard
unix 2 [ ACC ] STREAM LISTENING 8133 private/local
unix 2 [ ACC ] STREAM LISTENING 8137 private/virtual
unix 2 [ ACC ] STREAM LISTENING 8141 private/lmtp
unix 2 [ ACC ] STREAM LISTENING 8145 private/anvil
unix 2 [ ACC ] STREAM LISTENING 8149 private/scache
unix 2 [ ACC ] STREAM LISTENING 8153 private/maildrop
unix 2 [ ACC ] STREAM LISTENING 8157 private/uucp
unix 2 [ ACC ] STREAM LISTENING 8161 private/ifmail
unix 2 [ ACC ] STREAM LISTENING 8165 private/bsmtp
unix 2 [ ACC ] STREAM LISTENING 8169
private/scalemail-backend
unix 2 [ ACC ] STREAM LISTENING 8173 private/mailman
unix 2 [ ACC ] STREAM LISTENING 6436
/var/run/postgresql/.s.PGSQL.5432
unix 2 [ ACC ] STREAM LISTENING 6547 /var/run/acpid.socket
unix 2 [ ACC ] STREAM LISTENING 5117511
/var/run/cups/cups.sock
unix 2 [ ACC ] STREAM LISTENING 6639
/var/run/dbus/system_bus_socket
unix 2 [ ACC ] STREAM LISTENING 4874259
/var/run/avahi-daemon/socket
unix 2 [ ACC ] STREAM LISTENING 4981340
/var/run/dirmngr/socket
unix 2 [ ACC ] STREAM LISTENING 393809
/tmp/ksocket-rgomesiKMpra/www.jquantlib.org-5286-48dcebd6
unix 2 [ ACC ] STREAM LISTENING 19699
/var/run/asterisk/asterisk.ctl
unix 2 [ ] DGRAM 3626
@/org/kernel/udev/udevd
unix 2 [ ACC ] STREAM LISTENING 4568798 /var/run/slapd/ldapi
unix 2 [ ACC ] STREAM LISTENING 4665380 /var/run/nscd/socket
unix 2 [ ACC ] STREAM LISTENING 4183765
/var/run/mysqld/mysqld.sock
unix 2 [ ACC ] STREAM LISTENING 6655
@/var/run/hald/dbus-wNQ7am3dzo
unix 2 [ ACC ] STREAM LISTENING 4423429 /var/run/.kcm_socket
unix 2 [ ] DGRAM 6663
@/org/freedesktop/hal/udev_event
unix 2 [ ACC ] STREAM LISTENING 397955 /tmp/fail2ban.sock
unix 2 [ ACC ] STREAM LISTENING 4425406
/tmp/ksocket-root/www.jquantlib.org-4c91-4942b3f8
unix 2 [ ACC ] STREAM LISTENING 6654
@/var/run/hald/dbus-k4WJlZ24rq
unix 2 [ ] DGRAM 5141346
unix 2 [ ] DGRAM 5126129
unix 3 [ ] STREAM CONNECTED 5126100
unix 3 [ ] STREAM CONNECTED 5126099
unix 2 [ ] DGRAM 5120896
unix 3 [ ] STREAM CONNECTED 5120866
unix 3 [ ] STREAM CONNECTED 5120865
unix 2 [ ] DGRAM 5117549
unix 2 [ ] STREAM CONNECTED 5104791
unix 2 [ ] DGRAM 5093171
unix 3 [ ] STREAM CONNECTED 5093168
unix 3 [ ] STREAM CONNECTED 5093167
unix 3 [ ] STREAM CONNECTED 4874262
/var/run/dbus/system_bus_socket
unix 3 [ ] STREAM CONNECTED 4874261
unix 3 [ ] STREAM CONNECTED 4874256
unix 3 [ ] STREAM CONNECTED 4874255
unix 2 [ ] DGRAM 4874227
unix 2 [ ] DGRAM 4666450
unix 2 [ ] DGRAM 4568794
unix 2 [ ] STREAM CONNECTED 4555313
unix 2 [ ] STREAM CONNECTED 4425403
/tmp/ksocket-rgomesiKMpra/kdeinit_localhost_12
unix 2 [ ] DGRAM 4423438
unix 2 [ ] DGRAM 4183759
unix 3 [ ] STREAM CONNECTED 4075811
/var/run/dbus/system_bus_socket
unix 3 [ ] STREAM CONNECTED 4075810
unix 2 [ ] DGRAM 3723123
unix 2 [ ] STREAM CONNECTED 393806
/tmp/ksocket-rgomesiKMpra/kdeinit_localhost_10
unix 2 [ ] DGRAM 11208
unix 3 [ ] STREAM CONNECTED 8176
unix 3 [ ] STREAM CONNECTED 8175
unix 3 [ ] STREAM CONNECTED 8172
unix 3 [ ] STREAM CONNECTED 8171
unix 3 [ ] STREAM CONNECTED 8168
unix 3 [ ] STREAM CONNECTED 8167
unix 3 [ ] STREAM CONNECTED 8164
unix 3 [ ] STREAM CONNECTED 8163
unix 3 [ ] STREAM CONNECTED 8160
unix 3 [ ] STREAM CONNECTED 8159
unix 3 [ ] STREAM CONNECTED 8156
unix 3 [ ] STREAM CONNECTED 8155
unix 3 [ ] STREAM CONNECTED 8152
unix 3 [ ] STREAM CONNECTED 8151
unix 3 [ ] STREAM CONNECTED 8148
unix 3 [ ] STREAM CONNECTED 8147
unix 3 [ ] STREAM CONNECTED 8144
unix 3 [ ] STREAM CONNECTED 8143
unix 3 [ ] STREAM CONNECTED 8140
unix 3 [ ] STREAM CONNECTED 8139
unix 3 [ ] STREAM CONNECTED 8136
unix 3 [ ] STREAM CONNECTED 8135
unix 3 [ ] STREAM CONNECTED 8132
unix 3 [ ] STREAM CONNECTED 8131
unix 3 [ ] STREAM CONNECTED 8128
unix 3 [ ] STREAM CONNECTED 8127
unix 3 [ ] STREAM CONNECTED 8124
unix 3 [ ] STREAM CONNECTED 8123
unix 3 [ ] STREAM CONNECTED 8120
unix 3 [ ] STREAM CONNECTED 8119
unix 3 [ ] STREAM CONNECTED 8116
unix 3 [ ] STREAM CONNECTED 8115
unix 3 [ ] STREAM CONNECTED 8112
unix 3 [ ] STREAM CONNECTED 8111
unix 3 [ ] STREAM CONNECTED 8108
unix 3 [ ] STREAM CONNECTED 8107
unix 3 [ ] STREAM CONNECTED 8104
unix 3 [ ] STREAM CONNECTED 8103
unix 3 [ ] STREAM CONNECTED 8100
unix 3 [ ] STREAM CONNECTED 8099
unix 3 [ ] STREAM CONNECTED 8096
unix 3 [ ] STREAM CONNECTED 8095
unix 3 [ ] STREAM CONNECTED 8092
unix 3 [ ] STREAM CONNECTED 8091
unix 3 [ ] STREAM CONNECTED 8088
unix 3 [ ] STREAM CONNECTED 8087
unix 3 [ ] STREAM CONNECTED 8084
unix 3 [ ] STREAM CONNECTED 8083
unix 3 [ ] STREAM CONNECTED 8080
unix 3 [ ] STREAM CONNECTED 8079
unix 3 [ ] STREAM CONNECTED 8077
unix 3 [ ] STREAM CONNECTED 8076
unix 3 [ ] STREAM CONNECTED 8073
unix 3 [ ] STREAM CONNECTED 8072
unix 3 [ ] STREAM CONNECTED 8068
unix 3 [ ] STREAM CONNECTED 8067
unix 2 [ ] DGRAM 8060
unix 3 [ ] STREAM CONNECTED 7932
unix 3 [ ] STREAM CONNECTED 7931
unix 3 [ ] STREAM CONNECTED 7768
/var/run/dbus/system_bus_socket
unix 3 [ ] STREAM CONNECTED 7767
unix 2 [ ] DGRAM 7766
unix 3 [ ] STREAM CONNECTED 7758
/var/run/dbus/system_bus_socket
unix 3 [ ] STREAM CONNECTED 7757
unix 3 [ ] STREAM CONNECTED 7688
@/var/run/hald/dbus-k4WJlZ24rq
unix 3 [ ] STREAM CONNECTED 7687
unix 3 [ ] STREAM CONNECTED 7499 /var/run/acpid.socket
unix 3 [ ] STREAM CONNECTED 7498
unix 3 [ ] STREAM CONNECTED 7493
@/var/run/hald/dbus-k4WJlZ24rq
unix 3 [ ] STREAM CONNECTED 7467
unix 3 [ ] STREAM CONNECTED 6658
@/var/run/hald/dbus-wNQ7am3dzo
unix 3 [ ] STREAM CONNECTED 6657
unix 3 [ ] STREAM CONNECTED 6642
unix 3 [ ] STREAM CONNECTED 6641
unix 2 [ ] DGRAM 6304
unix 2 [ ] DGRAM 6261
Thanks! :)
> wagon-ftp :: error uploading site:: too many open files
> -------------------------------------------------------
>
> Key: WAGON-254
> URL: http://jira.codehaus.org/browse/WAGON-254
> Project: Maven Wagon
> Issue Type: Bug
> Affects Versions: 1.0-beta-4
> Environment: Maven version: 2.1.0-M1
> Java version: 1.6.0_10-rc2
> Default locale: en_GB, platform encoding: UTF-8
> OS name: "linux" version: "2.6.26-1-amd64" arch: "amd64" family: "unix"
> Reporter: Richard Gomes
> Priority: Minor
> Attachments: wagon-ftp_too-many-open-files.tar.bz2
>
>
> A complete log file is attached. Below you can see the stack trace:
> [INFO] Error uploading site
> Embedded error: IOException caught while attempting to upload
> /home/rgomes/workspace/jquantlib/target/site/testapidocs/org/jquantlib/testsuite/math/distributions/InverseCumulativeNormalTest.dot
> Too many open files
> [INFO]
> ------------------------------------------------------------------------
> [DEBUG] Trace
> org.apache.maven.lifecycle.LifecycleExecutionException: Error uploading site
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:701)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalWithLifecycle(DefaultLifecycleExecutor.java:538)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoal(DefaultLifecycleExecutor.java:517)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalAndHandleFailures(DefaultLifecycleExecutor.java:369)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeTaskSegments(DefaultLifecycleExecutor.java:330)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.execute(DefaultLifecycleExecutor.java:181)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:336)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:129)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:302)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.codehaus.classworlds.Launcher.launchEnhanced(Launcher.java:315)
> at org.codehaus.classworlds.Launcher.launch(Launcher.java:255)
> at
> org.codehaus.classworlds.Launcher.mainWithExitCode(Launcher.java:430)
> at org.codehaus.classworlds.Launcher.main(Launcher.java:375)
> Caused by: org.apache.maven.plugin.MojoExecutionException: Error uploading
> site
> at
> org.apache.maven.plugins.site.SiteDeployMojo.execute(SiteDeployMojo.java:203)
> at
> org.apache.maven.plugin.DefaultPluginManager.executeMojo(DefaultPluginManager.java:458)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:676)
> ... 16 more
> Caused by: org.apache.maven.wagon.TransferFailedException: IOException caught
> while attempting to upload
> /home/rgomes/workspace/jquantlib/target/site/testapidocs/org/jquantlib/testsuite/math/distributions/InverseCumulativeNormalTest.dot
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:639)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:580)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:573)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:573)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:573)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:573)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:573)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:573)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.putDirectory(FtpWagon.java:500)
> at
> org.apache.maven.plugins.site.SiteDeployMojo.execute(SiteDeployMojo.java:187)
> ... 18 more
> Caused by: java.net.SocketException: Too many open files
> at java.net.Socket.createImpl(Socket.java:388)
> at java.net.Socket.<init>(Socket.java:362)
> at java.net.Socket.<init>(Socket.java:180)
> at
> org.apache.commons.net.DefaultSocketFactory.createSocket(DefaultSocketFactory.java:53)
> at
> org.apache.commons.net.ftp.FTPClient._openDataConnection_(FTPClient.java:513)
> at
> org.apache.commons.net.ftp.FTPClient.__storeFile(FTPClient.java:388)
> at org.apache.commons.net.ftp.FTPClient.storeFile(FTPClient.java:1388)
> at
> org.apache.maven.wagon.providers.ftp.FtpWagon.ftpRecursivePut(FtpWagon.java:603)
> ... 27 more
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 22 minutes 26 seconds
> [INFO] Finished at: Wed Dec 31 10:49:27 GMT 2008
> [INFO] Final Memory: 132M/370M
> [INFO]
> ------------------------------------------------------------------------
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira