I never had such problem with default settings, Suse Linux 9.3, J2SE 5 (default installation of Java 1.5.0_03 from Suse ftp site)...
> at java.net.PlainSocketImpl.socketConnect(Native Method) - native method... Seems like OS error... Try some tuning (may be memory not enough? May be bad NIC driver?) -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Sent: Tuesday, October 18, 2005 11:00 PM To: [email protected] Subject: Re: No buffer space available But I tired it on two different machines, one with Linux Cent OS and the other one Linux UBUNTU! On example of the given Exception is like this: 051018 153727 28 fetching http://perso.wanadoo.es/largo/ java.net.SocketException: No buffer space available at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:364) at java.net.Socket.connect(Socket.java:507) at java.net.Socket.connect(Socket.java:457) at java.net.Socket.<init>(Socket.java:365) at java.net.Socket.<init>(Socket.java:238) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.c reateSocket(DefaultProtocolSocketFactory.java:79) at org.apache.commons.httpclient.protocol.ControllerThreadSocketFactory$ 1.doit(ControllerThreadSocketFactory.java:90) at org.apache.commons.httpclient.protocol.ControllerThreadSocketFactory$ SocketTask.run(ControllerThreadSocketFactory.java:157) at java.lang.Thread.run(Thread.java:595) Nima On 10/18/05, Fuad Efendi <[EMAIL PROTECTED]> wrote: > > java.net.SocketException - Thrown to indicate that there is an error > in the underlying protocol, such as a TCP error. > > "No buffer space available" - message comes from underlying OS... > > I think it's not Nutch or configuration of Nutch... > > May be OS tuning? May be JVM version/vendor? > > I don't know in-depth UNIX, but it has some specific settings for > protocol... > > > > -----Original Message----- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] > Sent: Tuesday, October 18, 2005 9:29 PM > To: [email protected] > Subject: No buffer space available > > > Hi, > I was trying to fetch DMOZ open directory using using the exact > example in the nutch tutorial website. So did the following steps: > mkdir db mkdir segments bin/nutch admin db -create bin/nutch inject db > -dmozfile ../nutch-0.7.1/content.rdf.u8 -subset 3000 bin/nutch > generate db segments s1=`ls -d segments/2* | tail -1` echo $s1 > bin/nutch fetch -showThreadID -noParsing -threads 50 $s1 bin/nutch > updatedb db $s1 It starts fetching the pages, but after couple > hundred pages it starts giving me this exception: > "java.net.SocketException: No buffer space available" > Do you have any idea why this might happen? I know it is running out of > availabe buffer for new socket, but why the old socket are not closed? Even > if a fetch fails its socket should be closed and the its buffer should get > freed! I tried both 0.7 and 0.7.1. Thanks. Nima > >
