Hi, The meaning of this exception is that the site you crawl, did not answer for a certain time and/or network congestion prevented the socket connection until timeout.
Try to set the following in your nutch-site.xml <!-- HTTP properties --> <property><name>http.timeout</name><value>80000</value></property> <property><name>http.max.delays</name><value>1000</value></property> HTH, Gal. > -----Original Message----- > From: cha [mailto:[EMAIL PROTECTED] > Sent: Thursday, April 19, 2007 2:31 PM > To: [EMAIL PROTECTED] > Subject: java.net.SocketTimeoutException:connect timed out > > > Hi All, > > When am crawling it is giving me following errors in my error log : > > [2007-04-17 16:45:56,343] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? java.net.SocketTimeoutException: > connect timed out > [2007-04-17 16:45:56,344] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.socketConnect(Native Method) > [2007-04-17 16:45:56,345] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) > [2007-04-17 16:45:56,346] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) > [2007-04-17 16:45:56,346] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) > [2007-04-17 16:45:56,347] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > [2007-04-17 16:45:56,347] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.Socket.connect(Socket.java:516) > [2007-04-17 16:45:56,347] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:94) > [2007-04-17 16:45:56,348] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.protocol.http.Http.getResponse(Http.java:63) > [2007-04-17 16:45:56,349] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.jav > a:208) > [2007-04-17 16:45:56,352] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:144) > [2007-04-17 16:46:31,961] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? java.net.SocketTimeoutException: > connect timed out > [2007-04-17 16:46:31,962] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.socketConnect(Native Method) > [2007-04-17 16:46:31,962] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) > [2007-04-17 16:46:31,962] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) > [2007-04-17 16:46:31,964] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) > [2007-04-17 16:46:31,964] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > [2007-04-17 16:46:31,965] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > java.net.Socket.connect(Socket.java:516) > [2007-04-17 16:46:31,965] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.protocol.http.HttpResponse.<init>(HttpResponse.java:94) > [2007-04-17 16:46:31,965] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.protocol.http.Http.getResponse(Http.java:63) > [2007-04-17 16:46:31,968] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.protocol.http.api.HttpBase.getProtocolOutput(HttpBase.jav > a:208) > [2007-04-17 16:46:31,968] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? at > org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:144) > [2007-04-17 16:47:07,731] [FetcherThread] ERROR > org.apache.nutch.protocol.http.Http:? > > Can some one tell me how to resolve it.. > > I have set the fetcher.threads.fetch =2 and http.max.delay=1000 in > nutch-site.xml .. > > Anything I like to set apart from this.. > > Pls let me know your valuable thoughts.. > > cheers, > cha > -- > View this message in context: > http://www.nabble.com/java.net.SocketTimeoutException%3Aconnect-timed-out- > tf3606564.html#a10076229 > Sent from the Nutch - User mailing list archive at Nabble.com. ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
