Please see attached file:
-----Original Message-----
From: Andrzej Bialecki [mailto:[EMAIL PROTECTED]
Sent: Friday, August 19, 2005 5:24 AM
To: [email protected]
Subject: Re: Nutch 0.7 released
EM wrote:
> I installed 0.7 and started spidering sites.
>
> However, some fetching processes would block for a really long time
(hours),
> this wasn't the case with 0.6 on the same set of sites.
>
> I've saved a couple ctrl-breaks so far (two stalled processes in 3 hours,
> this is a record). Would somebody be interested looking into them and any
> new ones?
Yes, I would.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
Full thread dump Java HotSpot(TM) Client VM (1.4.2_08-b03 mixed mode):
"MultiThreadedHttpConnectionManager cleanup" daemon prio=5 tid=0x03224c58
nid=0x1be0 in Object.wait() [376f000..376fd8c]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <0x14e8b7e8> (a java.lang.ref.ReferenceQueue$Lock)
at
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1100)
"fetcher0" prio=5 tid=0x030ed1f0 nid=0x1cd4 in Object.wait() [332f000..332fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <0x14e8b868> (a
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ConnectionPool)
at
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager.doGetConnection(MultiThreadedHttpConnectionManager.java:509)
- locked <0x14e8b868> (a
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ConnectionPool)
at
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager.getConnectionWithTimeout(MultiThreadedHttpConnectionManager.java:394)
at
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:152)
at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:393)
at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)
at
org.apache.nutch.protocol.httpclient.HttpResponse.<init>(HttpResponse.java:102)
at
org.apache.nutch.protocol.httpclient.Http.getProtocolOutput(Http.java:204)
at org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:135)
"Signal Dispatcher" daemon prio=10 tid=0x00a004a0 nid=0x1870 waiting on
condition [0..0]
"Finalizer" daemon prio=9 tid=0x009fd878 nid=0x107c in Object.wait()
[2f5f000..2f5fd8c]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <0x14d07f80> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x009fc4f8 nid=0x1ed4 in Object.wait()
[2f1f000..2f1fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <0x14d07fe8> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:429)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
- locked <0x14d07fe8> (a java.lang.ref.Reference$Lock)
"main" prio=5 tid=0x000369b0 nid=0x1d20 waiting on condition [7f000..7fc38]
at java.lang.Thread.sleep(Native Method)
at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:351)
at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:488)
"VM Thread" prio=5 tid=0x00a3b5d0 nid=0x1e38 runnable
"VM Periodic Task Thread" prio=10 tid=0x00a56ba0 nid=0x1cc8 waiting on condition
"Suspend Checker Thread" prio=10 tid=0x009ffa50 nid=0x1adc runnable
Full thread dump Java HotSpot(TM) Client VM (1.4.2_08-b03 mixed mode):
"MultiThreadedHttpConnectionManager cleanup" daemon prio=5 tid=0x03224c50
nid=0x1e94 in Object.wait() [376f000..376fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <0x14e88498> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <0x14e88498> (a java.lang.ref.ReferenceQueue$Lock)
at
org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$ReferenceQueueThread.run(MultiThreadedHttpConnectionManager.java:1100)
"fetcher0" prio=5 tid=0x030ed1f0 nid=0x1398 runnable [332f000..332fd8c]
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
- locked <0x100e4618> (a java.io.BufferedInputStream)
at
org.apache.commons.httpclient.ContentLengthInputStream.read(ContentLengthInputStream.java:169)
at
org.apache.commons.httpclient.ContentLengthInputStream.read(ContentLengthInputStream.java:183)
at
org.apache.commons.httpclient.ChunkedInputStream.exhaustInputStream(ChunkedInputStream.java:368)
at
org.apache.commons.httpclient.ContentLengthInputStream.close(ContentLengthInputStream.java:117)
at java.io.FilterInputStream.close(FilterInputStream.java:159)
at
org.apache.commons.httpclient.AutoCloseInputStream.notifyWatcher(AutoCloseInputStream.java:176)
at
org.apache.commons.httpclient.AutoCloseInputStream.close(AutoCloseInputStream.java:140)
at
org.apache.nutch.protocol.httpclient.HttpResponse.<init>(HttpResponse.java:125)
at
org.apache.nutch.protocol.httpclient.Http.getProtocolOutput(Http.java:204)
at org.apache.nutch.fetcher.Fetcher$FetcherThread.run(Fetcher.java:135)
"Signal Dispatcher" daemon prio=10 tid=0x00a004a0 nid=0x1c40 waiting on
condition [0..0]
"Finalizer" daemon prio=9 tid=0x009fd878 nid=0x1ab0 in Object.wait()
[2f5f000..2f5fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <0x14d05c40> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <0x14d05c40> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x009fc4f8 nid=0x1be8 in Object.wait()
[2f1f000..2f1fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <0x14d05ca8> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:429)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
- locked <0x14d05ca8> (a java.lang.ref.Reference$Lock)
"main" prio=5 tid=0x000369b0 nid=0x19f8 waiting on condition [7f000..7fc38]
at java.lang.Thread.sleep(Native Method)
at org.apache.nutch.fetcher.Fetcher.run(Fetcher.java:351)
at org.apache.nutch.fetcher.Fetcher.main(Fetcher.java:488)
"VM Thread" prio=5 tid=0x00a3b5d0 nid=0x1d30 runnable
"VM Periodic Task Thread" prio=10 tid=0x00a56c40 nid=0x1d8c waiting on condition
"Suspend Checker Thread" prio=10 tid=0x009ffa50 nid=0x1d44 runnable
