|
Hi!
Background:
I have a Java web crawler app which spawns about 15 threads
with the sole purpose of downloading web pages as fast as possible. It
works fine under Windows NT w/jview-- but who wants to use NT? Under
FreeBSD (which is derived from the Blackdown work, I believe) the JVM appears to
hang after a while. I'm trying to work with the FreeBSD folks for
support, but in the mean time I'm looking for other options. Perhaps this
is an opportunity to work some Linux boxes into my system.
Problem:
The good news is that the JVM doesn't appear to hang under
Linux. That bad news is that now I get a huge number of "NoRouteToHost"
exceptions. The strange thing is that it scans about 100 pages OK, then I
get maybe 50 errors, and then it picks up and starts working again. The
cycle is repeated over and over.
When I start getting the "NoRouteToHost" exceptions, the
entire Linux machine appears to have network problems-- not just Java.
Seems like the JVM is using up a kernel resource which eventually gets freed up,
but not quickly enough. Is this possible? Any ideas or
suggestions? The app is pretty small, and I can publish the source if it
would help.
Any help would be greatly appreciated!
Here are some details:
Redhat 6.1
[rick@spinner geckobot]$ java -version [root@spinner /root]# ldconfig -D 2>&1 | grep ld | tail
-1 java version "1.1.7B" ld-linux.so.2 => ld-2.1.2.so [root@spinner /root]# ldconfig -D 2>&1 | grep libc | tail -1 libc.so.6 => libc-2.1.2.so [root@spinner /root]# uname -r 2.2.12-20smp Regards,
Rick
|
