Hi everybody,
The last weekend I moved the mail service of my company to James-2.1.
There are about 220 users, very active , generating about 120
inbound/outbound messages per hour, and about 2 pop3 requests per second
during peak hours.
On a server class Pentium III biprocessor with 2x350 MHz, > 512 MB Ram under
Windows 2000 Server SP3, everything works great and fast (5-6% CPU per
processor). James runs as a Windows service.
But after perhaps some hours, suddenly CPU goes up to about 50% per
processor (very balanced 50/50) and never goes back again. All such cpu is
on the James process (shown as java). Performance continues to be ok from
the end-user perception (nobody perceives anything), but there is something
wrong going on. The only way to fix the situation is to shutdown and restart
James.
During this strange period I start getting in the mailet log, after almost
EVERY delivery, the message:
29/01/03 16:56:21 INFO James.Mailet: RemoteDelivery: Exception caught in
RemoteDelivery.run(): java.util.ConcurrentModificationException
I kept it running for hours!
I even got the following few on the mailstore log (brrrr):
29/01/03 10:26:48 ERROR mailstore: Exception retrieving mail:
java.lang.RuntimeException: Exception caught while retrieving an object,
cause: java.io.FileNotFoundException:
D:\james\apps\james\var\mail\outgoing\4D61696C313034333833323430373238312D39
33392D746F2D7265706C792E6974.Repository.FileObjectStore (The system cannot
find the file specified), so we're deleting it... good riddance!
29/01/03 10:27:43 ERROR mailstore: Exception retrieving mail:
java.lang.RuntimeException: Exception caught while retrieving an object,
cause: java.io.FileNotFoundException:
D:\james\apps\james\var\mail\outgoing\4D61696C313034333833323436333034362D39
34392D746F2D7473662E6974.Repository.FileObjectStore (The system cannot find
the file specified), so we're deleting it... good riddance!
29/01/03 10:35:20 ERROR mailstore: Exception retrieving mail:
java.lang.RuntimeException: Exception caught while retrieving an object,
cause: java.io.FileNotFoundException:
D:\james\apps\james\var\mail\outgoing\4D61696C313034333833323838363235302D31
3030352D746F2D766967656C2E636F6D.Repository.FileObjectStore (The system
cannot find the file specified), so we're deleting it... good riddance!
29/01/03 11:13:53 ERROR mailstore: Exception retrieving mail:
java.lang.RuntimeException: Exception caught while retrieving an object,
cause: java.io.FileNotFoundException:
D:\james\apps\james\var\mail\inboxes\username\4D61696C3130343338333532333135
36322D31323931.Repository.FileObjectStore (The system cannot find the file
specified), so we're deleting it... good riddance!
29/01/03 11:13:53 ERROR mailstore: Exception retrieving mail:
java.lang.RuntimeException: Cannot lock Mail1043835231562-1291 to remove it
29/01/03 11:24:01 ERROR mailstore: Exception retrieving mail:
java.lang.RuntimeException: Exception caught while retrieving an object,
cause: java.io.FileNotFoundException:
D:\james\apps\james\var\mail\outgoing\4D61696C313034333833353735393630392D31
3339352D746F2D636F736D6574616C2E6974.Repository.FileObjectStore (The system
cannot find the file specified), so we're deleting it... good riddance!
29/01/03 12:11:42 ERROR mailstore: Exception retrieving mail:
java.lang.RuntimeException: Exception caught while retrieving an object,
cause: java.io.FileNotFoundException:
D:\james\apps\james\var\mail\outgoing\4D61696C313034333833383730303839302D31
3830332D746F2D66736E632E6974.Repository.FileObjectStore (The system cannot
find the file specified), so we're deleting it... good riddance!
I got also things (very few) like the following on the pop3server log:
29/01/03 10:23:11 ERROR pop3server: Exception during connection from
LINUXSERV (10.10.10.22) : Read timed out
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:116)
at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:404)
at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:442)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:179)
at java.io.InputStreamReader.read(InputStreamReader.java:167)
at java.io.BufferedReader.fill(BufferedReader.java:136)
at java.io.BufferedReader.readLine(BufferedReader.java:299)
at java.io.BufferedReader.readLine(BufferedReader.java:362)
at
org.apache.james.pop3server.POP3Handler.handleConnection(POP3Handler.java:25
6)
at
org.apache.james.util.connection.ServerConnection$ClientConnectionRunner.run
(ServerConnection.java:404)
at
org.apache.avalon.excalibur.thread.impl.ExecutableRunnable.execute(Executabl
eRunnable.java:47)
at
org.apache.avalon.excalibur.thread.impl.WorkerThread.run(WorkerThread.java:8
0)
29/01/03 11:07:19 ERROR pop3server: Exception during connection from
LINUXSERV (10.10.10.22) : Connection reset by peer: JVM_recv in socket input
stream read
java.net.SocketException: Connection reset by peer: JVM_recv in socket input
stream read
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:116)
at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:404)
at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:442)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:179)
at java.io.InputStreamReader.read(InputStreamReader.java:167)
at java.io.BufferedReader.fill(BufferedReader.java:136)
at java.io.BufferedReader.readLine(BufferedReader.java:299)
at java.io.BufferedReader.readLine(BufferedReader.java:362)
at
org.apache.james.pop3server.POP3Handler.handleConnection(POP3Handler.java:25
6)
at
org.apache.james.util.connection.ServerConnection$ClientConnectionRunner.run
(ServerConnection.java:404)
at
org.apache.avalon.excalibur.thread.impl.ExecutableRunnable.execute(Executabl
eRunnable.java:47)
at
org.apache.avalon.excalibur.thread.impl.WorkerThread.run(WorkerThread.java:8
0)
29/01/03 11:13:53 ERROR pop3server: Exception during connection from
LINUXSERV (10.10.10.22) : Exception while retrieving mail: Cannot lock
Mail1043835231562-1291 to remove it
java.lang.RuntimeException: Exception while retrieving mail: Cannot lock
Mail1043835231562-1291 to remove it
at
org.apache.james.mailrepository.AvalonMailRepository.retrieve(AvalonMailRepo
sitory.java:340)
at org.apache.james.pop3server.POP3Handler.stat(POP3Handler.java:379)
at org.apache.james.pop3server.POP3Handler.doPASS(POP3Handler.java:504)
at
org.apache.james.pop3server.POP3Handler.parseCommand(POP3Handler.java:436)
at
org.apache.james.pop3server.POP3Handler.handleConnection(POP3Handler.java:25
6)
at
org.apache.james.util.connection.ServerConnection$ClientConnectionRunner.run
(ServerConnection.java:404)
at
org.apache.avalon.excalibur.thread.impl.ExecutableRunnable.execute(Executabl
eRunnable.java:47)
at
org.apache.avalon.excalibur.thread.impl.WorkerThread.run(WorkerThread.java:8
0)
LINUXSERV is our firewall server.
But have not been able to find a correlation between those messages and the
beginning of the CPU rise (I would need to watch for hours the performance
monitor).
To complete the informations, I'm using file based repositories for messages
and spool, and an SqlServer database for the LocalUsers and any mailing
lists repository.
I'm worried that there is some bug somewhere. Can anybody help me?
Thank you,
Vincenzo Gianferrari Pini
Wait a moment: just now CPU rose up and I received the following messages:
On the mailet log:
29/01/03 17:45:52 INFO James.Mailet: RemoteDelivery: No mail server found
for: starvox.i
29/01/03 17:45:52 INFO James.Mailet: RemoteDelivery: Temporary exception
delivering mail (Mail1043858744437-279-to-starvox.i:
javax.mail.MessagingException: There are no DNS entries for the hostname
starvox.i. I cannot determine where to send this message.
at
org.apache.james.transport.mailets.RemoteDelivery.deliver(RemoteDelivery.jav
a:185)
at
org.apache.james.transport.mailets.RemoteDelivery.run(RemoteDelivery.java:59
3)
at java.lang.Thread.run(Thread.java:536)
On the pop3server log:
29/01/03 17:47:20 ERROR pop3server: Exception during connection from
LINUXSERV (10.10.10.22) : Connection reset by peer: JVM_recv in socket input
stream read
java.net.SocketException: Connection reset by peer: JVM_recv in socket input
stream read
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:116)
at sun.nio.cs.StreamDecoder$CharsetSD.readBytes(StreamDecoder.java:404)
at sun.nio.cs.StreamDecoder$CharsetSD.implRead(StreamDecoder.java:442)
at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:179)
at java.io.InputStreamReader.read(InputStreamReader.java:167)
at java.io.BufferedReader.fill(BufferedReader.java:136)
at java.io.BufferedReader.readLine(BufferedReader.java:299)
at java.io.BufferedReader.readLine(BufferedReader.java:362)
at
org.apache.james.pop3server.POP3Handler.handleConnection(POP3Handler.java:25
6)
at
org.apache.james.util.connection.ServerConnection$ClientConnectionRunner.run
(ServerConnection.java:404)
at
org.apache.avalon.excalibur.thread.impl.ExecutableRunnable.execute(Executabl
eRunnable.java:47)
at
org.apache.avalon.excalibur.thread.impl.WorkerThread.run(WorkerThread.java:8
0)
Should (?) be one of such events.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
