Re: Tomcat 6.0 clustering problem with replication mode.

2010-04-14 Thread Filip Hanik - Dev Lists 

The first error
>java.util.ConcurrentModificationException
happens cause the membership changed in between. The error logs, but the 
system is not interrupted.


The second error
>java.net.SocketTimeoutException: Read timed out

This means the node failed to respond. This means you got a problem. You 
should post

- your exact tomcat version
- your configuration
- your jvm version

best
Filip


On 04/14/2010 05:01 AM, Pardeep Ruhil wrote:

Hi,
We are running our application in  load balanced mode in Tomcat 6.0 with 
session replication.
When we are starting the servers in load balanced mode,  then in the console we 
are getting the following  error :

2010-04-14 11:47:51,078 (main) [ VfsLog.java:122:INFO ] Using 
"C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\vfs_cache" as temporary files store.
2010-04-14 11:48:05,140 (GroupChannel-Heartbeat-1) [   
GroupChannel.java:665:ERROR] Unable to send heartbeat through Tribes 
interceptor stack. Will try to sleep again.
java.util.ConcurrentModificationException
 at 
java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372)
 at java.util.AbstractList$Itr.next(AbstractList.java:343)
 at 
org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:152)
 at 
org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661)
class org.webslinger.commons.vfs.flat.FlatFileProvider
2010-04-14 11:48:09,937 (main) [  ChannelSocket.java:387:INFO ] JK: ajp13 
listening on /0.0.0.0:8009
2010-04-14 11:48:09,984 (main) [ JkMain.java:344:INFO ] Jk running 
ID=0 time=16/78  config=null
2010-04-14 11:48:10,125 (main) [ Http11Protocol.java:209:INFO ] Starting 
Coyote HTTP/1.1 on http-0.0.0.0-8080

When  we are testing 100 concurrent users using JMeter, it is giving following 
error after  5-10 mins.

0-04-14 09:46:10,703 (GroupChannel-Heartbeat-1) [  
BioSender.java:287:WARN ] Unable to read acknowledgement from [/192.168.1.3:1,93
a.net.SocketTimeoutException: Read timed out
  at java.net.SocketInputStream.socketRead0(Native Method)
  at java.net.SocketInputStream.read(SocketInputStream.java:129)
  at java.net.SocketInputStream.read(SocketInputStream.java:182)
  at 
org.apache.catalina.tribes.transport.bio.BioSender.waitForAck(BioSender.java:263)
  at 
org.apache.catalina.tribes.transport.bio.BioSender.pushMessage(BioSender.java:245)
  at 
org.apache.catalina.tribes.transport.bio.BioSender.sendMessage(BioSender.java:125)
  at 
org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:52)
  at 
org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51)
  at 
org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80)
  at 
org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78)
  at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
  at 
org.apache.catalina.tribes.group.interceptors.TcpFailureDetector.sendMessage(TcpFailureDetector.java:87)
  at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
  at 
org.apache.catalina.tribes.group.interceptors.MessageDispatchInterceptor.sendMessage(MessageDispatchInterceptor.java:73)
  at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
  at 
org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:216)
  at 
org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:175)
  at org.apache.catalina.tribes.group.RpcChannel.send(RpcChannel.java:89)
  at 
org.apache.catalina.tribes.tipis.AbstractReplicatedMap.ping(AbstractReplicatedMap.java:253)
  at 
org.apache.catalina.tribes.tipis.AbstractReplicatedMap.heartbeat(AbstractReplicatedMap.java:793)
  at 
org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:153)
  at 
org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661)
0-04-14 09:46:13,718 (GroupChannel-Heartbeat-1) 
[AbstractReplicatedMap.java:795:ERROR] Unable to send 
AbstractReplicatedMap.ping message
.apache.catalina.tribes.ChannelException: java.net.SocketTimeoutException: Read 
timed out; Faulty members:tcp://{-64, -88, 1, 3}:4001;
  at 
org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:54)
  at 
org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51)
  at 
org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80)
  at 
org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78)
  at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java

Tomcat 6.0 clustering problem with replication mode.

2010-04-14 Thread Pardeep Ruhil 

Hi,
We are running our application in  load balanced mode in Tomcat 6.0 with 
session replication.
When we are starting the servers in load balanced mode,  then in the console we 
are getting the following  error :

2010-04-14 11:47:51,078 (main) [ VfsLog.java:122:INFO ] Using 
"C:\DOCUME~1\ADMINI~1\LOCALS~1\Temp\vfs_cache" as temporary files store.
2010-04-14 11:48:05,140 (GroupChannel-Heartbeat-1) [   
GroupChannel.java:665:ERROR] Unable to send heartbeat through Tribes 
interceptor stack. Will try to sleep again.
java.util.ConcurrentModificationException
at 
java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372)
at java.util.AbstractList$Itr.next(AbstractList.java:343)
at 
org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:152)
at 
org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661)
class org.webslinger.commons.vfs.flat.FlatFileProvider
2010-04-14 11:48:09,937 (main) [  ChannelSocket.java:387:INFO ] JK: ajp13 
listening on /0.0.0.0:8009
2010-04-14 11:48:09,984 (main) [ JkMain.java:344:INFO ] Jk running 
ID=0 time=16/78  config=null
2010-04-14 11:48:10,125 (main) [ Http11Protocol.java:209:INFO ] Starting 
Coyote HTTP/1.1 on http-0.0.0.0-8080

When  we are testing 100 concurrent users using JMeter, it is giving following 
error after  5-10 mins.

0-04-14 09:46:10,703 (GroupChannel-Heartbeat-1) [  
BioSender.java:287:WARN ] Unable to read acknowledgement from [/192.168.1.3:1,93
a.net.SocketTimeoutException: Read timed out
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.net.SocketInputStream.read(SocketInputStream.java:182)
 at 
org.apache.catalina.tribes.transport.bio.BioSender.waitForAck(BioSender.java:263)
 at 
org.apache.catalina.tribes.transport.bio.BioSender.pushMessage(BioSender.java:245)
 at 
org.apache.catalina.tribes.transport.bio.BioSender.sendMessage(BioSender.java:125)
 at 
org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:52)
 at 
org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51)
 at 
org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80)
 at 
org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78)
 at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
 at 
org.apache.catalina.tribes.group.interceptors.TcpFailureDetector.sendMessage(TcpFailureDetector.java:87)
 at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
 at 
org.apache.catalina.tribes.group.interceptors.MessageDispatchInterceptor.sendMessage(MessageDispatchInterceptor.java:73)
 at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
 at 
org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:216)
 at 
org.apache.catalina.tribes.group.GroupChannel.send(GroupChannel.java:175)
 at org.apache.catalina.tribes.group.RpcChannel.send(RpcChannel.java:89)
 at 
org.apache.catalina.tribes.tipis.AbstractReplicatedMap.ping(AbstractReplicatedMap.java:253)
 at 
org.apache.catalina.tribes.tipis.AbstractReplicatedMap.heartbeat(AbstractReplicatedMap.java:793)
 at 
org.apache.catalina.tribes.group.GroupChannel.heartbeat(GroupChannel.java:153)
 at 
org.apache.catalina.tribes.group.GroupChannel$HeartbeatThread.run(GroupChannel.java:661)
0-04-14 09:46:13,718 (GroupChannel-Heartbeat-1) 
[AbstractReplicatedMap.java:795:ERROR] Unable to send 
AbstractReplicatedMap.ping message
.apache.catalina.tribes.ChannelException: java.net.SocketTimeoutException: Read 
timed out; Faulty members:tcp://{-64, -88, 1, 3}:4001;
 at 
org.apache.catalina.tribes.transport.bio.MultipointBioSender.sendMessage(MultipointBioSender.java:54)
 at 
org.apache.catalina.tribes.transport.bio.PooledMultiSender.sendMessage(PooledMultiSender.java:51)
 at 
org.apache.catalina.tribes.transport.ReplicationTransmitter.sendMessage(ReplicationTransmitter.java:80)
 at 
org.apache.catalina.tribes.group.ChannelCoordinator.sendMessage(ChannelCoordinator.java:78)
 at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
 at 
org.apache.catalina.tribes.group.interceptors.TcpFailureDetector.sendMessage(TcpFailureDetector.java:87)
 at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
 at 
org.apache.catalina.tribes.group.interceptors.MessageDispatchInterceptor.sendMessage(MessageDispatchInterceptor.java:73)
 at 
org.apache.catalina.tribes.group.ChannelInterceptorBase.sendMessage(ChannelInterceptorBase.java:75)
 at