Murali Reddy created CLOUDSTACK-7679:
----------------------------------------
Summary: bump up the RabbitMQ AMQP java client version from 2.8.7
to 3.3.5
Key: CLOUDSTACK-7679
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7679
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Affects Versions: 4.2.0, 4.1.0, 4.3.0, 4.4.0
Reporter: Murali Reddy
Assignee: Murali Reddy
Fix For: 4.5.0
When management server is run with event bus enabled for longer duration like
week or so, it is observed that there is locking issues due to which management
server will become un-responsive. Stack trace is observed as below.
2670351 "catalina-exec-25" daemon prio=10 tid=0x00007f6a04bbf000 nid=0x17dc in
Object.wait() [0x00007f69f30ae000]
2670352 java.lang.Thread.State: WAITING (on object monitor)
2670353 >---at java.lang.Object.wait(Native Method)
2670354 >---- waiting on <0x000000075c1687e8> (a
com.rabbitmq.utility.BlockingValueOrException)
2670355 >---at java.lang.Object.wait(Object.java:502)
2670356 >---at com.rabbitmq.utility.BlockingCell.get(BlockingCell.java:50)
2670357 >---- locked <0x000000075c1687e8> (a
com.rabbitmq.utility.BlockingValueOrException)
2670358 >---at
com.rabbitmq.utility.BlockingCell.uninterruptibleGet(BlockingCell.java:89)
2670359 >---- locked <0x000000075c1687e8> (a
com.rabbitmq.utility.BlockingValueOrException)
2670360 >---at
com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:33)
2670361 >---at
com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:343)
2670362 >---at
com.rabbitmq.client.impl.AMQChannel.privateRpc(AMQChannel.java:216)
2670363 >---at
com.rabbitmq.client.impl.AMQChannel.exnWrappingRpc(AMQChannel.java:118)
2670364 >---at com.rabbitmq.client.impl.ChannelN.open(ChannelN.java:125)
2670365 >---at
com.rabbitmq.client.impl.ChannelManager.createChannel(ChannelManager.java:121)
2670366 >---at
com.rabbitmq.client.impl.AMQConnection.createChannel(AMQConnection.java:466)
2670367 >---at
org.apache.cloudstack.mom.rabbitmq.RabbitMQEventBus.createChannel(RabbitMQEventBus.java:389)
2670368 >---at
org.apache.cloudstack.mom.rabbitmq.RabbitMQEventBus.publish(RabbitMQEventBus.java:242)
2670369 >---at
com.cloud.event.ActionEventUtils.publishOnEventBus(ActionEventUtils.java:224)
2670370 >---at
com.cloud.event.ActionEventUtils.onActionEvent(ActionEventUtils.java:78)
2670371 >---at
com.cloud.user.AccountManagerImpl.authenticateUser(AccountManagerImpl.java:1942)
2670372 >---at sun.reflect.GeneratedMethodAccessor355.invoke(Unknown Source)
2670373 >---at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2670374 >---at java.lang.reflect.Method.invoke(Method.java:616)
2670375 >---at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
2670376 >---at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
2670377 >---at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
2670378 >---at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
2670379 >---at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
2670380 >---at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
2670381 >---at $Proxy83.authenticateUser(Unknown Source)
2670382 >---at com.cloud.api.ApiServer.loginUser(ApiServer.java:893)
In the latest version of rabbitMQ java AMQP client seems to have fixed some of
issues. This bug is to bump up the client version to use latest RabbitMQ AMQP
client.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
