Hi Santosh, Couple of questions -
a) Does crash happen instantaneously – I mean within shorter intervals or degradation is progressive over time ? b) since you emulate the flaps, is it possible to control the frequency of flapping with your emulation ? If (a) holds true or (b) is possible in your emulation, trend of threads created can be captured using tools like VisualVM or even from JConsole to find if there is a progressively increasing thread-creation happening for this scenario Btw, I assume you are using only single ODL controller and not a cluster – right ? Regards Muthu From: openflowplugin-dev-boun...@lists.opendaylight.org [mailto:openflowplugin-dev-boun...@lists.opendaylight.org] On Behalf Of Santosh Singh Sent: Friday, February 17, 2017 1:08 PM To: Anil Vishnoi <vishnoia...@gmail.com> Cc: openflowplugin-dev@lists.opendaylight.org Subject: Re: [openflowplugin-dev] opendaylight [ Lithuim ] crashes due to "java.lang.OutOfMemoryError: unable to create new native thread" Hi Anil , Thanks for your response .. We are running with following memory option , I think which is sufficient for ODL instance having 150 OF connection. -Xms128M -Xmx31393m -XX:MaxPermSize=15696m Any thoughts on this ?? We would be trying to recreate this issue in order to get heap dump .... Thanks Santosh On Fri, Feb 17, 2017 at 12:53 PM, Anil Vishnoi <vishnoia...@gmail.com<mailto:vishnoia...@gmail.com>> wrote: Hi Santosh, Looks like your controller crashed while spawning a new native JVM thread, because your JVM Is out of native heap space. Can you increase your native heap space and see if you still hit the issue (it might take longer to recreate the issue). Meanwhile if you have the heapdump, please upload the heapdump, that will help in analyzing the possible cause. Thanks Anil On Thu, Feb 16, 2017 at 11:05 PM, Santosh Singh <santosh.chan...@gmail.com<mailto:santosh.chan...@gmail.com>> wrote: Hello openflowplugin developers , I have been using lithium release of opendaylight. We are seeing ODL crashes with error mentioned in the subject line , when we test the scenario of frequent connection flap . If this issue has been already addressed as part of the latest release , could anyone point to the corresponding bug. I have pasted the complete stack trace at the below of this mail.. Thanks Santosh 2017-02-12 22:19:15,360 | ERROR | lt-dispatcher-27 | ActorSystemImpl | 156 - com.typesafe.akka.slf4j - 2.3.10 | Uncaught error from thread [opendaylight-cluster-data-akka.actor.default-dispatcher-4] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled java.lang.OutOfMemoryError: unable to create new native thread at java.lang.Thread.start0(Native Method)[:1.7.0_95] at java.lang.Thread.start(Thread.java:714)[:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:949)[:1.7.0_95] at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1360)[:1.7.0_95] at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:628)[:1.7.0_95] at com.google.common.util.concurrent.MoreExecutors$ListeningDecorator.execute(MoreExecutors.java:550)[51:com.google.guava:18.0.0] at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:132)[:1.7.0_95] at com.google.common.util.concurrent.AbstractListeningExecutorService.submit(AbstractListeningExecutorService.java:58)[51:com.google.guava:18.0.0] at org.opendaylight.openflowplugin.impl.services.SalRoleServiceImpl.setRole(SalRoleServiceImpl.java:109) at org.opendaylight.openflowplugin.impl.role.RoleContextImpl.onRoleChanged(RoleContextImpl.java:110) at org.opendaylight.openflowplugin.impl.role.OpenflowOwnershipListener.ownershipChanged(OpenflowOwnershipListener.java:62) at org.opendaylight.controller.cl<http://org.opendaylight.controller.cl>uster.datastore.entityownership.EntityOwnershipListenerActor.onEntityOwnershipChanged(EntityOwnershipListenerActor.java:44)[170:org.opendaylight.controller.sal-distributed-datastore:1.2.4.SNAPSHOT] at org.opendaylight.controller.cl<http://org.opendaylight.controller.cl>uster.datastore.entityownership.EntityOwnershipListenerActor.handleReceive(EntityOwnershipListenerActor.java:36)[170:org.opendaylight.controller.sal-distributed-datastore:1.2.4.SNAPSHOT] at org.opendaylight.controller.cl<http://org.opendaylight.controller.cl>uster.common.actor.AbstractUntypedActor.onReceive(AbstractUntypedActor.java:34)[162:org.opendaylight.controller.sal-clustering-commons:1.2.4.SNAPSHOT] at akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)[155:com.typesafe.akka.actor:2.3.10] at akka.actor.Actor$class.aroundReceive(Actor.scala:467)[155:com.typesafe.akka.actor:2.3.10] _______________________________________________ openflowplugin-dev mailing list openflowplugin-dev@lists.opendaylight.org<mailto:openflowplugin-dev@lists.opendaylight.org> https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev -- Thanks Anil
_______________________________________________ openflowplugin-dev mailing list openflowplugin-dev@lists.opendaylight.org https://lists.opendaylight.org/mailman/listinfo/openflowplugin-dev
