Hello Vamshi, that typically indicates that there is another vDNS operation on the same underlying resource going on .. would have to through network.log to see from the periodic stream of ONSETs from DCAE actually wins. -Jorge
From: onap-discuss@lists.onap.org [mailto:onap-discuss@lists.onap.org] On Behalf Of vamshi Sent: Thursday, November 08, 2018 6:49 AM To: onap-discuss@lists.onap.org Subject: [onap-discuss] [Policy] Error while running vDNS use case on OOM Hi, When I trigger the vDNS usecase on the closedloop policy provisioned from the CLAMP, I see the below error from the debug log org.onap.policy.controlloop.ControlLoopException: Already working an Operation, do not call this method Can someone explain when do we see this error, and how to understand this to troubleshoot. I'm attaching network and debug log below for your reference. Appreciate your help. Thank you. network log [2018-11-08T10:03:37.677+00:00|qtp35534346-31814]10.42.199.135 - healthcheck [08/Nov/2018:10:03:37 +0000] "GET //drools:6969/healthcheck?pretty HTTP/1.1" 200 276 [2018-11-08T10:03:50.671+00:00|qtp1665620686-25][IN|UEB|unauthenticated.DCAE_CL_OUTPUT] { "closedLoopControlName": "ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0", "closedLoopAlarmStart": 1484677482204798, "closedLoopEventClient": "DCAE_INSTANCE_ID.dcae-tca", "closedLoopEventStatus": "ONSET", "requestID": "e4f95e0c-a013-4530-8e59-c5c5f9e539b7", "target_type": "VNF", "target": "vserver.vserver-name", "AAI": { "vserver.is-closed-loop-disabled": "false", "vserver.prov-status": "ACTIVE", "vserver.vserver-name": "zdfw1lb01lb01" }, "from": "DCAE", "version": "1.0.2" } [2018-11-08T10:03:50.673+00:00|qtp1665620686-25]0:0:0:0:0:0:0:1 - @1b3rt [08/Nov/2018:10:03:50 +0000] "PUT //localhost:9696/policy/pdp/engine/topics/sources/ueb/unauthenticated.DCAE_CL_OUTPUT/events HTTP/1.1" 200 5869 [2018-11-08T10:03:50.684+00:00|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam][OUT|UEB|POLICY-CL-MGT] { "AAI": { "vserver.prov-status": "ACTIVE", "vserver.is-closed-loop-disabled": "false", "vserver.vserver-name": "zdfw1lb01lb01" }, "closedLoopAlarmStart": 1484677482204798, "closedLoopControlName": "ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0", "version": "1.0.2", "requestId": "e4f95e0c-a013-4530-8e59-c5c5f9e539b7", "closedLoopEventClient": "DCAE_INSTANCE_ID.dcae-tca", "targetType": "VNF", "target": "vserver.vserver-name", "from": "pdp-0001-controller=controlloop:amsterdam", "policyScope": "CLAMPClampTest1_v1_0_vLB_VF0", "policyName": "CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT", "policyVersion": "2", "notification": "ACTIVE", "notificationTime": "2018-11-08 10:03:50.673000+00:00", "history": [] } [2018-11-08T10:03:50.693+00:00|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam][OUT|UEB|POLICY-CL-MGT] { "AAI": { "vserver.prov-status": "ACTIVE", "vserver.is-closed-loop-disabled": "false", "vserver.vserver-name": "zdfw1lb01lb01" }, "closedLoopAlarmStart": 1484677482204798, "closedLoopControlName": "ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0", "version": "1.0.2", "requestId": "e4f95e0c-a013-4530-8e59-c5c5f9e539b7", "closedLoopEventClient": "DCAE_INSTANCE_ID.dcae-tca", "targetType": "VNF", "target": "vserver.vserver-name", "from": "policy:amsterdam", "policyScope": "CLAMPClampTest1_v1_0_vLB_VF0", "policyName": "CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT.MANAGER", "policyVersion": "2", "notification": "FINAL: FAILURE", "message": "Already working an Operation, do not call this method.", "notificationTime": "2018-11-08 10:03:50.691000+00:00", "history": [] } [2018-11-08T10:03:52.708+00:00|qtp35534346-31842]10.42.199.135 - healthcheck [08/Nov/2018:10:03:52 +0000] "GET //drools:6969/healthcheck?pretty HTTP/1.1" 200 276 [2018-11-08T10:04:07.737+00:00|qtp35534346-41849]10.42.199.135 - healthcheck [08/Nov/2018:10:04:07 +0000] "GET //drools:6969/healthcheck?pretty HTTP/1.1" 200 276 debug.log [2018-11-08T10:03:50.673+00:00|INFO|controlloop|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0: CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT [2018-11-08T10:03:50.682+00:00|INFO|MavenDroolsController|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] org.onap.policy.controlloop.VirtualControlLoopNotificationMavenDroolsController [policyContainer=org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:, alive=true, locked=, modelClassLoaderHash=1832808183] class loader matches original drools controller rules classloader sun.misc.Launcher$AppClassLoader@764c12b6<mailto:sun.misc.Launcher$AppClassLoader@764c12b6> [2018-11-08T10:03:50.683+00:00|INFO|MDCTransactionImpl|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] [2018-11-08T10:03:50.683+00:00|INFO|MavenDroolsController|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] MavenDroolsController [policyContainer=org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:, alive=true, locked=, modelClassLoaderHash=1832808183]DELIVER: org.onap.policy.controlloop.VirtualControlLoopNotification@5424619e<mailto:org.onap.policy.controlloop.VirtualControlLoopNotification@5424619e> FROM MavenDroolsController [policyContainer=org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:, alive=true, locked=, modelClassLoaderHash=1832808183] TO InlineUebTopicSink [getTopicCommInfrastructure()=UEB, toString()=InlineBusTopicSink [partitionId=babee87f-13b0-473a-a4dc-06b779c5e6ff, alive=true, publisher=CambriaPublisherWrapper []]] [2018-11-08T10:03:50.685+00:00|INFO|controlloop|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0: CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT.MANAGER: event=org.onap.policy.controlloop.VirtualControlLoopEvent@16e79356<mailto:event=org.onap.policy.controlloop.VirtualControlLoopEvent@16e79356> manager=ControlLoopEventManager [closedLoopControlName=ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0, requestID=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, processor=org.onap.policy.controlloop.processor.ControlLoopProcessor@11e1c798<mailto:processor=org.onap.policy.controlloop.processor.ControlLoopProcessor@11e1c798>, onset=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, numOnsets=1, numAbatements=0, isActivated=true, currentOperation=null, targetLock=null] clTimer=ControlLoopTimer( closedLoopControlName=ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0, requestID=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, delay=345s ) [2018-11-08T10:03:50.690+00:00|INFO|controlloop|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0: CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT.MANAGER: guard lock acquired=VMTargetLock [lockID=f500d846-877e-4caf-99c8-6b9559d63409, targetType=VM, target=zdfw1lb01lb01, requestID=e4f95e0c-a013-4530-8e59-c5c5f9e539b7] [2018-11-08T10:03:50.690+00:00|INFO|controlloop|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0: CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT.MANAGER: starting operation=ControlLoopOperationManager [onset=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, policy=54ba1630-fcb0-445d-b480-6703424c6288, attempts=0, policyResult=null, currentOperation=null, operationHistory=[]] [2018-11-08T10:03:50.691+00:00|INFO|controlloop|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0: CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT.MANAGER: event=org.onap.policy.controlloop.VirtualControlLoopEvent@16e79356<mailto:event=org.onap.policy.controlloop.VirtualControlLoopEvent@16e79356> manager=ControlLoopEventManager [closedLoopControlName=ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0, requestID=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, processor=org.onap.policy.controlloop.processor.ControlLoopProcessor@11e1c798<mailto:processor=org.onap.policy.controlloop.processor.ControlLoopProcessor@11e1c798>, onset=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, numOnsets=1, numAbatements=0, isActivated=true, currentOperation=ControlLoopOperationManager [onset=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, policy=54ba1630-fcb0-445d-b480-6703424c6288, attempts=0, policyResult=null, currentOperation=null, operationHistory=[]], targetLock=VMTargetLock [lockID=f500d846-877e-4caf-99c8-6b9559d63409, targetType=VM, target=zdfw1lb01lb01, requestID=e4f95e0c-a013-4530-8e59-c5c5f9e539b7]] clTimer=ControlLoopTimer( closedLoopControlName=ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0, requestID=e4f95e0c-a013-4530-8e59-c5c5f9e539b7, delay=345s ) [2018-11-08T10:03:50.691+00:00|WARN|controlloop|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] ClosedLoop-dde85c87-d1ff-11e8-a193-02415f72e5ef_0: CLAMPClampTest1_v1_0_vLB_VF0.Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0.EVENT.MANAGER: unexpected org.onap.policy.controlloop.ControlLoopException: Already working an Operation, do not call this method. at org.onap.policy.controlloop.eventmanager.ControlLoopEventManager.processControlLoop(ControlLoopEventManager.java:356) at org.onap.policy.controlloop.Rule_CLAMPClampTest1_v1_0_vLB_VF0$u46$Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0$u46$EVENT$u46$MANAGER1402735486.defaultConsequence(Rule_CLAMPClampTest1_v1_0_vLB_VF0$u46$Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0$u46$EVENT$u46$MANAGER1402735486.java:145) at org.onap.policy.controlloop.Rule_CLAMPClampTest1_v1_0_vLB_VF0$u46$Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0$u46$EVENT$u46$MANAGER1402735486DefaultConsequenceInvokerGenerated.evaluate(Unknown Source) at org.onap.policy.controlloop.Rule_CLAMPClampTest1_v1_0_vLB_VF0$u46$Config_BRMS_Param_ClosedLoop_dde85c87_d1ff_11e8_a193_02415f72e5ef_Policy_12lup3h_0$u46$EVENT$u46$MANAGER1402735486DefaultConsequenceInvoker.evaluate(Unknown Source) at org.drools.core.common.DefaultAgenda.fireActivation(DefaultAgenda.java:1052) at org.drools.core.phreak.RuleExecutor.fire(RuleExecutor.java:121) at org.drools.core.phreak.RuleExecutor.evaluateNetworkAndFire(RuleExecutor.java:74) at org.drools.core.common.DefaultAgenda.fireNextItem(DefaultAgenda.java:970) at org.drools.core.common.DefaultAgenda.fireLoop(DefaultAgenda.java:1312) at org.drools.core.common.DefaultAgenda.fireUntilHalt(DefaultAgenda.java:1232) at org.drools.core.impl.StatefulKnowledgeSessionImpl.fireUntilHalt(StatefulKnowledgeSessionImpl.java:1398) at org.drools.core.impl.StatefulKnowledgeSessionImpl.fireUntilHalt(StatefulKnowledgeSessionImpl.java:1377) at org.onap.policy.drools.core.PolicySession$DefaultThreadModel.run(PolicySession.java:563) at java.lang.Thread.run(Thread.java:748) [2018-11-08T10:03:50.691+00:00|INFO|MavenDroolsController|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] org.onap.policy.controlloop.VirtualControlLoopNotificationMavenDroolsController [policyContainer=org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:, alive=true, locked=, modelClassLoaderHash=1832808183] class loader matches original drools controller rules classloader sun.misc.Launcher$AppClassLoader@764c12b6<mailto:sun.misc.Launcher$AppClassLoader@764c12b6> [2018-11-08T10:03:50.692+00:00|INFO|MDCTransactionImpl|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] [2018-11-08T10:03:50.692+00:00|INFO|MavenDroolsController|Session org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:closedloop-amsterdam] MavenDroolsController [policyContainer=org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:, alive=true, locked=, modelClassLoaderHash=1832808183]DELIVER: org.onap.policy.controlloop.VirtualControlLoopNotification@5ee43cb1<mailto:org.onap.policy.controlloop.VirtualControlLoopNotification@5ee43cb1> FROM MavenDroolsController [policyContainer=org.onap.policy-engine.drools.amsterdam:policy-amsterdam-rules:0.8.0:, alive=true, locked=, modelClassLoaderHash=1832808183] TO InlineUebTopicSink [getTopicCommInfrastructure()=UEB, toString()=InlineBusTopicSink [partitionId=babee87f-13b0-473a-a4dc-06b779c5e6ff, alive=true, publisher=CambriaPublisherWrapper []]] [2018-11-08T10:03:50.694+00:00|INFO|CambriaSimplerBatchPublisher|pool-9-thread-1] sending 2 msgs to /events/POLICY-CL-MGT. Oldest: 10 ms [2018-11-08T10:03:50.694+00:00|INFO|HttpClient|pool-9-thread-1] POST http://message-router:3904/events/POLICY-CL-MGT<https://urldefense.proofpoint.com/v2/url?u=http-3A__message-2Drouter-3A3904_events_POLICY-2DCL-2DMGT&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=KBxNCnvBiULMFrLf7-mWDLRIqfGifj9OdPuEw3oydrY&m=kNFz1gmU8qMVB_yrkO23dH5WuqNTo7OBJU6vBDCM-XY&s=tuwwLzm8xuTogXJXHeoLEgNjQZxLweJljttvCobd160&e=> (anonymous) ... [2018-11-08T10:03:50.900+00:00|INFO|HttpClient|pool-9-thread-1] --> HTTP/1.1 200 OK Thanks & Regards, Vamshi Krishna | Tech Mahindra [cid:image001.jpg@01D25617.55BC0E30]<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.techmahindra.com_&d=DwMFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=KBxNCnvBiULMFrLf7-mWDLRIqfGifj9OdPuEw3oydrY&m=kNFz1gmU8qMVB_yrkO23dH5WuqNTo7OBJU6vBDCM-XY&s=CpQh5DBRxiDqld2r7qqs2hswgKA3rXcGpMkVo4-rEdU&e=> ============================================================================================================================ Disclaimer: This message and the information contained herein is proprietary and confidential and subject to the Tech Mahindra policy statement, you may review the policy at http://www.techmahindra.com/Disclaimer.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.techmahindra.com_Disclaimer.html&d=DwMFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=KBxNCnvBiULMFrLf7-mWDLRIqfGifj9OdPuEw3oydrY&m=kNFz1gmU8qMVB_yrkO23dH5WuqNTo7OBJU6vBDCM-XY&s=GFvBfzIGLXJf-Dhc7s8Pl07n0IoH1wL--b2Ff4kgosw&e=> externally http://tim.techmahindra.com/tim/disclaimer.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__tim.techmahindra.com_tim_disclaimer.html&d=DwMFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=KBxNCnvBiULMFrLf7-mWDLRIqfGifj9OdPuEw3oydrY&m=kNFz1gmU8qMVB_yrkO23dH5WuqNTo7OBJU6vBDCM-XY&s=mcMCysJiDEoRe2l0dRXOcAnFwN_vHmoOAT6rwvf8xRk&e=> internally within TechMahindra. ============================================================================================================================ -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#13620): https://lists.onap.org/g/onap-discuss/message/13620 Mute This Topic: https://lists.onap.org/mt/28035754/21656 Group Owner: onap-discuss+ow...@lists.onap.org Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
