HI, You could try this script to see if the connectivity between dmaap router and APPC is working or no..
curl -X POST -v -H "Content-Type: application/json" -d @./scaleout.json http://<k8s-ip>:30227/events/APPC-LCM-READ<http://%3ck8s-ip%3e:30227/events/APPC-LCM-READ> curl -v http://<k8s-ip>:30227/topics<http://%3ck8s-ip%3e:30227/topics> scaleout.json { "version": "2.00", "rpc-name": "config-scale-out", "correlation-id": "a20e2073-30b1-4357-893b-f5ed57b66ef0-10", "type": "request", "body": { "input": { "common-header": { "timestamp": "2020-02-25T19:27:30.44Z", "api-ver": "2.00", "originator-id": "SDNGP", "request-id": "ScaleOut_RB3_16th May_TC3", "sub-request-id": "ScaleOut_RB3_16th May_TC3", "flags": { "force": "TRUE", "ttl": 60000 } }, "action": "ConfigScaleOut", "action-identifiers": { "vnf-id": "APPC-test-vLB" }, "payload": "{\"request-parameters\":{\"vnf-host-ip-address\":\"10.12.6.195\",\"vf-module-id\": \"zdfw1lb01lb01\",\"controller-template-id\": \"vLB\"},\"configuration-parameters\":{\"ip-addr\":\"192.168.10.212\", \"oam-ip-addr\":\"10.0.150.4\",\"enabled\":\"true\"}}" } } } Also AAF client cert will be expired in next month for El Alto release. I suggest to add this patch: https://gerrit.onap.org/r/c/oom/+/104787 Taka From: Devangam Manjunatha <[email protected]> Sent: Monday, May 11, 2020 6:24 AM To: CHO, TAKAMUNE <[email protected]>; [email protected]; FREEMAN, BRIAN D <[email protected]> Cc: JOMY JOSE <[email protected]> Subject: [onap-discuss] [El-Alto][vCPE]- APPC not reading DMAAP messages "closed loop" event in vCPE use case Hi Taka, I got your contact in ONAP portal for APPC component. We have following issue in APPC component. In ONAP Elalto release we deployed vCPE use case. As part of closed loop testing, when we trigger the closed loop event, Policy triggering "restart" action to APPC via DMAAP, But in APPC's Karaf.log nothing updating / APPC not taking any action on closed loop request. Please find the below "network.log" from Policy component. Policy network.log: [2020-05-11T08:23:17.577+00:00|Session org.onap.policy.drools-applications.controlloop.common:controller-usecases:1.5.3:usecases][OUT|DMAAP|POLICY-CL-MGT] { "AAI": { "generic-vnf.resource-version": "1589043762743", "generic-vnf.prov-status": "ACTIVE", "generic-vnf.orchestration-status": "Active", "generic-vnf.is-closed-loop-disabled": "false", "generic-vnf.service-id": "f9457e8c-4afd-45da-9389-46acd9bf5116", "generic-vnf.in-maint": "false", "generic-vnf.vnf-name": "vcpe_vnf_vcpe_vgmux_202005092007", "generic-vnf.model-version-id": "1e6cc29b-c16d-41cc-8508-decadf278bbd", "generic-vnf.model-customization-id": "2f635775-527e-4d0e-ae0e-2039f769f77d", "generic-vnf.vnf-type": "demoVCPEvGMUX/vCPE_vgmux 5b9af3eb-1808 0", "generic-vnf.model-invariant-id": "cc2959fc-a753-4ce5-87a8-bf6cab04f345", "generic-vnf.vnf-id": "9c04c768-9284-43a2-9e2b-1a22966bc8ad" }, "closedLoopAlarmStart": 1589090598779787, "closedLoopControlName": "ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e", "version": "1.0.2", "requestId": "ba1803dd-3550-4580-94c5-df567273a8e0", "closedLoopEventClient": "DCAE_INSTANCE_ID.dcae-tca", "targetType": "VNF", "target": "generic-vnf.vnf-name", "from": "policy:usecases", "policyScope": "onap.policies.controlloop.Operational:1.0.0", "policyName": "operational.vcpe.EVENT.MANAGER.OPERATION.LOCKED.GUARD_PERMITTED", "policyVersion": "1.0.0", "notification": "OPERATION", "message": "actor=APPC,operation=Restart,target=Target [type=VM, resourceId=null],subRequestId=1", "notificationTime": "2020-05-11 08:23:17.576000+00:00", "history": [] } [2020-05-11T08:23:17.578+00:00|Session org.onap.policy.drools-applications.controlloop.common:controller-usecases:1.5.3:usecases][OUT|DMAAP|APPC-LCM-READ] { "body": { "input": { "common-header": { "timestamp": "2020-05-11T08:23:17.576Z", "api-ver": "2.00", "originator-id": "ba1803dd-3550-4580-94c5-df567273a8e0", "request-id": "ba1803dd-3550-4580-94c5-df567273a8e0", "sub-request-id": "1", "flags": {} }, "action": "Restart", "action-identifiers": { "vnf-id": "9c04c768-9284-43a2-9e2b-1a22966bc8ad" } } }, "version": "2.0", "rpc-name": "restart", "correlation-id": "ba1803dd-3550-4580-94c5-df567273a8e0-1", "type": "request" } [2020-05-11T08:23:18.640+00:00|qtp1569754439-35]10.42.3.9 - [email protected]<mailto:[email protected]> [11/May/2020:08:23:18 +0000] "GET /healthcheck HTTP/1.1" 200 102 [2020-05-11T08:23:19.148+00:00|DMAAP-source-APPC-LCM-WRITE][IN|DMAAP|APPC-LCM-WRITE] {"body":{"output":{"common-header":{"timestamp":"2020-05-11T08:23:17.576Z","originator-id":"ba1803dd-3550-4580-94c5-df567273a8e0","request-id":"ba1803dd-3550-4580-94c5-df567273a8e0","sub-request-id":"1","flags":{},"api-ver":"2.00"},"status":{"message":"ACCEPTED - request accepted","code":100}}},"cambria.partition":"MSO","correlation-id":"ba1803dd-3550-4580-94c5-df567273a8e0-1","rpc-name":"restart","type":"response","version":"2.0"} With the above message, it is clear that Policy triggering "Restart" request to APPC component via DMAAP. Please find the DMAAP log below. DMAAP log: 2020-05-11 08:23:17,502|||qtp89387388-4828437||||INFO||||||| inside servlet filter Cambria Auth Headers checking before doing other Authentication 2020-05-11 08:23:17,503|||qtp89387388-4828437||||INFO||||||| Publishing message to topic POLICY-CL-MGT 2020-05-11 08:23:17,508|||qtp89387388-4828437||||INFO||||||| Published 2 msgs in 3 ms for topic POLICY-CL-MGT from server 10.42.2.21 2020-05-11 08:23:17,508|||qtp89387388-4828437||||INFO||||||| Overall Response time - Published msgs in 5 ms for topic POLICY-CL-MGT 2020-05-11 08:23:17,622|||qtp89387388-4826421||||INFO||||||| inside servlet filter Cambria Auth Headers checking before doing other Authentication 2020-05-11 08:23:17,623|||qtp89387388-4826421||||INFO||||||| Publishing message to topic POLICY-CL-MGT 2020-05-11 08:23:17,624|||qtp89387388-4826421||||INFO||||||| Published 2 msgs in 0 ms for topic POLICY-CL-MGT from server 10.42.2.21 2020-05-11 08:23:17,624|||qtp89387388-4826421||||INFO||||||| Overall Response time - Published msgs in 1 ms for topic POLICY-CL-MGT 2020-05-11 08:23:17,632|||qtp89387388-4828437||||INFO||||||| inside servlet filter Cambria Auth Headers checking before doing other Authentication 2020-05-11 08:23:17,632|||qtp89387388-4828437||||INFO||||||| Publishing message to topic APPC-LCM-READ 2020-05-11 08:23:17,636|||qtp89387388-4828437||||INFO||||||| Published 1 msgs in 2 ms for topic APPC-LCM-READ from server 10.42.2.21 2020-05-11 08:23:17,636|||qtp89387388-4828437||||INFO||||||| Overall Response time - Published msgs in 4 ms for topic APPC-LCM-READ >From the above it is clear that Messages are publishing in "APPC-LCM-READ" >topic. But APPC component not receiving messages. Please find the below APPC >"karaf.log". APPC Karaf.log: 2020-05-11T08:23:03,564 | INFO | Appc-Listener-2 | HttpDmaapConsumerImpl | 444 - appc-common-bundle - 1.6.4 | GET http://message-router.onap:3904/events/APPC-CL/appcDemoEventListener/185?timeout=60000&limit=1000<https://urldefense.proofpoint.com/v2/url?u=http-3A__message-2Drouter.onap-3A3904_events_APPC-2DCL_appcDemoEventListener_185-3Ftimeout-3D60000-26limit-3D1000&d=DwQFAw&c=LFYZ-o9_HUMeMTSQicvjIg&r=2SpRaOlaUglzr4dgoYaSsJQHU3X5g6PDPy8-4kdLndM&m=OTTzNdNWsO5LdTFFY59csFg4mAZ0AZXY_tXed_xCwlU&s=FsArvgvUU7IBhi3HCyELRnN2I9sie0vUmxjJV615sHw&e=> 2020-05-11T08:23:03,574 | ERROR | Appc-Listener-2 | HttpDmaapConsumerImpl | 444 - appc-common-bundle - 1.6.4 | Did not get 200 from DMaaP. Got 404 - {"mrstatus":3001,"helpURL":"http://onap.readthedocs.io","message":"No<https://urldefense.proofpoint.com/v2/url?u=http-3A__onap.readthedocs.io-2522-2C-2522message-2522-3A-2522No&d=DwQFAw&c=LFYZ-o9_HUMeMTSQicvjIg&r=2SpRaOlaUglzr4dgoYaSsJQHU3X5g6PDPy8-4kdLndM&m=OTTzNdNWsO5LdTFFY59csFg4mAZ0AZXY_tXed_xCwlU&s=vMabuCjHwe1_V7ZPQd46CUyBra2Nls-0fLloaB1CsH8&e=> such topic exists.-[APPC-CL]","status":404} 2020-05-11T08:23:03,574 | INFO | Appc-Listener-2 | HttpDmaapConsumerImpl | 444 - appc-common-bundle - 1.6.4 | Sleeping for 60s after failed request 2020-05-11T08:23:11,530 | INFO | sshd-SshServer[46dcd05c]-nio2-thread-2 | ServerUserAuthService | 143 - org.apache.sshd.core - 1.6.0 | Session karaf@/127.0.0.1:48880<mailto:karaf@/127.0.0.1:48880> authenticated 2020-05-11T08:23:13,001 | INFO | sshd-SshServer[46dcd05c]-nio2-thread-2 | ServerUserAuthService | 143 - org.apache.sshd.core - 1.6.0 | Session karaf@/127.0.0.1:48894<mailto:karaf@/127.0.0.1:48894> authenticated 2020-05-11T08:23:35,817 | INFO | Appc-Listener-1 | HttpDmaapConsumerImpl | 444 - appc-common-bundle - 1.6.4 | Got 0 messages from DMaaP 2020-05-11T08:23:35,818 | INFO | Appc-Listener-1 | EventHandlerImpl | 444 - appc-common-bundle - 1.6.4 | Read 0 messages from APPC-LCM-READ as APPC-EVENT-LISTENER-TEST/593. 2020-05-11T08:23:35,818 | INFO | Appc-Listener-1 | EventHandlerImpl | 444 - appc-common-bundle - 1.6.4 | Getting up to 10 incoming events 2020-05-11T08:23:35,818 | INFO | Appc-Listener-1 | HttpDmaapConsumerImpl | 444 - appc-common-bundle - 1.6.4 | GET http://message-router.onap:3904/events/APPC-LCM-READ/APPC-EVENT-LISTENER-TEST/593?timeout=60000&limit=10<https://urldefense.proofpoint.com/v2/url?u=http-3A__message-2Drouter.onap-3A3904_events_APPC-2DLCM-2DREAD_APPC-2DEVENT-2DLISTENER-2DTEST_593-3Ftimeout-3D60000-26limit-3D10&d=DwQFAw&c=LFYZ-o9_HUMeMTSQicvjIg&r=2SpRaOlaUglzr4dgoYaSsJQHU3X5g6PDPy8-4kdLndM&m=OTTzNdNWsO5LdTFFY59csFg4mAZ0AZXY_tXed_xCwlU&s=48MyEWy-conN0fer1MXaT8EXx5z8dEfh86Lr9A52KjQ&e=> 2020-05-11T08:24:03,574 | INFO | Appc-Listener-2 | EventHandlerImpl | 444 - appc-common-bundle - 1.6.4 | Read 0 messages from APPC-CL as appcDemoEventListener/185. 2020-05-11T08:24:03,575 | INFO | Appc-Listener-2 | EventHandlerImpl | 444 - appc-common-bundle - 1.6.4 | Getting up to 1000 incoming events Request to let us know why APPC not receiving Closed loop restart request. Are we missing anything ? Are we on right track ? Please let know how to fix this issue. For more details please find the attached log from VES collector, Policy, Dmaap & APPC components, Also RegionOne details & Event which is triggered. Regards, Manjunath. L&T Technology Services Ltd www.LTTS.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.LTTS.com&d=DwQFAw&c=LFYZ-o9_HUMeMTSQicvjIg&r=2SpRaOlaUglzr4dgoYaSsJQHU3X5g6PDPy8-4kdLndM&m=OTTzNdNWsO5LdTFFY59csFg4mAZ0AZXY_tXed_xCwlU&s=EpWPgmBfVeCBPYofZ3zDOby6OuJQiFtZ5daaYCrLZEY&e=> L&T Technology Services Limited (LTTS) is committed to safeguard your data privacy. For more information to view our commitment towards data privacy under GDPR, please visit the privacy policy on our website www.Ltts.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__www.Ltts.com&d=DwQFAw&c=LFYZ-o9_HUMeMTSQicvjIg&r=2SpRaOlaUglzr4dgoYaSsJQHU3X5g6PDPy8-4kdLndM&m=OTTzNdNWsO5LdTFFY59csFg4mAZ0AZXY_tXed_xCwlU&s=YD7TjJUNcryUHO2pbXsH_X8jh1GWtggJsmPMhg08CUI&e=>. This Email may contain confidential or privileged information for the intended recipient (s). If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system. -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#21013): https://lists.onap.org/g/onap-discuss/message/21013 Mute This Topic: https://lists.onap.org/mt/74132753/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
