Hi Dan, Thanks for the help, I fixed that by deleting all SDNC pods, I can't tell which pod is in bad shape , neither I can reproduce the issue. I will update you if I encounter the same issue in future. Thanks
Bin 在 2019年6月5日，20:36，TIMONEY, DAN <[email protected]<mailto:[email protected]>> 写道： Yang, I can’t really tell what happened there – it looks like the local log was truncated. But healthchecks are passing on that node : ubuntu@mc-test-rancher:~$ curl -k -uadmin:Kp8bJ4SXszM0WXlhak3eHlcse2gAw84vaoGGmJvUy2U http://10.12.6.25:30202/restconf/operations/SLI-API:healthcheck -H "Content-Type: application/json" -X POST {"output":{"response-code":"200","ack-final-indicator":"Y","response-message":"SDN-C is healthy"}} I looked for that error message in our generic-resource-api DGs and didn’t see it, and there’s nothing in the log now that helps. From the error message, though, it sounds like an attempt was made to unassign something as part of a rollback that SDNC didn’t have. If you can duplicate this, I’ll take a look at the logs to try to confirm that. Dan Dan Timoney Principal Technical Staff Member AT&T Email : [email protected]<mailto:[email protected]> Office : +1 (732) 420-3226 Mobile : +1 (201) 960-1211 200 S Laurel Ave, Rm E2-2A03 Middletown, NJ 08873 From: onap-discuss <[email protected]<mailto:[email protected]>> on behalf of Yang Bin <[email protected]<mailto:[email protected]>> Reply-To: onap-discuss <[email protected]<mailto:[email protected]>>, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Tuesday, June 4, 2019 at 9:28 PM To: onap-discuss <[email protected]<mailto:[email protected]>> Cc: "'[email protected]<mailto:[email protected]>' ([email protected]<mailto:[email protected]>)" <[email protected]<mailto:[email protected]>>, "FREEMAN, BRIAN D" <[email protected]<mailto:[email protected]>> Subject: [onap-discuss] Need help on resolving SDN-C healthcheck failure Dear SDNC team, I am experiencing a failure while trying to instantiate a service instance with vLB model with GR-API, I got an error report as below: "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:40", "requestState": "FAILED", "requestStatus": "STATUS: Error from SDNC: SQL query failed FLOW STATUS: UnassignServiceInstanceBB has failed. ROLLBACK STATUS: Error from SDNC: SQL query failed", "percent-progress": "100" "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:39", "requestState": "IN_PROGRESS", "requestStatus": "STATUS: Error from SDNC: SQL query failed", "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:38", "requestState": "IN_PROGRESS", "requestStatus": "STATUS: Error from SDNC: SQL query failed", "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:37", "requestState": "IN_PROGRESS", "requestStatus": "STATUS: Error from SDNC: SQL query failed", "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:36", "requestState": "IN_PROGRESS", "requestStatus": "STATUS: Error from SDNC: SQL query failed", "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:35", "requestState": "IN_PROGRESS", "requestStatus": "STATUS: Error from SDNC: SQL query failed", "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:34", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:33", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:32", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:30", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:29", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:28", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:27", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "requestType": "createInstance", "timestamp": "Wed, 05 Jun 2019 09:02:25", "requestState": "IN_PROGRESS", "requestStatus": undefined, "percent-progress": undefined 06/05/19 09:02:24 HTTP Status: Accepted (202) { "requestReferences": { "requestId": "a5f76c09-f7ed-4473-a73d-cf6e44e15224", "instanceId": "39884081-9605-4c82-a245-7be245b8ffb1", "requestSelfLink": "http://so.onap:8080/orchestrationRequests/v7/a5f76c09-f7ed-4473-a73d-cf6e44e15224";<https://urldefense.proofpoint.com/v2/url?u=http-3A__so.onap-3A8080_orchestrationRequests_v7_a5f76c09-2Df7ed-2D4473-2Da73d-2Dcf6e44e15224-2522&d=DwQFAg&c=LFYZ-o9_HUMeMTSQicvjIg&r=qLcfee4a2vOwYSub0bljcQ&m=KcB9OAlhJIGWMA3mYt0dXig7uaQv0T2fjfc4PWA_DRY&s=O0FTtkOUgRF8BTuwnD9sTv8MVxe-VvxqJRJGaxxCEb0&e=> } } So I don’t understand what this means , so I just check the health of SDNC services, then I got following failure: Basic SDNC Health Check | FAIL | Resolving variable '${resp.json()['output']['response-code']}' failed: JSONDecodeError: Expecting value: line 1 column 1 (char 0) root@mc-test-rancher:~/oom/kubernetes/robot# kubectl -n onap get pods |grep -i sdnc dev-pomba-pomba-sdncctxbuilder-7cbddff658-6mgxd 2/2 Running 0 42h dev-sdnc-cds-blueprints-processor-647d7977bf-bjthb 1/1 Running 0 42h dev-sdnc-cds-command-executor-984b8cd6b-prdsp 1/1 Running 0 42h dev-sdnc-cds-controller-blueprints-85958b647b-djjsm 1/1 Running 0 42h dev-sdnc-cds-db-0 1/1 Running 0 42h dev-sdnc-cds-sdc-listener-5dffd89669-gpv6z 1/1 Running 0 42h dev-sdnc-cds-ui-7bcb484679-j8qtd 1/1 Running 0 42h dev-sdnc-nengdb-0 1/1 Running 0 42h dev-sdnc-network-name-gen-5b577dd544-rmhmw 1/1 Running 0 42h dev-sdnc-sdnc-0 2/2 Running 0 42h dev-sdnc-sdnc-ansible-server-76744bb4d-zm4ht 1/1 Running 0 42h dev-sdnc-sdnc-dgbuilder-57c74666c8-sxzfg 1/1 Running 0 42h dev-sdnc-sdnc-dmaap-listener-75f47947b6-f5npm 1/1 Running 0 42h dev-sdnc-sdnc-ueb-listener-7fcc65796d-hhp89 1/1 Running 4 42h dev-so-so-sdnc-adapter-679d6c94cb-xj8tb 1/1 Running 0 42h Could anyone from SDN-C team could shed some lights on this issue? Thanks BTW, if you would like to check on the rancher, the ip is: rancher IP: [email protected]<mailto:[email protected]> k8s node IP: 10.12.6.25 Thanks Best Regards, Bin Yang, Solution Engineering Team, Wind River ONAP Multi-VIM/Cloud PTL Direct +86,10,84777126 Mobile +86,13811391682 Fax +86,10,64398189 Skype: yangbincs993 -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17439): https://lists.onap.org/g/onap-discuss/message/17439 Mute This Topic: https://lists.onap.org/mt/31932994/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
