It seems that the pods have some lifecycle hooks on them. These are blocking by default. They will need to complete before the call to delete the pod can be sent. Maybe they are not completing or there is some other error there.
In the case of the cassandra pod, it seems like we have a preStop that seems to want to do a graceful shutdown of the process: ["/bin/sh", "-c", "PID=$(pidof java) && kill $PID && while ps -p $PID > /dev/null; do sleep 1; done"] Why not use nodetool drain instead of kill as documented here (https://kubernetes.io/docs/tutorials/stateful-application/cassandra/ ) Thanks, -- K i r a n From: Ranganathan, Dileep Sent: Wednesday, October 10, 2018 9:13 AM To: [email protected]; [email protected]; Michael O'Brien <[email protected]>; Kamineni, Kiran K <[email protected]>; NELSON JR., THOMAS <[email protected]>; PUZHAVAKATH NARAYANAN, SHANKARANARAYANAN <[email protected]> Subject: RE: [onap-discuss] [OOM] StatefulSet not removed while Delete/Purge a project I am having helm version of 2.9.1 and k8s 1.8.x When we purge the project, do we have to do something extra to make sure the common chart resources get purged as well? From: [email protected]<mailto:[email protected]> [mailto:[email protected]] On Behalf Of Mandeep Khinda Sent: Wednesday, October 10, 2018 7:11 AM To: [email protected]<mailto:[email protected]>; Ranganathan, Dileep <[email protected]<mailto:[email protected]>>; Michael O'Brien <[email protected]<mailto:[email protected]>>; Kamineni, Kiran K <[email protected]<mailto:[email protected]>>; NELSON JR., THOMAS <[email protected]<mailto:[email protected]>>; PUZHAVAKATH NARAYANAN, SHANKARANARAYANAN <[email protected]<mailto:[email protected]>> Subject: Re: [onap-discuss] [OOM] StatefulSet not removed while Delete/Purge a project Hi Dileep, What version of helm & kubernetes are you using? In Casablanca we have up-revved the recommended helm 2.9.1 and K8s 1.10.x There are some known issues where dynamic PVC resources are left behind after a purge but not statefulsets. From: <[email protected]<mailto:[email protected]>> on behalf of Dileep Ranganathan <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Wednesday, October 10, 2018 at 12:15 AM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>, Michael O'Brien <[email protected]<mailto:[email protected]>>, "Kamineni, Kiran K" <[email protected]<mailto:[email protected]>>, "NELSON JR., THOMAS" <[email protected]<mailto:[email protected]>>, "PUZHAVAKATH NARAYANAN, SHANKARANARAYANAN" <[email protected]<mailto:[email protected]>> Subject: [onap-discuss] [OOM] StatefulSet not removed while Delete/Purge a project Hi OOM team, For the OOF project, while deleting/purging a project, there are some dangling resources which is affecting redeploy. OOF has added common music charts in requirements.yaml (WIP) and it is starting Cassandra and Zookeeper. The statefulsets and pods related to these two services brought up as part of common charts are not deleted while deleting the project oof. These are the steps I am following to redeploy oof in my local system. helm del dev-oof –purge helm deploy dev local/onap --namespace onap And the error I am getting is. Release "dev-oof" does not exist. Installing it now. Error: release dev-oof failed: statefulsets.apps "dev-oof-cassandra" already exists Thanks, Dileep This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement, you may review at https://www.amdocs.com/about/email-disclaimer -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#12936): https://lists.onap.org/g/onap-discuss/message/12936 Mute This Topic: https://lists.onap.org/mt/27154235/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
