All the "device or resource busy" errors seem related to tmpfs mounts for secret volumes.
On 4 October 2016 at 17:32, Lionel Orellana <lione...@gmail.com> wrote: > Hi All, > > I had a v1.3 cluster with a master and a node going. Both servers were > rebooted over the weekend and all hell broke loose. > > The registry, the router and all apps I had running have stopped working. > > I see quite a few of these errors in the logs: > > Oct 04 17:14:07 poc-docker02.aipo.gov.au origin-node[1773]: I1004 > 17:14:07.510615 1815 kubelet.go:2117] Failed to remove orphaned pod > "c449d37f-8549-11e6-83c1-005056915814" dir; err: remove > /var/lib/origin/openshift.local.volumes/pods/c449d37f- > 8549-11e6-83c1-005056915814/volumes/kubernetes.io~secret/ > builder-token-ftgao:* device or resource busy* > > I don't really know what happened, how I got into this state. The registry > is stuck in "Container Creating". If I start a new deployment of the > router the deployment pod doesn't get past "Pending". > > Seems like I can't delete pods either. They get stuck in "Terminating". > > Not sure how to narrow this down. Any help greatly appreciated. > > Thanks > > Lionel. >
_______________________________________________ users mailing list users@lists.openshift.redhat.com http://lists.openshift.redhat.com/openshiftmm/listinfo/users