kubelet: Image GC attempts to remove images in use by stopped containers #54440
Closed
Description
What happened:
We are running some workloads and I use kubectl describe on a node and was met with an enormous wall of text from Image GC attempting to remove images that were still in use by stopped containers on the node.
What you expected to happen:
Image GC should either not attempt to do this or we should limit how spammy the message is coming out of it.
How to reproduce it (as minimally and precisely as possible):
Nothing super clear here, but run a lot of pods to completion but do not prune them on your node.
Kubernetes version:
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"7", GitVersion:"v1.7.0+695f48a16f", GitCommit:"d2e5420", GitTreeState:"clean", BuildDate:"2017-08-31T19:30:25Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"7", GitVersion:"v1.7.0+695f48a16f", GitCommit:"d2e5420", GitTreeState:"clean", BuildDate:"2017-08-30T13:35:56Z", GoVersion:"go1.8.3", Compiler:"gc", Platform:"linux/amd64"}
Bad kubectl describe output:
Click to expand output
Name: origin-ci-ig-n-kwtq
Role:
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/instance-type=n1-standard-8
beta.kubernetes.io/os=linux
failure-domain.beta.kubernetes.io/region=us-central1
failure-domain.beta.kubernetes.io/zone=us-central1-a
kubernetes.io/hostname=origin-ci-ig-n-kwtq
role=app
Annotations: cluster-autoscaler.kubernetes.io/scale-down-when-unready-disabled=true
volumes.kubernetes.io/controller-managed-attach-detach=true
Taints: <none>
CreationTimestamp: Wed, 30 Aug 2017 08:11:59 -0700
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
NetworkUnavailable False Mon, 01 Jan 0001 00:00:00 +0000 Wed, 30 Aug 2017 08:12:00 -0700 RouteCreated openshift-sdn cleared kubelet-set NoRouteCreated
OutOfDisk False Mon, 23 Oct 2017 14:03:58 -0700 Fri, 22 Sep 2017 03:19:05 -0700 KubeletHasSufficientDisk kubelet has sufficient disk space available
MemoryPressure False Mon, 23 Oct 2017 14:03:58 -0700 Fri, 22 Sep 2017 03:19:05 -0700 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Mon, 23 Oct 2017 14:03:58 -0700 Sat, 21 Oct 2017 17:39:57 -0700 KubeletHasNoDiskPressure kubelet has no disk pressure
Ready True Mon, 23 Oct 2017 14:03:58 -0700 Fri, 13 Oct 2017 08:08:22 -0700 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 10.128.0.10
ExternalIP: 104.154.246.93
Hostname: origin-ci-ig-n-kwtq
Capacity:
cpu: 8
memory: 30716976Ki
pods: 80
Allocatable:
cpu: 8
memory: 30614576Ki
pods: 80
System Info:
Machine ID: 0fb831b9af0c70629bc60f8366e636c8
System UUID: AF393997-7324-1C9A-B2B0-47B6222D2195
Boot ID: 479852e1-6606-46b4-8ade-632b28ff16db
Kernel Version: 3.10.0-693.1.1.el7.x86_64
OS Image: CentOS Linux 7 (Core)
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://1.12.6
Kubelet Version: v1.7.0+695f48a16f
Kube-Proxy Version: v1.7.0+695f48a16f
ExternalID: 4317559410358185612
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits
--------- ---- ------------ ---------- --------------- -------------
cewong-dev jenkins-jjb-controller-1-5266x 0 (0%) 0 (0%) 0 (0%) 0 (0%)
cewong-dev jenkins-secrets-controller-1-3tb4k 0 (0%) 0 (0%) 0 (0%) 0 (0%)
ci hook-22-0tj1h 0 (0%) 0 (0%) 0 (0%) 0 (0%)
ci jenkins-operator-28-sv31s 0 (0%) 0 (0%) 0 (0%) 0 (0%)
ci jenkins-proxy-26-gzkrf 0 (0%) 0 (0%) 0 (0%) 0 (0%)
ci plank-26-c04pr 0 (0%) 0 (0%) 0 (0%) 0 (0%)
ci submit-queue-origin-aggregated-logging-1-8tjps 100m (1%) 100m (1%) 0 (0%) 0 (0%)
kube-system prometheus-1354940558-449h9 0 (0%) 0 (0%) 0 (0%) 0 (0%)
kube-system prometheus-node-exporter-fl7d1 100m (1%) 200m (2%) 30Mi (0%) 50Mi (0%)
origin-ci compile-1177-pr-16884-1df97a6b95874a35c3735fd9-3fjn5-build 0 (0%) 0 (0%) 0 (0%) 0 (0%)
origin-ci ut-716-pr-17009-b1c4dcaf7b471e40adc0ce6c-zgb4s 2500m (31%) 0 (0%) 7Gi (23%) 10Gi (34%)
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
CPU Requests CPU Limits Memory Requests Memory Limits
------------ ---------- --------------- -------------
2700m (33%) 300m (3%) 7198Mi (24%) 10290Mi (34%)
Events:
FirstSeen LastSeen Count From SubObjectPath Type Reason Message
--------- -------- ----- ---- ------------- -------- ------ -------
1h 1h 1 kubelet, origin-ci-ig-n-kwtq Warning ImageGCFailed wanted to free 8913566924 bytes, but freed 12468095958 bytes space with errors in image deletion: [rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 837c76105ac2 (must be forced) - image is being used by stopped container d21ec541b826"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 427bb848ee38 (must be forced) - image is being used by stopped container 0e4272b10670"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6c33890d9bff (must be forced) - image is being used by stopped container bf5c8c5d2d1d"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 644c4f7c63f5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8271bf5b642 (must be forced) - image is being used by stopped container f7df23fbed28"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete feb93d74246b (must be forced) - image is being used by stopped container 4e521493a689"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 56684f9b1357 (must be forced) - image is being used by stopped container 7c9a2f105e83"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete f9ea88f4d4fd (must be forced) - image is being used by stopped container ddecf5349fbd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6a66a3caff89 (must be forced) - image is being used by stopped container 9cab8358785c"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6f836c704424 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a44dde950357 (cannot be forced) - image is being used by running container 568048097c46"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete dba1dd3055ab (must be forced) - image is being used by stopped container eff78d2a3812"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 8f9bb26186dc (must be forced) - image is being used by stopped container 00bb98b77796"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 1160c6fb7572 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c5b004c911b9 (must be forced) - image is being used by stopped container d1ecef54ef89"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2a63ef9eca80 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 68fa83eb3f0f (must be forced) - image is being used by stopped container 44753bb5dccc"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 27542787e4b6 (must be forced) - image is being used by stopped container bffd7f9e21ad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6dc20eeb36e0 (must be forced) - image is being used by stopped container edd2bef48516"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 7a57ce3b8f23 (must be forced) - image is being used by stopped container 1cd11c43d408"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 51bb0bf6186d (must be forced) - image is being used by stopped container 904289409d64"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3d38b1de1707 (must be forced) - image is being used by stopped container 9eda708605da"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0fe60a52a3a9 (must be forced) - image is being used by stopped container 6e3871c5feaf"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2585b05ba29f (must be forced) - image is being used by stopped container 46b58a340bad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 94c9711133a8 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5321e129c193 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 558ec82df5b2 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 04d3d53a8be5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4e9fb26c1003 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d0d6f23217ae (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 28f3312fec61 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 773e7033f3de (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 96bcb1e7b8ee (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cb95821cb6f7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a6860762f5e4 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 9df86d711cd7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2c3e1b8e0dfa (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d6403886da88 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ac5d93a8e2d6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4f08e303819f (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 129dfee5c05d (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8430b6af7f3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete e1ae996611bd (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2276ec3af1fe (cannot be forced) - image has dependent child images"}]
1h 1h 1 kubelet, origin-ci-ig-n-kwtq Warning ImageGCFailed wanted to free 7504673996 bytes, but freed 10946735920 bytes space with errors in image deletion: [rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6c33890d9bff (must be forced) - image is being used by stopped container bf5c8c5d2d1d"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 644c4f7c63f5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6f836c704424 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete feb93d74246b (must be forced) - image is being used by stopped container 4e521493a689"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete f9ea88f4d4fd (must be forced) - image is being used by stopped container ddecf5349fbd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 56684f9b1357 (must be forced) - image is being used by stopped container 7c9a2f105e83"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8271bf5b642 (must be forced) - image is being used by stopped container f7df23fbed28"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 837c76105ac2 (must be forced) - image is being used by stopped container d21ec541b826"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 427bb848ee38 (must be forced) - image is being used by stopped container 0e4272b10670"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6a66a3caff89 (must be forced) - image is being used by stopped container 9cab8358785c"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a44dde950357 (cannot be forced) - image is being used by running container 94dd002230b3"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete dba1dd3055ab (must be forced) - image is being used by stopped container eff78d2a3812"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 8f9bb26186dc (must be forced) - image is being used by stopped container 00bb98b77796"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 1160c6fb7572 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c5b004c911b9 (must be forced) - image is being used by stopped container d1ecef54ef89"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2a63ef9eca80 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 68fa83eb3f0f (must be forced) - image is being used by stopped container 44753bb5dccc"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6dc20eeb36e0 (must be forced) - image is being used by stopped container edd2bef48516"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 27542787e4b6 (must be forced) - image is being used by stopped container bffd7f9e21ad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 7a57ce3b8f23 (must be forced) - image is being used by stopped container 1cd11c43d408"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 51bb0bf6186d (must be forced) - image is being used by stopped container 904289409d64"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3d38b1de1707 (must be forced) - image is being used by stopped container 9eda708605da"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0fe60a52a3a9 (must be forced) - image is being used by stopped container 6e3871c5feaf"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2585b05ba29f (must be forced) - image is being used by stopped container 46b58a340bad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 94c9711133a8 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5321e129c193 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 558ec82df5b2 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 04d3d53a8be5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4e9fb26c1003 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d0d6f23217ae (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 28f3312fec61 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 773e7033f3de (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 96bcb1e7b8ee (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cb95821cb6f7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a6860762f5e4 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 9df86d711cd7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2c3e1b8e0dfa (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d6403886da88 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ac5d93a8e2d6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4f08e303819f (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 129dfee5c05d (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8430b6af7f3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 002ef681e318 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 267c7071970f (must be forced) - image is being used by stopped container bb4084ccce19"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5d0ffad34296 (cannot be forced) - image has dependent child images"}]
1h 1h 1 kubelet, origin-ci-ig-n-kwtq Warning ImageGCFailed wanted to free 6571965644 bytes, but freed 12472152074 bytes space with errors in image deletion: [rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 56684f9b1357 (must be forced) - image is being used by stopped container 7c9a2f105e83"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete f9ea88f4d4fd (must be forced) - image is being used by stopped container ddecf5349fbd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6a66a3caff89 (must be forced) - image is being used by stopped container 9cab8358785c"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 837c76105ac2 (must be forced) - image is being used by stopped container d21ec541b826"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete feb93d74246b (must be forced) - image is being used by stopped container 4e521493a689"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a44dde950357 (cannot be forced) - image is being used by running container b744ea5959be"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6f836c704424 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6c33890d9bff (must be forced) - image is being used by stopped container bf5c8c5d2d1d"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 427bb848ee38 (must be forced) - image is being used by stopped container 0e4272b10670"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 644c4f7c63f5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8271bf5b642 (must be forced) - image is being used by stopped container f7df23fbed28"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete dba1dd3055ab (must be forced) - image is being used by stopped container eff78d2a3812"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 8f9bb26186dc (must be forced) - image is being used by stopped container 00bb98b77796"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 1160c6fb7572 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c5b004c911b9 (must be forced) - image is being used by stopped container d1ecef54ef89"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2a63ef9eca80 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 68fa83eb3f0f (must be forced) - image is being used by stopped container 44753bb5dccc"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6dc20eeb36e0 (must be forced) - image is being used by stopped container edd2bef48516"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 27542787e4b6 (must be forced) - image is being used by stopped container bffd7f9e21ad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 7a57ce3b8f23 (must be forced) - image is being used by stopped container 1cd11c43d408"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 51bb0bf6186d (must be forced) - image is being used by stopped container 904289409d64"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3d38b1de1707 (must be forced) - image is being used by stopped container 9eda708605da"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0fe60a52a3a9 (must be forced) - image is being used by stopped container 6e3871c5feaf"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2585b05ba29f (must be forced) - image is being used by stopped container 46b58a340bad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 94c9711133a8 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5321e129c193 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 558ec82df5b2 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 04d3d53a8be5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4e9fb26c1003 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d0d6f23217ae (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 28f3312fec61 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 773e7033f3de (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 96bcb1e7b8ee (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cb95821cb6f7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a6860762f5e4 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 9df86d711cd7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2c3e1b8e0dfa (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d6403886da88 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ac5d93a8e2d6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4f08e303819f (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 129dfee5c05d (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8430b6af7f3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 002ef681e318 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 267c7071970f (must be forced) - image is being used by stopped container bb4084ccce19"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5d0ffad34296 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 87f571a52fc3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3ea4ab40dc98 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c29ff1f4545b (cannot be forced) - image has dependent child images"}]
1h 1h 1 kubelet, origin-ci-ig-n-kwtq Warning ImageGCFailed wanted to free 9915538636 bytes, but freed 10946951345 bytes space with errors in image deletion: [rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8271bf5b642 (must be forced) - image is being used by stopped container f7df23fbed28"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6a66a3caff89 (must be forced) - image is being used by stopped container 9cab8358785c"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 427bb848ee38 (must be forced) - image is being used by stopped container 0e4272b10670"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 644c4f7c63f5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete feb93d74246b (must be forced) - image is being used by stopped container 4e521493a689"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6c33890d9bff (must be forced) - image is being used by stopped container bf5c8c5d2d1d"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a44dde950357 (cannot be forced) - image is being used by running container 94dd002230b3"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 837c76105ac2 (must be forced) - image is being used by stopped container d21ec541b826"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete f9ea88f4d4fd (must be forced) - image is being used by stopped container ddecf5349fbd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6f836c704424 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 56684f9b1357 (must be forced) - image is being used by stopped container 7c9a2f105e83"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete dba1dd3055ab (must be forced) - image is being used by stopped container eff78d2a3812"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 8f9bb26186dc (must be forced) - image is being used by stopped container 00bb98b77796"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 1160c6fb7572 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c5b004c911b9 (must be forced) - image is being used by stopped container d1ecef54ef89"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2a63ef9eca80 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 68fa83eb3f0f (must be forced) - image is being used by stopped container 44753bb5dccc"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 27542787e4b6 (must be forced) - image is being used by stopped container bffd7f9e21ad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6dc20eeb36e0 (must be forced) - image is being used by stopped container edd2bef48516"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 7a57ce3b8f23 (must be forced) - image is being used by stopped container 1cd11c43d408"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 51bb0bf6186d (must be forced) - image is being used by stopped container 904289409d64"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3d38b1de1707 (must be forced) - image is being used by stopped container 9eda708605da"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0fe60a52a3a9 (must be forced) - image is being used by stopped container 6e3871c5feaf"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2585b05ba29f (must be forced) - image is being used by stopped container 46b58a340bad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 94c9711133a8 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5321e129c193 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 558ec82df5b2 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 04d3d53a8be5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4e9fb26c1003 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d0d6f23217ae (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 28f3312fec61 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 773e7033f3de (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 96bcb1e7b8ee (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cb95821cb6f7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a6860762f5e4 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 9df86d711cd7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2c3e1b8e0dfa (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d6403886da88 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ac5d93a8e2d6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4f08e303819f (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 129dfee5c05d (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8430b6af7f3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 002ef681e318 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 267c7071970f (must be forced) - image is being used by stopped container bb4084ccce19"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5d0ffad34296 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3ea4ab40dc98 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 16e0437412cb (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d4bdffc72eea (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cecc9575a4ea (cannot be forced) - image has dependent child images"}]
57m 57m 1 kubelet, origin-ci-ig-n-kwtq Warning ImageGCFailed wanted to free 8399576268 bytes, but freed 10946553940 bytes space with errors in image deletion: [rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 837c76105ac2 (must be forced) - image is being used by stopped container d21ec541b826"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8271bf5b642 (must be forced) - image is being used by stopped container f7df23fbed28"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6c33890d9bff (must be forced) - image is being used by stopped container bf5c8c5d2d1d"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 56684f9b1357 (must be forced) - image is being used by stopped container 7c9a2f105e83"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete feb93d74246b (must be forced) - image is being used by stopped container 4e521493a689"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete f9ea88f4d4fd (must be forced) - image is being used by stopped container ddecf5349fbd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a44dde950357 (cannot be forced) - image is being used by running container c1e788a59bfd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6a66a3caff89 (must be forced) - image is being used by stopped container 9cab8358785c"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 644c4f7c63f5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 427bb848ee38 (must be forced) - image is being used by stopped container 0e4272b10670"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6f836c704424 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete dba1dd3055ab (must be forced) - image is being used by stopped container eff78d2a3812"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 8f9bb26186dc (must be forced) - image is being used by stopped container 00bb98b77796"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 1160c6fb7572 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c5b004c911b9 (must be forced) - image is being used by stopped container d1ecef54ef89"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2a63ef9eca80 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 68fa83eb3f0f (must be forced) - image is being used by stopped container 44753bb5dccc"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6dc20eeb36e0 (must be forced) - image is being used by stopped container edd2bef48516"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 27542787e4b6 (must be forced) - image is being used by stopped container bffd7f9e21ad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 7a57ce3b8f23 (must be forced) - image is being used by stopped container 1cd11c43d408"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 51bb0bf6186d (must be forced) - image is being used by stopped container 904289409d64"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3d38b1de1707 (must be forced) - image is being used by stopped container 9eda708605da"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0fe60a52a3a9 (must be forced) - image is being used by stopped container 6e3871c5feaf"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2585b05ba29f (must be forced) - image is being used by stopped container 46b58a340bad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 94c9711133a8 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5321e129c193 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 558ec82df5b2 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 04d3d53a8be5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4e9fb26c1003 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d0d6f23217ae (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 28f3312fec61 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 773e7033f3de (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 96bcb1e7b8ee (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cb95821cb6f7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a6860762f5e4 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 9df86d711cd7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2c3e1b8e0dfa (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d6403886da88 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ac5d93a8e2d6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4f08e303819f (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 129dfee5c05d (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8430b6af7f3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 002ef681e318 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 267c7071970f (must be forced) - image is being used by stopped container bb4084ccce19"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5d0ffad34296 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3ea4ab40dc98 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 16e0437412cb (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d4bdffc72eea (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0e89507b3bf6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4a56f0f29cbf (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 33c2262feaac (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 736cc90f4270 (cannot be forced) - image has dependent child images"}]
52m 52m 1 kubelet, origin-ci-ig-n-kwtq Warning ImageGCFailed wanted to free 6704118988 bytes, but freed 10951445040 bytes space with errors in image deletion: [rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete feb93d74246b (must be forced) - image is being used by stopped container 4e521493a689"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6a66a3caff89 (must be forced) - image is being used by stopped container 9cab8358785c"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8271bf5b642 (must be forced) - image is being used by stopped container f7df23fbed28"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6f836c704424 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete f9ea88f4d4fd (must be forced) - image is being used by stopped container ddecf5349fbd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 837c76105ac2 (must be forced) - image is being used by stopped container d21ec541b826"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6c33890d9bff (must be forced) - image is being used by stopped container bf5c8c5d2d1d"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a44dde950357 (cannot be forced) - image is being used by running container b744ea5959be"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 427bb848ee38 (must be forced) - image is being used by stopped container 0e4272b10670"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 56684f9b1357 (must be forced) - image is being used by stopped container 7c9a2f105e83"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 644c4f7c63f5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete dba1dd3055ab (must be forced) - image is being used by stopped container eff78d2a3812"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 8f9bb26186dc (must be forced) - image is being used by stopped container 00bb98b77796"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 1160c6fb7572 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c5b004c911b9 (must be forced) - image is being used by stopped container d1ecef54ef89"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2a63ef9eca80 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 68fa83eb3f0f (must be forced) - image is being used by stopped container 44753bb5dccc"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6dc20eeb36e0 (must be forced) - image is being used by stopped container edd2bef48516"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 27542787e4b6 (must be forced) - image is being used by stopped container bffd7f9e21ad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 7a57ce3b8f23 (must be forced) - image is being used by stopped container 1cd11c43d408"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 51bb0bf6186d (must be forced) - image is being used by stopped container 904289409d64"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3d38b1de1707 (must be forced) - image is being used by stopped container 9eda708605da"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0fe60a52a3a9 (must be forced) - image is being used by stopped container 6e3871c5feaf"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2585b05ba29f (must be forced) - image is being used by stopped container 46b58a340bad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 94c9711133a8 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5321e129c193 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 558ec82df5b2 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 04d3d53a8be5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4e9fb26c1003 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d0d6f23217ae (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 28f3312fec61 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 773e7033f3de (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 96bcb1e7b8ee (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cb95821cb6f7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a6860762f5e4 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 9df86d711cd7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2c3e1b8e0dfa (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d6403886da88 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ac5d93a8e2d6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4f08e303819f (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 129dfee5c05d (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8430b6af7f3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 002ef681e318 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 267c7071970f (must be forced) - image is being used by stopped container bb4084ccce19"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5d0ffad34296 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3ea4ab40dc98 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 16e0437412cb (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d4bdffc72eea (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0e89507b3bf6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4a56f0f29cbf (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 736cc90f4270 (cannot be forced) - image has dependent child images"}]
27m 27m 1 kubelet, origin-ci-ig-n-kwtq Warning ImageGCFailed wanted to free 6650391756 bytes, but freed 12644234039 bytes space with errors in image deletion: [rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8271bf5b642 (must be forced) - image is being used by stopped container f7df23fbed28"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a44dde950357 (cannot be forced) - image is being used by running container b744ea5959be"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 644c4f7c63f5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6a66a3caff89 (must be forced) - image is being used by stopped container 9cab8358785c"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 837c76105ac2 (must be forced) - image is being used by stopped container d21ec541b826"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 427bb848ee38 (must be forced) - image is being used by stopped container 0e4272b10670"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 56684f9b1357 (must be forced) - image is being used by stopped container 7c9a2f105e83"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete f9ea88f4d4fd (must be forced) - image is being used by stopped container ddecf5349fbd"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6f836c704424 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6c33890d9bff (must be forced) - image is being used by stopped container bf5c8c5d2d1d"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete feb93d74246b (must be forced) - image is being used by stopped container 4e521493a689"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete dba1dd3055ab (must be forced) - image is being used by stopped container eff78d2a3812"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 8f9bb26186dc (must be forced) - image is being used by stopped container 00bb98b77796"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 1160c6fb7572 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c5b004c911b9 (must be forced) - image is being used by stopped container d1ecef54ef89"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2a63ef9eca80 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 68fa83eb3f0f (must be forced) - image is being used by stopped container 44753bb5dccc"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 6dc20eeb36e0 (must be forced) - image is being used by stopped container edd2bef48516"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 27542787e4b6 (must be forced) - image is being used by stopped container bffd7f9e21ad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 7a57ce3b8f23 (must be forced) - image is being used by stopped container 1cd11c43d408"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 51bb0bf6186d (must be forced) - image is being used by stopped container 904289409d64"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3d38b1de1707 (must be forced) - image is being used by stopped container 9eda708605da"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0fe60a52a3a9 (must be forced) - image is being used by stopped container 6e3871c5feaf"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2585b05ba29f (must be forced) - image is being used by stopped container 46b58a340bad"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 94c9711133a8 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5321e129c193 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 558ec82df5b2 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 04d3d53a8be5 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4e9fb26c1003 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d0d6f23217ae (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 28f3312fec61 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 773e7033f3de (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 96bcb1e7b8ee (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete cb95821cb6f7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete a6860762f5e4 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 9df86d711cd7 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2c3e1b8e0dfa (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d6403886da88 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ac5d93a8e2d6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4f08e303819f (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 129dfee5c05d (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c8430b6af7f3 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 002ef681e318 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 267c7071970f (must be forced) - image is being used by stopped container bb4084ccce19"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 5d0ffad34296 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 3ea4ab40dc98 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 16e0437412cb (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete d4bdffc72eea (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 0e89507b3bf6 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 4a56f0f29cbf (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 736cc90f4270 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 77f3fcb2c264 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete e891bf7128bb (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete da732bb45852 (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete c664f2b2bfda (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete 2b6b691f331c (cannot be forced) - image has dependent child images"}, rpc error: code = 2 desc = Error response from daemon: {"message":"conflict: unable to delete ae5d06bf5d6f (cannot be forced) - image has dependent child images"}]
/sig node
/kind bug
/cc @smarterclayton @derekwaynecarr