Skip to content
This repository has been archived by the owner on Jun 20, 2024. It is now read-only.

bandwidth limit plugin failed with error "no interfaces provided". #3787

Jump to bottom
Jump to bottom
Open
Open
bandwidth limit plugin failed with error "no interfaces provided".#3787
Labels
state/need-more-info
@jepsenwan

Description

@jepsenwan
jepsenwan
opened on Mar 15, 2020

I am trying to use bandwidth plugin with a Pod in my K8S Cluster running Weave as CNI.
But I encountered below errors:

Mar 15 12:36:49 k8s-worker01 kubelet: E0315 12:36:49.387807 1635 remote_runtime.go:105] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to set up sandbox container "10f312b7a935e7cadd5f28805466f12912a4a15c3e28bbdabde029583395fd7d" network for pod "httpd-bandwidth": networkPlugin cni failed to set up pod "httpd-bandwidth_default" network: no interfaces provided Mar 15 12:36:49 k8s-worker01 kubelet: E0315 12:36:49.387907 1635 kuberuntime_sandbox.go:68] CreatePodSandbox for pod "httpd-bandwidth_default(c1a002e2-ba4a-458f-84d5-cc9e02e60ef7)" failed: rpc error: code = Unknown desc = failed to set up sandbox container "10f312b7a935e7cadd5f28805466f12912a4a15c3e28bbdabde029583395fd7d" network for pod "httpd-bandwidth": networkPlugin cni failed to set up pod "httpd-bandwidth_default" network: no interfaces provided Mar 15 12:36:49 k8s-worker01 kubelet: E0315 12:36:49.387941 1635 kuberuntime_manager.go:729] createPodSandbox for pod "httpd-bandwidth_default(c1a002e2-ba4a-458f-84d5-cc9e02e60ef7)" failed: rpc error: code = Unknown desc = failed to set up sandbox container "10f312b7a935e7cadd5f28805466f12912a4a15c3e28bbdabde029583395fd7d" network for pod "httpd-bandwidth": networkPlugin cni failed to set up pod "httpd-bandwidth_default" network: no interfaces provided Mar 15 12:36:49 k8s-worker01 kubelet: E0315 12:36:49.388036 1635 pod_workers.go:191] Error syncing pod c1a002e2-ba4a-458f-84d5-cc9e02e60ef7 ("httpd-bandwidth_default(c1a002e2-ba4a-458f-84d5-cc9e02e60ef7)"), skipping: failed to "CreatePodSandbox" for "httpd-bandwidth_default(c1a002e2-ba4a-458f-84d5-cc9e02e60ef7)" with CreatePodSandboxError: "CreatePodSandbox for pod \"httpd-bandwidth_default(c1a002e2-ba4a-458f-84d5-cc9e02e60ef7)\" failed: rpc error: code = Unknown desc = failed to set up sandbox container \"10f312b7a935e7cadd5f28805466f12912a4a15c3e28bbdabde029583395fd7d\" network for pod \"httpd-bandwidth\": networkPlugin cni failed to set up pod \"httpd-bandwidth_default\" network: no interfaces provided" Mar 15 12:36:49 k8s-worker01 kubelet: W0315 12:36:49.389676 1635 docker_sandbox.go:394] failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod "httpd-bandwidth_default": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container "10f312b7a935e7cadd5f28805466f12912a4a15c3e28bbdabde029583395fd7d" Mar 15 12:36:50 k8s-worker01 kubelet: W0315 12:36:50.452014 1635 docker_sandbox.go:394] failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod "httpd-bandwidth_default": CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container "10f312b7a935e7cadd5f28805466f12912a4a15c3e28bbdabde029583395fd7d" Mar 15 12:37:15 k8s-worker01 kubelet: E0315 12:37:15.117651 1635 fsHandler.go:118] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/docker/overlay2/a3aa2f79430ab731404598f32c258551b1ed0af9e576319ad5acd77ad461d569/diff" to get inode usage: stat /var/lib/docker/overlay2/a3aa2f79430ab731404598f32c258551b1ed0af9e576319ad5acd77ad461d569/diff: no such file or directory, extraDiskErr: could not stat "/var/lib/docker/containers/79e4288cf9eadac00b82a655aa73167a496d3ed8de53cf1a3e008218e870489e" to get inode usage: stat /var/lib/docker/containers/79e4288cf9eadac00b82a655aa73167a496d3ed8de53cf1a3e008218e870489e: no such file or directory Mar 15 12:37:21 k8s-worker01 kubelet: W0315 12:37:21.893804 1635 cni.go:331] CNI failed to retrieve network namespace path: cannot find network namespace for the terminated container "10f312b7a935e7cadd5f28805466f12912a4a15c3e28bbdabde029583395fd7d"

How to reproduce it?

The YAML file is

apiVersion: v1
kind: Pod
metadata:
  name: httpd-bandwidth
  annotations:
    kubernetes.io/ingress-bandwidth: 1M
    kubernetes.io/egress-bandwidth: 1M
  labels:
    env: test
spec:
  containers:
  - name: http
    image: httpd
    imagePullPolicy: IfNotPresent
    
  nodeSelector:
    kubernetes.io/hostname: k8s-worker01 
EOF


cat /etc/cni/net.d/10-weave.conflist

{
"cniVersion": "0.3.0",
"name": "weave",
"plugins": [
{
"name": "weave",
"type": "weave-net",
"hairpinMode": true
},
{
"type": "portmap",
"capabilities": {"portMappings": true},
"snat": true
},
{
"type": "bandwidth",
"capabilities": {"bandwidth": true}
}
]
}

ls -l /opt/cni/bin/

-rwxr-xr-x 1 root root  4159240 Mar 10 17:07 bandwidth
-rwxr-xr-x 1 root root  2973336 Mar 26  2019 bridge
-rwxr-xr-x 1 root root  7598064 Mar 26  2019 dhcp
-rwxr-xr-x 1 root root  2110208 Mar 26  2019 flannel
-rwxr-xr-x 1 root root  2288536 Mar 26  2019 host-device
-rwxr-xr-x 1 root root  2238208 Mar 26  2019 host-local
-rwxr-xr-x 1 root root  2621472 Mar 26  2019 ipvlan
-rwxr-xr-x 1 root root  2257808 Mar 26  2019 loopback
-rwxr-xr-x 1 root root  2650160 Mar 26  2019 macvlan
-rwxr-xr-x 1 root root  2613864 Mar 26  2019 portmap
-rwxr-xr-x 1 root root  2946664 Mar 26  2019 ptp
-rwxr-xr-x 1 root root  1951880 Mar 26  2019 sample
-rwxr-xr-x 1 root root  2103456 Mar 26  2019 tuning
-rwxr-xr-x 1 root root  2617328 Mar 26  2019 vlan
lrwxrwxrwx 1 root root       18 Jan  1 12:01 weave-ipam -> weave-plugin-2.6.0
lrwxrwxrwx 1 root root       18 Jan  1 12:01 weave-net -> weave-plugin-2.6.0
-rwxr-xr-x 1 root root 11592224 Jun 25  2018 weave-plugin-2.3.0
-rwxr-xr-x 1 root root 29060656 Dec 11  2018 weave-plugin-2.5.0
-rwxr-xr-x 1 root root 27544296 Jan  1 12:01 weave-plugin-2.6.0


## Versions:
<!-- Please paste in the output of these commands; 'kubectl' only if using Kubernetes -->

$ weave version

weave script 2.6.0
weave 2.6.0

$ docker version

Client:
 Version:      18.03.1-ce
 API version:  1.37
 Go version:   go1.9.5
 Git commit:   9ee9f40
 Built:        Thu Apr 26 07:20:16 2018
 OS/Arch:      linux/amd64
 Experimental: false
 Orchestrator: swarm

Server:
 Engine:
  Version:      18.03.1-ce
  API version:  1.37 (minimum version 1.12)
  Go version:   go1.9.5
  Git commit:   9ee9f40
  Built:        Thu Apr 26 07:23:58 2018
  OS/Arch:      linux/amd64
  Experimental: false

$ uname -a

Linux k8s-master01 3.10.0-693.11.1.el7.x86_64 #1 SMP Mon Dec 4 23:52:40 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
$ kubectl version

Client Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.0", GitCommit:"70132b0f130acc0bed193d9ba59dd186f0e634cf", GitTreeState:"clean", BuildDate:"2019-12-07T21:20:10Z", GoVersion:"go1.13.4", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.0", GitCommit:"70132b0f130acc0bed193d9ba59dd186f0e634cf", GitTreeState:"clean", BuildDate:"2019-12-07T21:12:17Z", GoVersion:"go1.13.4", Compiler:"gc", Platform:"linux/amd64"}


## Logs:

DEBU: 2020/03/15 03:05:00.249580 EVENT UpdatePod {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66243798","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"phase":"Pending","qosClass":"BestEffort"}} {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66243799","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"phase":"Pending","qosClass":"BestEffort"}}
DEBU: 2020/03/15 03:05:00.304382 EVENT UpdatePod {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66243799","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"phase":"Pending","qosClass":"BestEffort"}} {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66243801","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Pending","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}}
DEBU: 2020/03/15 03:26:32.845121 EVENT UpdatePod {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66243801","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Pending","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}} {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":30,"deletionTimestamp":"2020-03-15T03:27:02Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249032","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Pending","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}}
DEBU: 2020/03/15 03:26:32.871502 EVENT UpdatePod {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":30,"deletionTimestamp":"2020-03-15T03:27:02Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249032","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Pending","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}} {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":30,"deletionTimestamp":"2020-03-15T03:27:02Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249033","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Pending","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}}
DEBU: 2020/03/15 03:26:33.452126 EVENT UpdatePod {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":30,"deletionTimestamp":"2020-03-15T03:27:02Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249033","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Pending","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}} {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":30,"deletionTimestamp":"2020-03-15T03:27:02Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249036","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Running","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}}
DEBU: 2020/03/15 03:26:33.461198 EVENT UpdatePod {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":30,"deletionTimestamp":"2020-03-15T03:27:02Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249036","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Running","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}} {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":0,"deletionTimestamp":"2020-03-15T03:26:32Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249037","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Running","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}}
DEBU: 2020/03/15 03:26:33.466768 EVENT DeletePod {"metadata":{"annotations":{"kubectl.kubernetes.io/last-applied-configuration":"{"apiVersion":"v1","kind":"Pod","metadata":{"annotations":{"kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http"}],"nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"}}}\n","kubernetes.io/egress-bandwidth":"1M","kubernetes.io/ingress-bandwidth":"1M"},"creationTimestamp":"2020-03-15T03:05:00Z","deletionGracePeriodSeconds":0,"deletionTimestamp":"2020-03-15T03:26:32Z","labels":{"env":"test"},"name":"httpd-bandwidth","namespace":"default","resourceVersion":"66249038","selfLink":"/api/v1/namespaces/default/pods/httpd-bandwidth","uid":"3d1971f8-8945-4dd2-b4fd-bf201931f008"},"spec":{"containers":[{"image":"httpd","imagePullPolicy":"IfNotPresent","name":"http","terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File"}],"dnsPolicy":"ClusterFirst","nodeName":"k8s-worker01","nodeSelector":{"kubernetes.io/hostname":"k8s-worker01"},"priority":0,"restartPolicy":"Always","schedulerName":"default-scheduler","securityContext":{},"serviceAccount":"default","serviceAccountName":"default","terminationGracePeriodSeconds":30},"status":{"conditions":[{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"Initialized"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","message":"containers with unready status: [http]","reason":"ContainersNotReady","status":"False","type":"ContainersReady"},{"lastProbeTime":null,"lastTransitionTime":"2020-03-15T03:05:00Z","status":"True","type":"PodScheduled"}],"hostIP":"10.200.10.201","phase":"Running","qosClass":"BestEffort","startTime":"2020-03-15T03:05:00Z"}}

It looks like somehow Weave could not locate the Pod network namespace?

Metadata

Assignees

No one assigned

    Labels

    state/need-more-info

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions