KubeEdge 部署的一些输出信息

kubeedge 12.2k 字 次

本文记录 KubeEdge 部署的一些输出信息。

一、云端

1.1 初始化

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
No config file exists, using default configurations for logger
2019-12-30 13:32:15.229 +08:00 DEBUG sync/once.go:44 init logger...
2019-12-30 13:32:15.233 +08:00 DEBUG go-archaius/configurationfactory.go:90 ConfigurationFactory Initiated
2019-12-30 13:32:15.233 +08:00 INFO go-archaius/archaius.go:53 Configuration files: 
2019-12-30 13:32:15.233 +08:00 WARN config-manager/configurationmanager.go:140 empty configurtion from FileSource
2019-12-30 13:32:15.233 +08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:FileSource
2019-12-30 13:32:15.233 +08:00 INFO go-archaius/archaius.go:112 archaius init success
2019-12-30 13:32:15.233 +08:00 WARN config-manager/configurationmanager.go:140 empty configurtion from MemorySource
2019-12-30 13:32:15.233 +08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:MemorySource
2019-12-30 13:32:15.233 +08:00 WARN config-manager/configurationmanager.go:140 empty configurtion from CommandlineSource
2019-12-30 13:32:15.233 +08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:CommandlineSource
2019-12-30 13:32:15.233 +08:00 INFO enviromentvariable-source/envconfigurationsource.go:46 enable env source
2019-12-30 13:32:15.233 +08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:EnvironmentSource
2019-12-30 13:32:15.234 +08:00 INFO memory-source/memorysource.go:105 mem source callback prepared
2019-12-30 13:32:15.234 +08:00 INFO file-source/filesource.go:354 create new watcher
2019-12-30 13:32:15.234 +08:00 DEBUG config-manager/configurationmanager.go:391 EventReceived &{FileSource CREATE modules.enabled [devicecontroller edgecontroller cloudhub]}
2019-12-30 13:32:15.235 +08:00 DEBUG event-system/eventsystem.go:115 event generated for a*
2019-12-30 13:32:15.248 +08:00 DEBUG go-archaius/archaius.go:188 config value after change modules.enabled | [devicecontroller edgecontroller cloudhub]
I1230 13:32:15.260044   70311 server.go:36] Version: v1.1.0
2019-12-30 13:32:15.260 +08:00 INFO core/module.go:41 module cloudhub registered
2019-12-30 13:32:15.260 +08:00 INFO core/module.go:41 module edgecontroller registered
2019-12-30 13:32:15.260 +08:00 INFO core/module.go:41 module devicecontroller registered
2019-12-30 13:32:15.260 +08:00 INFO core/core.go:23 starting module cloudhub
2019-12-30 13:32:15.260 +08:00 INFO core/core.go:23 starting module edgecontroller
2019-12-30 13:32:15.260 +08:00 INFO core/core.go:23 starting module devicecontroller
I1230 13:32:15.260933   70311 server.go:45] start unix domain socket server
E1230 13:32:15.261077   70311 uds.go:68] failed to listen addr: listen unix //var/lib/kubeedge/kubeedge.sock: bind: no such file or directory
I1230 13:32:15.261119   70311 buffer.go:64] Update controller.buffer.update-pod-status: 1024
I1230 13:32:15.261129   70311 buffer.go:71] Update controller.buffer.update-node-status: 1024
I1230 13:32:15.261134   70311 buffer.go:78] Update controller.buffer.query-configmap: 1024
I1230 13:32:15.261144   70311 buffer.go:92] Update controller.buffer.query-service: 1024
I1230 13:32:15.261149   70311 buffer.go:100] Update controller.buffer.query-endpoints: 1024
I1230 13:32:15.261155   70311 buffer.go:107] Update controller.buffer.pod-event: 1
I1230 13:32:15.261177   70311 buffer.go:114] Update controller.buffer.configmap-event: 1
I1230 13:32:15.261187   70311 buffer.go:121] Update controller.buffer.secret-event: 1
I1230 13:32:15.261193   70311 buffer.go:128] Update controller.buffer.service-event: 1
I1230 13:32:15.261198   70311 buffer.go:135] Update controller.buffer.endpoint-event: 1
I1230 13:32:15.261204   70311 buffer.go:142] Update controller.buffer.query-persistentvolume: 1024
I1230 13:32:15.261251   70311 buffer.go:149] Update controller.buffer.query-persistentvolumeclaim: 1024
I1230 13:32:15.261280   70311 buffer.go:156] Update controller.buffer.query-volumeattachment: 1024
I1230 13:32:15.261292   70311 buffer.go:163] Update controller.buffer.query-node: 1024
I1230 13:32:15.261299   70311 buffer.go:170] Update controller.buffer.update-node: 1024
I1230 13:32:15.261305   70311 context.go:29]  send module name: cloudhub
I1230 13:32:15.261309   70311 context.go:36] receive module name: edgecontroller
I1230 13:32:15.261314   70311 context.go:43] response module name: cloudhub
E1230 13:32:15.261325   70311 kube.go:30] Controller kube master not set
I1230 13:32:15.261330   70311 kube.go:34] Controller kube master: 
I1230 13:32:15.261338   70311 kube.go:41] Controller kube config: /home/ubuntu/.kube/config
I1230 13:32:15.261344   70311 kube.go:46] Controller kube namespace: 
I1230 13:32:15.261351   70311 kube.go:51] Controller kube content type: application/vnd.kubernetes.protobuf
I1230 13:32:15.261358   70311 kube.go:56] Controller kube QPS: 5.000000
I1230 13:32:15.261369   70311 kube.go:61] Controller kube burst: 10
I1230 13:32:15.261377   70311 kube.go:66] Controller kube update frequency: 10s
I1230 13:32:15.261389   70311 kube.go:72] Controller kube Node ID: 
I1230 13:32:15.261394   70311 kube.go:79] Controller kube Node Name: 
I1230 13:32:15.261403   70311 kube.go:86]  EdgeSite is false 
I1230 13:32:15.261409   70311 load.go:49] update pod status workers: 1
I1230 13:32:15.261413   70311 load.go:56] update node status workers: 1
I1230 13:32:15.261418   70311 load.go:63] query config map workers: 4
I1230 13:32:15.261423   70311 load.go:70] query secret workers: 4
I1230 13:32:15.261429   70311 load.go:77] query service workers: 4
I1230 13:32:15.261440   70311 load.go:84] query endpoints workers: 4
I1230 13:32:15.261447   70311 load.go:91] query persistentvolume workers: 4
I1230 13:32:15.261466   70311 load.go:98] query persistentvolumeclaim workers: 4
I1230 13:32:15.261481   70311 load.go:105] query volumeattachment workers: 4
I1230 13:32:15.261489   70311 load.go:112] query node workers: 4
I1230 13:32:15.261495   70311 load.go:119] update node workers: 4
I1230 13:32:15.261502   70311 messagelayer.go:19] message layer: context
I1230 13:32:15.267602   70311 upstream.go:108] start upstream controller
I1230 13:32:15.268231   70311 buffer.go:25] Update devicecontroller.buffer.update-device-status: 1024
I1230 13:32:15.268609   70311 buffer.go:32] Update devicecontroller.buffer.device-event: 1
I1230 13:32:15.268992   70311 buffer.go:39] Update devicecontroller.buffer.device-model-event: 1
I1230 13:32:15.269300   70311 context.go:29] Send module name: cloudhub
I1230 13:32:15.269595   70311 context.go:36] Receive module name: devicecontroller
I1230 13:32:15.269931   70311 context.go:43] Response module name: cloudhub
E1230 13:32:15.270642   70311 kube.go:30] Devicecontroller kube master not set
I1230 13:32:15.273409   70311 kube.go:34] Devicecontroller kube master: 
I1230 13:32:15.271607   70311 server.go:48] Start cloud hub quic server
I1230 13:32:15.272254   70311 server.go:55] Start cloud hub websocket server
I1230 13:32:15.293905   70311 kube.go:41] Devicecontroller kube config: /home/ubuntu/.kube/config
I1230 13:32:15.294511   70311 kube.go:48] Devicecontroller kube namespace: 
I1230 13:32:15.294529   70311 kube.go:55] Devicecontroller kube content type: application/vnd.kubernetes.protobuf
I1230 13:32:15.294541   70311 kube.go:62] Devicecontroller kube QPS: 5.000000
I1230 13:32:15.294556   70311 kube.go:69] Devicecontroller kube burst: 10
I1230 13:32:15.294563   70311 load.go:19] Update device status workers: 1
I1230 13:32:15.294568   70311 messagelayer.go:19] Message layer: context
I1230 13:32:15.314091   70311 downstream.go:814] Start downstream devicecontroller
I1230 13:32:15.392508   70311 downstream.go:429] start downstream controller
I1230 13:32:15.392610   70311 downstream.go:400] Send message successfully, operation: insert, resource: node/edge-node/kube-system/endpoints/kube-dns
I1230 13:32:15.392670   70311 downstream.go:400] Send message successfully, operation: insert, resource: node/edge-node/kube-system/endpoints/kube-scheduler
E1230 13:32:15.392691   70311 channelq.go:102] rChannel for edge node edge-node is removed
I1230 13:32:15.392698   70311 channelq.go:89] fail to get dispatch channel for edge-node
E1230 13:32:15.392704   70311 channelq.go:102] rChannel for edge node edge-node is removed
I1230 13:32:15.392709   70311 channelq.go:89] fail to get dispatch channel for edge-node
I1230 13:32:15.392741   70311 downstream.go:105] there are 0 nodes need to sync config map, operation: ADDED
I1230 13:32:15.392753   70311 downstream.go:105] there are 0 nodes need to sync config map, operation: ADDED
I1230 13:32:15.392763   70311 downstream.go:105] there are 0 nodes need to sync config map, operation: ADDED
I1230 13:32:15.392774   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.392780   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.392789   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.392866   70311 downstream.go:321] Send message successfully, operation: insert, resource: node/edge-node/kube-system/service/kube-dns
I1230 13:32:15.392886   70311 downstream.go:321] Send message successfully, operation: insert, resource: node/edge-node/default/service/kubernetes
E1230 13:32:15.392895   70311 channelq.go:102] rChannel for edge node edge-node is removed
I1230 13:32:15.392949   70311 channelq.go:89] fail to get dispatch channel for edge-node
E1230 13:32:15.392987   70311 channelq.go:102] rChannel for edge node edge-node is removed
I1230 13:32:15.392997   70311 channelq.go:89] fail to get dispatch channel for edge-node
I1230 13:32:15.393243   70311 downstream.go:105] there are 0 nodes need to sync config map, operation: ADDED
I1230 13:32:15.393266   70311 downstream.go:105] there are 0 nodes need to sync config map, operation: ADDED
I1230 13:32:15.393273   70311 downstream.go:105] there are 0 nodes need to sync config map, operation: ADDED
I1230 13:32:15.393281   70311 downstream.go:105] there are 0 nodes need to sync config map, operation: ADDED
I1230 13:32:15.393289   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393295   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393301   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393308   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393338   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393347   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393382   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393415   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393448   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393457   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393465   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393472   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393482   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393488   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393494   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393505   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393539   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393571   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393581   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393590   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393600   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393606   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393613   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393620   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393629   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393635   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393641   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393648   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393658   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393665   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393696   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.393728   70311 downstream.go:151] there are 0 nodes need to sync secret, operation: ADDED
I1230 13:32:15.397296   70311 downstream.go:400] Send message successfully, operation: insert, resource: node/edge-node/default/endpoints/kubernetes
I1230 13:32:15.397363   70311 downstream.go:414] Send message successfully, operation: update, resource: node/edge-node/default/podlist/kubernetes
I1230 13:32:15.397390   70311 downstream.go:400] Send message successfully, operation: insert, resource: node/edge-node/kube-system/endpoints/kube-controller-manager
E1230 13:32:15.397425   70311 channelq.go:102] rChannel for edge node edge-node is removed
I1230 13:32:15.397454   70311 channelq.go:89] fail to get dispatch channel for edge-node
E1230 13:32:15.397495   70311 channelq.go:102] rChannel for edge node edge-node is removed
I1230 13:32:15.397521   70311 channelq.go:89] fail to get dispatch channel for edge-node
E1230 13:32:15.397530   70311 channelq.go:102] rChannel for edge node edge-node is removed
I1230 13:32:15.397535   70311 channelq.go:89] fail to get dispatch channel for edge-node
I1230 13:32:17.315166   70311 upstream.go:65] Start upstream devicecontroller

1.2 运行正常后

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
I1230 14:55:00.354223   83594 eventhandler.go:201] event received for node edge-node id: 6eb21155-03ce-491c-ba2d-adff6cc71944, parent_id: , group: meta, source: edged, resource: node/edge-node/default/nodestatus/edge-node, operation: update, content: {"UID":"38796d14-1df3-11e8-8e5a-286ed488f209","Status":{"capacity":{"cpu":"1","memory":"974Mi","pods":"110"},"allocatable":{"cpu":"1","memory":"874Mi","pods":"110"},"phase":"Running","conditions":[{"type":"Ready","status":"True","lastHeartbeatTime":"2019-12-30T06:55:00Z","lastTransitionTime":"2019-12-30T06:55:00Z","reason":"EdgeReady","message":"edge is posting ready status"}],"addresses":[{"type":"InternalIP","address":"192.168.0.140"},{"type":"Hostname","address":"edge-node"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":0}},"nodeInfo":{"machineID":"","systemUUID":"","bootID":"","kernelVersion":"4.4.0-170-generic","osImage":"Ubuntu 16.04 LTS","containerRuntimeVersion":"remote://18.9.7","kubeletVersion":"v1.15.3-kubeedge-v1.1.0","kubeProxyVersion":"","operatingSystem":"linux","architecture":"amd64"}},"ExtendResources":null}
I1230 14:55:00.354331   83594 upstream.go:186] dispatch message: 6eb21155-03ce-491c-ba2d-adff6cc71944
I1230 14:55:00.354349   83594 util.go:88] The resource type is nodestatus, 3
I1230 14:55:00.354357   83594 upstream.go:193] message: 6eb21155-03ce-491c-ba2d-adff6cc71944, resource type is: nodestatus
I1230 14:55:00.354363   83594 upstream.go:195] message: 6eb21155-03ce-491c-ba2d-adff6cc71944, operation type is: update
I1230 14:55:00.354388   83594 upstream.go:341] message: 6eb21155-03ce-491c-ba2d-adff6cc71944, operation is: update, and resource is node/edge-node/default/nodestatus/edge-node
I1230 14:55:00.354509   83594 util.go:113] The resource name is edge-node, 4
I1230 14:55:00.362379   83594 upstream.go:452] message: 6eb21155-03ce-491c-ba2d-adff6cc71944, update node status successfully, namespace: , name: edge-node
I1230 14:55:00.362398   83594 upstream.go:457] message: 6eb21155-03ce-491c-ba2d-adff6cc71944 process successfully
I1230 14:55:00.362414   83594 eventhandler.go:369] event to send for node edge-node, id: 03af6a61-c734-4866-9dc7-77420ab6200f, parent_id: 6eb21155-03ce-491c-ba2d-adff6cc71944, group: resource, source: edgecontroller, resource: node/edge-node/default/node/edge-node, operation: response, content OK
I1230 14:55:10.371737   83594 eventhandler.go:201] event received for node edge-node id: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07, parent_id: , group: meta, source: edged, resource: node/edge-node/default/nodestatus/edge-node, operation: update, content: {"UID":"38796d14-1df3-11e8-8e5a-286ed488f209","Status":{"capacity":{"cpu":"1","memory":"974Mi","pods":"110"},"allocatable":{"cpu":"1","memory":"874Mi","pods":"110"},"phase":"Running","conditions":[{"type":"Ready","status":"True","lastHeartbeatTime":"2019-12-30T06:55:10Z","lastTransitionTime":"2019-12-30T06:55:10Z","reason":"EdgeReady","message":"edge is posting ready status"}],"addresses":[{"type":"InternalIP","address":"192.168.0.140"},{"type":"Hostname","address":"edge-node"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":0}},"nodeInfo":{"machineID":"","systemUUID":"","bootID":"","kernelVersion":"4.4.0-170-generic","osImage":"Ubuntu 16.04 LTS","containerRuntimeVersion":"remote://18.9.7","kubeletVersion":"v1.15.3-kubeedge-v1.1.0","kubeProxyVersion":"","operatingSystem":"linux","architecture":"amd64"}},"ExtendResources":null}
I1230 14:55:10.371788   83594 upstream.go:186] dispatch message: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07
I1230 14:55:10.371795   83594 util.go:88] The resource type is nodestatus, 3
I1230 14:55:10.371800   83594 upstream.go:193] message: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07, resource type is: nodestatus
I1230 14:55:10.371804   83594 upstream.go:195] message: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07, operation type is: update
I1230 14:55:10.371813   83594 upstream.go:341] message: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07, operation is: update, and resource is node/edge-node/default/nodestatus/edge-node
I1230 14:55:10.371901   83594 util.go:113] The resource name is edge-node, 4
I1230 14:55:10.390939   83594 upstream.go:452] message: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07, update node status successfully, namespace: , name: edge-node
I1230 14:55:10.390958   83594 upstream.go:457] message: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07 process successfully
I1230 14:55:10.390973   83594 eventhandler.go:369] event to send for node edge-node, id: 56699b67-c0bf-415e-83cc-34dc32e3b7e2, parent_id: 2c199dd6-a65a-4c52-a7f6-04a7ec7cfc07, group: resource, source: edgecontroller, resource: node/edge-node/default/node/edge-node, operation: response, content OK
I1230 14:55:14.594148   83594 eventhandler.go:98] Keepalive message received from node: edge-node
I1230 14:55:14.594205   83594 eventhandler.go:135] Node edge-node is still alive
I1230 14:55:20.403975   83594 eventhandler.go:201] event received for node edge-node id: c012b322-e2dc-45f9-b908-60184d6289e2, parent_id: , group: meta, source: edged, resource: node/edge-node/default/nodestatus/edge-node, operation: update, content: {"UID":"38796d14-1df3-11e8-8e5a-286ed488f209","Status":{"capacity":{"cpu":"1","memory":"974Mi","pods":"110"},"allocatable":{"cpu":"1","memory":"874Mi","pods":"110"},"phase":"Running","conditions":[{"type":"Ready","status":"True","lastHeartbeatTime":"2019-12-30T06:55:20Z","lastTransitionTime":"2019-12-30T06:55:20Z","reason":"EdgeReady","message":"edge is posting ready status"}],"addresses":[{"type":"InternalIP","address":"192.168.0.140"},{"type":"Hostname","address":"edge-node"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":0}},"nodeInfo":{"machineID":"","systemUUID":"","bootID":"","kernelVersion":"4.4.0-170-generic","osImage":"Ubuntu 16.04 LTS","containerRuntimeVersion":"remote://18.9.7","kubeletVersion":"v1.15.3-kubeedge-v1.1.0","kubeProxyVersion":"","operatingSystem":"linux","architecture":"amd64"}},"ExtendResources":null}
I1230 14:55:20.404025   83594 upstream.go:186] dispatch message: c012b322-e2dc-45f9-b908-60184d6289e2
I1230 14:55:20.404033   83594 util.go:88] The resource type is nodestatus, 3
I1230 14:55:20.404038   83594 upstream.go:193] message: c012b322-e2dc-45f9-b908-60184d6289e2, resource type is: nodestatus
I1230 14:55:20.404042   83594 upstream.go:195] message: c012b322-e2dc-45f9-b908-60184d6289e2, operation type is: update
I1230 14:55:20.404052   83594 upstream.go:341] message: c012b322-e2dc-45f9-b908-60184d6289e2, operation is: update, and resource is node/edge-node/default/nodestatus/edge-node
I1230 14:55:20.404149   83594 util.go:113] The resource name is edge-node, 4
I1230 14:55:20.424640   83594 upstream.go:452] message: c012b322-e2dc-45f9-b908-60184d6289e2, update node status successfully, namespace: , name: edge-node
I1230 14:55:20.424699   83594 upstream.go:457] message: c012b322-e2dc-45f9-b908-60184d6289e2 process successfully
I1230 14:55:20.424742   83594 eventhandler.go:369] event to send for node edge-node, id: a7fbaa99-bae0-4635-9971-2aa33f14e794, parent_id: c012b322-e2dc-45f9-b908-60184d6289e2, group: resource, source: edgecontroller, resource: node/edge-node/default/node/edge-node, operation: response, content OK
I1230 14:55:29.594960   83594 eventhandler.go:98] Keepalive message received from node: edge-node
I1230 14:55:29.595043   83594 eventhandler.go:135] Node edge-node is still alive
I1230 14:55:30.414090   83594 eventhandler.go:201] event received for node edge-node id: a29402fb-c4ee-4125-886c-f6c342cbe009, parent_id: , group: meta, source: edged, resource: node/edge-node/default/nodestatus/edge-node, operation: update, content: {"UID":"38796d14-1df3-11e8-8e5a-286ed488f209","Status":{"capacity":{"cpu":"1","memory":"974Mi","pods":"110"},"allocatable":{"cpu":"1","memory":"874Mi","pods":"110"},"phase":"Running","conditions":[{"type":"Ready","status":"True","lastHeartbeatTime":"2019-12-30T06:55:30Z","lastTransitionTime":"2019-12-30T06:55:30Z","reason":"EdgeReady","message":"edge is posting ready status"}],"addresses":[{"type":"InternalIP","address":"192.168.0.140"},{"type":"Hostname","address":"edge-node"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":0}},"nodeInfo":{"machineID":"","systemUUID":"","bootID":"","kernelVersion":"4.4.0-170-generic","osImage":"Ubuntu 16.04 LTS","containerRuntimeVersion":"remote://18.9.7","kubeletVersion":"v1.15.3-kubeedge-v1.1.0","kubeProxyVersion":"","operatingSystem":"linux","architecture":"amd64"}},"ExtendResources":null}
I1230 14:55:30.414228   83594 upstream.go:186] dispatch message: a29402fb-c4ee-4125-886c-f6c342cbe009
I1230 14:55:30.414254   83594 util.go:88] The resource type is nodestatus, 3
I1230 14:55:30.414333   83594 upstream.go:193] message: a29402fb-c4ee-4125-886c-f6c342cbe009, resource type is: nodestatus
I1230 14:55:30.414376   83594 upstream.go:195] message: a29402fb-c4ee-4125-886c-f6c342cbe009, operation type is: update
I1230 14:55:30.414468   83594 upstream.go:341] message: a29402fb-c4ee-4125-886c-f6c342cbe009, operation is: update, and resource is node/edge-node/default/nodestatus/edge-node
I1230 14:55:30.414632   83594 util.go:113] The resource name is edge-node, 4
I1230 14:55:30.434891   83594 upstream.go:452] message: a29402fb-c4ee-4125-886c-f6c342cbe009, update node status successfully, namespace: , name: edge-node
I1230 14:55:30.434921   83594 upstream.go:457] message: a29402fb-c4ee-4125-886c-f6c342cbe009 process successfully
I1230 14:55:30.434938   83594 eventhandler.go:369] event to send for node edge-node, id: 054294f1-1f27-47c9-895c-c585b8b32ef2, parent_id: a29402fb-c4ee-4125-886c-f6c342cbe009, group: resource, source: edgecontroller, resource: node/edge-node/default/node/edge-node, operation: response, content OK

二、边缘端

2.1 初始化

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
No config file exists, using default configurations for logger
2019-12-29 22:56:29.003 -08:00 DEBUG sync/once.go:44 init logger...
2019-12-29 22:56:29.004 -08:00 DEBUG go-archaius/configurationfactory.go:90 ConfigurationFactory Initiated
2019-12-29 22:56:29.004 -08:00 INFO go-archaius/archaius.go:53 Configuration files: 
2019-12-29 22:56:29.005 -08:00 WARN config-manager/configurationmanager.go:140 empty configurtion from FileSource
2019-12-29 22:56:29.006 -08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:FileSource
2019-12-29 22:56:29.006 -08:00 INFO go-archaius/archaius.go:112 archaius init success
2019-12-29 22:56:29.009 -08:00 WARN config-manager/configurationmanager.go:140 empty configurtion from MemorySource
2019-12-29 22:56:29.010 -08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:MemorySource
2019-12-29 22:56:29.010 -08:00 WARN config-manager/configurationmanager.go:140 empty configurtion from CommandlineSource
2019-12-29 22:56:29.010 -08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:CommandlineSource
2019-12-29 22:56:29.010 -08:00 INFO enviromentvariable-source/envconfigurationsource.go:46 enable env source
2019-12-29 22:56:29.011 -08:00 INFO config-manager/configurationmanager.go:117 invoke dynamic handler:EnvironmentSource
2019-12-29 22:56:29.008 -08:00 INFO file-source/filesource.go:354 create new watcher
2019-12-29 22:56:29.022 -08:00 INFO memory-source/memorysource.go:105 mem source callback prepared
2019-12-29 22:56:29.043 -08:00 INFO client/client_plugins.go:24 Install client plugin, protocol: rest
2019-12-29 22:56:29.043 -08:00 INFO registry/discovery.go:18 Installed service discovery plugin: edge
I1229 22:56:29.044356  127363 server.go:49] Version: v1.1.0
I1229 22:56:29.044675  127363 sql.go:20] Begin to register twin model
I1229 22:56:29.045075  127363 db.go:37] DB meta for module twin has been registered
I1229 22:56:29.045983  127363 db.go:37] DB meta for module twin has been registered
I1229 22:56:29.048347  127363 db.go:37] DB meta for module twin has been registered
2019-12-29 22:56:29.049 -08:00 INFO core/module.go:41 module twin registered
I1229 22:56:29.062562  127363 client.go:75] Connecting to docker on unix:///var/run/docker.sock
I1229 22:56:29.062591  127363 client.go:104] Start docker client with request timeout=0s
I1229 22:56:29.069609  127363 docker_service.go:238] Hairpin mode set to "hairpin-veth"
I1229 22:56:29.096657  127363 docker_service.go:253] Docker cri networking managed by kubernetes.io/no-op
I1229 22:56:29.107049  127363 docker_service.go:258] Docker Info: &{ID:YCU6:6HU5:5L6F:G4OG:FBL6:6KZF:TGRI:7TZU:YNYU:OMBT:S62I:OQWT Containers:4 ContainersRunning:2 ContainersPaused:0 ContainersStopped:2 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:false KernelMemory:true KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:false IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:33 OomKillDisable:true NGoroutines:46 SystemTime:2019-12-29T22:56:29.098251301-08:00 LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:4.4.0-170-generic OperatingSystem:Ubuntu 16.04 LTS OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc00050e770 NCPU:1 MemTotal:1021968384 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:edge-node Labels:[] ExperimentalBuild:false ServerVersion:18.09.7 ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil> Warnings:[]} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID: Expected:} RuncCommit:{ID:N/A Expected:N/A} InitCommit:{ID:v0.18.0 Expected:fec3683b971d9c3ef73f284f176672c44b448662} SecurityOptions:[name=apparmor name=seccomp,profile=default] ProductLicense: Warnings:[WARNING: No swap limit support]}
I1229 22:56:29.107209  127363 docker_service.go:271] Setting cgroupDriver to systemd
I1229 22:56:29.107273  127363 edged.go:544] RemoteRuntimeEndpoint: "unix:///var/run/dockershim.sock", remoteImageEndpoint: "unix:///var/run/dockershim.sock"
I1229 22:56:29.107287  127363 edged.go:547] Starting the GRPC server for the docker CRI shim.
I1229 22:56:29.107571  127363 state_mem.go:36] [cpumanager] initializing new in-memory state store
I1229 22:56:29.107646  127363 state_mem.go:84] [cpumanager] updated default cpuset: ""
I1229 22:56:29.107654  127363 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
I1229 22:56:29.119650  127363 kuberuntime_manager.go:205] Container runtime docker initialized, version: 18.09.7, apiVersion: 1.39.0
I1229 22:56:29.135357  127363 container_manager_linux.go:275] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName:systemd KubeletCgroupsName:systemd ContainerRuntime:docker CgroupsPerQOS:false CgroupRoot: CgroupDriver:systemd KubeletRootDir:/var/lib/edged ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[]} QOSReserved:map[] ExperimentalCPUManagerPolicy: ExperimentalCPUManagerReconcilePeriod:0s ExperimentalPodPidsLimit:0 EnforceCPULimits:false CPUCFSQuotaPeriod:0s}
I1229 22:56:29.136957  127363 container_manager_linux.go:295] Creating device plugin manager: false
E1229 22:56:29.139834  127363 cpu_manager.go:135] [cpumanager] Unknown policy "", falling back to default policy "none"
I1229 22:56:29.148842  127363 state_mem.go:36] [cpumanager] initializing new in-memory state store
I1229 22:56:29.160330  127363 state_mem.go:84] [cpumanager] updated default cpuset: ""
I1229 22:56:29.160373  127363 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
W1229 22:56:29.160537  127363 csi_plugin.go:222] kubernetes.io/csi: kubeclient not set, assuming standalone kubelet
2019-12-29 22:56:29.160 -08:00 INFO core/module.go:41 module edged registered
2019-12-29 22:56:29.160 -08:00 INFO core/module.go:41 module websocket registered
2019-12-29 22:56:29.161 -08:00 INFO core/module.go:41 module eventbus registered
2019-12-29 22:56:29.161 -08:00 INFO core/module.go:41 module edgemesh registered
I1229 22:56:29.161682  127363 db.go:37] DB meta for module metaManager has been registered
2019-12-29 22:56:29.163 -08:00 INFO core/module.go:41 module metaManager registered
2019-12-29 22:56:29.165 -08:00 INFO core/module.go:41 module servicebus registered
2019-12-29 22:56:29.165 -08:00 INFO core/module.go:44 module testManager is not register, please check modules.yaml
table `device` already exists, skip
table `device_attr` already exists, skip
table `device_twin` already exists, skip
table `meta` already exists, skip
2019-12-29 22:56:29.176 -08:00 INFO core/core.go:23 starting module twin
2019-12-29 22:56:29.176 -08:00 INFO core/core.go:23 starting module edged
2019-12-29 22:56:29.176 -08:00 INFO core/core.go:23 starting module websocket
2019-12-29 22:56:29.177 -08:00 INFO core/core.go:23 starting module eventbus
I1229 22:56:29.177600  127363 server.go:126] Subscribe internal topic to $hw/events/upload/#
I1229 22:56:29.177628  127363 server.go:126] Subscribe internal topic to $hw/events/device/+/state/update
I1229 22:56:29.177635  127363 server.go:126] Subscribe internal topic to $hw/events/device/+/twin/+
I1229 22:56:29.177641  127363 server.go:126] Subscribe internal topic to $hw/events/node/+/membership/get
I1229 22:56:29.177650  127363 server.go:126] Subscribe internal topic to SYS/dis/upload_records
I1229 22:56:29.177790  127363 dtcontroller.go:185] Begin to sync sqlite 
I1229 22:56:29.181288  127363 websocket.go:48] Websocket start to connect Access
2019-12-29 22:56:29.183 -08:00 INFO core/core.go:23 starting module edgemesh
2019-12-29 22:56:29.196 -08:00 INFO core/core.go:23 starting module metaManager
2019-12-29 22:56:29.186 -08:00 DEBUG loadbalancer/strategy.go:23 Installed strategy plugin: RoundRobin.
2019-12-29 22:56:29.206 -08:00 INFO core/core.go:23 starting module servicebus
I1229 22:56:29.232864  127363 proxy.go:94] [L4 Proxy] proxy is running now
I1229 22:56:29.234799  127363 tcp.go:27] start listening at 172.17.0.1:8080
2019-12-29 22:56:29.229 -08:00 INFO client/ws.go:45 dial wss://192.168.0.102:10000/e632aba927ea4ac2b575ec1603d56f10/edge-node/events successfully
I1229 22:56:29.237911  127363 websocket.go:79] Websocket connect to cloud access successful
2019-12-29 22:56:29.238 -08:00 WARN context/context_channel.go:341 failed to get type channel, type(sync)
I1229 22:56:29.238665  127363 dtcontroller.go:79] DeviceTwin receive msg
I1229 22:56:29.242214  127363 dtcontroller.go:138] Send msg to the CommModule module in twin
I1229 22:56:29.245739  127363 communicate.go:35] receive msg commModule
2019-12-29 22:56:29.246 -08:00 WARN context/context_channel.go:186 bad module type (sync), do nothing
I1229 22:56:29.242961  127363 servicebus.go:57] ServiceBus receive msg
I1229 22:56:29.242981  127363 msg_processor.go:634] get a message {Header:{ID:05e7b70f-4b2e-4c4d-ab5a-9789ede0ec4c ParentID: Timestamp:1577688989238 Sync:false} Router:{Source:edgehub Group:meta Operation:publish Resource:node/connection} Content:cloud_connected}
I1229 22:56:29.250729  127363 communicate.go:90] CONNECTED EVENT
I1229 22:56:29.250913  127363 communicate.go:139] Request detail
I1229 22:56:29.250766  127363 msg_processor.go:468] node connection event occur: cloud_connected
I1229 22:56:29.253697  127363 msg_processor.go:634] get a message {Header:{ID:16d05497-e87c-4910-85e6-74c395b1d5c7 ParentID: Timestamp:1577688989249 Sync:false} Router:{Source:edgehub Group:meta Operation:publish Resource:node/connection} Content:cloud_connected}
I1229 22:56:29.254110  127363 msg_processor.go:468] node connection event occur: cloud_connected
I1229 22:56:29.259807  127363 util.go:368] Looking for default routes with IPv4 addresses
I1229 22:56:29.262958  127363 util.go:373] Default route transits interface "ens33"
I1229 22:56:29.268374  127363 util.go:182] Interface ens33 is up
I1229 22:56:29.271996  127363 util.go:230] Interface "ens33" has 2 addresses :[192.168.0.140/24 fe80::b4fb:5f6a:6040:dcda/64].
I1229 22:56:29.272622  127363 util.go:198] Checking addr  192.168.0.140/24.
I1229 22:56:29.273063  127363 util.go:205] IP found 192.168.0.140
I1229 22:56:29.278440  127363 util.go:236] Found valid IPv4 address 192.168.0.140 for interface "ens33".
I1229 22:56:29.279045  127363 util.go:379] Found active IP 192.168.0.140 
I1229 22:56:29.295831  127363 cpu_manager.go:155] [cpumanager] starting with none policy
I1229 22:56:29.297621  127363 cpu_manager.go:156] [cpumanager] reconciling every 0s
I1229 22:56:29.297652  127363 policy_none.go:42] [cpumanager] none policy: Start
I1229 22:56:29.298495  127363 status_manager.go:43] Starting to sync pod status with apiserver
I1229 22:56:29.303502  127363 edged.go:765] start pod addition queue work 0
I1229 22:56:29.303567  127363 edged.go:765] start pod addition queue work 1
I1229 22:56:29.303574  127363 edged.go:765] start pod addition queue work 2
I1229 22:56:29.303580  127363 edged.go:765] start pod addition queue work 3
I1229 22:56:29.303585  127363 edged.go:765] start pod addition queue work 4
I1229 22:56:29.303714  127363 edged.go:342] starting plugin manager
I1229 22:56:29.300236  127363 container_manager_linux.go:868] Found 120 PIDs in root, 120 of them are not to be moved
I1229 22:56:29.300446  127363 volume_manager.go:243] Starting Kubelet Volume Manager
I1229 22:56:29.300456  127363 desired_state_of_world_populator.go:130] Desired state populator starts to run
I1229 22:56:29.304963  127363 generic.go:81] GenericLifecycle: Relisting
I1229 22:56:29.305011  127363 server.go:65] starting to listen on 127.0.0.1:10255
I1229 22:56:29.309909  127363 edged.go:345] starting syncPod
E1229 22:56:29.310635  127363 plugin_watcher.go:81] failed to traverse deprecated plugin socket path "/var/lib/edged/plugins", err: error accessing path: /var/lib/edged/plugins error: lstat /var/lib/edged/plugins: no such file or directory
W1229 22:56:29.315467  127363 container_manager_linux.go:827] CPUAccounting not enabled for pid: 127363
I1229 22:56:29.331549  127363 plugin_manager.go:116] Starting Kubelet Plugin Manager
W1229 22:56:29.332754  127363 container_manager_linux.go:830] MemoryAccounting not enabled for pid: 127363
W1229 22:56:29.358558  127363 docker_sandbox.go:384] failed to read pod IP from plugin/docker: Couldn't find network status for default/nginx-deployment-77698bff7d-bwc94 through plugin: invalid network status for
I1229 22:56:29.361048  127363 edged.go:726] sync loop ignore event: [ContainerDied], with pod [4b4cdbcd-fcae-45d4-abb2-46ddd5c3c41e] not found
W1229 22:56:29.370276  127363 docker_sandbox.go:384] failed to read pod IP from plugin/docker: Couldn't find network status for default/nginx-deployment-77698bff7d-vnmh2 through plugin: invalid network status for
I1229 22:56:29.378565  127363 edged.go:726] sync loop ignore event: [ContainerStarted], with pod [25d5d377-37cb-4280-b0ae-025b24bde8b7] not found
I1229 22:56:29.379119  127363 edged.go:726] sync loop ignore event: [ContainerStarted], with pod [25d5d377-37cb-4280-b0ae-025b24bde8b7] not found
I1229 22:56:29.379479  127363 edged.go:726] sync loop ignore event: [ContainerDied], with pod [25d5d377-37cb-4280-b0ae-025b24bde8b7] not found
I1229 22:56:29.404815  127363 util.go:368] Looking for default routes with IPv4 addresses
I1229 22:56:29.405446  127363 util.go:373] Default route transits interface "ens33"
I1229 22:56:29.406332  127363 util.go:182] Interface ens33 is up
I1229 22:56:29.408428  127363 util.go:230] Interface "ens33" has 2 addresses :[192.168.0.140/24 fe80::b4fb:5f6a:6040:dcda/64].
I1229 22:56:29.410593  127363 util.go:198] Checking addr  192.168.0.140/24.
I1229 22:56:29.412096  127363 util.go:205] IP found 192.168.0.140
I1229 22:56:29.412654  127363 util.go:236] Found valid IPv4 address 192.168.0.140 for interface "ens33".
I1229 22:56:29.412690  127363 util.go:379] Found active IP 192.168.0.140 
I1229 22:56:29.425555  127363 edged_status.go:163] Sync VolumesInUse: []
I1229 22:56:29.426117  127363 edged_status.go:380] Attempting to register node edge-node
I1229 22:56:29.437295  127363 msg_processor.go:634] get a message {Header:{ID:4a6078bf-05cc-41c2-8c0d-825fda3d3235 ParentID: Timestamp:1577688989426 Sync:true} Router:{Source:edged Group:meta Operation:update Resource:default/nodestatus/edge-node} Content:{UID:38796d14-1df3-11e8-8e5a-286ed488f209 Status:{Capacity:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1021313024 scale:0} d:{Dec:<nil>} s:974Mi Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Allocatable:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:916455424 scale:0} d:{Dec:<nil>} s: Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Phase:Running Conditions:[{Type:Ready Status:True LastHeartbeatTime:2019-12-29 22:56:29.424741899 -0800 PST m=+0.423874627 LastTransitionTime:2019-12-29 22:56:29.424741899 -0800 PST m=+0.423874627 Reason:EdgeReady Message:edge is posting ready status}] Addresses:[{Type:InternalIP Address:192.168.0.140} {Type:Hostname Address:edge-node}] DaemonEndpoints:{KubeletEndpoint:{Port:0}} NodeInfo:{MachineID: SystemUUID: BootID: KernelVersion:4.4.0-170-generic OSImage:Ubuntu 16.04 LTS ContainerRuntimeVersion:remote://18.9.7 KubeletVersion:v1.15.3-kubeedge-v1.1.0 KubeProxyVersion: OperatingSystem:linux Architecture:amd64} Images:[] VolumesInUse:[] VolumesAttached:[] Config:nil} ExtendResources:map[]}}
I1229 22:56:29.442087  127363 metaclient.go:117] send sync message default/nodestatus/edge-node successed and response: {{bc49fb40-c792-4

2.2 运行正常后

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
E1229 22:56:49.459550  127363 generic.go:99] Failed to get host IP: failed to get network interface: eth0 err:route ip+net: no such network interface
I1229 22:56:49.461731  127363 generic.go:429] pod waiting > 0, pending
I1229 22:56:49.484645  127363 edged_status.go:163] Sync VolumesInUse: []
I1229 22:56:49.495934  127363 msg_processor.go:634] get a message {Header:{ID:95de2151-11eb-4f29-9bbc-b4b68c7d852f ParentID: Timestamp:1577689009485 Sync:true} Router:{Source:edged Group:meta Operation:update Resource:default/nodestatus/edge-node} Content:{UID:38796d14-1df3-11e8-8e5a-286ed488f209 Status:{Capacity:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:1021313024 scale:0} d:{Dec:<nil>} s:974Mi Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Allocatable:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:916455424 scale:0} d:{Dec:<nil>} s: Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Phase:Running Conditions:[{Type:Ready Status:True LastHeartbeatTime:2019-12-29 22:56:49.483860058 -0800 PST m=+20.482992761 LastTransitionTime:2019-12-29 22:56:49.483860058 -0800 PST m=+20.482992761 Reason:EdgeReady Message:edge is posting ready status}] Addresses:[{Type:InternalIP Address:192.168.0.140} {Type:Hostname Address:edge-node}] DaemonEndpoints:{KubeletEndpoint:{Port:0}} NodeInfo:{MachineID: SystemUUID: BootID: KernelVersion:4.4.0-170-generic OSImage:Ubuntu 16.04 LTS ContainerRuntimeVersion:remote://18.9.7 KubeletVersion:v1.15.3-kubeedge-v1.1.0 KubeProxyVersion: OperatingSystem:linux Architecture:amd64} Images:[] VolumesInUse:[] VolumesAttached:[] Config:nil} ExtendResources:map[]}}
I1229 22:56:49.498527  127363 metaclient.go:117] send sync message default/nodestatus/edge-node successed and response: {{219e053c-ba12-488a-9b3e-3da3f65d01e9 95de2151-11eb-4f29-9bbc-b4b68c7d852f 1577689009498 false} {edged meta response default/nodestatus/edge-node} OK}
I1229 22:56:49.532400  127363 controller.go:182] received msg from cloud-hub:{Header:{ID:1828d947-2d7d-453d-a5ba-0c3e68c522a2 ParentID:95de2151-11eb-4f29-9bbc-b4b68c7d852f Timestamp:1577689009539 Sync:false} Router:{Source:edgecontroller Group:resource Operation:response Resource:default/node/edge-node} Content:[79 75]}
2019-12-29 22:56:49.532 -08:00 WARN context/context_channel.go:157 bad anonName(95de2151-11eb-4f29-9bbc-b4b68c7d852f), do nothing
I1229 22:56:50.462885  127363 generic.go:81] GenericLifecycle: Relisting
W1229 22:56:50.467849  127363 docker_sandbox.go:384] failed to read pod IP from plugin/docker: Couldn't find network status for default/nginx-deployment-77698bff7d-bwc94 through plugin: invalid network status for
E1229 22:56:50.474159  127363 generic.go:99] Failed to get host IP: failed to get network interface: eth0 err:route ip+net: no such network interface
I1229 22:56:50.474772  127363 generic.go:429] pod waiting > 0, pending
I1229 22:56:51.475953  127363 generic.go:81] GenericLifecycle: Relisting
W1229 22:56:51.482490  127363 docker_sandbox.go:384] failed to read pod IP from plugin/docker: Couldn't find network status for default/nginx-deployment-77698bff7d-bwc94 through plugin: invalid network status for
E1229 22:56:51.490697  127363 generic.go:99] Failed to get host IP: failed to get network interface: eth0 err:route ip+net: no such network interface
I1229 22:56:51.491345  127363 generic.go:429] pod waiting > 0, pending
I1229 22:56:52.492105  127363 generic.go:81] GenericLifecycle: Relisting
W1229 22:56:52.496771  127363 docker_sandbox.go:384] failed to read pod IP from plugin/docker: Couldn't find network status for default/nginx-deployment-77698bff7d-bwc94 through plugin: invalid network status for
E1229 22:56:52.499322  127363 generic.go:99] Failed to get host IP: failed to get network interface: eth0 err:route ip+net: no such network interface
I1229 22:56:52.500610  127363 generic.go:429] pod waiting > 0, pending

ARM运行

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
# ./edgecore
2020/01/06 22:37:31 DEBUG: ConfigurationFactory Initiated
2020/01/06 22:37:31 INFO: Configuration files: []
2020/01/06 22:37:31 WARN: empty configurtion from [FileSource]
2020/01/06 22:37:31 INFO: invoke dynamic handler:FileSource
2020/01/06 22:37:31 INFO: archaius init success
2020/01/06 22:37:31 WARN: empty configurtion from [MemorySource]
2020/01/06 22:37:31 INFO: invoke dynamic handler:MemorySource
2020/01/06 22:37:31 WARN: empty configurtion from [CommandlineSource]
2020/01/06 22:37:31 INFO: invoke dynamic handler:CommandlineSource
2020/01/06 22:37:31 INFO: enable env source
2020/01/06 22:37:31 INFO: invoke dynamic handler:EnvironmentSource
I0106 22:37:31.818113    3562 config.go:32] can not get database.driver key, use default sqlite3
I0106 22:37:31.821220    3562 config.go:38] can not get database.name key, use default default
I0106 22:37:31.823134    3562 config.go:44] can not get database.source key, use default edge.db
I0106 22:37:31.824984    3562 config.go:70] init common config successfully，config info {Modules:[eventbus servicebus websocket metaManager edged twin dbTest edgemesh] DriverName:sqlite3 DBName:default DataSource:edge.db}
2020/01/06 22:37:31 INFO: create new watcher
2020/01/06 22:37:31 INFO: mem source callback prepared
2020/01/06 22:37:32 INFO: Install client plugin, protocol: rest
2020/01/06 22:37:32 INFO: Installed service discovery plugin: edge
I0106 22:37:32.141871    3562 server.go:52] Version: v1.1.0-beta.0.323+52dd841358b292-dirty
I0106 22:37:32.277356    3562 config.go:39] init devicetwin config successfully，config info {NodeID:edge-node-arm}
I0106 22:37:32.279902    3562 sql.go:20] Begin to register twin model
I0106 22:37:32.282963    3562 db.go:22] DB meta for module twin has been registered
I0106 22:37:32.286015    3562 db.go:22] DB meta for module twin has been registered
I0106 22:37:32.289092    3562 db.go:22] DB meta for module twin has been registered
I0106 22:37:32.292119    3562 module.go:41] Module twin registered
I0106 22:37:32.294304    3562 config.go:158] init edged config successfully，config info {NodeName:edge-node-arm NodeNamespace:default InterfaceName:eth0 MemoryCapacity:7852396000 NodeStatusUpdateInterval:10s DevicePluginEnabled:false GPUPluginEnabled:false ImageGCHighThreshold:80 ImageGCLowThreshold:40 ImagePullProgressDeadline:60 MaxPerPodContainerCount:1 DockerAddress:unix:///var/run/docker.sock RuntimeType:docker RemoteRuntimeEndpoint:unix:///var/run/dockershim.sock RemoteImageEndpoint:unix:///var/run/dockershim.sock RuntimeRequestTimeout:{Duration:2m0s} PodSandboxImage:kubeedge/pause-arm:3.1 CgroupDriver:systemd NodeIP: ClusterDNS: ClusterDomain:}
I0106 22:37:32.422952    3562 client.go:75] Connecting to docker on unix:///var/run/docker.sock
I0106 22:37:32.431864    3562 client.go:104] Start docker client with request timeout=0s
I0106 22:37:32.506292    3562 docker_service.go:238] Hairpin mode set to "hairpin-veth"
W0106 22:37:32.511354    3562 cni.go:213] Unable to update cni config: No networks found in /etc/cni/net.d
W0106 22:37:32.578376    3562 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
I0106 22:37:32.626240    3562 docker_service.go:253] Docker cri networking managed by kubernetes.io/no-op
I0106 22:37:32.823908    3562 docker_service.go:258] Docker Info: &{ID:SNH3:MXMT:QABC:P5YF:PSCO:DYTI:XCU4:HXRF:RGS2:PHMU:E5W2:62QV Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:overlay2 DriverStatus:[[Backing Filesystem <unknown>] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[]} MemoryLimit:true SwapLimit:true KernelMemory:true KernelMemoryTCP:false CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:false IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:15 OomKillDisable:true NGoroutines:21 SystemTime:2020-01-06T22:37:32.689144895+08:00 LoggingDriver:json-file CgroupDriver:systemd NEventsListener:0 KernelVersion:4.14.67 OperatingSystem:Buildroot 2018.02.12 OSType:linux Architecture:armv7l IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0x3d0bbc0 NCPU:1 MemTotal:509239296 GenericResources:[] DockerRootDir:/mnt/docker HTTPProxy: HTTPSProxy: NoProxy: Name:buildroot Labels:[] ExperimentalBuild:false ServerVersion:17.05.0-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil> Warnings:[]} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:9048e5e50717ea4497b757314bad98ea3763c145 Expected:9048e5e50717ea4497b757314bad98ea3763c145} RuncCommit:{ID:N/A Expected:9c2d8d184e5da67c95d601382adf14862e4f2228} InitCommit:{ID:N/A Expected:} SecurityOptions:[] ProductLicense: Warnings:[]}
I0106 22:37:32.827798    3562 docker_service.go:271] Setting cgroupDriver to systemd
I0106 22:37:32.831886    3562 edged.go:431] RemoteRuntimeEndpoint: "unix:///var/run/dockershim.sock", remoteImageEndpoint: "unix:///var/run/dockershim.sock"
I0106 22:37:32.833777    3562 edged.go:434] Starting the GRPC server for the docker CRI shim.
I0106 22:37:32.841101    3562 state_mem.go:36] [cpumanager] initializing new in-memory state store
I0106 22:37:32.844814    3562 state_mem.go:84] [cpumanager] updated default cpuset: ""
I0106 22:37:32.847006    3562 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
I0106 22:37:32.898328    3562 kuberuntime_manager.go:205] Container runtime docker initialized, version: 17.05.0-ce, apiVersion: 1.29.0
I0106 22:37:33.035732    3562 container_manager_linux.go:275] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName:systemd KubeletCgroupsName:systemd ContainerRuntime:docker CgroupsPerQOS:false CgroupRoot: CgroupDriver:systemd KubeletRootDir:/var/lib/edged ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[]} QOSReserved:map[] ExperimentalCPUManagerPolicy: ExperimentalCPUManagerReconcilePeriod:0s ExperimentalPodPidsLimit:0 EnforceCPULimits:false CPUCFSQuotaPeriod:0s}
I0106 22:37:33.052504    3562 container_manager_linux.go:295] Creating device plugin manager: false
E0106 22:37:33.056341    3562 cpu_manager.go:135] [cpumanager] Unknown policy "", falling back to default policy "none"
I0106 22:37:33.067275    3562 state_mem.go:36] [cpumanager] initializing new in-memory state store
I0106 22:37:33.077600    3562 state_mem.go:84] [cpumanager] updated default cpuset: ""
I0106 22:37:33.081685    3562 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
W0106 22:37:33.087467    3562 csi_plugin.go:222] kubernetes.io/csi: kubeclient not set, assuming standalone kubelet
I0106 22:37:33.094163    3562 module.go:41] Module edged registered
I0106 22:37:33.099727    3562 config.go:194] init edgehub config successfully，config info {WSConfig:{URL:wss://192.168.0.102:10000/e632aba927ea4ac2b575ec1603d56f10/edge-node-arm/events CertFilePath:/etc/kubeedge/certs/edge.crt KeyFilePath:/etc/kubeedge/certs/edge.key HandshakeTimeout:30s ReadDeadline:15s WriteDeadline:15s} CtrConfig:{Protocol:websocket HeartbeatPeriod:15s ProjectID:e632aba927ea4ac2b575ec1603d56f10 NodeID:edge-node-arm} QcConfig:{URL:192.168.0.102:10001 CaFilePath:/etc/kubeedge/ca/rootCA.crt CertFilePath:/etc/kubeedge/certs/edge.crt KeyFilePath:/etc/kubeedge/certs/edge.key HandshakeTimeout:30s ReadDeadline:15s WriteDeadline:15s}}
I0106 22:37:33.106299    3562 module.go:41] Module websocket registered
I0106 22:37:33.111581    3562 config.go:101] init eventbus config successfully，config info {ExternalMqttURL:tcp://127.0.0.1:1883 InternalMqttURL:tcp://127.0.0.1:1884 QOS:0 Retain:false SessionQueueSize:100 Mode:0 NodeID:edge-node-arm}
I0106 22:37:33.115531    3562 module.go:41] Module eventbus registered
I0106 22:37:33.118944    3562 module.go:41] Module edgemesh registered
I0106 22:37:33.124651    3562 db.go:22] DB meta for module metaManager has been registered
I0106 22:37:33.128626    3562 config.go:40] can not get metamanager.context-send-group key , use default hub
I0106 22:37:33.132383    3562 config.go:47] can not get metamanager.edgesite key , use default false
I0106 22:37:33.134745    3562 config.go:60] can not get meta.sync.podstatus.interval key, use default 60
I0106 22:37:33.137137    3562 config.go:74] init common config successfully，config info {SendModuleGroupName:hub SendModuleName:websocket SyncInterval:60}
I0106 22:37:33.140657    3562 module.go:41] Module metaManager registered
I0106 22:37:33.143333    3562 module.go:41] Module servicebus registered
W0106 22:37:33.144328    3562 module.go:44] Module testManager is not register, please check modules.yaml
table `device` already exists, skip
table `device_attr` already exists, skip
table `device_twin` already exists, skip
table `meta` already exists, skip
I0106 22:37:33.220966    3562 core.go:24] Starting module twin
I0106 22:37:33.222981    3562 process.go:114] Begin to sync sqlite 
I0106 22:37:33.227099    3562 core.go:24] Starting module edged
I0106 22:37:33.240345    3562 core.go:24] Starting module websocket
I0106 22:37:33.277342    3562 core.go:24] Starting module eventbus
I0106 22:37:33.287071    3562 core.go:24] Starting module edgemesh
I0106 22:37:33.298154    3562 core.go:24] Starting module metaManager
I0106 22:37:33.301062    3562 core.go:24] Starting module servicebus
I0106 22:37:33.280586    3562 server.go:127] Subscribe internal topic to $hw/events/upload/#
I0106 22:37:33.326477    3562 server.go:127] Subscribe internal topic to $hw/events/device/+/state/update
I0106 22:37:33.289721    3562 log.go:172] DEBUG: Installed strategy plugin: [RoundRobin].
I0106 22:37:33.241684    3562 websocket.go:48] Websocket start to connect Access
I0106 22:37:33.329816    3562 server.go:127] Subscribe internal topic to $hw/events/device/+/twin/+
W0106 22:37:33.333236    3562 proxy.go:76] [L4 Proxy] create Device is failed : operation not supported
I0106 22:37:33.352696    3562 server.go:127] Subscribe internal topic to $hw/events/node/+/membership/get
I0106 22:37:33.378836    3562 server.go:127] Subscribe internal topic to SYS/dis/upload_records
I0106 22:37:33.367935    3562 tcp.go:27] start listening at 172.17.0.1:8080
I0106 22:37:33.699675    3562 util.go:368] Looking for default routes with IPv4 addresses
I0106 22:37:33.702450    3562 util.go:373] Default route transits interface "eth0"
I0106 22:37:33.706572    3562 util.go:182] Interface eth0 is up
I0106 22:37:33.710558    3562 util.go:230] Interface "eth0" has 3 addresses :[192.168.0.139/24 192.168.0.132/24 fe80::61f9:412c:1e9c:a85b/64].
I0106 22:37:33.712984    3562 util.go:198] Checking addr  192.168.0.139/24.
I0106 22:37:33.715132    3562 util.go:205] IP found 192.168.0.139
I0106 22:37:33.716887    3562 util.go:236] Found valid IPv4 address 192.168.0.139 for interface "eth0".
I0106 22:37:33.718738    3562 util.go:379] Found active IP 192.168.0.139 
I0106 22:37:33.723071    3562 cpu_manager.go:155] [cpumanager] starting with none policy
I0106 22:37:33.725482    3562 cpu_manager.go:156] [cpumanager] reconciling every 0s
I0106 22:37:33.727357    3562 policy_none.go:42] [cpumanager] none policy: Start
I0106 22:37:33.736524    3562 status_manager.go:43] Starting to sync pod status with apiserver
I0106 22:37:33.738965    3562 edged.go:670] start pod addition queue work 0
I0106 22:37:33.741410    3562 edged.go:670] start pod addition queue work 1
I0106 22:37:33.743284    3562 edged.go:670] start pod addition queue work 2
I0106 22:37:33.745505    3562 edged.go:670] start pod addition queue work 3
I0106 22:37:33.747379    3562 edged.go:670] start pod addition queue work 4
I0106 22:37:33.754483    3562 edged.go:304] starting plugin manager
I0106 22:37:33.759317    3562 edged.go:307] starting syncPod
E0106 22:37:33.764949    3562 plugin_watcher.go:81] failed to traverse deprecated plugin socket path "/var/lib/edged/plugins", err: error accessing path: /var/lib/edged/plugins error: lstat /var/lib/edged/plugins: no such file or directory
I0106 22:37:33.769030    3562 plugin_manager.go:116] Starting Kubelet Plugin Manager
I0106 22:37:33.796236    3562 container_manager_linux.go:868] Found 41 PIDs in root, 41 of them are not to be moved
I0106 22:37:33.869047    3562 volume_manager.go:243] Starting Kubelet Volume Manager
I0106 22:37:33.873937    3562 generic.go:81] GenericLifecycle: Relisting
I0106 22:37:33.876489    3562 server.go:47] starting to listen on 127.0.0.1:10255
I0106 22:37:33.906379    3562 desired_state_of_world_populator.go:130] Desired state populator starts to run
I0106 22:37:33.967712    3562 ws.go:46] dial wss://192.168.0.102:10000/e632aba927ea4ac2b575ec1603d56f10/edge-node-arm/events successfully
I0106 22:37:33.976293    3562 websocket.go:79] Websocket connect to cloud access successful
I0106 22:37:33.979752    3562 process.go:291] DeviceTwin receive msg
I0106 22:37:33.982890    3562 process.go:67] Send msg to the CommModule module in twin
I0106 22:37:33.985488    3562 communicate.go:36] receive msg commModule
I0106 22:37:33.986639    3562 communicate.go:91] CONNECTED EVENT
I0106 22:37:33.988865    3562 communicate.go:140] Request detail
I0106 22:37:33.992021    3562 process.go:619] get a message {Header:{ID:9f38c174-ac81-46fa-ab08-a85396b40cb7 ParentID: Timestamp:1578321453976 Sync:false} Router:{Source:edgehub Group:meta Operation:publish Resource:node/connection} Content:cloud_connected}
I0106 22:37:33.994178    3562 process.go:446] node connection event occur: cloud_connected
I0106 22:37:33.996994    3562 servicebus.go:69] ServiceBus receive msg
I0106 22:37:33.999009    3562 process.go:619] get a message {Header:{ID:bc65dda4-de72-41e1-859e-78c9fe0ad05a ParentID: Timestamp:1578321453977 Sync:false} Router:{Source:edgehub Group:meta Operation:publish Resource:node/connection} Content:cloud_connected}
I0106 22:37:34.001320    3562 process.go:446] node connection event occur: cloud_connected
I0106 22:37:34.073531    3562 reconciler.go:150] Reconciler: start to sync state
I0106 22:37:34.228576    3562 util.go:368] Looking for default routes with IPv4 addresses
I0106 22:37:34.233631    3562 util.go:373] Default route transits interface "eth0"
I0106 22:37:34.244158    3562 util.go:182] Interface eth0 is up
I0106 22:37:34.264189    3562 util.go:230] Interface "eth0" has 3 addresses :[192.168.0.139/24 192.168.0.132/24 fe80::61f9:412c:1e9c:a85b/64].
I0106 22:37:34.269703    3562 util.go:198] Checking addr  192.168.0.139/24.
I0106 22:37:34.274042    3562 util.go:205] IP found 192.168.0.139
I0106 22:37:34.278134    3562 util.go:236] Found valid IPv4 address 192.168.0.139 for interface "eth0".
I0106 22:37:34.281560    3562 util.go:379] Found active IP 192.168.0.139 
I0106 22:37:34.318744    3562 edged_status.go:165] Sync VolumesInUse: []
I0106 22:37:34.323359    3562 edged_status.go:391] Attempting to register node edge-node-arm
I0106 22:37:34.338054    3562 process.go:619] get a message {Header:{ID:6b598780-e300-478f-b0e0-43946a2542ff ParentID: Timestamp:1578321454326 Sync:true} Router:{Source:edged Group:meta Operation:update Resource:default/nodestatus/edge-node-arm} Content:{UID:38796d14-1df3-11e8-8e5a-286ed488f209 Status:{Capacity:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:508559360 scale:0} d:{Dec:<nil>} s:485Mi Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Allocatable:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:403701760 scale:0} d:{Dec:<nil>} s: Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Phase:Running Conditions:[{Type:Ready Status:True LastHeartbeatTime:2020-01-06 22:37:34.300513458 +0800 +08 m=+2.567091661 LastTransitionTime:2020-01-06 22:37:34.300513458 +0800 +08 m=+2.567091661 Reason:EdgeReady Message:edge is posting ready status}] Addresses:[{Type:InternalIP Address:192.168.0.139} {Type:Hostname Address:buildroot}] DaemonEndpoints:{KubeletEndpoint:{Port:0}} NodeInfo:{MachineID: SystemUUID: BootID: KernelVersion:4.14.67 OSImage:Buildroot 2018.02.12 ContainerRuntimeVersion:remote://17.5.0 KubeletVersion:v1.15.3-kubeedge-v1.1.0-beta.0.323+52dd841358b292-dirty KubeProxyVersion: OperatingSystem:linux Architecture:arm} Images:[] VolumesInUse:[] VolumesAttached:[] Config:nil} ExtendResources:map[]}}
I0106 22:37:34.377148    3562 metaclient.go:114] send sync message default/nodestatus/edge-node-arm successed and response: {{64727cc3-ae09-42a5-932f-7ba149b6b3aa 6b598780-e300-478f-b0e0-43946a2542ff 1578321454376 false} {edged meta response default/nodestatus/edge-node-arm} OK}
I0106 22:37:34.383941    3562 edged_status.go:394] Successfully registered node edge-node-arm
I0106 22:37:34.412622    3562 edged_status.go:165] Sync VolumesInUse: []
I0106 22:37:34.428004    3562 process.go:619] get a message {Header:{ID:9b603617-6e6d-4d31-a19c-e78b3b2fe60f ParentID: Timestamp:1578321454416 Sync:true} Router:{Source:edged Group:meta Operation:update Resource:default/nodestatus/edge-node-arm} Content:{UID:38796d14-1df3-11e8-8e5a-286ed488f209 Status:{Capacity:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:508559360 scale:0} d:{Dec:<nil>} s:485Mi Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Allocatable:map[cpu:{i:{value:1 scale:0} d:{Dec:<nil>} s:1 Format:DecimalSI} memory:{i:{value:403701760 scale:0} d:{Dec:<nil>} s: Format:BinarySI} pods:{i:{value:110 scale:0} d:{Dec:<nil>} s: Format:DecimalSI}] Phase:Running Conditions:[{Type:Ready Status:True LastHeartbeatTime:2020-01-06 22:37:34.387730835 +0800 +08 m=+2.654308497 LastTransitionTime:2020-01-06 22:37:34.387730835 +0800 +08 m=+2.654308497 Reason:EdgeReady Message:edge is posting ready status}] Addresses:[{Type:InternalIP Address:192.168.0.139} {Type:Hostname Address:buildroot}] DaemonEndpoints:{KubeletEndpoint:{Port:0}} NodeInfo:{MachineID: SystemUUID: BootID: KernelVersion:4.14.67 OSImage:Buildroot 2018.02.12 ContainerRuntimeVersion:remote://17.5.0 KubeletVersion:v1.15.3-kubeedge-v1.1.0-beta.0.323+52dd841358b292-dirty KubeProxyVersion: OperatingSystem:linux Architecture:arm} Images:[] VolumesInUse:[] VolumesAttached:[] Config:nil} ExtendResources:map[]}}
I0106 22:37:34.456074    3562 metaclient.go:114] send sync message default/nodestatus/edge-node-arm successed and response: {{5c5b010a-dae9-4320-8c86-b426faf0a02a 9b603617-6e6d-4d31-a19c-e78b3b2fe60f 1578321454449 false} {edged meta response default/nodestatus/edge-node-arm} OK}
I0106 22:37:34.880375    3562 generic.go:81] GenericLifecycle: Relisting
W0106 22:37:35.396780    3562 proxy.go:76] [L4 Proxy] create Device is failed : operation not supported
I0106 22:37:35.887446    3562 generic.go:81] GenericLifecycle: Relisting
I0106 22:37:36.890632    3562 generic.go:81] GenericLifecycle: Relisting
W0106 22:37:37.449382    3562 proxy.go:76] [L4 Proxy] create Device is failed : operation not supported
I0106 22:37:37.898331    3562 generic.go:81] GenericLifecycle: Relisting
I0106 22:37:38.906629    3562 generic.go:81] GenericLifecycle: Relisting
W0106 22:37:39.483700    3562 proxy.go:76] [L4 Proxy] create Device is failed : operation not supported
I0106 22:37:39.914609    3562 generic.go:81] GenericLifecycle: Relisting
I0106 22:37:40.922371    3562 generic.go:81] GenericLifecycle: Relisting
W0106 22:37:41.541183    3562 proxy.go:76] [L4 Proxy] create Device is failed : operation not supported
I0106 22:37:41.928450    3562 generic.go:81] GenericLifecycle: Relisting
I0106 22:37:42.932460    3562 generic.go:81] GenericLifecycle: Relisting
W0106 22:37:43.597142    3562 proxy.go:76] [L4 Proxy] create Device is failed : operation not supported

三、容器等

节点状态：

1
2
3
4
# kubectl get nodes
NAME        STATUS   ROLES    AGE   VERSION
edge-node   Ready    edge     23s   v1.15.3-kubeedge-v1.1.0
ubuntu      Ready    master   16h   v1.17.0

运行的 pod：

1
2
3
4
5
6
7
8
9
10
# kubectl get pods -o wide -n kube-system
NAME                             READY   STATUS    RESTARTS   AGE   IP              NODE     NOMINATED NODE   READINESS GATES
coredns-9d85f5447-fwmgd          1/1     Running   2          17h   10.244.0.2      ubuntu   <none>           <none>
coredns-9d85f5447-rxnlp          1/1     Running   2          17h   10.244.0.3      ubuntu   <none>           <none>
etcd-ubuntu                      1/1     Running   0          17h   192.168.0.102   ubuntu   <none>           <none>
kube-apiserver-ubuntu            1/1     Running   0          17h   192.168.0.102   ubuntu   <none>           <none>
kube-controller-manager-ubuntu   1/1     Running   2          17h   192.168.0.102   ubuntu   <none>           <none>
kube-flannel-ds-amd64-pqqx6      1/1     Running   1          16h   192.168.0.102   ubuntu   <none>           <none>
kube-proxy-48qgf                 1/1     Running   0          17h   192.168.0.102   ubuntu   <none>           <none>
kube-scheduler-ubuntu            1/1     Running   2          17h   192.168.0.102   ubuntu   <none>           <none>

部署的应用：

1
2
3
# kubectl get pods -o wide
NAME                                READY   STATUS    RESTARTS   AGE     IP       NODE        NOMINATED NODE   READINESS GATES
nginx-deployment-77698bff7d-bwc94   1/1     Running   1          8m56s   <none>   edge-node   <none>           <none>

边缘节点：

1
2
3
4
# docker ps
CONTAINER ID        IMAGE                COMMAND                  CREATED             STATUS              PORTS                NAMES
882570ac2dec        53f3fd8007f7         "nginx -g 'daemon of…"   7 seconds ago       Up 6 seconds                             k8s_nginx_nginx-deployment-77698bff7d-bwc94_default_4b4cdbcd-fcae-45d4-abb2-46ddd5c3c41e_1
183903d7816f        kubeedge/pause:3.1   "/pause"                 7 seconds ago       Up 6 seconds        0.0.0.0:80->80/tcp   k8s_POD_nginx-deployment-77698bff7d-bwc94_default_4b4cdbcd-fcae-45d4-abb2-46ddd5c3c41e_6

IP地址：

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
# ifconfig 
docker0   Link encap:Ethernet  HWaddr 02:42:97:33:4c:d5  
          inet addr:172.17.0.1  Bcast:172.17.255.255  Mask:255.255.0.0
          inet6 addr: fe80::42:97ff:fe33:4cd5/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:84 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:9352 (9.3 KB)

ens33     Link encap:Ethernet  HWaddr 00:0c:29:96:3c:7a  
          inet addr:192.168.0.140  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::b4fb:5f6a:6040:dcda/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1624614 errors:0 dropped:0 overruns:0 frame:0
          TX packets:758174 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:282906209 (282.9 MB)  TX bytes:212322343 (212.3 MB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:3062 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3062 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1 
          RX bytes:250888 (250.8 KB)  TX bytes:250888 (250.8 KB)

vethe3f407d Link encap:Ethernet  HWaddr da:10:e4:bf:22:9f  
          inet6 addr: fe80::d810:e4ff:febf:229f/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:122 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:13572 (13.5 KB)

四、1.3 版本
云端首次运行，创建token：

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
I0601 23:35:27.905595   15352 server.go:59] Version: v1.3.0-beta.0.49+5bfca35b2d99a5-dirty
I0601 23:35:27.908118   15352 module.go:34] Module cloudhub registered successfully
I0601 23:35:27.908781   15352 module.go:34] Module edgecontroller registered successfully
I0601 23:35:27.909554   15352 module.go:34] Module devicecontroller registered successfully
I0601 23:35:27.940771   15352 module.go:34] Module synccontroller registered successfully
W0601 23:35:27.941622   15352 module.go:37] Module cloudStream is disabled, do not register
I0601 23:35:27.943248   15352 core.go:24] Starting module cloudhub
I0601 23:35:27.944870   15352 core.go:24] Starting module edgecontroller
I0601 23:35:27.950256   15352 core.go:24] Starting module devicecontroller
I0601 23:35:27.967710   15352 upstream.go:96] start upstream controller
I0601 23:35:27.974674   15352 core.go:24] Starting module synccontroller
I0601 23:35:27.980514   15352 downstream.go:796] Start downstream devicecontroller
I0601 23:35:28.408942   15352 downstream.go:430] start downstream controller
I0601 23:35:28.461465   15352 server.go:201] Ca and CaKey don't exist in local directory, and will read from the secret
I0601 23:35:28.476102   15352 server.go:205] Ca and CaKey don't exist in the secret, and will be created by CloudCore
I0601 23:35:28.550280   15352 server.go:249] CloudCoreCert and key don't exist in local directory, and will read from the secret
I0601 23:35:28.567889   15352 server.go:253] CloudCoreCert and key don't exist in the secret, and will be signed by CA
I0601 23:35:28.622531   15352 cloudhub.go:77] LL DEBUG Will generateToken....
I0601 23:35:28.667324   15352 signcerts.go:101] Succeed to creating token

再次运行：

1
I0602 00:20:15.017250   23568 signcerts.go:101] Succeed to creating token

第一次跑，tokensecret 值：

1
2
3
4
5
kubectl get secret tokensecret -n kubeedge -oyaml
apiVersion: v1
data:
  tokendata: ZWE1NDg3YWNhYjZlMWEwNmE2OGI5OTNkOTMxNGVlMzA5OTg2YzJkM2MyOTkzMmNlNGI2NTE2MzI0NzljMDlhOC5leUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKbGVIQWlPakUxT1RFeE1USXhNamg5LlVoUHBBdnR6YmhMZkcycUNaZmtqX3Zoak9qbEw5VEFQdElGWkJQTlpuZ0E=
kind: Secret

第二次跑，tokensecret 值：

1
2
3
4
5
kubectl get secret tokensecret -n kubeedge -oyaml
apiVersion: v1
data:
  tokendata: ZWE1NDg3YWNhYjZlMWEwNmE2OGI5OTNkOTMxNGVlMzA5OTg2YzJkM2MyOTkzMmNlNGI2NTE2MzI0NzljMDlhOC5leUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKbGVIQWlPakUxT1RFeE1UUTRNVFI5LkVnSDUxWVA0Q0tTSEZXTDJWdG1mYkhGU3ZsTWZxbWlrd1pYbXFsLU84SGM=
kind: Secret

两次 token 值：

1
2
3
ea5487acab6e1a06a68b993d9314ee309986c2d3c29932ce4b651632479c09a8.eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE1OTExMTIxMjh9.UhPpAvtzbhLfG2qCZfkj_vhjOjlL9TAPtIFZBPNZngA

ea5487acab6e1a06a68b993d9314ee309986c2d3c29932ce4b651632479c09a8.eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE1OTExMTQ4MTR9.EgH51YP4CKSHFWL2VtmfbHFSvlMfqmikwZXmql-O8Hc

注：以点号.为界限，只有最后一部分是变化的，程序应该只判断前面部分（仅猜测）。

运行pod，停止边缘端程序。约半分钟，检测到变化并更新状态。

1
2
3
4
# kubectl get nodes
NAME                 STATUS     ROLES        AGE   VERSION
latelee-18.30        NotReady   agent,edge   34m   v1.17.1-kubeedge-v1.3.0-beta.0.49+5bfca35b2d99a5-dirty
latelee-virtualbox   Ready      master       25h   v1.17.3

但是等待2分钟，pod状态依然为 Running：

1
2
3
kubectl get pod 
NAME                                READY   STATUS    RESTARTS   AGE
nginx-deployment-77698bff7d-wmqfx   1/1     Running   0          2m20s