Verified on v1.3.x-head 20230517

longhorn v1.3.x-head (5adcc7f)
longhorn-manager v1.3.x-head (d935d18)

The test steps

#5809 (comment)

Result Passed

The instance-manager-r pod no longer waits for 1 minute to update its status after restarting the node.

ryao@ryao-laptop:~/Downloads/test-record> kubetail instance-manager-r
Found:  instance-manager-r-ca87b80d7151aa49219c3c789fb37c09
Found:  instance-manager-r-cfb4345cfbbb8af7d6d6a33e62274299
instance-manager-r-cfb4345cfbbb8af7d6d6a33e62274299 Starting Stream
instance-manager-r-ca87b80d7151aa49219c3c789fb37c09 Starting Stream
[vol-0-r-c5a5f4af] time="2023-05-17T10:16:39Z" level=info msg="Prune overlapping chunks from volume-snap-0238eeae-54a5-45f4-b6c3-c52ada40448d.img based on volume-head-004.img"
[vol-0-r-f68ad194] time="2023-05-17T10:16:39Z" level=info msg="Prune overlapping chunks from volume-snap-0238eeae-54a5-45f4-b6c3-c52ada40448d.img based on volume-head-004.img"
[vol-0-r-f68ad194] time="2023-05-17T10:16:39Z" level=info msg="Prepare removing disk: 0238eeae-54a5-45f4-b6c3-c52ada40448d"
instance-manager-r-cfb4345cfbbb8af7d6d6a33e62274299 EOF

[vol-0-r-c5a5f4af] time="2023-05-17T10:16:39Z" level=info msg="Prepare removing disk: 0238eeae-54a5-45f4-b6c3-c52ada40448d"
[longhorn-instance-manager] time="2023-05-17T10:19:41Z" level=info msg="Process Manager: got logs for process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:41Z" level=info msg="Process Manager: start getting logs for process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: prepare to delete process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: deleted process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: prepare to delete process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Wait for process vol-0-r-f68ad194 to shutdown"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: trying to stop process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: deleted process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: successfully unregistered process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: successfully unregistered process vol-0-r-f68ad194"
[longhorn-instance-manager] time="2023-05-17T10:19:46Z" level=info msg="Process Manager: process vol-0-r-f68ad194 stopped"
time="2023-05-17T10:19:46Z" level=warning msg="Starting to execute registered shutdown func github.com/longhorn/longhorn-engine/app/cmd.startReplica.func4"

ryao@ryao-laptop:~/Downloads/test-record> kubectl get -n longhorn-system lhim instance-manager-r-cfb4345cfbbb8af7d6d6a33e62274299 -w -o jsonpath='{"instance-manager "}{.status.currentState}{" "}{.status.ip}{"   vol-0-r-c5a5f4af "}{.status.instances.vol-0-r-c5a5f4af.status.state}{" "}{.status.instances.vol-0-r-c5a5f4af.status.portStart}{"\n"}'
instance-manager running 10.42.1.68   vol-0-r-c5a5f4af running 10000
instance-manager running 10.42.1.68   vol-0-r-c5a5f4af running 10000
instance-manager unknown 10.42.1.68   vol-0-r-c5a5f4af running 10000
instance-manager unknown 10.42.1.68   vol-0-r-c5a5f4af running 10000
instance-manager error 10.42.1.68   vol-0-r-c5a5f4af  
instance-manager starting 10.42.1.68   vol-0-r-c5a5f4af  
instance-manager running 10.42.1.90   vol-0-r-c5a5f4af  
instance-manager running 10.42.1.90   vol-0-r-c5a5f4af  
instance-manager running 10.42.1.90   vol-0-r-c5a5f4af running 10000

longhorn-support-bundle_05212ffa-0e27-43e0-b276-250707e989b8_2023-05-17T10-37-55Z.zip

[BACKPORT][v1.3.4][BUG] Instance manager may not update instance status for a minute after starting #5828

Description

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions