Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

After warm reboot, execution of sudo config reload -y does not restart syncd #2435

Closed
stepanblyschak opened this issue Jan 11, 2019 · 1 comment
Assignees

Comments

@stepanblyschak
Copy link
Collaborator

Description
After warm reboot, execution of sudo config reload -y does not restart syncd

Steps to reproduce the issue:

  1. sudo warm-reboot
  2. sudo config reload -y
  3. syncd restart count is same as before sudo config reload -y

Describe the results you received:

admin@mts-sonic-dut:~$ sudo warm-reboot -v
Fri Jan 11 02:21:34 UTC 2019 Prepare MLNX ASIC to fastfast-reboot: install new FW if required
Mellanox firmware is up to date
Fri Jan 11 02:21:36 UTC 2019 Pausing orchagent ...
Fri Jan 11 02:21:37 UTC 2019 Stopping bgp ...
Fri Jan 11 02:21:38 UTC 2019 Stopped bgp ...
Fri Jan 11 02:21:40 UTC 2019 Initialize pre-shutdown ...
Fri Jan 11 02:21:42 UTC 2019 Requesting pre-shutdown ...
Fri Jan 11 02:21:42 UTC 2019 Waiting for pre-shutdown ...
Fri Jan 11 02:21:45 UTC 2019 Pre-shutdown succeeded ...
Fri Jan 11 02:21:47 UTC 2019 Backing up database ...
Fri Jan 11 02:21:48 UTC 2019 Stopping teamd ...
Fri Jan 11 02:21:48 UTC 2019 Stopped teamd ...
Fri Jan 11 02:21:48 UTC 2019 Stopping syncd ...
Fri Jan 11 02:22:11 UTC 2019 Stopped syncd ...
Fri Jan 11 02:22:14 UTC 2019 Rebooting with /sbin/reboot to SONiC-OS-develop.0-796e373 ...
Write failed: Broken pipe



admin@mts-sonic-dut:~$ show warm_restart state
name             restore_count  state
-------------  ---------------  ----------------------
neighsyncd                   6  reconciled
vlanmgrd                     6
orchagent                    6  reconciled
teamsyncd                    6
bgp                          6  reconciled
warm-shutdown                0  pre-shutdown-succeeded
teammgrd                     6
portsyncd                    6
syncd                        6




admin@mts-sonic-dut:~$ show warm_restart config
name    enable    timer_name    timer_duration
------  --------  ------------  ----------------
system  true      NULL          NULL

admin@mts-sonic-dut:~$ sudo config reload -y
Running command: systemctl stop dhcp_relay
Running command: systemctl stop swss
Running command: systemctl stop snmp
Warning: Stopping snmp.service, but it can still be activated by:
  snmp.timer
Running command: systemctl stop lldp
Running command: systemctl stop pmon
Running command: systemctl stop bgp
Running command: systemctl stop teamd
Running command: /usr/local/bin/sonic-cfggen -j /etc/sonic/config_db.json --write-to-db
Running command: systemctl restart hostname-config
Running command: systemctl restart interfaces-config
Running command: systemctl restart ntp-config
Running command: systemctl restart rsyslog-config
Running command: systemctl restart swss
Running command: systemctl restart bgp
Running command: systemctl restart teamd
Running command: systemctl restart pmon
Running command: systemctl restart lldp
Running command: systemctl restart snmp
Running command: systemctl restart dhcp_relay
admin@mts-sonic-dut:~$ show warm_restart state
name             restore_count  state
-------------  ---------------  ----------------------
neighsyncd                   0  reconciled
vlanmgrd                     0
orchagent                    0  reconciled
teamsyncd                    0
bgp                          0  reconciled
warm-shutdown                0  pre-shutdown-succeeded
teammgrd                     0
portsyncd                    0
syncd                        6


Describe the results you expected:

admin@mts-sonic-dut:~$ sudo warm-reboot -v
Fri Jan 11 02:21:34 UTC 2019 Prepare MLNX ASIC to fastfast-reboot: install new FW if required
Mellanox firmware is up to date
Fri Jan 11 02:21:36 UTC 2019 Pausing orchagent ...
Fri Jan 11 02:21:37 UTC 2019 Stopping bgp ...
Fri Jan 11 02:21:38 UTC 2019 Stopped bgp ...
Fri Jan 11 02:21:40 UTC 2019 Initialize pre-shutdown ...
Fri Jan 11 02:21:42 UTC 2019 Requesting pre-shutdown ...
Fri Jan 11 02:21:42 UTC 2019 Waiting for pre-shutdown ...
Fri Jan 11 02:21:45 UTC 2019 Pre-shutdown succeeded ...
Fri Jan 11 02:21:47 UTC 2019 Backing up database ...
Fri Jan 11 02:21:48 UTC 2019 Stopping teamd ...
Fri Jan 11 02:21:48 UTC 2019 Stopped teamd ...
Fri Jan 11 02:21:48 UTC 2019 Stopping syncd ...
Fri Jan 11 02:22:11 UTC 2019 Stopped syncd ...
Fri Jan 11 02:22:14 UTC 2019 Rebooting with /sbin/reboot to SONiC-OS-develop.0-796e373 ...
Write failed: Broken pipe



admin@mts-sonic-dut:~$ show warm_restart state
name             restore_count  state
-------------  ---------------  ----------------------
neighsyncd                   6  reconciled
vlanmgrd                     6
orchagent                    6  reconciled
teamsyncd                    6
bgp                          6  reconciled
warm-shutdown                0  pre-shutdown-succeeded
teammgrd                     6
portsyncd                    6
syncd                        6




admin@mts-sonic-dut:~$ show warm_restart config
name    enable    timer_name    timer_duration
------  --------  ------------  ----------------
system  true      NULL          NULL

admin@mts-sonic-dut:~$ sudo config reload -y
Running command: systemctl stop dhcp_relay
Running command: systemctl stop swss
Running command: systemctl stop snmp
Warning: Stopping snmp.service, but it can still be activated by:
  snmp.timer
Running command: systemctl stop lldp
Running command: systemctl stop pmon
Running command: systemctl stop bgp
Running command: systemctl stop teamd
Running command: /usr/local/bin/sonic-cfggen -j /etc/sonic/config_db.json --write-to-db
Running command: systemctl restart hostname-config
Running command: systemctl restart interfaces-config
Running command: systemctl restart ntp-config
Running command: systemctl restart rsyslog-config
Running command: systemctl restart swss
Running command: systemctl restart bgp
Running command: systemctl restart teamd
Running command: systemctl restart pmon
Running command: systemctl restart lldp
Running command: systemctl restart snmp
Running command: systemctl restart dhcp_relay
admin@mts-sonic-dut:~$ show warm_restart state
name             restore_count  state
-------------  ---------------  ----------------------
neighsyncd                   0 
vlanmgrd                     0
orchagent                    0 
teamsyncd                    0
bgp                          0  
warm-shutdown                0 
teammgrd                     0
portsyncd                    0
syncd                        0


Additional information you deem important (e.g. issue happens only occasionally):

**Output of `show version`:**

```

admin@mts-sonic-dut:~$ show version
SONiC Software Version: SONiC.HEAD.851-ae19072
Distribution: Debian 9.6
Kernel: 4.9.0-8-amd64
Build commit: ae19072
Build date: Thu Jan 10 13:38:03 UTC 2019
Built by: johnar@jenkins-worker-4

Docker images:
REPOSITORY TAG IMAGE ID SIZE
docker-orchagent-mlnx HEAD.851-ae19072 8d140c496132 283MB
docker-orchagent-mlnx latest 8d140c496132 283MB
docker-syncd-mlnx HEAD.851-ae19072 a213970fff70 362MB
docker-syncd-mlnx latest a213970fff70 362MB
docker-lldp-sv2 HEAD.851-ae19072 88e04cc413aa 271MB
docker-lldp-sv2 latest 88e04cc413aa 271MB
docker-dhcp-relay HEAD.851-ae19072 9ad9c92cfed1 253MB
docker-dhcp-relay latest 9ad9c92cfed1 253MB
docker-database HEAD.851-ae19072 c7d90e7cf9a5 252MB
docker-database latest c7d90e7cf9a5 252MB
docker-teamd HEAD.851-ae19072 6016d67e11bb 271MB
docker-teamd latest 6016d67e11bb 271MB
docker-snmp-sv2 HEAD.851-ae19072 bf1d0c23e38b 291MB
docker-snmp-sv2 latest bf1d0c23e38b 291MB
docker-router-advertiser HEAD.851-ae19072 2080fd94a218 250MB
docker-router-advertiser latest 2080fd94a218 250MB
docker-platform-monitor HEAD.851-ae19072 cdf68adb5a22 284MB
docker-platform-monitor latest cdf68adb5a22 284MB
docker-fpm-quagga HEAD.851-ae19072 86069e9d8eb3 278MB
docker-fpm-quagga latest 86069e9d8eb3 278MB
```

@xinliu-seattle xinliu-seattle self-assigned this Feb 7, 2019
@yxieca yxieca assigned yxieca and unassigned xinliu-seattle Feb 7, 2019
@yxieca
Copy link
Contributor

yxieca commented Sep 12, 2019

This issue was addressed by #2715

@yxieca yxieca closed this as completed Sep 12, 2019
theasianpianist added a commit to theasianpianist/sonic-buildimage that referenced this issue Sep 2, 2022
Introduce following commits:

- eedf59d [intfmgr]: Enable `accept_untracked_na` kernel param (sonic-net#2439)
- bbd4eb7 [BFD]Clean up state_db BFD entries on swss restart (sonic-net#2434) (sonic-net#2435)
- aa7b546 [FDB] [202012] Fix fbdorch to properly handle syncd FDB FLUSH Notif (sonic-net#2401)
- 4190c13 Support for platforms based on Clounix Networks' device (sonic-net#2399)

Signed-off-by: Lawrence Lee <lawlee@microsoft.com>
theasianpianist added a commit that referenced this issue Sep 3, 2022
Include following new kernel commits:
- 815cb34 [patch]: Add accept_untracked_na kernel param (#291)
- fbb76cc Remove kernel config SERIAL_8250_RUNTIME_UARTS (#286)

Introduce following SWSS commits:
- eedf59d [intfmgr]: Enable `accept_untracked_na` kernel param (#2439)
- bbd4eb7 [BFD]Clean up state_db BFD entries on swss restart (#2434) (#2435)
- aa7b546 [FDB] [202012] Fix fbdorch to properly handle syncd FDB FLUSH Notif (#2401)
- 4190c13 Support for platforms based on Clounix Networks' device (#2399)

Signed-off-by: Lawrence Lee <lawlee@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants