[VS] fabric testcase is failing with errors

[lolyu]

test_fabric.py::TestVirtualChassis::test_voq_switch errored in branch 202205:

test_fabric.py::TestVirtualChassis::test_voq_switch ERROR                [ 23%]

Please refer to this dummy PR for more details: #2566

[lolyu]

This error is consistently failing on 202205 branch:

test_voq_switch failed (1 runs remaining out of 2).
	<class 'AssertionError'>
	Operation timed out after 60 seconds with result {'arp_update': 'STOPPED', 'bgpd': 'STOPPED', 'buffermgrd': 'RUNNING', 'coppmgrd': 'RUNNING', 'fdbsyncd': 'RUNNING', 'fpmsyncd': 'RUNNING', 'gbsyncd': 'STOPPED', 'gearsyncd': 'STOPPED', 'intfmgrd': 'RUNNING', 'natmgrd': 'RUNNING', 'natsyncd': 'RUNNING', 'nbrmgrd': 'RUNNING', 'neighsyncd': 'RUNNING', 'orchagent': 'EXITED', 'portmgrd': 'RUNNING', 'portsyncd': 'RUNNING', 'redis-chassis': 'RUNNING', 'redis-server': 'RUNNING', 'restore_neighbors': 'STOPPED', 'rsyslogd': 'RUNNING', 'sflowmgrd': 'RUNNING', 'start.sh': 'EXITED', 'staticd': 'RUNNING', 'syncd': 'RUNNING', 'teammgrd': 'RUNNING', 'teamsyncd': 'RUNNING', 'tunnelmgrd': 'RUNNING', 'vlanmgrd': 'RUNNING', 'vrfmgrd': 'RUNNING', 'vxlanmgrd': 'RUNNING', 'zebra': 'RUNNING'}
	[<TracebackEntry /agent/_work/1/s/tests/conftest.py:1823>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:1410>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:1505>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:1565>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:406>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:460>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:498>, <TracebackEntry /agent/_work/1/s/tests/dvslib/dvs_common.py:60>]
test_voq_switch failed; it passed 0 out of the required 1 times.
	<class 'AssertionError'>
	Operation timed out after 60 seconds with result {'arp_update': 'STOPPED', 'bgpd': 'STOPPED', 'buffermgrd': 'RUNNING', 'coppmgrd': 'RUNNING', 'fdbsyncd': 'RUNNING', 'fpmsyncd': 'RUNNING', 'gbsyncd': 'STOPPED', 'gearsyncd': 'STOPPED', 'intfmgrd': 'RUNNING', 'natmgrd': 'RUNNING', 'natsyncd': 'RUNNING', 'nbrmgrd': 'RUNNING', 'neighsyncd': 'RUNNING', 'orchagent': 'EXITED', 'portmgrd': 'RUNNING', 'portsyncd': 'RUNNING', 'redis-chassis': 'RUNNING', 'redis-server': 'RUNNING', 'restore_neighbors': 'STOPPED', 'rsyslogd': 'RUNNING', 'sflowmgrd': 'RUNNING', 'start.sh': 'EXITED', 'staticd': 'RUNNING', 'syncd': 'RUNNING', 'teammgrd': 'RUNNING', 'teamsyncd': 'RUNNING', 'tunnelmgrd': 'RUNNING', 'vlanmgrd': 'RUNNING', 'vrfmgrd': 'RUNNING', 'vxlanmgrd': 'RUNNING', 'zebra': 'RUNNING'}
	[<TracebackEntry /usr/local/lib/python3.8/dist-packages/six.py:718>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:1823>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:1410>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:1505>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:1565>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:406>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:460>, <TracebackEntry /agent/_work/1/s/tests/conftest.py:498>, <TracebackEntry /agent/_work/1/s/tests/dvslib/dvs_common.py:60>]
test_nonflaky_dummy passed 1 out of the required 1 times. Success!

[prsunny]

@arlakshm , can you please take a look? Seems blocking 202205 PRs.

[judyjoseph]

@lolyu, in your dummy PR: #2566, My observation is that I see that the sonic-swss build is not successful because the dependent the sairedis pkg download is failing. Bellow is the link

https://dev.azure.com/mssonic/build/_build/results?buildId=189338&view=logs&jobId=80130f07-32fc-5c19-809b-35051dcc5ef5&j=80130f07-32fc-5c19-809b-35051dcc5ef5&t=9220db1c-94e3-516e-bb9d-5e982f91f3ea

It fails with the error "##[error]No builds currently exist in the pipeline definition supplied." We need to fix this to get the correct sonic-swss package which will be installed later in docker-sonic-vs which is being build in the pipeline.

[judyjoseph]

Checked with @xumia , created another issue sonic-net/sonic-sairedis#1178 for @kcudnik to take a look.

Once this is fixed we should have a sairedis build and a sonic-swss build in 202205, which should should solve this original issue

[judyjoseph]

Sai has fixed this issue in master sonic-net/sonic-sairedis#1174, Needs to be backported to different branches, adding @yxieca for 202205 branch

[bingwang-ms]

The issue is fixed by PR sonic-net/sonic-sairedis#1189. Closing this issue