Test Design of TestCase Label

The Design of Label Mechanism of Test Case

The Label of test case is used to filter case conveniently.

The Usage

The labels can be added into test case by below way:

start:test_case_name
description: The description of current case 
os:Linux
hcp:openbmc
label:label1,label2,label3,.....
.....
end

Suppose in future developer/FVT can filter expected case list by below way:

# xcattst -s (label1 and label2) or (label3 and label4) or (! label5)

Label Mechanism

There are two primary dimensions of labels, ones are vertical dimension labels that decides the running order of cases, ones are horizontal dimension labels that decides the category of cases.

Vertical Dimension Labels

level	Label name
1	xcat_install
-------	-----------
2	mn_only
-------	-----------
3	sn_diskful
	sn_diskless
-------	-----------
4	flat_cn_diskful
	flat_cn_diskless
	hierarchy_cn_diskful
	hierarchy_cn_diskless
-------	-----------
5	cn_bmc_ready
	cn_os_ready
-------	-----------
6	others

Horizontal Dimension Labels

db,xcatd, hctrl_gen,hctrl_hmc,hctrl_fsp,hctrl_ipmi,hctrl_openbmc provision,go-xcat,statelite invoke_provison``

console, discovery docker GPU KIT migration network postscripts restapi Switch PDU HA

go-coserver dhcp dns IB packaging parallel_cmds scaling security updatenode file-sync xcatprobe cumulus virtualization firmware performance