This repository has been archived by the owner on Oct 25, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 211
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Signed-off-by: Wenxin Zhang <wenxin.zhang@intel.com>
- Loading branch information
1 parent
4038579
commit f34b97f
Showing
4 changed files
with
41 additions
and
19 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,17 +1,29 @@ | ||
# CI Introduction | ||
Intel Extension for Transformers use Github Action (GHA) for CI test, if you are new to GHA, please refer to [GHA](https://docs.github.com/en/actions) | ||
All the test scripts will be maintained under [.github](../.github/workflows). | ||
|
||
|
||
Generally We use [Azure Cloud](https://azure.microsoft.com/en-us/pricing/purchase-options/pay-as-you-go) to deploy CI on Es-v5, Bas-v2. | ||
|
||
| Test Name | Test Pass Criteria | Checks | | ||
|
||
| Test Name | Test Scope | Test Pass Criteria | | ||
|-------------------------------|-----------------------------------------------|---------------| | ||
| Format Scan | Pylint/Cpplint/bandit/cloc Pass | 4 | | ||
| Spell Check | Check Pass | 1 | | ||
| Copyright Check | Add License on top of code/scripts | 1 | | ||
| DCO | Use git commit -s to signoff | 1 | | ||
| Unit Test | a. No failure, no core dump, no segmentation fault b. No coverage drop| 5 | | ||
| Kernel Benchmark | No failure, No performance regression | 1 | | ||
| Model Test | a. Fp32/Int8 inference no regression b. API no fucntionality success | 5 | | ||
| CPP Graph Test | No failure, No performance regression | 1 | | ||
| Format Scan | Pylint/Cpplint/bandit/cloc/clangformat Pass | PASS | | ||
| Spell Check | Spelling Check | PASS | | ||
| Copyright Check | Copyright Check | PASS | | ||
| [DCO](https://github.com/apps/dco/) | Use git commit -s to sign off | PASS | | ||
| Unit Test | pytest + coverage + gtest | PASS(No failure, No core dump, No segmentation fault, No coverage drop) | | ||
| Kernel Benchmark | Benchmark [Details](../intel_extension_for_transformers/backends/neural_engine/test/kernels/benchmark) | PASS(No performance regression) | | ||
| Model Test | Pytorch + Tensorflow + Neural Engine + IPEX + CPP Graph | PASS(FP32/INT8 No performance regression) | | ||
|
||
# FAQ | ||
1. How to add examples | ||
|
||
(1) Still need to pass detected CI tests | ||
|
||
(2) Use [Extension Test](https://inteltf-jenk.sh.intel.com/view/nlp-toolkit-validation/job/nlp-toolkit-validation-top-mr-extension/) to cover new examples. If you do not have permission for extension test, please contact [Maintainers](inc.maintainers@intel.com) | ||
|
||
|
||
2. How to test specific component version | ||
|
||
(1) Use [Extension Test](https://inteltf-jenk.sh.intel.com/view/nlp-toolkit-validation/job/nlp-toolkit-validation-top-mr-extension/) to specify the version. If you do not have permission for extension test, please contact [Maintainers](inc.maintainers@intel.com) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters