-
Notifications
You must be signed in to change notification settings - Fork 54
How to use the “Add data from other (automated) tests” functionality
This is documentation for the “Add data from other (automated) tests” function in “Step 4: Audit the Selected Sample” of the WCAG-EM Report Tool. Currently this function is experimental and works only partially depending on the automated tools used. It demonstrates how results from automated tests can be imported into reports.
- Select a sample of web pages you want to evaluated in Step 3
- Select "Import data" button in Step 4, to select a data file
- Select data file from automated tool in EARL/JSON-LD format
- Results from the data file are added to corresponding pages
- Review and edit these automatically-generated test results
The function relies on assertions in EARL/JSON-LD format. Each assertion expresses the result from carrying out a particular test on a particular page. The function compares each assertion to the sample selected by the evaluator in Step 3 of the WCAG-EM Report Tool. If there is an assertion for a web page in the selected sample and this assertion matches one of the WCAG Success Criteria, then the result is added in the outcome and observations in Step 4 of the WCAG-EM Report Tool.
Currently only few automated tools provide test results in the required EARL/JSON-LD format but we hope these examples will increase over time. Most importantly, tools tend to express results on the individual test rules they carried out rather than on the WCAG Success Criteria directly. WCAG-EM Report Tool cannot match such results without further information on how they map to WCAG Success Criteria.
Currently the import function is fairly rudimentary. Future improvements could including comparing existing results in the WCAG-EM Report Tool before adding (and potentially overriding) results, comparing the selected sample and proposing additional pages to be added to the sample, and inferring conclusions on the overall sample based on individual results found in the data.