Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add tests for computed label #41463

Merged
merged 35 commits into from
Nov 13, 2023

Update to use latest version aria-utils.js from main branch

e23a35f
Select commit
Loading
Failed to load commit list.
Merged

Add tests for computed label #41463

Update to use latest version aria-utils.js from main branch
e23a35f
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-chrome-dev-results succeeded Nov 13, 2023 in 3m 2s

Community-TC (pull_request)

Collect results for all tests affected by a pull request in chrome.

Details

View task in Taskcluster
View logs in Taskcluster

WPT Command: python3 ./wpt run --channel=dev --no-fail-on-unexpected --log-wptreport=../artifacts/wpt_report.json --log-wptscreenshot=../artifacts/wpt_screenshot.txt --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --no-headless --verify-log-full --enable-swiftshader chrome

Setting default value
Failed to read: session.screen0.showwindowposition
Setting default value
Failed to read: session.screen0.autoRaise
Setting default value
Failed to read: session.screen0.clickRaises
Setting default value
Failed to read: session.screen0.defaultDeco
Setting default value
Failed to read: session.screen0.tab.placement
Setting default value
Failed to read: session.screen0.windowMenu
Setting default value
Failed to read: session.screen0.noFocusWhileTypingDelay
Setting default value
Failed to read: session.screen0.workspaces
Setting default value
Failed to read: session.screen0.edgeSnapThreshold
Setting default value
Failed to read: session.screen0.window.focus.alpha
Setting default value
Failed to read: session.screen0.window.unfocus.alpha
Setting default value
Failed to read: session.screen0.menu.alpha
Setting default value
Failed to read: session.screen0.menuDelay
Setting default value
Failed to read: session.screen0.tab.width
Setting default value
Failed to read: session.screen0.tooltipDelay
Setting default value
Failed to read: session.screen0.allowRemoteActions
Setting default value
Failed to read: session.screen0.clientMenu.usePixmap
Setting default value
Failed to read: session.screen0.tabs.usePixmap
Setting default value
Failed to read: session.screen0.tabs.maxOver
Setting default value
Failed to read: session.screen0.tabs.intitlebar
Setting default value
Failed to read: session.screen0.focusModel
Setting default value
Failed to read: session.screen0.tabFocusModel
Setting default value
Failed to read: session.screen0.focusNewWindows
Setting default value
Failed to read: session.screen0.focusSameHead
Setting default value
Failed to read: session.screen0.rowPlacementDirection
Setting default value
Failed to read: session.screen0.colPlacementDirection
Setting default value
Failed to read: session.screen0.windowPlacement
Setting default value
Failed to read: session.screen0.slit.acceptKdeDockapps
Setting default value
Failed to read: session.screen0.slit.autoHide
Setting default value
Failed to read: session.screen0.slit.maxOver
Setting default value
Failed to read: session.screen0.slit.placement
Setting default value
Failed to read: session.screen0.slit.alpha
Setting default value
Failed to read: session.screen0.slit.onhead
Setting default value
Failed to read: session.screen0.slit.layer
Setting default value
Failed to read: session.screen0.toolbar.autoHide
Setting default value
Failed to read: session.screen0.toolbar.maxOver
Setting default value
Failed to read: session.screen0.toolbar.visible
Setting default value
Failed to read: session.screen0.toolbar.alpha
Setting default value
Failed to read: session.screen0.toolbar.layer
Setting default value
Failed to read: session.screen0.toolbar.onhead
Setting default value
Failed to read: session.screen0.toolbar.placement
Setting default value
Failed to read: session.screen0.toolbar.height
Setting default value
Failed to read: session.screen0.iconbar.mode
Setting default value
Failed to read: session.screen0.iconbar.alignment
Setting default value
Failed to read: session.screen0.iconbar.iconWidth
Setting default value
Failed to read: session.screen0.iconbar.iconTextPadding
Setting default value
Failed to read: session.screen0.iconbar.usePixmap
Setting default value
  ERROR: Command errored out with exit status 1:
   command: /home/test/web-platform-tests/_venv3/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-ghshnj1_/mozlog/setup.py'"'"'; __file__='"'"'/tmp/pip-install-ghshnj1_/mozlog/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-qr0_f1_m
       cwd: /tmp/pip-install-ghshnj1_/mozlog/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help
  
  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for mozlog
 0:00.00 INFO Set tests_root to /home/test/web-platform-tests
 0:00.00 INFO Set metadata_root to /home/test/web-platform-tests
 0:00.00 INFO Set manifest_update to True
 0:00.00 INFO Set manifest_download to True
 0:09.67 INFO Identified 1 affected tests
 0:09.78 INFO Downloading Mojo bindings from https://storage.googleapis.com/chrome-wpt-mojom/121.0.6115.2/linux64/mojojs.zip
 0:09.85 INFO MojoJS enabled automatically (mojojs_path: /home/test/web-platform-tests/_venv3/mojojs/gen)
 0:09.88 INFO Searching for ChromeDriver downloads for version 121.0.6115.2.
 0:09.98 INFO Downloading ChromeDriver from https://edgedl.me.gvt1.com/edgedl/chrome/chrome-for-testing/121.0.6115.2/linux64/chromedriver-linux64.zip
 0:10.44 INFO Automatically turning on experimental features for Chrome Dev/Canary or Chromium trunk
 0:16.49 INFO Installed font: Ahem.ttf
 0:17.51 wptserve INFO Starting http server on http://127.0.0.1:8002
 0:17.53 wptserve INFO Starting http server on http://127.0.0.1:8000
 0:17.58 wptserve INFO Starting https server on https://127.0.0.1:8443
 0:17.58 wptserve INFO Starting http server on http://127.0.0.1:8003
 0:17.62 wptserve INFO Starting http server on http://127.0.0.1:8001
 0:17.64 wptserve INFO Starting https server on https://127.0.0.1:8445
 0:17.66 wptserve INFO Starting https server on https://127.0.0.1:8444
 0:17.68 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:17.68 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:17.68 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:17.69 wptserve INFO Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:17.69 wptserve INFO Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:17.69 wptserve INFO Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:17.70 wptserve INFO Starting https server on https://127.0.0.1:8446
 0:17.73 wptserve INFO Starting http2 server on https://127.0.0.1:9000
 0:17.82 wptserve INFO Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:19.33 SUITE_START: web-platform-test - running 1 tests
 0:24.79 INFO Using 1 child processes
 0:25.30 pid:2174 Full command: /home/test/web-platform-tests/_venv3/bin/chrome/chromedriver --port=33313 --url-base=/ --enable-chrome-logs --disable-build-check
pid:2174 Starting ChromeDriver 121.0.6115.2 (e2dc854e936c4a27d4ec3eef3a2a7f7115b1b2fb-refs/branch-heads/6115@{#4}) on port 33313
 0:25.30 pid:2174 Only local connections are allowed.
 0:25.30 pid:2174 Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
 0:25.30 pid:2174 ChromeDriver was started successfully.
 0:25.30 INFO Starting runner
 0:25.62 pid:2174 [2186:2186:1113/193444.376223:WARNING:chrome_main_delegate.cc(668)] This is Chrome version 121.0.6115.2 (not a warning)
 0:25.81 pid:2174 [2186:2186:1113/193444.562291:INFO:policy_logger.cc(144)] :components/enterprise/browser/controller/chrome_browser_cloud_management_controller.cc(168) Starting CBCM Controller Initialization
 0:25.81 pid:2174 [2186:2186:1113/193444.562335:INFO:policy_logger.cc(144)] :components/enterprise/browser/controller/chrome_browser_cloud_management_controller.cc(196) No machine level policy manager exists.
 0:25.87 pid:2174 
 0:25.87 pid:2174 DevTools listening on ws://127.0.0.1:42749/devtools/browser/0f197158-d7a5-4705-8c21-f51f0c753ac1
 0:25.89 pid:2174 [2224:2224:1113/193444.645842:WARNING:gpu_memory_buffer_support_x11.cc(49)] dri3 extension not supported.
 0:25.89 pid:2174 [2224:2224:1113/193444.648973:WARNING:sandbox_linux.cc(400)] InitializeSandbox() called with multiple threads in process gpu-process.
 0:25.96 pid:2174 [2186:2186:1113/193444.709769:WARNING:bluez_dbus_manager.cc(248)] Floss manager not present, cannot set Floss enable/disable.
Failed to read: session.screen0.titlebar.left
Setting default value
Failed to read: session.screen0.titlebar.right
Setting default value
 0:25.97 pid:2174 [1699904084.727][WARNING]: You are using an unsupported command-line switch: --disable-build-check. Please don't report bugs that cannot be reproduced with this switch removed.
 0:25.99 pid:2174 [2186:2299:1113/193444.746506:ERROR:object_proxy.cc(577)] Failed to call method: org.freedesktop.DBus.Properties.Get: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 0:26.00 pid:2174 [2186:2299:1113/193444.746533:WARNING:property.cc(144)] DaemonVersion: GetAndBlock: failed.
 0:26.00 pid:2174 [2186:2299:1113/193444.746778:ERROR:object_proxy.cc(577)] Failed to call method: org.freedesktop.UPower.GetDisplayDevice: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 0:26.00 pid:2174 [2186:2299:1113/193444.747093:ERROR:object_proxy.cc(577)] Failed to call method: org.freedesktop.UPower.EnumerateDevices: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
 0:26.11 TEST_START: /accname/name/comp_label.html
 0:30.38 TEST_END: Test OK. Subtests passed 131/141. Unexpected 10
FAIL label valid on option element - assert_equals: <option aria-label="label" value="foo" data-expectedlabel="label" data-testname="label valid on option element" class="ex">x</option> expected "label" but got "x"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL aria-label undefined on img w/ alt - assert_equals: <img alt="alt" aria-label="undefined" data-expectedlabel="alt" data-testname="aria-label undefined on img w/ alt" class="ex"> expected "alt" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL aria-label undefined on img w/o alt - assert_equals: <img aria-label="undefined" data-expectedlabel="" data-testname="aria-label undefined on img w/o alt" class="ex"> expected "" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL aria-label undefined on img w/ empty alt - assert_equals: <img alt="" aria-label="undefined" data-expectedlabel="" data-testname="aria-label undefined on img w/ empty alt" class="ex"> expected "" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL aria-label undefined on img w/o alt but w/ title - assert_equals: <img aria-label="undefined" data-expectedlabel="title" data-testname="aria-label undefined on img w/o alt but w/ title" class="ex"> expected "title" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL aria-label undefined on img w/ empty alt but w/ title - assert_equals: <img alt="" aria-label="undefined" data-expectedlabel="title" data-testname="aria-label undefined on img w/ empty alt but w/ title" class="ex"> expected "title" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL button's hidden referenced name (visibility:hidden) with hidden aria-labelledby traversal falls back to aria-label - assert_equals: <button aria-labelledby="span4" aria-label="foo" data-expectedlabel="foo" data-testname="button's hidden referenced name (visibility:hidden) with hidden aria-labelledby traversal falls back to aria-label" class="ex">
  <span id="span4">
    <span id="span5" style="visibility:hidden;">label</span>
  </span>
  x
</button> expected "foo" but got "label"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL textarea with tab character as aria-label does not use aria-label as name - assert_equals: <textarea aria-label="  " title="title" data-testname="textarea with tab character as aria-label does not use aria-label as name" data-expectedlabel="title" class="ex">textarea contents</textarea> expected "title" but got ""
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL button with carriage return as aria-label does not use aria-label as name - assert_equals: <button aria-label="
" data-testname="button with carriage return as aria-label does not use aria-label as name" data-expectedlabel="my button" class="ex">my button</button> expected "my button" but got ""
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
FAIL button with space characters as aria-label does not use aria-label as name - assert_equals: <button aria-label="      " data-testname="button with space characters as aria-label does not use aria-label as name" data-expectedlabel="my button" class="ex">my button</button> expected "my button" but got ""
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)

 0:30.38 INFO No more tests
 0:30.38 INFO No more tests
 0:30.39 INFO Closing logging queue
 0:30.39 INFO queue closed
 0:30.45 SUITE_END

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 142 checks (141 subtests, 1 tests)
Expected results: 132
Unexpected results: 10
  subtest: 10 (10 fail)

Unexpected Results
------------------
/accname/name/comp_label.html
  FAIL label valid on option element - assert_equals: <option aria-label="label" value="foo" data-expectedlabel="label" data-testname="label valid on option element" class="ex">x</option> expected "label" but got "x"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL aria-label undefined on img w/ alt - assert_equals: <img alt="alt" aria-label="undefined" data-expectedlabel="alt" data-testname="aria-label undefined on img w/ alt" class="ex"> expected "alt" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL aria-label undefined on img w/o alt - assert_equals: <img aria-label="undefined" data-expectedlabel="" data-testname="aria-label undefined on img w/o alt" class="ex"> expected "" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL aria-label undefined on img w/ empty alt - assert_equals: <img alt="" aria-label="undefined" data-expectedlabel="" data-testname="aria-label undefined on img w/ empty alt" class="ex"> expected "" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL aria-label undefined on img w/o alt but w/ title - assert_equals: <img aria-label="undefined" data-expectedlabel="title" data-testname="aria-label undefined on img w/o alt but w/ title" class="ex"> expected "title" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL aria-label undefined on img w/ empty alt but w/ title - assert_equals: <img alt="" aria-label="undefined" data-expectedlabel="title" data-testname="aria-label undefined on img w/ empty alt but w/ title" class="ex"> expected "title" but got "undefined"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL button's hidden referenced name (visibility:hidden) with hidden aria-labelledby traversal falls back to aria-label - assert_equals: <button aria-labelledby="span4" aria-label="foo" data-expectedlabel="foo" data-testname="button's hidden referenced name (visibility:hidden) with hidden aria-labelledby traversal falls back to aria-label" class="ex">
  <span id="span4">
    <span id="span5" style="visibility:hidden;">label</span>
  </span>
  x
</button> expected "foo" but got "label"
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL textarea with tab character as aria-label does not use aria-label as name - assert_equals: <textarea aria-label="  " title="title" data-testname="textarea with tab character as aria-label does not use aria-label as name" data-expectedlabel="title" class="ex">textarea contents</textarea> expected "title" but got ""
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL button with carriage return as aria-label does not use aria-label as name - assert_equals: <button aria-label="
" data-testname="button with carriage return as aria-label does not use aria-label as name" data-expectedlabel="my button" class="ex">my button</button> expected "my button" but got ""
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
  FAIL button with space characters as aria-label does not use aria-label as name - assert_equals: <button aria-label="      " data-testname="button with space characters as aria-label does not use aria-label as name" data-expectedlabel="my button" class="ex">my button</button> expected "my button" but got ""
    at Test.<anonymous> (http://web-platform.test:8000/wai-aria/scripts/aria-utils.js:154:9)
 0:30.45 INFO Got 1 unexpected results, with 0 unexpected passes
 0:30.45 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 0:30.71 wptserve INFO Stopped http server on 127.0.0.1:8000
 0:30.73 wptserve INFO Stopped http server on 127.0.0.1:8003
 0:30.73 wptserve INFO Stopped http server on 127.0.0.1:8001
 0:30.74 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 0:30.74 wptserve INFO Stopped http server on 127.0.0.1:8443
 0:30.74 wptserve INFO Stopped http server on 127.0.0.1:8002
 0:30.74 wptserve INFO Stopped http server on 127.0.0.1:8445
 0:30.74 wptserve INFO Stopped http server on 127.0.0.1:8444
 0:30.74 wptserve INFO Stopped http server on 127.0.0.1:8446
 0:30.74 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 0:30.74 wptserve INFO Stopped http server on 127.0.0.1:9000
 0:30.90 INFO Removed font: Ahem.ttf
 0:30.93 INFO Closing logging queue
 0:30.93 INFO queue closed
 0:30.93 INFO Tolerating 1 unexpected results
[taskcluster 2023-11-13 19:34:51.717Z] === Task Finished ===
[taskcluster 2023-11-13 19:34:52.431Z] Successful task run with exit code: 0 completed in 164.076 seconds
View more details on Community-TC Integration