Scenario: Add Support for UI Automation

[carlos-zamora]

Megathread for v1.0 Accessibility Features

Navigation

This is a subset of issues that are mainly located in the XAML Layer.

• Feature Request: Automation Properties #2099: Automation Properties
• Localize Accessibility Resources #2142: Localization
• Feature Request: Clean up UIA Tree Navigation #2102: Manage focus properly

Providers

This is a subset of issues that are dedicated to presenting information from the Terminal to UIA Clients.

• Windows Terminal: Set up UIA tree and hook it up properly #634: Set-up UIA Tree
• Task: Refactor IRenderData and create IAccessibilityData #1992: Create IUiaData (Terminal data needed for UIA)
• UIA Word Navigation #3161: Word Navigation
• Feature Request: Fix Accessibility BoundingRects for TextRanges #2103: BoundingRect scaling
• UiaTextRange - ScrollIntoView Implementation #2361: Scrolling
• UIA Providers misrepresent box selections #4509: Box Selection
• Accessibility: Wide Glyph Detection #1354: Wide Glyph Detection

Signaling

This is a subset of issues that are dedicated to telling UIA Clients that our content has changed and needs to be re-read.

• Accessibility: Signaling Model #2447: Selection
• Accessibility: Signaling Model #2447: Output
• Accessibility: Signaling Model #2447: Scrolling

Miscellaneous Bugs and Polish

• Crash if Narrator open #2907: Crash when UIA Client is open
• Narrator line navigation gets stuck on some lines #2160, All forms of UIA navigation appear to skip entries when going back and are unable to go forwards #3976: Navigation stuck
• Refactor UiaTextRange #3895, Task: Explore de-static-fying UiaTextRange functions #1993: Refactor UiaTextRange
• Terminal hangs when navigating (back?) by word in Narrator #4485: Word Navigation Hangs
• Bug Report: Misaligned UIA text range bounding rectangles in displays that are not 100%-scale #2551: BoundingRect scaling on High DPI
• Task: Re-attach Tracing to UIA Tree #1914 : Tracing
• ScreenInfoUiaProvider::GetSelection() returns an improper result #4452: ScreenInfoUiaProvider::GetSelection()
• ScreenInfoUiaProvider::GetVisibleRanges() returns an improper result #4507: ScreenInfoUiaProvider::GetVisibleRanges()
• Additional Testing for UiaTextRange #4421: Additional UiaTextRange Testing

[DHowett-MSFT]

This is a scenario that's tracking open issues, so I'm triaging it. Carlos already marked it v1.

[codeofdusk]

Now that nvaccess/nvda#10784 has been merged, NVDA has full support for Windows Terminal as of 2020.2! It also now supports the post #4018 Windows Console with UIA if "use UI Automation to access the Windows Console when available" is enabled from advanced settings. Builds from NVDA master are available here.

[carlos-zamora]

Now that nvaccess/nvda#10784 has been merged, NVDA has full support for Windows Terminal as of 2020.2! It also now supports the post #4018 Windows Console with UIA if "use UI Automation to access the Windows Console when available" is enabled from advanced settings. Builds from NVDA master are available here.

Thanks for all your hard work @codeofdusk! As we move forward with some internal testing, @cinnamon-msft and I will make sure NVDA v2020.2 is used. 😊