Manual test run on Windows x64 for 1.11.x - Beta

[kjozwiak]

Installer

• Check that installer is close to the size of last release
• Check signature: If OS Run spctl --assess --verbose /Applications/Brave-Browser-Beta.app/ and make sure it returns accepted. If Windows right click on the brave_installer-x64.exe and go to Properties, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window

Data(Upgrade from previous release)

• Make sure that data from the last version appears in the new version OK
• With data from the last version, verify that
  • Bookmarks on the bookmark toolbar and bookmark folders can be opened
  • Cookies are preserved
  • Installed extensions are retained and work correctly
  • Opened tabs can be reloaded
  • Stored passwords are preserved
  • Unpinned tabs can be pinned
  • Sync chain created in previous version is retained
  • Social media blocking buttons changes are retained

About pages

• Verify that chrome:// forwards to brave://

Widevine

• Verify Widevine Notification is shown when you visit Netflix for the first time
• Test that you can stream on Netflix on a fresh profile after installing Widevine

Performance test

Each start should take less than 7 seconds

• Enable only rewards
• Only import a large set of bookmarks
• Combine rewards, and a large set of bookmarks

Bravery settings

• Verify that HTTPS Everywhere works by loading http://https-everywhere.badssl.com/
• Turning HTTPS Everywhere off and shields off both disable the redirect to https://https-everywhere.badssl.com/
• Verify that toggling Ads and trackers blocked works as expected
• Visit https://testsafebrowsing.appspot.com/s/phishing.html, verify that Safe Browsing (via our Proxy) works for all the listed items
• Visit https://brianbondy.com/ and then turn on script blocking, page should not load. Allow it from the script blocking UI in the URL bar and it should load the page correctly
• Test that 3rd party storage results are blank at https://jsfiddle.net/7ke9r14a/9/ when 3rd party cookies are blocked and not blank when 3rd party cookies are unblocked

Fingerprint Tests

• Visit https://jsfiddle.net/bkf50r8v/13/, ensure 3 blocked items are listed in shields. Result window should show got canvas fingerprint 0 and got webgl fingerprint 00
• Test that audio fingerprint is blocked at https://audiofingerprint.openwpm.com/ only when Block all fingerprinting protection is on
• Test that Brave browser isn't detected on https://extensions.inrialpes.fr/brave/
• Test that https://diafygi.github.io/webrtc-ips/ doesn't leak IP address when Block all fingerprinting protection is on

Content tests

• Open a page with an input control and type some misspellings on a textbox, make sure they are underlined
• Make sure that right clicking on a word with suggestions gives a suggestion and that clicking on the suggestion replaces the text
• Test that https://mixed-script.badssl.com/ shows up as grey not red (no mixed content scripts are run)

Social-media blocking settings

• Verify individual Social media blocking buttons works as intended when enabled/disabled by visiting https://fmarier.github.io/brave-testing/social-widgets.html

Session storage

• Temporarily move away your browser profile and test that a new profile is created when browser is launched
  • macOS - ~/Library/Application\ Support/BraveSoftware/
  • Windows - %userprofile%\appdata\Local\BraveSoftware\
  • Linux(Ubuntu) - ~/.config/BraveSoftware/
• Test that windows and tabs restore when closed, including active tab
  • Ensure that the tabs in the above session are being lazy loaded when the session is restored

Update tests

• Verify visiting brave://settings/help triggers update check
• Verify once update is downloaded, prompts to Relaunch to install update

Chromium upgrade tests

• Verify brave://gpu on Brave and chrome://gpu on Chrome are similar for the same Chromium version on both browsers

Components

• Delete Adblock folder from browser profile and restart browser. Visit brave://components and verify Brave Ad Block Updater downloads and update the component. Repeat for all Brave components
• Restart the browser, load brave://components, wait for 8 mins and verify that no component shows any errors
• Verify Brave Local Data Updater, Brave Ad Block Updater, Brave Tor Client Updater (Mac), PDF Viewer (PDF.js), Brave HTTPS Everywhere Updater have non-zero version numbers

[srirambv]

Verified on

Brave	1.11.97 Chromium: 84.0.4147.89 (Official Build) (64-bit)
Revision	19abfe7bcba9318a0b2a6bc6634a67fc834aa592-refs/branch-heads/4147@{# 852}
OS	Windows 10 OS Version 1809 (Build 17763.1339)