-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
New test harness for HTML-based tests (#3012)
* Initial commit * Refinements * Refinement on timeout * Refinement on test output * Refinements * Robustness * Ignore some non-test code * Add code coverage * Fix test * Single runHTMLTest * Rename to typeInSendBox * Apply PR suggestions * Prettier * Speed up lint-staged * Prettier * Hide console errors when ignoring * Test reliability
- Loading branch information
Showing
116 changed files
with
8,827 additions
and
154 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -3,3 +3,4 @@ | |
| /__tests__/__image_snapshots__ | ||
| !/packages/bundle/dist | ||
| !/packages/playground/build | ||
| !/packages/testharness/dist | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,2 +1,3 @@ | ||
| /**/nodes_modules/ | ||
| /samples/**/build/static/ | ||
| /samples/04.api/k.telemetry-application-insights/index.html |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,15 @@ | ||
| FROM node:alpine | ||
|
|
||
| RUN apk update && \ | ||
| apk upgrade && \ | ||
| apk add --no-cache bash git openssh | ||
|
|
||
| ENV PORT=80 | ||
| EXPOSE 80 | ||
| RUN npm install serve@11.3.0 -g | ||
| WORKDIR /web/ | ||
| ENTRYPOINT ["npx", "--no-install", "serve", "-p", "80", "/web/__tests__/html/"] | ||
|
|
||
| ADD __tests__/html/ /web/__tests__/html/ | ||
| ADD packages/bundle/dist/webchat-es5.js /web/packages/bundle/dist/ | ||
| ADD packages/testharness/dist/testharness.js /web/packages/testharness/dist/ |
Binary file modified
BIN
-1.56 KB
(96%)
...oll-to-bottom-js-show-new-messages-button-only-when-new-message-come-3-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file removed
BIN
-36.2 KB
...oll-to-bottom-js-show-new-messages-button-only-when-new-message-come-5-snap.png
Binary file not shown.
Binary file added
BIN
+18.8 KB
...-connectivity-status-when-a-java-script-error-is-present-in-the-code-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+7.84 KB
...he-connecting-connectivity-status-when-connecting-for-the-first-time-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+8.49 KB
...e-ui-should-show-unable-to-connect-ui-when-credentials-are-incorrect-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+9.89 KB
...rruption-occurred-reconnecting-status-when-connection-is-interrupted-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+14.6 KB
...display-send-failed-retry-when-activity-is-sent-but-not-acknowledged-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+8.34 KB
...i-should-display-send-failed-retry-when-activity-is-not-able-to-send-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+8.76 KB
...-show-taking-longer-than-usual-to-connect-ui-when-connection-is-slow-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+7.53 KB
...-show-taking-longer-than-usual-to-connect-ui-when-connection-is-slow-2-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+8.39 KB
...-show-taking-longer-than-usual-to-connect-ui-when-connection-is-slow-3-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+8.76 KB
...how-taking-longer-than-usual-to-connect-ui-when-reconnection-is-slow-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+10 KB
...pshots__/html/toast-js-notification-toast-should-show-privacy-policy-1-snap.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| /__dist__ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,42 @@ | ||
| const { relative } = require('path'); | ||
| const AbortController = require('abort-controller'); | ||
| const NodeEnvironment = require('jest-environment-node'); | ||
|
|
||
| const { browserName } = require('../../constants.json'); | ||
| const hostServe = require('./hostServe'); | ||
| const serveJSON = require('../serve.json'); | ||
|
|
||
| class WebChatEnvironment extends NodeEnvironment { | ||
| constructor(config, context) { | ||
| super(config, context); | ||
|
|
||
| this.abortController = new AbortController(); | ||
| this.relativeTestPath = relative(process.cwd(), context.testPath); | ||
| this.global.docker = browserName === 'chrome-docker'; | ||
| } | ||
|
|
||
| async setup() { | ||
| super.setup(); | ||
|
|
||
| const { signal } = this.abortController; | ||
|
|
||
| this.global.abortSignal = signal; | ||
|
|
||
| if (this.global.docker) { | ||
| const { port } = await hostServe(signal, { | ||
| ...serveJSON, | ||
| public: '.' | ||
| }); | ||
|
|
||
| this.global.webServerPort = port; | ||
| } | ||
| } | ||
|
|
||
| async teardown() { | ||
| this.abortController.abort(); | ||
|
|
||
| await super.teardown(); | ||
| } | ||
| } | ||
|
|
||
| module.exports = WebChatEnvironment; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,67 @@ | ||
| import AbortController from 'abort-controller'; | ||
| import createDeferred from 'p-defer'; | ||
| import Observable from 'core-js/features/observable'; | ||
|
|
||
| import sleep from './sleep'; | ||
|
|
||
| const ABORT_SYMBOL = Symbol(); | ||
|
|
||
| export default function createJobObservable(driver, { ignorePageError = false } = {}) { | ||
| return new Observable(observer => { | ||
| const abortController = new AbortController(); | ||
| const abortPromise = new Promise(resolve => | ||
| abortController.signal.addEventListener('abort', () => resolve(ABORT_SYMBOL)) | ||
| ); | ||
|
|
||
| (async function() { | ||
| for (;;) { | ||
| const job = await Promise.race([driver.executeScript(() => window.WebChatTest.jobs.acquire()), abortPromise]); | ||
|
|
||
| if (!job) { | ||
| await sleep(50); | ||
| continue; | ||
| } | ||
|
|
||
| if (job === ABORT_SYMBOL) { | ||
| break; | ||
| } else if (job.type === 'done') { | ||
| observer.complete(); | ||
| break; | ||
| } else if (job.type === 'error') { | ||
| observer.error( | ||
| new Error(`Unhandled exception from the test code on the page.\n\n${job.payload.error.stack}`) | ||
| ); | ||
| break; | ||
| } else if (job.type === 'pageerror') { | ||
| if (!ignorePageError) { | ||
| observer.error(new Error(`The page emitted an "error" event.\n\n${job.payload.error.stack}`)); | ||
| break; | ||
| } | ||
| } else { | ||
| const deferred = createDeferred(); | ||
|
|
||
| observer.next({ | ||
| deferred, | ||
| job | ||
| }); | ||
|
|
||
| await deferred.promise.then( | ||
| (result = null) => | ||
| driver.executeScript((id, result) => window.WebChatTest.jobs.resolve(id, result), job.id, result), | ||
| async error => { | ||
| await driver.executeScript( | ||
| (id, stack) => window.WebChatTest.jobs.reject(id, new Error(stack)), | ||
| job.id, | ||
| error.stack | ||
| ); | ||
|
|
||
| observer.error(error); | ||
| } | ||
| ); | ||
| } | ||
| } | ||
| })(); | ||
|
|
||
| return () => abortController.abort(); | ||
| }); | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,22 @@ | ||
| const { createServer } = require('http'); | ||
| const getPort = require('get-port'); | ||
| const serveHandler = require('serve-handler'); | ||
|
|
||
| async function hostServe(abortSignal, serveHandlerOptions) { | ||
| return new Promise(async (resolve, reject) => { | ||
| const port = await getPort(); | ||
| const httpServer = createServer((req, res) => serveHandler(req, res, serveHandlerOptions)); | ||
|
|
||
| abortSignal && | ||
| abortSignal.addEventListener('abort', () => { | ||
| httpServer.close(); | ||
|
|
||
| reject(new Error('Server aborted.')); | ||
| }); | ||
|
|
||
| httpServer.once('error', reject); | ||
| httpServer.listen(port, () => resolve({ port })); | ||
| }); | ||
| } | ||
|
|
||
| module.exports = hostServe; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,8 @@ | ||
| module.exports = function indent(message, count = 4) { | ||
| const indentation = new Array(count).fill(' ').join(''); | ||
|
|
||
| return message | ||
| .split('\n') | ||
| .map(line => indentation + line) | ||
| .join('\n'); | ||
| }; |
Oops, something went wrong.