[WIP]: Configure UI tests for Lite Deployment #2473
build.yml
on: pull_request
Build jupytercad
4m 23s
Check Links
1m 27s
test_isolated
29s
Integration tests Lite
4m 19s
deploy
0s
Annotations
9 errors, 1 warning, and 2 notices
tests/lite.spec.ts:24:9 › UI Test › Should be able to render test.jcad without error:
ui-tests/tests/lite.spec.ts#L55
1) tests/lite.spec.ts:24:9 › UI Test › Should be able to render test.jcad without error ──────────
Error: expect(Buffer).toMatchSnapshot(expected)
13444 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts-snapshots/Render-test-jcad-linux.png
Received: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--e037b-der-test-jcad-without-error/Render-test-jcad-actual.png
Diff: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--e037b-der-test-jcad-without-error/Render-test-jcad-diff.png
53 | expect(errors).toBe(0);
54 | if (main) {
> 55 | expect(await main.screenshot()).toMatchSnapshot({
| ^
56 | name: `Render-${file}.png`,
57 | maxDiffPixelRatio: 0.01
58 | });
at /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts:55:41
|
tests/lite.spec.ts:24:9 › UI Test › Should be able to render test.jcad without error:
ui-tests/tests/lite.spec.ts#L55
1) tests/lite.spec.ts:24:9 › UI Test › Should be able to render test.jcad without error ──────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
11834 pixels (ratio 0.02 of all image pixels) are different.
Expected: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts-snapshots/Render-test-jcad-linux.png
Received: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--e037b-der-test-jcad-without-error-retry1/Render-test-jcad-actual.png
Diff: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--e037b-der-test-jcad-without-error-retry1/Render-test-jcad-diff.png
53 | expect(errors).toBe(0);
54 | if (main) {
> 55 | expect(await main.screenshot()).toMatchSnapshot({
| ^
56 | name: `Render-${file}.png`,
57 | maxDiffPixelRatio: 0.01
58 | });
at /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts:55:41
|
tests/lite.spec.ts:24:9 › UI Test › Should be able to render 3M_CONNECTOR.STEP without error:
ui-tests/tests/lite.spec.ts#L55
2) tests/lite.spec.ts:24:9 › UI Test › Should be able to render 3M_CONNECTOR.STEP without error ──
Error: expect(Buffer).toMatchSnapshot(expected)
286158 pixels (ratio 0.42 of all image pixels) are different.
Expected: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts-snapshots/Render-3M-CONNECTOR-STEP-linux.png
Received: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--995b0-ONNECTOR-STEP-without-error/Render-3M-CONNECTOR-STEP-actual.png
Diff: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--995b0-ONNECTOR-STEP-without-error/Render-3M-CONNECTOR-STEP-diff.png
53 | expect(errors).toBe(0);
54 | if (main) {
> 55 | expect(await main.screenshot()).toMatchSnapshot({
| ^
56 | name: `Render-${file}.png`,
57 | maxDiffPixelRatio: 0.01
58 | });
at /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts:55:41
|
tests/lite.spec.ts:24:9 › UI Test › Should be able to render 3M_CONNECTOR.STEP without error:
ui-tests/tests/lite.spec.ts#L55
2) tests/lite.spec.ts:24:9 › UI Test › Should be able to render 3M_CONNECTOR.STEP without error ──
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(Buffer).toMatchSnapshot(expected)
23141 pixels (ratio 0.04 of all image pixels) are different.
Expected: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts-snapshots/Render-3M-CONNECTOR-STEP-linux.png
Received: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--995b0-ONNECTOR-STEP-without-error-retry1/Render-3M-CONNECTOR-STEP-actual.png
Diff: /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/test-results/tests-lite-UI-Test-Should--995b0-ONNECTOR-STEP-without-error-retry1/Render-3M-CONNECTOR-STEP-diff.png
53 | expect(errors).toBe(0);
54 | if (main) {
> 55 | expect(await main.screenshot()).toMatchSnapshot({
| ^
56 | name: `Render-${file}.png`,
57 | maxDiffPixelRatio: 0.01
58 | });
at /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts:55:41
|
tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file:
ui-tests/tests/lite.spec.ts#L1
3) tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file ───────────────
Test timeout of 60000ms exceeded.
|
tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file:
ui-tests/tests/lite.spec.ts#L81
3) tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file ───────────────
Error: locator.waitFor: Test ended.
Call log:
- waiting for locator('.jp-InputArea-prompt').locator('text="[1]:"').first() to be visible
79 | await page.keyboard.press('Control+Enter');
80 |
> 81 | await page.locator('.jp-InputArea-prompt >> text="[1]:"').first().waitFor();
| ^
82 |
83 | const outputErrors = await page.$$('.jp-OutputArea-error');
84 | expect(outputErrors.length).toBe(0);
at /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts:81:71
|
tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file:
ui-tests/tests/lite.spec.ts#L1
3) tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file ───────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file:
ui-tests/tests/lite.spec.ts#L81
3) tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file ───────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.waitFor: Test ended.
Call log:
- waiting for locator('.jp-InputArea-prompt').locator('text="[1]:"').first() to be visible
79 | await page.keyboard.press('Control+Enter');
80 |
> 81 | await page.locator('.jp-InputArea-prompt >> text="[1]:"').first().waitFor();
| ^
82 |
83 | const outputErrors = await page.$$('.jp-OutputArea-error');
84 | expect(outputErrors.length).toBe(0);
at /home/runner/work/JupyterCAD/JupyterCAD/ui-tests/tests/lite.spec.ts:81:71
|
Integration tests Lite
Process completed with exit code 1.
|
Build jupytercad
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
|
🎭 Playwright Run Summary
9 passed (1.4m)
|
🎭 Playwright Run Summary
3 failed
tests/lite.spec.ts:24:9 › UI Test › Should be able to render test.jcad without error ───────────
tests/lite.spec.ts:24:9 › UI Test › Should be able to render 3M_CONNECTOR.STEP without error ───
tests/lite.spec.ts:63:7 › UI Test › Should create and execute a new .ipynb file ────────────────
1 passed (3.2m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
appsharingspace
|
355 Bytes |
|
extension-artifacts
|
20.8 MB |
|
galata-apss
|
355 Bytes |
|
github-pages
|
49.9 MB |
|
jupytercad-lite-playwright-tests
|
186 MB |
|
jupytercad-playwright-tests
|
230 KB |
|
lite-artifacts
|
50.1 MB |
|