End-to-end testing infrastructure #320

jcheng5 · 2022-08-24T15:41:50Z

Fixes #324

This PR adds make e2e, which runs a series of automated end-to-end tests using the Playwright for Python framework.

The tests exist under ./e2e/*/test_*.py files, which test against either e2e-test-specific app.py files in those same directories, or ./examples/*/app.py example apps.

TODO

~~Consider renaming e2e to tests-e2e~~ I'm not going to do this, doesn't feel worth the time

This should probably be tox eventually

…tox now" This reverts commit 0a9f899.

jcheng5 · 2022-09-16T17:17:23Z

FYI, the next version of Playwright (1.26) will allow us to remove # pyright: reportUnknownMemberType=false from the top of the e2e tests.

e2e/README.md

e2e/conftest.py

Co-authored-by: Carson Sievert <[email protected]>

e2e/conftest.py

Co-authored-by: Carson Sievert <[email protected]>

e2e/conftest.py

e2e/controls.py

Co-authored-by: Carson Sievert <[email protected]>

jcheng5 marked this pull request as draft August 24, 2022 15:42

jcheng5 changed the title ~~First attempt at playwright integration~~ End-to-end testing Aug 24, 2022

jcheng5 marked this pull request as ready for review August 30, 2022 21:07

jcheng5 changed the title ~~End-to-end testing~~ End-to-end testing infrastructure Aug 30, 2022

jcheng5 added 21 commits September 1, 2022 12:30

First attempt at playwright integration

99c0c2e

e2e: Print stderr after app exit

e548182

Install dependencies for e2e tests

1b33c19

This should probably be tox eventually

Fix broken regex

8c20d54

Pass type checks for playwright

68368b8

Install unpinned dependencies for airmass

7d81b88

Increase timeout on playwright test

35eeb96

Oops... timeout is in ms

3eae5e1

Fix type checking

1dcce81

Fix type checking, attempt 2

c99b092

Add local_app fixture; code cleanup; e2e docs

726d290

More e2e testing

4da2030

Remove cpuinfo app copy from e2e tests

48a540a

Fix pyright errors

829d239

Improve e2e docs, remove cruft

ab01e7e

Test with all browsers; test in parallel

2185293

Remove e2e prereq install, we're using tox now

ab6487e

Add 'playwright install-deps'

da596c0

Minor cleanup

8a49785

Remove playwright from requirements-dev.txt, it's managed by tox now

fd07477

Revert "Remove playwright from requirements-dev.txt, it's managed by …

592bb62

…tox now" This reverts commit 0a9f899.

jcheng5 force-pushed the e2e-tests branch from ce740b4 to 592bb62 Compare September 1, 2022 19:32

Mouse up after dragging

1c7a405

jcheng5 requested a review from cpsievert September 16, 2022 16:35