long list of manual things to test

[jessfraz]

@Irev-Dev @paultag @pierremtb @franknoirot please add to this

eventually we will want to automate these things but we should test these before releases

related to

• Add a basic tauri e2e test on Linux #684
• Playwright or similar for ui testing  #536

---

-- edit Kurt: Turning these into checkboxes to keep track of e2e tests I'm writing

• can authenticate
• test for Alt + drag-code-mirror-number in lets you drag for a second #1558
• you should be able to create a sketch and generate code from the onboarding example code
• code stays between refreshes of app
• in tauri app, code re-executed when selecting a new file, should zoom to fit
• in tauri should zoom to fit when opening new project
• when you update your units in project settings / user settings it re-renders
• when you type the keybindings outside the editor it re-formats the code
• when you type the keybindings inside the editor it re-formats the code
• when you are already in an indented line in pipe going to a new line also indents
• going from having a rendered model, then delete all code, then you should be able to start sketch again by clicking button and selecting a plane
• sketching next to the part from the onboarding should work just like everything else
• errors from execution show up in the gutter and error pane
• if you write invalid kcl you get inlined errors
• code executes on initial page load in web app
• typing in the editor re-executes the model and changes it based on your code
• on startsketch click, you see the three planes
• pan, zoom, moving model works
• you can create new sketches w click and point
• you can create a sketch on any plane (xy, yz, xz, -xy, -yz, -xz)
• autocomplete works
• when engine stops and restarts, code re-executes and you get the gizmo and planes
• you can change your keyboard shortcuts to other settings and they work
• you can reload the onboarding from any screen and the onboarding works #1110
• you can edit sketches, as long as they are not closed
• you should not be able to edit sketches that are closed, the button should not appear
• you can move lines in edit sketch and it updates the code (more than once)
• you can move lines in a fresh sketch from Start Sketch and it updates the code (more than once) #1112
• in tauri can create new projects
• can apply constraints in edit sketch mode
• test exports #1139 you can export your model in each file type and the exported file is valid (done besides STL and PLY exports broken #1140)
• hover over functions shows function description #1111
• if you add constraints the code is stored for refresh adding constraints dont store code but it updates #861
• if you restart the onboarding it re-executes with the new code for the onboarding restarting onboarding needs to re-execute the model #862
• selections e2e test #1136 Selections should work
  • start a new sketch
  • create a few line segments
  • de-select the line tool
  • hover over a few segments to check it highlights the correct range in the code
  • exit and re-enter the sketch and check hovering agin

[mlfarrell]

Once/If we get a QA agency in place, we can lean on their experience to put together a full regression testing plan, smoke testing plan (subset of these testing most crucial), etc etc. All based on this list.

[franknoirot]

• You can navigate to any shown link and get a page, no 404ing links
• You can open an empty file without engine/stream/app issue
• You can open a file with syntax errors without engine/stream/app issue
• You can replay the onboarding from the home settings
• You can replay the onboarding from a project's settings
• Replaying the onboarding doesn't delete your file

[pierremtb]

List to be covered by e2e tauri tests:

• Add a basic tauri e2e test on Linux #684 (app launches and the sign in button can be clicked)
• Add tauri e2e test for auth on Linux #968
• Create a file and expect engine to fail on Linux
• Get tauri e2e tests to work on Windows
• Create a file on Windows and test sample code

[jessfraz]

closing because between qawolf and our most recent electron tests issues i think we are covered here.