testing

Three layers in CI today, by ascending integration scope: unit → ART → E2E. The PR gate (flox activate -- task ci) runs typecheck + unit + ART + E2E. VRT (Visual Regression Tests) is planned for the video domain but not yet implemented — see below.

Unit

Vitest, fast, scoped per workspace. Lives next to the code (foo.ts ↔ foo.test.ts). Run all unit tests:

flox activate -- task test

Coverage areas today: graph store mutations, capacity logic, auth handshake, layout merging, note-entry coercion, docs module-manifest generator.

Port-surface consistency gates

Three gates keep each module’s I/O surface consistent across def, published manifest, and rendered UI — drift between them was the root cause of the RIOTGIRLS regression where the def grew dozens of CV inputs but the card only rendered three handles per voice (cables had nothing visible to land on).

1. The module def at packages/web/src/lib/{audio,video}/modules/<type>.ts (the runtime source of truth — what the engine wires up).
2. The published manifest at /docs/modules/<type> (built from packages/web/src/lib/docs/module-manifest.ts).
3. The card UI at packages/web/src/lib/ui/modules/<Type>Card.svelte (the Svelte Flow Handle elements the user can plug cables into).

• Unit — manifest stays in sync with defs: packages/web/src/lib/docs/module-manifest.test.ts iterates over getAllModuleSpecs() and asserts the manifest’s input/output ids equal the def’s. Catches drift between the def and the docs builder.
• E2E — UI matches def: e2e/tests/io-spec-consistency.spec.ts spawns each module type, reads window.__moduleSpecs, and asserts every Handle’s data-handleid matches the def.
• E2E — CV range uniformity: e2e/tests/cv-range-uniformity.spec.ts walks every cv input port and asserts a cvScale hint is declared, then drives an LFO at ±1 to confirm the target slider sweeps edge-to-edge. Catches the regression where a new module is added with a raw passthrough CV input, leaving an LFO touching only ~10% of the natural range. See .myrobots/plans/cv-range-standard.md.

Adding a new module: the unit test iterates the registry automatically — no edit needed. For the E2E test, add the new ModuleType string to the MODULE_TYPES array in io-spec-consistency.spec.ts and make sure the card’s <Handle> id= values match the def’s port ids exactly. If the UI is intentionally lagging the def (e.g. some CV ports kept off-card to avoid chrome overload), add an entry to SKIP_DEF_VS_UI with a TODO pointing at the follow-up branch.

Helper: packages/web/src/lib/dev/module-specs.ts exposes getAllModuleSpecs() as a thin projection of the registry. In dev / VITE_E2E_HOOKS=1 builds it’s also published as window.__moduleSpecs.

ART — Audio Regression Tests

Offline render of compiled DSP through node-web-audio-api → Float32 PCM. Tests assert on FFT peak frequency, harmonic ratios, silence floor, and where deterministic, byte-identical match against a .f32 baseline pinned in Git LFS. The harness lives at art/setup/render.ts.

flox activate -- task art           # run
flox activate -- task art:update    # regenerate .f32 + .sha baselines

Browse a rendered gallery of every .f32 baseline — a waveform + log-frequency spectrogram per baseline, grouped by scenario — published to GitHub Pages: ART gallery →. It’s generated by art/build_gallery.py and republished on every push to main (.github/workflows/art-gallery.yml), the audio sibling of the VRT gallery.

Scenarios (119)

Baselines (214)

Pinned in Git LFS at art/baselines/. .f32 = raw 32-bit PCM, .sha = sidecar hash.

VRT — Visual Regression Tests

E2E — Playwright

Headless Chromium, real Web Audio (worklets and all), against the actual SvelteKit app. Boots a Vite dev server (or vite preview when E2E_USE_PREVIEW=1). Lives under e2e/tests/; specs tagged @smoke double as the post-deploy live check on autotest.

flox activate -- task e2e          # full suite
flox activate -- task e2e:headed   # with the browser visible
flox activate -- task ci:smoke:live  # smoke vs autotest.patchtogether.live

Specs (321)

• 4plexer.spec.ts
• 4plexvid.spec.ts
• acidwarp-render-smoke.spec.ts
• adsr-poly-midilane.spec.ts
• adsr-vca-invert.spec.ts
• ai-debug.spec.ts
• ai-smoke.spec.ts
• analog-logic-maths.spec.ts
• analog-vco-fm-sync.spec.ts
• analog-vco-hard-sync.spec.ts
• archivist.spec.ts
• atlantis-catalyst.spec.ts
• attenumix.spec.ts
• audio-controls.spec.ts
• audio-gate.spec.ts
• audio-in.spec.ts
• audioctx-sample-rate.spec.ts
• aut-patch-panel.spec.ts
• auth-handshake.spec.ts
• auth-routes.spec.ts
• awareness.spec.ts
• b3ntb0x.spec.ts
• backdraft-full-output.spec.ts
• backdraft-render-smoke.spec.ts
• backdraft.spec.ts
• bentbox.spec.ts
• blood-audio-output.spec.ts
• blood-ingame.spec.ts
• blood-keyboard.spec.ts
• blood-mount.spec.ts
• bluebox.spec.ts
• bridge-late-materialization.spec.ts
• buggles.spec.ts
• cable-drag-drilldown.spec.ts
• cable-drag-panel-lock.spec.ts
• cable-drag-section-expand.spec.ts
• cable-z-order.spec.ts
• cadillac-collab.spec.ts
• cadillac.spec.ts
• camera-input.spec.ts
• capacity.spec.ts
• carl-rackspace.spec.ts
• cellshade.spec.ts
• chowkick.spec.ts
• clear-load-multiwindow.spec.ts
• clear-patch-undo.spec.ts
• clear.spec.ts
• click-pickup-cable.spec.ts
• clipplayer-controls.spec.ts
• clipplayer-edit-launch.spec.ts
• clipplayer-songmode.spec.ts
• clipplayer.spec.ts
• clouds.spec.ts
• cloudseed.spec.ts
• cofefve.spec.ts
• collab.spec.ts
• combinations.spec.ts
• connection-validate-edge.spec.ts
• control-color.spec.ts
• control-surface.spec.ts
• coverage-group-1-sinks.spec.ts
• coverage-group-2-sources.spec.ts
• coverage-groups-3-4-5.spec.ts
• coverage-groups-6-7-8-9.spec.ts
• cube.spec.ts
• cv-range-uniformity.spec.ts
• destructor-render-smoke.spec.ts
• docs-virtual-module.spec.ts
• docs.spec.ts
• doom-aspect.spec.ts
• doom-audio-output.spec.ts
• doom-cheat-gates.spec.ts
• doom-controls.spec.ts
• doom-handles.spec.ts
• doom-identity-crossview.spec.ts
• doom-keyboard-routing.spec.ts
• doom-late-join.spec.ts
• doom-launch.spec.ts
• doom-mp-latejoin-freeze.spec.ts
• doom-mp-lockstep-sharedstate.spec.ts
• doom-mp-probe.spec.ts
• doom-mp-real.spec.ts
• doom-multiplayer.spec.ts
• doom-per-type-death-gates.spec.ts
• doom-wasm.spec.ts
• drumseqz.spec.ts
• duplicate-module.spec.ts
• dx7-syx-load.spec.ts
• dx7.spec.ts
• edges.spec.ts
• electra-control.spec.ts
• fader-midi-assign.spec.ts
• fader.spec.ts
• featurecv-source-chain.spec.ts
• feedback.spec.ts
• flip-rack-rear-view.spec.ts
• four-modules.spec.ts
• foxy-freeze-locks-wavetable.spec.ts
• foxy.spec.ts
• freezeframe.spec.ts
• frogger.spec.ts
• gamepad.spec.ts
• gibribbon.spec.ts
• graphic-eq-render-smoke.spec.ts
• group-exposed-controls.spec.ts
• grouping-phase1.spec.ts
• grouping-phase2.spec.ts
• grouping-phase3.spec.ts
• house-style.spec.ts
• illogic.spec.ts
• in-card-title.spec.ts
• insert-on-cable.spec.ts
• instrument-exposed-port-patching.spec.ts
• instruments.spec.ts
• integration.spec.ts
• inwards-render-smoke.spec.ts
• io-spec-consistency.spec.ts
• joystick.spec.ts
• keyboard-nav.spec.ts
• kickdrum.spec.ts
• kria.spec.ts
• landing-links.spec.ts
• landing-routing.spec.ts
• lasso-group.spec.ts
• launchpad-clip-launch.spec.ts
• launchpad-keys-record.spec.ts
• launchpad-single-arm-row.spec.ts
• lfo-modulation-visible.spec.ts
• lines-render-smoke.spec.ts
• livecode.spec.ts
• load-example-dropdown.spec.ts
• load-patch.spec.ts
• loopback.spec.ts
• macseq.spec.ts
• mandelbulb-render-smoke.spec.ts
• mandleblot-render-smoke.spec.ts
• mapper.spec.ts
• mappy-export-import.spec.ts
• mappy-output.spec.ts
• matrixmix.spec.ts
• meowbox.spec.ts
• midi-autobind-perfzip.spec.ts
• midi-cv-buddy.spec.ts
• midi-lane.spec.ts
• midi-learn-note.spec.ts
• midi-learn.spec.ts
• midi-out-buddy.spec.ts
• midi.spec.ts
• midiclock.spec.ts
• mike-rackspace.spec.ts
• milkdrop-render-smoke.spec.ts
• modtris.spec.ts
• modulation.spec.ts
• module-annotate.spec.ts
• modules.spec.ts
• multi-output.spec.ts
• multi-video-playback.spec.ts
• nested-module-menu.spec.ts
• nibbles-cv-scope.spec.ts
• nibbles-render-smoke.spec.ts
• nibbles.spec.ts
• node-context-menu.spec.ts
• noise.spec.ts
• note-entry.spec.ts
• numpad-plus.spec.ts
• onetonine.spec.ts
• organize-modules.spec.ts
• outlines-render-smoke.spec.ts
• outlines.spec.ts
• painter.spec.ts
• palette.spec.ts
• param-edit-undo.spec.ts
• patch-menu-redesign.spec.ts
• patch-menu-ux.spec.ts
• patch-panel-jack-indicator.spec.ts
• patch-panel-nested.spec.ts
• patch-panel.spec.ts
• patch-to-cascade.spec.ts
• peaks.spec.ts
• peakstate-render-smoke.spec.ts
• peertube.spec.ts
• pentemelodica.spec.ts
• per-module-per-port-behavioral.spec.ts
• per-module-per-port.spec.ts
• per-module.spec.ts
• perf-tempo-under-modulation.spec.ts
• picturebox-asset-select.spec.ts
• picturebox-gif.spec.ts
• picturebox-limits.spec.ts
• picturebox-sync.spec.ts
• poly-chord.spec.ts
• polyseqz.spec.ts
• pong.spec.ts
• present-second-display.spec.ts
• preset-slots-and-sets.spec.ts
• qbert-cv-joystick.spec.ts
• qbert-rom-missing.spec.ts
• quadralogical-assign.spec.ts
• quadralogical.spec.ts
• rackspace-isolation.spec.ts
• rackspace-persistence.spec.ts
• rear-view-patching.spec.ts
• recorderbox.spec.ts
• render-worker-acidwarp.spec.ts
• render-worker-toybox.spec.ts
• reshaper-shapedramps.spec.ts
• resofilter.spec.ts
• ringback.spec.ts
• rings.spec.ts
• riotgirls.spec.ts
• sample-hold.spec.ts
• samsloop-boundaries-roundtrip.spec.ts
• samsloop-download.spec.ts
• samsloop-memory-bench.spec.ts
• samsloop-persistence.spec.ts
• samsloop-record.spec.ts
• samsloop.spec.ts
• save-group-and-naming.spec.ts
• save-load.spec.ts
• saved-groups-wiring.spec.ts
• scaler-cv-passthrough.spec.ts
• scope-tuner.spec.ts
• scope-video-out.spec.ts
• scope-xy-intensity.spec.ts
• score.spec.ts
• scoreboard.spec.ts
• sequencer-clock-without-play.spec.ts
• sequencer-clock.spec.ts
• sequencer-pages.spec.ts
• sequencer-playhead-alignment.spec.ts
• sequencer-transport.spec.ts
• shapegen-clock.spec.ts
• shapegen.spec.ts
• shared-clock.spec.ts
• shared-rack-sync.spec.ts
• sidecar.spec.ts
• skifree.spec.ts
• skin-persists-app-wide.spec.ts
• skins.spec.ts
• slider-drag.spec.ts
• snes9x-gameplay-gates.spec.ts
• snes9x.spec.ts
• snh-hold.spec.ts
• soak.spec.ts
• spawn-at-cursor.spec.ts
• spirographs-render-smoke.spec.ts
• stages.spec.ts
• stereo-autowire.spec.ts
• sticky-note.spec.ts
• swolevco.spec.ts
• synesthesia-video-mode.spec.ts
• tempest-render-smoke.spec.ts
• tempo-stability.spec.ts
• textmarquee-render-smoke.spec.ts
• textmarquee.spec.ts
• theme-diner.spec.ts
• theme-lcars.spec.ts
• theme-matrixcowboy.spec.ts
• tiler.spec.ts
• timelorde-auto-spawn.spec.ts
• timelorde-tap-tempo.spec.ts
• timelorde-video.spec.ts
• topbar-1024.spec.ts
• topbar-buttons.spec.ts
• toybox-combine-editor.spec.ts
• toybox-cv-section.spec.ts
• toybox-disk-loading.spec.ts
• toybox-feedback.spec.ts
• toybox-layer-input.spec.ts
• toybox-layer-selector.spec.ts
• toybox-new-content.spec.ts
• toybox-node-batch.spec.ts
• toybox-node-controls.spec.ts
• toybox-node-menu.spec.ts
• toybox-presets-io.spec.ts
• toybox-presets.spec.ts
• toybox-shadertoy.spec.ts
• toybox-video-inputs.spec.ts
• toybox-video-projection.spec.ts
• tv-librarian-audio.spec.ts
• tv-librarian.spec.ts
• twotracks-perfzip.spec.ts
• twotracks.spec.ts
• ui-refresh.spec.ts
• varispeed-multislot-persist.spec.ts
• varispeed-panel-layout.spec.ts
• vco-pitch-tracking.spec.ts
• veils.spec.ts
• version-heading.spec.ts
• vfpga-floorplan.spec.ts
• vfpga-p2-cells.spec.ts
• vfpga-p3-composite.spec.ts
• vfpga-p4-early-hd.spec.ts
• vfpga-patchpanel-presets.spec.ts
• vfpga-runner-render-smoke.spec.ts
• vfpga-runner.spec.ts
• video-aspect-switch.spec.ts
• video-audio-cvgate-coverage.spec.ts
• video-audio-output.spec.ts
• video-chain.spec.ts
• video-controls.spec.ts
• video-full-frame.spec.ts
• video-fullscreen-multimonitor.spec.ts
• video-fullscreen.spec.ts
• video-hide-controls.spec.ts
• video-orientation.spec.ts
• videobox-output.spec.ts
• videobox-performance-bundle.spec.ts
• videobox-upload-perf.spec.ts
• videovarispeed-output.spec.ts
• videovarispeed-perfzip.spec.ts
• videovarispeed-switch.spec.ts
• voice-chain-art.spec.ts
• voice-chain.spec.ts
• warps.spec.ts
• warrenspectrum.spec.ts
• wavecel-video-outs.spec.ts
• wavecel-viz.spec.ts
• waveform-trace-shape.spec.ts
• wavesculpt.spec.ts
• writeseq.spec.ts

Chaos

Single-user randomized intent fuzzer. Drives the canvas through 200+ random patches / mutations; checks invariants between each. Multi-user invariants land post-Stage B.

flox activate -- task chaos:run

CI shape

The full gate runs in .github/workflows/ci.yml inside Flox so the toolchain (Node 22, Faust 2.85.5, esbuild) matches local. Postgres 17 is a service container; the DB schema is applied before task ci runs.