Platform / Spec2RunAI / User guide / Good practice

Spec2RunAI user guide · updated 22 October 2026

Good practice

Start with one test case

Get a single test case running end to end before building a suite. You will learn how the engine reads your wording, and that knowledge makes every subsequent test better.

Keep a stable regression gate

Maintain one dependable test case you run before and after any significant change — a platform upgrade, a new dataset, a large edit. If it stays green, changes elsewhere are yours to reason about. If it goes red, you know immediately.

Fix advisories when they appear

A script-defect advisory is a step that passes today and will fail eventually. They take seconds to apply and cost real time when ignored.

Use step expected results as checkpoints

Not on every step — on the ones that matter. A failure at step 4 with a clear checkpoint is far cheaper to diagnose than a failure at step 11 that actually went wrong at step 4.

Let memory warm up

The second run of a test case is usually faster and cheaper than the first, because the engine reuses what it learned. Judge performance on a warm run, not a cold one.

Watch the engagement estimate

It appears before you launch. A hundred-row dataset against a ten-step test case is a genuinely large run — worth knowing before, not after.

Check coverage before sign-off

Before a run goes to anyone as evidence, open its report and look at verification coverage. A passing run with unverified steps has proved less than it appears to. Add expected results to the steps that matter, re-run, and send the PDF.

Try it on your own tests

Ten test cases. Untouched. We run them and send the evidence report.