pi-test-runner

⚠️ Experimental / Work in Progress — behaviour may change.

Pi extension that discovers and runs JS/TS test scripts from the nearest package.json, spawning an isolated subagent to execute them. Results are injected back into the session automatically when done — the tool is non-blocking.

How it works

1. Scans up from the current directory to find the nearest package.json.
2. Extracts scripts matching test patterns (test, test:*, jest, vitest, playwright, mocha, cypress, e2e, spec).
3. If multiple scripts exist and no script param is given, shows a picker.
4. Detects the package manager from lockfiles (yarn.lock, pnpm-lock.yaml, fallback to npm).
5. Spawns an isolated pi subprocess as the subagent.
6. Returns immediately — session is unlocked while tests run.
7. Subagent sends contact_supervisor progress updates via pi-intercom.
8. When done, pi.sendMessage({ triggerTurn: true }) re-engages the LLM with structured pass/fail results.

Tool parameters

Parameter	Type	Description
script	string?	Script key from package.json (e.g. test:unit). Auto-detected if omitted.
cwd	string?	Working directory to search. Defaults to current project directory.
model	string?	Model ID for the subagent. Overrides the configured default.

Commands

/run-tests                — run tests, truly non-blocking
/run-tests test:unit      — run a specific script

/test-runner              — show current config and active runs
/test-runner model <id>   — set default subagent model
/test-runner model        — show current default model
/test-runner reset        — clear all config
/test-runner back         — return to the previous session

/run-tests vs run_tests tool

	/run-tests command	run_tests tool
Triggered by	You (directly)	LLM
LLM turn while running	None	One turn for "started", one for results
Session stays idle?	✓ Always	✗ LLM responds twice
When to use	Normal test runs	LLM-driven workflows

Configuration

Global config: ~/.pi/agent/test-runner/config.json

Option	Type	Default	Description
defaultModel	string	(pi default)	Model ID for the test-runner subagent

{
  "$schema": "./.pi/agent/test-runner/config.schema.json",
  "defaultModel": "claude-haiku-4-5"
}