agent-qa
The self-improving Agentic QA harness with Memory
Package details
Install agent-qa from npm and Pi will load the resources declared by the package manifest.
$ pi install npm:agent-qa- Package
agent-qa- Version
0.2.6- Published
- Nov 3, 2026
- Downloads
- 3,893/mo · 1,163/wk
- Author
- pranshuchittora
- License
- FSL-1.1-ALv2
- Types
- skill
- Size
- 6.5 MB
- Dependencies
- 30 dependencies · 0 peers
Pi manifest JSON
{
"skills": [
"./skills"
]
}Security note
Pi packages can execute code and influence agent behavior. Review the source before installing third-party packages.
README
Your AI QA engineer, with memory. Describe a user journey in plain language. agent-qa tests it on web, Android or iOS and keeps the evidence. Use the CLI, the dashboard, or your coding agent through MCP and skills.
- memidex: remembers facts and working procedures as reviewable files in your repository.
- Self-improvement: validates lessons from runs, retires stale knowledge, and uses your feedback to correct mistakes.
| Benchmark | Rank | Published result |
|---|---|---|
| AndroidWorld | #1 | 100% pass@1 (116/116 tasks) |
| AppControlBench | #1 | 99.6% completion (114.5/115 points) |
Read the full benchmark reports, with run evidence and methodology, on our blog. Both used gpt-6-sol with memory and self-improvement off; AppControlBench gives half credit for partial completion.
See it in action
Inspect a failure. The demo catches a cart showing $29 instead of $53, with the failed step and its screenshot side by side.
See what memory contributed. Inspect the knowledge supplied to a run and trace it back to the steps that used it.
Run from your terminal. Real output from the demo suite: checkout passes; the deliberate cart-total bug fails.
Get started
Requires Node.js 24+.
npm install -D agent-qa
npx agent-qa initFollow the quickstart to connect a model and run the demo, or set up with your coding agent.
[!NOTE] Early stage. Expect bugs. Report an issue when something breaks.