openmerit
Evidence-driven model decisions for coding harnesses.
Package details
Install openmerit from npm and Pi will load the resources declared by the package manifest.
$ pi install npm:openmerit- Package
openmerit- Version
0.3.0- Published
- Nov 4, 2026
- Downloads
- 2,818/mo · 581/wk
- Author
- lazimey
- License
- MIT
- Types
- extension
- Size
- 363.4 KB
- Dependencies
- 0 dependencies · 1 peer
Pi manifest JSON
{
"extensions": [
"./dist/pi/src/index.js"
]
}Security note
Pi packages can execute code and influence agent behavior. Review the source before installing third-party packages.
README
OpenMerit
OpenMerit provides Scout guidance for application-model choices: in the browser, from the openmerit scout command, and through MCP for Claude Code and Pi.
Scout recommends candidates to evaluate. It is not a request router or proof of application-quality improvements.
Connect Scout to Claude Code
Run npx -y openmerit@latest install --client claude-code, then approve the device in your browser. The command installs the MCP server and shared Scout guidance and checks the connection. New Claude Code sessions can consult Scout before choosing application models. Requires the claude CLI on PATH; see setup, project policy and removal. Installing the npm package alone makes no agent configuration changes.
Connect Scout to Pi
OpenMerit 0.1.12 adds a thin Scout adapter for Pi 1.5.0, replacing the old Pi 0.87 evaluation extension:
npx -y openmerit@latest install --client pi --scope user
Approve the matching device code in your browser, then start a new Pi session. Scope defaults to user; run with --scope project from a project's root for project-only setup. Each client/scope installation has its own key; project credentials stay outside the repository. The installed openmerit-scout.ts extension references private configuration and uses Pi's native MCP with the shared Scout rule and skill. Pi owns tools, model, permissions and sessions.
There are no /openmerit lifecycle commands, evaluation setup, scheduler, LaunchAgent, or automatic update hooks. To update, explicitly rerun the installer with the same scope. Shell login, logout, status, remove and doctor support --client pi --scope user|project. See Pi setup and migration for paths, conflicts, old background-job removal, and SDK embedding with createScoutPiExtension plus Pi's explicit createMcpExtension().
Package publication and website deployment are separate releases. Pi setup requires OpenMerit 0.1.12 or newer; check the resolved package version when using @latest.
Evaluation CLI retirement — npm 0.3.0
OpenMerit 0.3.0 removes the standalone openmerit eval commands, including planning. Existing local evaluation files are not deleted. The old Scout JSON recommendation API is retired in source and goes offline with a separate Scout deployment. Scout's conversational agent, MCP, coding-agent setup and catalogue publication remain available; see retirement details.
Inference Terminal retirement — npm 0.3.0
OpenMerit 0.3.0 also removes the local Inference Terminal: openmerit dash, its --demo sample, collectors, repository index and browser interface. Existing .openmerit/terminal.json, .openmerit/inference.jsonl and application logs are not deleted. Older installed packages keep the command until they are upgraded. See retirement details.
Documentation
The documentation overview links the maintained Markdown guides. The unpublished /docs/ website shell is retired; the live Scout data policy and protected memo have separate builds.
- Getting started and troubleshooting
- Scout and Pi adapter
- Retired: Inference Terminal and agent evaluations
- Security and data handling
- Testing and current limitations
Development
npm ci
npm run verify
packages/terminal contains the openmerit CLI: Scout setup, updates and the scout command; packages/pi supplies only the native Scout adapter. The package exports openmerit/pi and the openmerit command. See the Pi package README for bounded adapter tests. Provider credentials belong to the harness or its environment and must never be committed.
Edit documentation in docs/, then run npm run check:docs. npm run build:site builds only the Scout data policy and protected memo, not a docs website. A local build does not publish changes; follow deployment maintenance before any approved release.