pi-lean-host

Placeholder for future pi-lean-portal browser benchmarking suite. Host is the evaluation harness for BrowserPlugin backends against BrowserGym task suites (MiniWoB, WebArena, etc.).

Packages

Package details

extension

Install pi-lean-host from npm and Pi will load the resources declared by the package manifest.

$ pi install npm:pi-lean-host
Package
pi-lean-host
Version
0.0.1
Published
Jul 5, 2026
Downloads
not available
Author
sofuego
License
AGPL-3.0-only
Types
extension
Size
37.4 KB
Dependencies
0 dependencies · 5 peers

Security note

Pi packages can execute code and influence agent behavior. Review the source before installing third-party packages.

README

pi-lean-host

Placeholder for future pi-lean-portal browser benchmarking suite.

pi-lean-host is the evaluation harness for pi-lean-portal BrowserPlugin backends against BrowserGym task suites (MiniWoB, WebArena, WorkArena, etc.).

This package is research tooling — it consumes pi-lean-portal's BrowserPlugin interface and runs behavioral evaluation tests (MiniWoB, WebArena, custom task packages) against any plugin implementation.

Status

🚧 Placeholder — the §1.0 CDP endpoint spike has completed successfully (see docs/cdp-endpoint-spike.md), proving that two Playwright clients can share one Chromium instance via CDP attach with no @e-ref contamination. Full implementation follows the BrowserGym migration plan.

Planned contents

  • adapter/browsergym-bridge.py — Python JSON-RPC adapter for BrowserGym task setup/validate
  • adapter/browsergym-adapter.ts — TypeScript wrapper, CDP attach, task lifecycle
  • solvers/ — Trivial solvers for MiniWoB parity validation
  • suites/ — Test files that run BrowserGym tasks against BrowserPlugin backends
  • scripts/setup-venv — Dedicated BrowserGym virtual environment
  • scripts/setup-miniwob — MiniWoB++ HTML content checkout

npm namespace

pi-lean-host is published to npm as a placeholder (0.0.1) to reserve the name. Real content ships under later versions.

License

AGPL-3.0-only