@agimon-ai/doompi-computer-use

Session scoped semantic computer control through the DoomPi Desktop capability.

Packages

Package details

extension

Install @agimon-ai/doompi-computer-use from npm and Pi will load the resources declared by the package manifest.

npm repohome report
$ pi install npm:@agimon-ai/doompi-computer-use
Package
@agimon-ai/doompi-computer-use
Version
0.0.1-alpha.13
Published
Sep 9, 2026
Downloads
423/mo · 423/wk
Author
agiflow-ai
License
MIT
Types
extension
Size
327.9 KB
Dependencies
5 dependencies · 1 peer
Pi manifest JSON
{
  "extensions": [
    "./dist/extensions/pi.mjs"
  ]
}

Security note

Pi packages can execute code and influence agent behavior. Review the source before installing third-party packages.

README

@agimon-ai/doompi-computer-use

Session-scoped semantic computer control through the DoomPi Desktop capability.

Requirements

  • Node.js 22.19.0 or newer
  • DoomPi Desktop with Computer Use available
  • @earendil-works/pi-coding-agent 0.85.0

Install

pi install npm:@agimon-ai/doompi-computer-use

Use

Enable the default-off Computer Use minor mode in the cockpit. Its Activity section then lists eligible Desktop targets, lets you select one, and starts the activation and confirmation flow. Only one session can hold a live Desktop run.

The computer-use minor mode exposes Activate, Deactivate, and Doctor actions. /computer-use reports the current state.

While active, the package exposes three tools:

  • computer_state observes the authorized window and returns a semantic snapshot.
  • computer_action performs one semantic press, focus change, value change, or scroll against a current snapshot.
  • computer_exec runs a trusted, explicitly allowed local TypeScript script with JSON input, then returns a fresh observation.

Computer scripts are trusted Node.js code and are not sandboxed. Configure exact allowed paths with DOOMPI_COMPUTER_USE_SCRIPT_PATHS and review every script before allowing it. See Author computer scripts for the execution contract, limits, and an example.

All three tools and their model guidance remain unavailable during setup and are exposed only after the native grant becomes active. The Activity section shows activation status, busy ownership, stop controls, and completed recording or trace metadata. Browser clients cannot call observation or action routes.

Public API

import { activateComputerUseExtension, createComputerUseSessionClient } from '@agimon-ai/doompi-computer-use';

The session API entry is available at @agimon-ai/doompi-computer-use/session-api. Its agent and hub routes use separate host-issued context tokens. Grants remain opaque and session-bound inside the request broker.

Development

pnpm fixcode
pnpm typecheck
pnpm test
pnpm build

License

MIT