pi-omlx-tps

Pi extension that shows OMLX inference data in the processing prompt

Packages

Package details

extension

Install pi-omlx-tps from npm and Pi will load the resources declared by the package manifest.

npm report

$ pi install npm:pi-omlx-tps

Package: pi-omlx-tps
Version: 0.1.0
Published: Jun 18, 2026
Downloads: not available
Author: nathandaven
License: MIT
Types: extension
Size: 5.6 MB
Dependencies: 0 dependencies · 1 peer

Pi manifest JSON

{
  "extensions": [
    "./index.ts"
  ],
  "video": "https://github.com/nathandaven/pi-omlx-tps/raw/refs/heads/main/screenshots/demo.mp4",
  "image": "https://github.com/nathandaven/pi-omlx-tps/raw/refs/heads/main/screenshots/4-generating.jpg"
}

Security note

Pi packages can execute code and influence agent behavior. Review the source before installing third-party packages.

README

pi-omlx-tps

This extension is basic and adds omlx stat reporting using the built in omlx stats endpoint. The goal was to bring the stats given by the webui to the processing prompt. It also adds data each turn to the bottom status bar on tokens in/out and time elapsed.

Example:

 ⠴ Loading model... (17.0% complete, 31.2s remaining, 3.4gb/25.4gb used)
 ⠏ Preparing... (21.2gb/25.7gb used)
 ⠼ Prefilling... (83.7% complete, 31.6s remaining, 22.7gb/25.1gb used)
 ⠸ Generating... (20.0 tok/s, 2.1s elapsed, 20.1gb/25.3gb used)

The maxmium ram defaults to the hard limit value, not soft. This is not configurable at the moment.

If you have a api key configured in the web ui, the extension will use the api key stored in the pi auth storage as a first try. This lets it work with pi-omlx-picker. It is reccomended to just use this for omlx model configuration and API key confgiuration. As a fall back, it will use the OMLX_API_KEY env variable.

Install

# npm
pi install npm:pi-omlx-stats

# git
pi install git:github.com/nathandaven/pi-omlx-tps

Configuration

Below env variables are available (defaults given):

# Used to create a log file. Log file stored at `/tmp/omlx-tps.log`. Set to 1 to enable.
OMLX_TPS_EXTENSION_DEBUG=
# Omlx base url.
OMLX_BASE_URL="http://127.0.0.1:8000/v1"
# If you have set up an API key for the web ui, set it here.
OMLX_API_KEY=

Screenshots

License

MIT