pi-vertex

A Google Vertex AI provider for the Pi Coding Agent — giving you access to Gemini, Claude, Llama, DeepSeek, Qwen, Mistral, and other MaaS models through a single provider, billed through your GCP project.

About this fork

This is a fork of @ssweens/pi-vertex. The original is excellent on features (43 models, unified streaming, tool calling, thinking/reasoning support) but is shipped as part of a mono-repo without tests, CI, placeholder npm scripts (echo 'nothing to check').

This fork is created to add new models, fix some bugs, add tests, and to move out of a big combined mono-repo:

What's been added

Improvement	Details
88 unit tests	auth.ts, config.ts, utils.ts, models/, streaming/index.ts, streaming/gemini.ts, streaming/maas.ts, convertToGeminiMessages — covering message conversion, tool call normalization, cost calculation, auth resolution, model validation
GitHub Actions CI	Type-check (tsc --noEmit), lint (biome check), test + coverage on every push/PR
Biome linting/formatting	Catches noExplicitAny, enforces import sorting, consistent formatting
Real npm scripts	build, check, test, test:coverage, clean
Bug fixes	Fixed Anthropic stream lifecycle so streams end exactly once; removed hardcoded maxTokens / 2 halving; hardened Gemini message conversion, cache accounting, image tool results, missing tool results, and blocked-finish handling
Standalone repo	Filtered from the ssweens/pi-packages monorepo with git filter-repo for focused development

Fork provenance

• Original upstream: ssweens/pi-packages (path: pi-vertex/)
• Fork point: v1.1.4 (commit 598534cf, 2026-03-30)
• Filtered with: git filter-repo --path pi-vertex/ --path-rename pi-vertex/: (preserves full upstream git history)
• This repo: lhl/pi-vertex

pi install npm:@lhl/pi-vertex
export GOOGLE_CLOUD_PROJECT=your-project-id
export GOOGLE_APPLICATION_CREDENTIALS=/path/to/key.json

Set your GCP project and credentials. Vertex AI models (Gemini, Claude, Llama, DeepSeek, Qwen, Mistral, and others) appear in pi's model selector, billed through your GCP project.

Features

• 43 models across 4 categories:

  • Gemini (9): 3.5 Flash, 3.1 Pro, 3.1 Flash-Lite, 3 Flash, 2.5 Pro, 2.5 Flash, 2.5 Flash-Lite, 2.0 Flash, and 2.0 Flash-Lite
  • Claude (10): Opus 4.7, Opus 4.6, Sonnet 4.6, 4.5, 4.1, 4, Haiku 4.5, 3.5 Sonnet v2
  • Llama (3): 4 Maverick, 4 Scout, 3.3 70B
  • Other MaaS (21): Grok, Gemma, Mistral, DeepSeek, Qwen, OpenAI GPT-OSS, Kimi, MiniMax, GLM

• Unified streaming: Single provider, multiple model families

• Full tool calling support: All models with multi-turn tool use and proper tool result handling

• Thinking/reasoning: Gemini 3 thinking levels, Gemini 2.5 thinking budgets, thought signature preservation

• Automatic auth: Uses Google Application Default Credentials

• Region awareness: Global endpoints where supported, regional where required

• Pricing tracking: Built-in cost per token for all models (including thinking tokens)

Installation

# Via pi (recommended)
pi install npm:@lhl/pi-vertex

# Or via npm
npm install -g @lhl/pi-vertex

# Or from source
git clone https://github.com/lhl/pi-vertex.git
cd pi-vertex
npm install
# pi install /path/to/pi-vertex

Setup

1. Authenticate with Google Cloud

# Option A: User credentials (development)
gcloud auth application-default login

# Option B: Service account (production)
export GOOGLE_APPLICATION_CREDENTIALS=/path/to/service-account-key.json

2. Set environment variables

# Required: Your GCP project ID
export GOOGLE_CLOUD_PROJECT=your-project-id

# Optional: Override default region
export GOOGLE_CLOUD_LOCATION=us-central1

3. Configuration file (optional)

For persistent settings, create ~/.pi/agent/settings/pi-vertex.json:

{
  "googleCloudProject": "my-gcp-project",
  "googleCloudLocation": "us-central1",
  "googleApplicationCredentials": "/path/to/service-account.json"
}

Config file values take priority over environment variables.

4. Verify setup

pi --provider vertex --model gemini-2.5-pro --version

Usage

Command line

# Use any supported model
pi --provider vertex --model claude-opus-4-7
pi --provider vertex --model gemini-2.5-pro
pi --provider vertex --model llama-4-maverick
pi --provider vertex --model deepseek-v3.2

# With options
pi --provider vertex --model claude-sonnet-4-6 --reasoning high

Shell alias (recommended)

Add to ~/.bashrc or ~/.zshrc:

# Claude 4.7 Opus
alias pic="GOOGLE_CLOUD_PROJECT=your-project pi --provider vertex --model claude-opus-4-7"

# Gemini 2.5 Pro
alias pig="GOOGLE_CLOUD_PROJECT=your-project pi --provider vertex --model gemini-2.5-pro"

# Llama 4 Maverick
alias pil="GOOGLE_CLOUD_PROJECT=your-project pi --provider vertex --model llama-4-maverick"

Model Reference

Gemini Models

Model	Context	Max Tokens	Input	Reasoning	Price (in/out)
gemini-3.5-flash	1M	65,535	text, image	✅	$1.50/$9.00
gemini-3.1-pro	1M	65,536	text, image	✅	$2.00/$12.00
gemini-3.1-flash-lite	1M	65,535	text, image	✅	$0.25/$1.50
gemini-3-flash	1M	65,536	text, image	✅	$0.50/$3.00
gemini-2.5-pro	1M	65,536	text, image	✅	$1.25/$10.00
gemini-2.5-flash	1M	65,536	text, image	✅	$0.30/$2.50
gemini-2.5-flash-lite	1M	65,536	text, image	✅	$0.10/$0.40
gemini-2.0-flash	1M	8,192	text, image	❌	$0.15/$0.60
gemini-2.0-flash-lite	1M	8,192	text, image	❌	$0.075/$0.30

Claude Models

Prices shown are for the global endpoint. Non-global Vertex regions use costRegional where Google publishes a regional premium.

Model	Context	Max Tokens	Input	Reasoning	Price global (in/out)	Price regional (in/out)
claude-opus-4-7	1M	128,000	text, image	✅	$5.00/$25.00	$5.50/$27.50
claude-opus-4-6	1M	128,000	text, image	✅	$5.00/$25.00	$5.50/$27.50
claude-sonnet-4-6	1M	128,000	text, image	✅	$3.00/$15.00	$3.30/$16.50
claude-opus-4-5	200K	32,000	text, image	✅	$5.00/$25.00	$5.50/$27.50
claude-sonnet-4-5	200K	64,000	text, image	✅	$3.00/$15.00	$3.30/$16.50
claude-haiku-4-5	200K	64,000	text, image	✅	$1.00/$5.00	$1.10/$5.50
claude-opus-4-1	200K	32,000	text, image	✅	$15.00/$75.00	(uniform)
claude-opus-4	200K	32,000	text, image	✅	$15.00/$75.00	(uniform)
claude-sonnet-4	200K	64,000	text, image	✅	$3.00/$15.00	(uniform)
claude-3-5-sonnet-v2	200K	8,192	text, image	❌	$3.00/$15.00	(uniform)

Llama Models

Model	Context	Max Tokens	Input	Reasoning	Price (in/out)	Region
llama-4-maverick	524K	32,000	text	✅	$0.35/$1.15	global
llama-4-scout	1,310K	32,000	text	✅	$0.25/$0.70	global
llama-3.3-70b	128K	8,192	text	❌	$0.72/$0.72	global

Other MaaS Models

Model	Context	Publisher	Price (in/out)	Region
grok-4.20-reasoning	200K	xai	$1.25/$2.50	global
grok-4.1-fast-reasoning	128K	xai	$0.20/$0.50	global
gemma-4-26b-a4b-it	262K	google	$0.15/$0.60	global
mistral-medium-3	128K	mistralai	$0.40/$2.00	global
mistral-small-3.1	128K	mistralai	$0.10/$0.30	global
mistral-ocr	30 pages	mistralai	$0.0005/page	global
codestral-2	128K	mistralai	$0.30/$0.90	global
deepseek-v3.2	163K	deepseek-ai	$0.56/$1.68	global
deepseek-v3.1	163K	deepseek-ai	$0.60/$1.70	global
deepseek-r1	163K	deepseek-ai	$1.35/$5.40	global
deepseek-ocr	Varies	deepseek-ai	$0.0003/page	global
qwen3-235b	262K	qwen	$0.22/$0.88	global
qwen3-next-instruct	262K	qwen	$0.15/$1.20	global
qwen3-next-thinking	262K	qwen	$0.15/$1.20	global
qwen3-coder	262K	qwen	$0.22/$1.80	global
gpt-oss-120b	131K	openai	$0.09/$0.36	global
gpt-oss-20b	131K	openai	$0.07/$0.25	global
kimi-k2-thinking	262K	moonshotai	$0.60/$2.50	global
minimax-m2	196K	minimaxai	$0.30/$1.20	global
glm-5	200K	zai-org	$1.00/$3.20	global
glm-4.7	200K	zai-org	$0.60/$2.20	global

Regional Endpoints

Models use different endpoints based on availability:

• Global (most models): aiplatform.googleapis.com
• Regional (older Claude models): {region}-aiplatform.googleapis.com

Default regions by model:

• Gemini: global
• Claude (all): global
• MaaS: global

Override with:

export GOOGLE_CLOUD_LOCATION=us-central1

Architecture

┌─────────────┐
│     Pi      │
└──────┬──────┘
       │ registerProvider("vertex")
       ▼
┌─────────────┐
│  pi-vertex  │
└──────┬──────┘
       │ streamSimple(model, context, options)
       ▼
┌─────────────────────────────────────┐
│         Handler Dispatch            │
├──────────────┬──────────────────────┤
│   Gemini     │        MaaS          │
│  (@google/   │  (OpenAI-compatible  │
│   genai)     │   endpoint)          │
└──────────────┴──────────────────────┘

Dependencies

• @google/genai: Google GenAI SDK for Gemini models
• @anthropic-ai/vertex-sdk: Official Anthropic-on-Vertex SDK for Claude models (native streaming)
• google-auth-library: ADC authentication for all models
• @mariozechner/pi-ai: Peer dependency
• @mariozechner/pi-coding-agent: Peer dependency

License

MIT