Sunday, August 30, 2026

Weave Router

★2,891Worth testing
DemoAPI

Drop-in model router for agent stacks — scores each action and sends it to the right model in under 50ms so you cut spend without rewriting tools.

Weave Router

Why it matters

Weave Router is an open Go proxy from WorkWeave built for agentic traffic. You point Anthropic, OpenAI, or Gemini-shaped clients at one endpoint. A cluster scorer (Avengers-Pro style, ONNX embedder in-process) chooses among the models you enabled for that action — not a vibes prompt and not only fallback when a key dies. It speaks Messages, Chat Completions, and Gemini native, including tools, vision, and streaming, and can reach OSS models through OpenRouter or any OpenAI-compatible backend. BYOK keys stay local and encrypted; OTLP traces drop into Weave’s dashboard or your own collector.

Most coding agents burn one expensive default model on every tool call. Weave Router sits in front of Claude Code, Codex, Cursor, and friends, picks the model per action with a local embedder, and keeps provider keys on your box. Founders get continuity plus a real cost lever, not another key-rotation dashboard.

How it works

Fastest path: npx @workweave/router wires Claude Code, Codex, opencode, or pi to the hosted router. For full control, make full-setup boots Postgres plus the router on localhost:8080 with a local rk_ key and optional dashboard. Point your agent’s base URL at the proxy, leave keys in env or BYOK storage, and inspect /v1/route when you want the decision without proxying. Optional HMM sidecar for a frozen policy if the default cluster scorer is not enough.

Not a multi-key fallback gateway and not a token compressor. The job is semantic routing per action so cheap models handle routine steps and strong models handle hard ones, with one endpoint change across the agent tools you already use.

Capabilities

DemoAPI
  • Public demo available
  • API / SDK surface

Similar tools

model-routerai-gatewayagentsclaude-codecost
Source ↗

Via github

X