English · 简体中文
Important
This is the official public documentation, issue tracker, and release home for Misceo. The product is distributed as prebuilt binaries through npm. Source code is not included in this repository.
Cut AI-agent costs without breaking conversations or tool loops.
Misceo is a local Anthropic-compatible gateway. It routes eligible requests through a lower-cost model, checks the completed candidate, and escalates to a stronger model when policy requires it.
Unlike a request-only router, Misceo also protects agent state: session continuity, cross-model transcript compatibility, and ownership of active tool loops.
Strong-only routing is simple but pays strong-model cost for every request. Cheap-only routing lowers spend but cannot recover when the answer is empty, malformed, or inadequate.
A static router decides before generation. Misceo can also inspect the first completed candidate before choosing which answer the client receives.
| Strategy | Decision point | Trade-off |
|---|---|---|
| Strong-only | Before generation | Consistent quality posture; strong-model cost on every request. |
| Cheap-only | Before generation | Lowest routing overhead; no automatic recovery. |
| Static router | Before generation | Uses request metadata but cannot inspect the generated answer. |
| Misceo | Before and after the first attempt | Accepts a checked candidate or regenerates with a stronger model. |
Misceo does not make a cheaper model equivalent to a stronger model. It makes the cost-versus-quality policy explicit, observable, and configurable.
flowchart LR
A["Anthropic-compatible client"] --> B["Misceo local gateway"]
B --> C{"Protected route?"}
C -->|"Yes"| S["Strong backend"]
C -->|"No"| L["Lower-cost attempt"]
L --> G{"Structural gate"}
G -->|"Fail"| S
G -->|"Pass"| J{"Judge policy"}
J -->|"Accept or skip"| R["Return candidate"]
J -->|"Reject or fail closed"| S
S --> R2["Return regenerated answer"]
B --> O["Local history and dashboard"]