Skip to content

Cost & Optimization

Cost & Optimization is the money-and-efficiency service. It answers four questions in order: what did this workspace spend, on which model and which agent; what is wrong with the way that traffic is shaped; which model could carry it instead; and did the swap actually hold quality. Operators find it under Operate → Cost & Optimization — "Spend across models and agents, pricing, model-switch recommendations and parity testing".

Enterprise module

Cost & Optimization is an enterprise module in its entirety — the screens, the services and the APIs. A community installation sees the entry in the service catalog with an upsell page behind it; /api/cost/*, /api/prescriptions/* and /api/abacus/* return HTTP 402 per tenant without an enterprise licence, rather than a broken page. See Licensing.

The sub-navigation is the workflow, left to right:

PageWhat it is for
Model costsSpend per model, with pricing status
Agent costsThe same spend attributed to agents
AnalysisDeterministic per-agent / per-model metrics from traces
PrescriptionsAutomated reports with prescribed actions
RecommendationsCheaper / faster model candidates, computed from observed usage
Parity testsReplay real traffic against a candidate and score it
PricingThe effective-dated price catalog
ReportsSpend over time, daily / weekly / monthly

Two layers

The module does two different kinds of work, and it is worth knowing which one you are looking at, because they carry different weight.

Measurement and diagnosis — Model costs, Agent costs, Analysis, Prescriptions, Pricing and Reports — is computed from data the console already collects: the usage_daily rollup and agent traces. No model is called to produce a number, so the figures are reproducible and you can check them.

Simulation and proof — Recommendations, parity tests and the model matrix — is predictive. Recommendations replays observed token volume against other models' prices; parity tests and the model matrix replay real traffic against a candidate and score the answers. A recommendation is a projection; a parity test is a measurement. Do not act on the first without the second — a projected saving and a measured pass rate regularly disagree, and when they do, the pass rate is the one that matters.

Two RBAC service ids cover the module: cost for spend, analysis, prescriptions, pricing and reports, and abacus ("Cost intelligence: what-if repricing, model-switch recommendations and parity testing") for the predictive surfaces.

Pricing resolution stays in the community edition. Resolving which price applied on a given day runs on the ingest path, where trace-derived usage is priced before it is written to usage_daily. That rollup also feeds spend reporting, quotas and Model Hub figures, so a community install that never sees these screens still has to be able to resolve a price.

These are dashboard routes

/api/cost/*, /api/prescriptions/* and /api/abacus/* are dashboard APIs. They authenticate with a browser session and are tenant- and project-scoped from that session — a cpeer_… bearer token will not drive them. The token-authenticated public surface is /api/client/v1/*; see the API overview.

Model costs and Agent costs

Both pages read one source: the usage_daily rollup for the models service. Every distinct model that appears there is an observed model, and each one resolves to one of three pricing states.

Pricing source badgeMeaning
Model HubA Model Hub model — priced by the hub entry, edited in the Model Hub
External pricingNot in the hub; priced by this tenant's external catalog entry
UnpricedNo price anywhere — usage was recorded with cost 0

Model costs

Model costs: the Pricing source column is the one to read first. Spend is only trustworthy for rows that are not Unpriced — an unpriced row contributes real tokens and $0 of spend. The via Observability column separates trace-derived spend from gateway traffic.

Rows arrive from two directions. Calls that went through the console gateway land with source api. Calls the agent made directly to a provider land with source tracing, ingested from the agent's traces — which is why an agent that never touches the gateway still shows up here, as long as it reports traces (see Agent Tracing). The per-model split is carried on costBySource, and the Model costs table surfaces the trace-derived share in its via Observability column.

Agent costs groups the same rows by the tracing agentKey instead of the model, with a per-model composition inside each agent. Traffic with no agent attribution — plain gateway calls — is grouped under Unattributed (gateway). An agent whose models include an unpriced one is flagged: its spend reads low.

When any observed model has no price, both pages raise a banner. Model costs names how many models have usage but no pricing and how many tokens were recorded at $0; Agent costs names how many agents use models without pricing and links to the Pricing page.

Pricing

Pricing is the full catalog: every Model Hub model in scope, every external pricing entry, and every model observed in usage in the range — merged case-insensitively. Prices are effective-dated: an entry holds a list of versions, and the price used for a given UTC day is the version with the latest effectiveFrom on or before that day.

The Add pricing form takes the model name exactly as it appears in trace events (case-insensitive), the three rates — Input tokens — USD per 1M, Output tokens — USD per 1M, Cached input tokens — USD per 1M (optional) — and an Effective from day. Model Hub keys are rejected here on purpose: hub pricing always wins for hub models, so a catalog entry for one would be dead weight. When observed models are unpriced, Match from catalog bulk-matches them against the public market price feed.

Entering a price prices ingests from then on

This is the single most common surprise in the whole service. Cost is computed at ingest and written onto the rollup row. Entering a price today does not retro-price yesterday's traffic — recorded history is never rewritten by an edit. A model that ran for a month unpriced keeps a month of $0 rows.

The escape hatch is deliberate and manual: the Recalculate action on an external entry (POST /api/cost/pricing/reprice) walks the recorded rows and recomputes each one with the price effective on that row's day. The pricing form carries the same thing as a Recalculate recorded spend switch. Rows whose day is covered by no version keep their existing cost — an unknown price is not a free price. Model Hub models are rejected: their history was computed from hub pricing at ingest and is not repriceable here.

The external market price feed has its own endpoints (/api/model-price-catalog*): status, a paged entry listing, per-name suggestions, and a manual refresh. There are no background timers or schedulers — the in-memory catalog is refetched lazily when it is empty or older than 24 hours, and the refresh endpoint forces one.

Analysis

Analysis (/dashboard/cost/analysis) is the deterministic metric surface: "Deterministic, reproducible metrics from live traces — analyse an agent or a model, then jump into optimization". A segmented control switches between Agents and Models; window tiles show Sessions, Total tokens, Cache hit and Output share.

Underneath sit the cards that Prescriptions later reads as evidence: Deterministic insights (Tool menu / call, Tool schema complexity, Traffic language, AI calls / session, Tool calls / session, Input tokens / AI call, System prompt), System prompt checks, Repeated tool calls and Recurring errors. In model mode there is also Agents using this model. The header links out to Full observability (agent mode only) and Run model matrix.

The eight prompt checks — Size budget, Duplicate paragraphs, Duplicate sentences, Overall repetitiveness, Dynamic content in prefix (cache killer), Placeholder / unfinished content, Whitespace hygiene, Invisible / control characters — each report PASS, WARN or FAIL.

Rather than repeat the walkthrough here: Optimize token usage takes an agent from instrumentation through analysis, snapshot, evaluation and proof in one pass. Read that first if you are working an agent end to end.

Prescriptions

Analysis shows you numbers. Prescriptions decides which of those numbers are problems.

Automated analysis over observed traffic: deterministic detectors turn tracing + cost evidence into findings with prescribed actions. Numbers come from detectors only — nothing is estimated by a model.

Prescriptions list

The list is two cards. Eligibility is the trigger surface — it states the thresholds in words and marks each subject analysis due, up to date or not enough data. Reports is the history, newest first; the Findings column summarises severity counts and Est. savings shows where nothing could be priced.

What a report is

A report is generated for one subject over one window:

Subject kindEvidence used
AgentThe agent's tracing overview + its cost entry
ModelThe model's tracing overview + its observed-cost entry
Workspace (all traffic)The workspace cost report + per-agent costs + every observed model

The New analysis overlay collects the subject (section Subject: Kind, then Agent or Model name) and the window (section Window: Analysis windowLast 7 days, Last 14 days or Last 30 days), then Run analysis. Generation is asynchronous: evidence gathering reads full session windows, so it never runs inside the HTTP request. The report row appears immediately as pending, moves to running, then to ready or failed, and the page polls on its own.

While a report for the same subject is pending or running, asking for another one returns the in-flight report instead of enqueueing a duplicate.

Eligibility and the auto-run

The Eligibility card renders the rule with the live values substituted: Subjects with ≥N sessions in the last W days qualify for automatic analysis; a ready report older than S days counts as stale.

ThresholdEnvironment variableDefault
Sessions needed in the windowPRESCRIPTIONS_MIN_SESSIONS50
Age at which a ready report is stalePRESCRIPTIONS_STALE_DAYS7

The header's Analyze stale (N) button runs every eligible subject whose latest ready report is stale. It is scoped to the current tenant only, and it enqueues the workspace report plus at most ten agents per call. A subject with an in-flight report is never counted stale, so repeated clicks cannot pile up duplicates.

Eligibility lists the workspace and the agents observed in the window. Model subjects are not listed there — request one from New analysis with kind Model.

Finding anatomy

Prescription detail

A report with two critical findings. Read a card top-down: severity badge, category badge, title; the summary states what was measured; the evidence table shows the measured values the detector used; the bold Prescription: line is the action; the CTA on the right jumps to the screen where you fix it. Note the Est. savings tile reading — no finding in this report could be priced, and the tile refuses to invent a number.

Every finding carries:

PartValues / notes
Severitycritical, warn, info — findings are ordered by severity, then by savings
Categorycost, reliability, performance, hygiene
SummaryStates the measurement, and the threshold that fired where the detector has one
EvidenceLabel/value rows taken verbatim from the measured data
PrescriptionThe concrete action, plus an optional CTA
Est. savingsA conservative monthly estimate, or null

The CTAs are the ones the detectors emit: Open agent analysis, Open agent sessions, Open pricing, Open cost by agent, Open recommendations.

null savings means unpriceable, not zero

estMonthlySavingsUsd is null whenever the problem is real but cannot be priced from available data — typically because the model has no price, or no cached-token rate is known for it. The estimate is never guessed to fill the column. Cache savings, for example, are only computed when the model's pricing has both an input rate and a cached rate, and they are scaled to a conservative 50% attainable cache rate. Everything else reports .

Lifecycle

Each finding has an action pair: Applied and Dismiss, with Reopen on a dismissed one. applied is what makes the loop closable — mark the fix, re-run the report on the same subject later, and the detector either goes quiet or does not. Dismissed findings stay on the report, dimmed.

The narrative

The detail page has a Narrative card — "An LLM narrates the findings below — it is generated from them and adds no numbers of its own." Pick a hub model in the Narrator model (hub) select and press Generate (Regenerate afterwards).

Its role is strictly bounded, in the prompt and by design: it receives the finished findings as JSON and may use only figures that appear there, verbatim. It may not add findings, causes or savings; a finding with null savings gets no dollar figure attached. It orders by severity and writes a short executive summary. It runs only against a ready report. If you want to know where a number came from, the answer is always a detector — never the narrator.

The 17 detectors

The detector battery is the whole engine. Each detector runs only for the subject kinds it applies to, and a detector that throws is skipped rather than sinking the report.

Cost

FindingSubjectsFires when
Prompt cache barely usedagent, modelCache hit rate below 40% over ≥1M input tokens in the window; critical below 10%. Names the dynamic-prefix lint check as the likely cause when that check is not passing
Dynamic content in the prompt prefix (cache killer)agent, modelThe dynamic-prefix prompt-lint check is not passing; FAIL → critical
System prompt over the size budgetagent, modelThe size prompt-lint check is not passing; reports estimated tokens and characters
Very large context per model callagent, modelAverage input tokens per AI call ≥20,000; critical at ≥50,000
Tool menu larger than the agent usesagent, modelAverage menu ≥30 tools per call, or ≥10 offered tools were never called in the window
Anomalous spend daysworkspaceDaily spend days that sit far outside the workspace's own baseline (robust z ≥ 5)
Spend has shifted to a higher levelworkspaceThe last 7 days' median daily spend is at least 2× the prior two weeks' median. A drop by the same factor is reported as info under the mirrored title
Spend concentrated on premium-tier modelsworkspace≥70% of priced spend on top-tier models, with ≥$50 total priced spend. Severity info — it is a candidate for testing, not a defect
Models with heavy input volume and low cache hitworkspaceModels with ≥1M input tokens and a cache hit rate below 40%, ranked by priced opportunity

Reliability

FindingSubjectsFires when
The same error keeps recurringagent, modelOne error signature occurred ≥10 times in the window; critical at ≥50
Elevated session error rateagent, model≥5% of sessions ended in error, over at least 20 sessions; critical at ≥15%
Tools failing at a high rateagent, modelA tool with ≥20 calls and an error rate ≥30%; critical when any reaches 70%
High request error rate across the workspaceworkspace≥5% of at least 100 model requests errored; critical at ≥15%

Performance

FindingSubjectsFires when
Identical tool calls repeated inside sessionsagent, model≥10 wasted calls and ≥10% of analysed tool calls repeat an earlier call with identical arguments in the same session; critical at ≥30%

Hygiene

FindingSubjectsFires when
Abnormal traffic spike daysagent, modelDaily session counts deviate massively from the subject's own baseline (robust z ≥ 6)
Token usage with no price attachedworkspaceAny tokens recorded against unpriced models; critical when ≥20% of the window's tokens
Same model recorded under multiple keysworkspaceTwo or more usage keys normalize to the same underlying model name

API

Eight session-authenticated dashboard routes:

MethodEndpointDescription
GET/api/prescriptionsList reports (project-scoped)
POST/api/prescriptionsEnqueue a report → 202
POST/api/prescriptions/auto-runEnqueue for every stale eligible subject → 202
GET/api/prescriptions/eligibilityWhich subjects qualify, and which reports are stale
GET/api/prescriptions/:idReport detail (the UI polls this)
DELETE/api/prescriptions/:idDelete a report
PATCH/api/prescriptions/:id/findings/:findingIdFinding status: open / applied / dismissed
POST/api/prescriptions/:id/narrativeGenerate the narrative over a ready report

The window defaults to 14 days and is clamped to 3–90 days server-side, whatever the UI offers. See the Cost & Prescriptions API.

Recommendations

Enterprise module

Recommendations is part of the enterprise edition. The /api/abacus/* routes behind it are licence-gated per tenant and answer 402 without one. See Licensing.

/dashboard/cost/recommendations — "Optimization opportunities computed from observed usage — cost via pricing, latency via observed averages (no pricing needed)". (/dashboard/abacus is kept as an alias, so old links still resolve.)

Everything is computed on demand from the same usage_daily rollup, Model Hub pricing and the external pricing catalog. Trace-derived rows participate automatically, so agents that call providers directly are covered as long as their traces land in the console.

Recommendations

Two rows, one per target — an agent and a model — each proposing the same switch. The banner above the table is the important part: projections assume the observed token volume transfers 1:1 to the candidate, so they are directional until a parity test measures the real ratio.

Expanding a row is where the reasoning lives.

An expanded recommendation

Note the Compatibility checks row: three gates read UNKNOWN and the candidate is still ranked. Unknown is not a failure — see Hard gates below. Workload profile summarises what the traffic actually looks like, and Top candidates for this target shows the alternatives that were considered, including ones that would cost more (a negative saving).

Objectives

A segmented control picks Cost or Latency.

ObjectiveRanks onNeeds
CostProjected spend if the observed token volume ran on the candidatePriced usage
LatencyObserved average latency from the rollup's latency countersNothing but traffic — the on-prem path

Default thresholds: a segment must clear 50 requests, and a candidate must beat the baseline by 20% (savings, or latency gain) to surface. Each is overridable per request (min_requests, min_savings_pct, min_latency_gain_pct).

The Market catalog switch

Candidates come in three tiers, and the tier decides how actionable the advice is.

Tier badgeSourceActionability
HubA Model Hub LLMRoutable and parity-testable
ExternalObserved in the window, priced by the external catalogAdvice — the console cannot route to it
MarketThe community market price feedAdvice — add it to the hub to make it actionable

The Market catalog switch appears under the Cost objective only, and it is off by default. While it is off the market tier is not considered at all — only hub models and externally-priced observed models are, so an empty or dull feed is very often this switch alone. That is also where the open-weight universe lives: with the switch off, the only open-weight candidates you can see are the ones already in your Model Hub. Turning it on widens the pool to the whole priced, chat-capable market, deduplicated across hosts so a top-N cut is not filled with N copies of one model.

Columns

The shared columns are the expand caret, Target, Switch, Window, Requests, the objective-specific block, Confidence, and the row action. The objective changes the middle:

ObjectiveExtra columns
CostBaseline → projected · Savings · Monthly
LatencyTokens/req · Avg latency · Gain

Row badges carry the rest: the tier (Hub / External / Market), Open weights, No cache rate (the candidate publishes no prompt-cache price, so the cached slice of the prompt was projected at its full input rate — the saving shown is real but conservative), the evidence tier (Projected / Compatible / Parity-proven) and confidence (High confidence / Medium confidence / Low confidence, driven by traffic volume).

The expanded row

Expanding a row opens five blocks:

BlockWhat it shows
Score breakdownThe weighted components behind the composite score — savings, latency, quality — each labelled with its source (projected, measured, parity evidence, or size-tier prior)
Compatibility checksEach gate that ran, with pass or unknown, plus the count excluded by failed gates
Workload profileCache rate, tool schema count/band/depth, tools offered per turn, turns per session, primary language and non-English share
Self-hostingFor open-weight candidates: GPUs required, $/hour, $/month, expected tok/s, and break-even versus observed utilisation
Parity evidenceThe matched parity run: pass rate, average score, items, measured token ratio and latency, with a link to the run

Hard gates, and why unknown never excludes

Seven deterministic gates run before ranking. Capability facts come from the market price catalog, where an absent fact means unknown, never false.

Check idUI labelExcludes a candidate when
toolsTool callingThe workload calls tools and the candidate is known not to support them
contextWindowContext windowThe candidate's known max input is smaller than the observed requirement
outputTokensOutput tokensThe candidate's known max output is smaller than the observed requirement
qualityTierQuality tierThe candidate is more than one size tier below the baseline
promptCachePrompt cache≥40% of the segment's input comes from cache and the candidate publishes no cache price
toolComplexityTool complexityThe candidate is below the tier floor the workload's tool schemas, menu size and turn horizon demand
languageLanguageAt least 50% of the classified traffic is non-English and the candidate is documented English-first

Two rules matter more than the list:

A candidate that fails a gate is not shown at all. It is removed from the ranking and counted in the line "N candidates excluded by failed hard gates". A short candidate list on a cache-heavy, non-English, complex-tool workload is a finding, not a bug — the Workload profile block exists to show you why.

Unknown never excludes. Only a known incompatibility removes a candidate. A gate with missing data records unknown, the candidate stays in the ranking, and — absent parity evidence — the row's evidence tier is held at Projected: the recommendation is still made, but not claimed as verified.

Parity evidence overrides the prompt-cache, language, quality-tier and tool-complexity gates for the exact pair it proves. Evidence beats prior, always.

Parity tests and Model matrix

Enterprise module

Parity tests and the model matrix are part of the enterprise edition, on the same licence-gated /api/abacus/* surface as Recommendations.

/dashboard/cost/parity — "Quality-parity runs launched from cost recommendations — snapshot, suite and evaluation run per test". (/dashboard/abacus/parity is an alias.)

Where a run starts

Not on this page. A parity run starts from the row action on Recommendations, which opens the Run parity test overlay with the subtitle <current model> → <candidate model>. The overlay collects:

FieldNotes
Data sourceSample fresh traffic (mode snapshot) or Use existing dataset (mode existing-dataset)
Candidate modelA Model Hub LLM — the model under test. Pricing is not required
Judge modelA Model Hub LLM that scores answer equivalence against the recorded production answer
Evaluation datasetExisting-dataset mode only — an imported, snapshot or hand-built dataset, already anonymized at creation
Sampling % / Max itemsSnapshot mode only: defaults 10 and 100
PII categoriesSnapshot mode only — the anonymization gate is mandatory

A market or external candidate cannot be replayed; add it to the Model Hub first.

In snapshot mode the run is three stages behind one button: sample the target's real traffic into an evaluation dataset (behind the PII gate), create a suite targeting the candidate with a tool-call scorer and an llm-judge scorer, and enqueue the run. Existing-dataset mode skips straight to the suite. The overlay reports progress as Parity test in progressEvaluation run started, or Parity test failed. Nothing is cleaned up silently: if a later stage fails, the ids of the stages that succeeded are still linked, so a dataset created before a suite failure is inspectable.

The list on the Parity tests page has columns Created, Target, Switch, Judge, Items, Status and Links. The status badge reads Queued, Running, Ready or Failed (the underlying values are pending, running, ready, failed); a running row also names its stage. Results land on the normal evaluation run pages — see Evaluation & Analysis.

Model matrix

The Model matrix is a panel at the top of the Parity tests page, not a route of its own — the Run model matrix action on Analysis navigates here.

Replay ONE evaluation dataset against MANY candidate models and compare them side by side — pass rate, judge score, tool fidelity and measured cost per item.

Pick a Dataset, one or more Candidate models, a Judge model, and press Run matrix. Each candidate gets its own suite and run on the same dataset, enqueued in one launch and executed in the background; a candidate that fails validation is reported without stopping the others.

Results table: Candidate, Status, Pass, Judge, Tool fidelity, $ / item, Latency, Run. The Judge cell shows "N scored" under the average.

A completed model matrix

A run from the demo tenant, and a good example of why this exists. The recommendation engine had just proposed switching to the cheapest candidate on a projected 75% saving. The matrix replayed the same 186-item dataset against all three models and measured the incumbent at 65% pass while both alternatives scored 0% — the cheap model is not answering these questions the same way at all. A projection said switch; a measurement said no.

The footnote under the table matters too: judge and tool averages count only the items each scorer actually exercised. A dataset with no expected tool trajectories will show a tool fidelity of 0.00 over the items that were tested rather than a flattering 1.00 over none.

The judge cannot be trusted to grade itself

When the judge model is also among the candidates the panel says so:

Note: the judge model is also a candidate — its own row carries self-judgement bias.

Treat that row as indicative and confirm it with a different judge.

Two aggregation details keep the comparison honest. The tool-call scorer returns a perfect score when an item correctly expects no tools; averaging that blindly would inflate candidates on datasets without trajectories, so Tool fidelity averages only over items where tool behaviour was actually exercised (toolTested). Judge likewise averages only over items the judge actually scored (judgeScored) — which is what the "N scored" line reports. Neither average can be inflated by items that were never really tested.

What-if versus parity

These two words describe very different claims, and the difference decides how much you should trust a number.

What-if (Recommendations)Parity (Parity tests, Model matrix)
MethodStatic repricing of observed volumeA real replay of real traffic
Model called?NoYes — candidate and judge
Token volumeAssumed to transfer 1:1 to the candidateMeasured
QualityA size-tier priorMeasured: pass rate, judge score, tool fidelity
CostProjected from published pricesMeasured $ per item
Answers"Which candidates are worth testing?""Did this candidate actually hold up?"

What-if corrects itself. Once a completed parity run has measured a token ratio for a (current → candidate) pair, the recommendation engine stops using the 1:1 assumption for that pair and reprices with the measured ratio, marking the row as measured. The evidence tier reaches Parity-proven once that run is both large and clean enough — at least 50 completed items at a pass rate of 90% or better. The estimate is not a permanent guess; it is the starting point that evidence replaces.

There is deliberately no tokens objective. Under a 1:1 transfer assumption every candidate ties on tokens, so a static what-if cannot rank on it — the ranking would be meaningless rather than merely imprecise. Put plainly: cost needs pricing; latency works from observed averages and needs none; token savings cannot be estimated, only measured — which is exactly what a parity test is for.

Internal signals with no screen of their own

Three helpers produce numbers you will see attributed to other places:

HelperWhere it surfaces
Workload signalsThe Workload profile block on Recommendations (cache rate, tool schema band and depth, tool menu size, turns per session, primary language and non-English share), and the Tool schema complexity / Traffic language tiles on Analysis
Model traitsNot shown directly — it feeds the Quality tier row and the tier gate
GPU hourly ratesThe Self-hosting block on Recommendations

Self-hosting figures are indicative, not a quote

The $/GPU-hour numbers behind the Self-hosting block are order-of-magnitude public on-demand rates. They are not a quote: reserved capacity, spot and owned hardware all land well below them, so the estimate is conservative in the direction of "self-hosting looks more expensive". Override the rate per request with the gpu_hourly_usd query parameter.

Read the source field before quoting the block. fleet means it was sized on an accelerator the tenant actually owns; reference means there was no readable fleet and an H100 PCIe stood in. A reference estimate answers "is this worth exploring", not "this is your bill". See GPU Fleet.

Snapshot dataset items also carry a lang:<iso> tag, so parity and matrix results can be read per language rather than as one blended number.

Reports

Cost Reports — "Spend over time — daily, weekly or monthly, per project or across all projects." Two segmented controls set the scope (This project / All projects) and the granularity (Daily / Weekly / Monthly), alongside a date filter.

The page shows the series table (Day / Week of / Month, Requests, Errors, Tokens, Spend) plus the top models and top agents for the range, each with Requests, Tokens and Spend. The same report is what the workspace-subject detectors read for spend anomalies, regime shifts and the workspace error rate.

For per-token, per-user and per-key attribution — budgets, quotas and spend grouping — see the Spend & Budgets API.

Things that surprise people

SurpriseWhy
Adding a price did not change last month's spendCost is computed at ingest and history is never rewritten. Use Recalculate on an external entry — hub models cannot be repriced
A model shows tokens but $0 spendIt is Unpriced. Add pricing, or use Match from catalog
An agent's spend reads lowOne of its models is unpriced; the row is flagged for exactly this reason
A model appears twice under slightly different namesSplit usage keys — the "Same model recorded under multiple keys" detector names them
The savings column shows The finding is real but could not be priced. A number is never guessed to fill the column
Recommendations shows nothing usefulThe Market catalog switch is off by default, and without it the whole market tier — and with it nearly every open-weight candidate — is never considered
A cheap model you expected is missingIt failed a hard gate and was excluded, counted in "N candidates excluded by failed hard gates". Unknown capability never excludes — only a known incompatibility does
Latency recommendations appear where cost ones do notThe latency objective needs no pricing at all; the cost objective cannot run on unpriced traffic
The narrative added no new insightBy design. It narrates the findings and is forbidden from introducing numbers, causes or savings of its own
Prescriptions ignores a busy agentIt is below PRESCRIPTIONS_MIN_SESSIONS in the window, or a report already exists and is not yet stale
The judge model scored itself wellIf it is also a candidate, the panel warns about self-judgement bias — re-run with a different judge
Enterprise pages return 402Recommendations, Parity tests and the model matrix are enterprise; every /api/abacus/* route is licence-gated per tenant

Community edition is AGPL-3.0. Commercial licensing and support are available separately.