Retrieval workload planner

RAG cost calculator

Model generation and retrieval together so a low token estimate does not hide search and storage cost.

RAG Cost Calculator

Estimate retrieval-augmented generation cost with model steps, embeddings, vector storage and retrieval allowances.

Workload
Tasks completed without needing a rerun
Model usage
Source-linked public list pricing; update before planning spend
Agent behavior
Extra requests after failures or incomplete outputs
Traces, logs, evaluation and retention allowance
Optional escalation or quality-review allowance
Visible uncertainty around your chosen assumptions
RAG & tools
Third-party APIs, browser or search services
Embeddings, vector reads and storage allowance

Estimated monthly cost

$0

Planning range: —

↘ Model your drivers
$0.000Cost / request
$0.000Cost / successful task
—Cost / 100 users

Cost breakdown (monthly)

Model tokens$0
Tools & RAG$0
Observability$0
Human review$0
Retries$0
Top driver: model tokens

Try caching stable context to reduce repeated input cost.

⌁ How the estimate works

Monthly cost combines model tokens, tools, RAG, observability, human review and retry behavior from your editable assumptions.

monthly = model + tools + RAG + observability + human review + retries

▣ Sources & assumptions

Rate records are source-linked and versioned. Always check the provider page before final budgeting.

? FAQ

Why can an invoice differ? Contracts, taxes, regional pricing, tool metering and usage behavior can change the final bill.

RAG is a chain of meters

RAG can include document preparation, embedding, vector storage, vector reads, reranking, context tokens and answer generation. Use a per-task allowance for the non-token parts until you have a detailed usage export.

Frequently asked questions

Does API list pricing equal my monthly cost?

No. List pricing is one input. Your bill can also reflect output length, cache behavior, retries, tool calls, storage, regional or contract terms, taxes and provider-specific metering.

Why estimate cost per successful task?

Requests that fail, retry, or need manual recovery still consume resources. Cost per successful task connects technical usage to the outcome your product actually delivers.

Can I use custom pricing?

Yes. Select Custom rates in the calculator and enter your own input and output price per million tokens. This is useful for negotiated or provider-specific terms.