Documentation
How to call the llm-bench API: quickstart, reference, errors, and what we do with your data.
The llm-bench API is OpenAI-compatible: you point the SDK you already use at our
base URL and change the key. What differs is what model means — here it names a
capability, a task you define, and we choose the model that serves it.
Start with the Quickstart. The reference pages below are for when you need a specific field, header or error code.
The Terms of Service, Privacy Policy and Data Processing Agreement govern use of the API. Where anything on these pages differs from those, those govern.
- Quickstart
Point the OpenAI SDK you already use at llm-bench and make a working call in under ten lines — including what to vault first and what `model` means here.
- API Reference: Data Plane
The OpenAI-compatible chat completions and Batch endpoints: what matches OpenAI exactly, what differs, every llmbench extension field, every response header, and the errors you can get.
- API Reference: Control Plane
Everything you can do with a management-scope key: API keys, account, provider credentials, capabilities, routing policies, schemas, validators, webhooks, usage and billing.
- Prompt Variables and Capabilities
Define your own task: how prompt variables are substituted, how a capability's prompts, output schema and validators are created and edited, and what an edit changes.
- Lifecycle and What You Pay
How a task moves from exploring to a fixed price, who pays for the model calls we make along the way, and how to see what you were actually charged.
- Error Reference
Every error code the OpenAI-compatible plane can return, what it means, and what to do about it.
- Migrating from OpenAI
What changes and what does not when you repoint an OpenAI SDK at llm-bench: base URL and key, the model field becoming a task slug, what fails loudly, what you gain, and the friction to expect.
- Data and Privacy
What we store, for how long, who else sees it, and what a deletion request does and does not reach — a plain-language index into the legal documents that govern.