Skip to main content
A model is served by a provider inside a workspace. Pass workspace_id on reads and writes. Reads need models:read and writes need models:write.

List models

Send gateway_name to the gateway to route inference to this model.

Get a model

Create a model

string
required
The workspace the model belongs to.
string
required
The provider that serves the model.
string
required
The internal model name.
string
required
A readable label for the model.
string
required
One of chat, embedding, moderation, vision, audio, or image.
number
required
Cost per input unit.
number
required
Cost per output unit.
integer
required
The context window size in tokens.
string
The name the upstream provider expects, if it differs from name.

Update a model

Accepts any create field except provider_id. Send workspace_id in the body.

Delete a model