Documentation

Presets

Save a model, a system prompt and parameters under one name.

What a preset is

A preset stores a model, a system prompt and default parameters under a short name. Create them under Presets; each one gets a slug from its name, for example code-reviewer.

Using one

Send @preset/<slug> where the model id goes. The preset fills in the model, prepends its system prompt and supplies defaults for temperature, top_p and max_tokens. Anything you pass explicitly still wins.

JSON
1{2  "model": "@preset/code-reviewer",3  "messages": [{ "role": "user", "content": "Review this diff." }]4}

Presets are private to your account, so a slug only resolves for your own keys. An unknown one returns 404 preset_not_found.

Why bother

  • Change model or prompt without deploying code.
  • Keep a long system prompt out of every request body.
  • Give several services the same behaviour by name.