Editors & tools

Ollima in VS Code

Use the Ollima catalog as the models behind your AI coding assistant. Because the gateway is OpenAI-compatible, any VS Code extension that takes a custom OpenAI-shape endpoint works — point it at Ollima, drop in your key, and code against kimi-2.7 and friends.

Install

The Ollima catalog works in any VS Code extension that supports a custom OpenAI-compatible endpoint. Pick one and install it from the Extensions panel (Ctrl+Shift+X / ⇧⌘X):

Then add your key and the models as shown below. A preconfigured Ollima extension with this catalog built in is on the way — until it lands, use any of the above.

How it works

Every extension needs the same four values. The field names differ; the values don't:

FieldValue
Provider / API typeOpenAI Compatible — not plain "OpenAI"
Base URL / API basehttps://api.ollima.com/v1/
API keyyour sk-t0-…
Model IDan alias from the table below, e.g. kimi-2.7
The base URL must end in a trailing slash (/v1/). Without it, most clients drop the path and you get a 404. This is the single most common setup mistake.

Mint a key

Sign in at app.ollima.com, open the Keys page, click Create key, and copy the sk-t0-… value once — we never show it again. Use one key per machine so a lost laptop is a one-line revoke. Set a monthly spend cap while you're there.

Configure the models

For Continue-based extensions (including the Ollima build), models live in a YAML config. Click the gear icon in the chat panel to open it, or edit it directly:

Paste the catalog — replace sk-t0-… with your real key in each entry:

# ~/.continue/config.yaml
models:
  - name: Kimi K2              # default — agentic coder (chat + agent)
    provider: openai
    model: kimi-2.7
    apiBase: https://api.ollima.com/v1/
    apiKey: sk-t0-…
    roles: [chat, edit, apply]
    capabilities: [tool_use]     # required for Agent mode — see below
    defaultCompletionOptions: { maxTokens: 8192 }   # reasoning model — give it headroom

  - name: Qwen3 Coder Next     # fill-in-middle autocomplete
    provider: openai
    model: qwen3-coder-next
    apiBase: https://api.ollima.com/v1/
    apiKey: sk-t0-…
    roles: [autocomplete]

  - name: DeepSeek V4          # flagship coder, 1M context
    provider: openai
    model: deepseek-v4
    apiBase: https://api.ollima.com/v1/
    apiKey: sk-t0-…
    roles: [chat, edit]
    capabilities: [tool_use]

Save, and the models appear in the chat model dropdown immediately — no restart. Pick Kimi K2 to start.

Models & roles

Roles tell the extension which model to use for each job: chat (the conversation panel), autocomplete (inline ghost-text), edit (in-place rewrites), and apply (applying a suggested diff).

AliasGood forSuggested roles
kimi-2.7Default. Agentic coder — chat, edits, applying diffs.chat, edit, apply
qwen3-coder-nextFill-in-middle inline completion.autocomplete
deepseek-v4Flagship coder, 1M context.chat, edit, apply
deepseek-v4-flashCheapest strong coder — fast apply.autocomplete, chat, apply
minimax-m3 (premium)Agentic coder, strong SWE-bench.chat, edit
glm-5.1 (premium)Top-ranked coding/agentic model.chat, edit
Use qwen3-coder-next for autocomplete — it does real fill-in-middle. Avoid reasoning models here: they spend the token budget on internal reasoning and can return empty completions.

Strongest coding picks

Beyond the core models above, the catalog has a dedicated coding lane. The current open-weights benchmark leaders are deepseek-v4 (80.6% SWE-bench Verified) and minimax-m3 (80.5%) — both priced under $3 / 1M output. Drop these into the same config.yaml:

# strong coders — add alongside the models above
  - name: DeepSeek V4          # flagship coder, 1M context
    provider: openai
    model: deepseek-v4
    apiBase: https://api.ollima.com/v1/
    apiKey: sk-t0-…
    roles: [chat, edit, apply]

  - name: DeepSeek V4 Flash    # cheapest strong coder — great for autocomplete
    provider: openai
    model: deepseek-v4-flash
    apiBase: https://api.ollima.com/v1/
    apiKey: sk-t0-…
    roles: [autocomplete, chat]

  - name: MiMo v2.5 Pro        # agentic coding, long context
    provider: openai
    model: mimo-v2
    apiBase: https://api.ollima.com/v1/
    apiKey: sk-t0-…
    roles: [chat, edit, apply]
AliasGood forOutput $/1M
deepseek-v4Flagship coder — hard refactors, multi-file.$0.87
deepseek-v4-flashCheapest strong coder — autocomplete.$0.18
minimax-m3Agentic / tool-use coding.$1.20
qwen3-plus · qwen3-35bLong-context Qwen coders.$1.28 · $1.00
mimo-v2MiMo — agentic, 1M context.$0.87
glm-5.1 (premium)Top-ranked coding/agentic. Output above $3.$3.08

Full list with INR pricing and context windows is at /models; deeper guidance at Choosing a model.

Agent mode

In Agent mode the model doesn't just talk — it reads your files, creates new ones, edits code, and runs terminal commands by calling tools. To use it: switch the mode dropdown at the bottom of the chat panel from Chat to Agent, open a folder (the agent needs a workspace to write into), then ask for what you want — e.g. "create a FastAPI project with a health endpoint and a Dockerfile". It will scaffold the files for you.

Agent tools only fire if the model is declared tool-capable. Every model entry needs capabilities: [tool_use] (shown in the config above). The Ollima build ships this on all chat models; if you're hand-configuring Continue or Cline, add the line yourself. Without it the model only narrates ("I've created the file…") while nothing is actually written to disk.

By default every file-write or command pauses for your approval — you click Accept on the tool card before it runs. To skip that for a given tool, open Tools settings (the tools icon in the chat toolbar, or the gear → Tools) and change its policy:

PolicyBehavior
AutomaticRuns immediately — no Accept click.
Ask First (default)Shows the Accept card for write & terminal tools.
ExcludedTool is disabled entirely.
Setting Create New File to Automatic is convenient. Leave Run Terminal Command on Ask First — auto-running shell commands an LLM generates is genuinely risky. Editing existing files is already automatic.

Verify it routed

Don't trust that text merely appeared — confirm it went through Ollima. Send a prompt, then open app.ollima.comLogs. The inference shows up with the model name and token counts. That's proof the request hit our gateway and not some other provider the editor had configured.

Other editors

The same four values work in any extension with a custom OpenAI-compatible provider:

Local models (Ollama) — free & private

Want fully-free, fully-private inference with no key at all? Run models locally with Ollama and point the extension at it. Because this runs on your machine, it's configured directly in the editor — not through the Ollima cloud gateway (a cloud service can't reach your localhost).

  1. Install Ollama and pull a coding model: ollama pull qwen2.5-coder.
  2. Add it to the same config.yaml with the ollama provider:
# local — no apiKey, runs on your machine
  - name: Qwen2.5 Coder (local)
    provider: ollama
    model: qwen2.5-coder
    apiBase: http://localhost:11434

Mix and match: keep Ollima cloud models for the heavy lifting and a local Ollama model for offline or sensitive work — both appear in the same model picker. Local runs are free and never leave your machine, but quality and speed depend on your hardware.

Troubleshooting

SymptomCause / fix
401 UnauthorizedKey typo, or it isn't a real sk-t0-…. Re-copy from the Keys page.
404 Not FoundBase URL lost its trailing slash. It must be …/v1/.
Empty autocompleteYou assigned a reasoning model to autocomplete. Switch to qwen3-coder-next.
429 Too Many RequestsFree-plan rate limit. See Rate limits.
Text appears but nothing in LogsThe editor is using a different provider, not Ollima. Re-check which model is selected in the picker.
Agent says "I created the file" but nothing is writtenEither you're in Chat mode (switch to Agent), or the model is missing capabilities: [tool_use]. Add it and reload.
Agent can't write filesNo folder is open. File → Open Folder first — the agent needs a workspace.
403 request blocked from an OpenAI SDKA bot/WAF filter is blocking the SDK User-Agent. On Cloudflare, exempt api. from "Block AI bots".