Ollima in VS Code
Use the Ollima catalog as the models behind your AI coding assistant. Because the gateway is OpenAI-compatible, any VS Code extension that takes a custom OpenAI-shape endpoint works — point it at Ollima, drop in your key, and code against kimi-2.7 and friends.
Install
The Ollima catalog works in any VS Code extension that supports a custom OpenAI-compatible endpoint. Pick one and install it from the Extensions panel (Ctrl+Shift+X / ⇧⌘X):
- Continue, Cline, or Roo Code — all on the VS Code Marketplace. Any of them works; the rest of this page uses Continue's config format.
Then add your key and the models as shown below. A preconfigured Ollima extension with this catalog built in is on the way — until it lands, use any of the above.
How it works
Every extension needs the same four values. The field names differ; the values don't:
| Field | Value |
|---|---|
| Provider / API type | OpenAI Compatible — not plain "OpenAI" |
| Base URL / API base | https://api.ollima.com/v1/ |
| API key | your sk-t0-… |
| Model ID | an alias from the table below, e.g. kimi-2.7 |
/v1/). Without it, most clients drop the path and you get a 404. This is the single most common setup mistake.Mint a key
Sign in at app.ollima.com, open the Keys page, click Create key, and copy the sk-t0-… value once — we never show it again. Use one key per machine so a lost laptop is a one-line revoke. Set a monthly spend cap while you're there.
Configure the models
For Continue-based extensions (including the Ollima build), models live in a YAML config. Click the gear icon in the chat panel to open it, or edit it directly:
- Windows:
%USERPROFILE%\.continue\config.yaml - macOS / Linux:
~/.continue/config.yaml
Paste the catalog — replace sk-t0-… with your real key in each entry:
# ~/.continue/config.yaml models: - name: Kimi K2 # default — agentic coder (chat + agent) provider: openai model: kimi-2.7 apiBase: https://api.ollima.com/v1/ apiKey: sk-t0-… roles: [chat, edit, apply] capabilities: [tool_use] # required for Agent mode — see below defaultCompletionOptions: { maxTokens: 8192 } # reasoning model — give it headroom - name: Qwen3 Coder Next # fill-in-middle autocomplete provider: openai model: qwen3-coder-next apiBase: https://api.ollima.com/v1/ apiKey: sk-t0-… roles: [autocomplete] - name: DeepSeek V4 # flagship coder, 1M context provider: openai model: deepseek-v4 apiBase: https://api.ollima.com/v1/ apiKey: sk-t0-… roles: [chat, edit] capabilities: [tool_use]
Save, and the models appear in the chat model dropdown immediately — no restart. Pick Kimi K2 to start.
Models & roles
Roles tell the extension which model to use for each job: chat (the conversation panel), autocomplete (inline ghost-text), edit (in-place rewrites), and apply (applying a suggested diff).
| Alias | Good for | Suggested roles |
|---|---|---|
kimi-2.7 | Default. Agentic coder — chat, edits, applying diffs. | chat, edit, apply |
qwen3-coder-next | Fill-in-middle inline completion. | autocomplete |
deepseek-v4 | Flagship coder, 1M context. | chat, edit, apply |
deepseek-v4-flash | Cheapest strong coder — fast apply. | autocomplete, chat, apply |
minimax-m3 (premium) | Agentic coder, strong SWE-bench. | chat, edit |
glm-5.1 (premium) | Top-ranked coding/agentic model. | chat, edit |
qwen3-coder-next for autocomplete — it does real fill-in-middle. Avoid reasoning models here: they spend the token budget on internal reasoning and can return empty completions.Strongest coding picks
Beyond the core models above, the catalog has a dedicated coding lane. The current open-weights benchmark leaders are deepseek-v4 (80.6% SWE-bench Verified) and minimax-m3 (80.5%) — both priced under $3 / 1M output. Drop these into the same config.yaml:
# strong coders — add alongside the models above - name: DeepSeek V4 # flagship coder, 1M context provider: openai model: deepseek-v4 apiBase: https://api.ollima.com/v1/ apiKey: sk-t0-… roles: [chat, edit, apply] - name: DeepSeek V4 Flash # cheapest strong coder — great for autocomplete provider: openai model: deepseek-v4-flash apiBase: https://api.ollima.com/v1/ apiKey: sk-t0-… roles: [autocomplete, chat] - name: MiMo v2.5 Pro # agentic coding, long context provider: openai model: mimo-v2 apiBase: https://api.ollima.com/v1/ apiKey: sk-t0-… roles: [chat, edit, apply]
| Alias | Good for | Output $/1M |
|---|---|---|
deepseek-v4 | Flagship coder — hard refactors, multi-file. | $0.87 |
deepseek-v4-flash | Cheapest strong coder — autocomplete. | $0.18 |
minimax-m3 | Agentic / tool-use coding. | $1.20 |
qwen3-plus · qwen3-35b | Long-context Qwen coders. | $1.28 · $1.00 |
mimo-v2 | MiMo — agentic, 1M context. | $0.87 |
glm-5.1 (premium) | Top-ranked coding/agentic. Output above $3. | $3.08 |
Full list with INR pricing and context windows is at /models; deeper guidance at Choosing a model.
Agent mode
In Agent mode the model doesn't just talk — it reads your files, creates new ones, edits code, and runs terminal commands by calling tools. To use it: switch the mode dropdown at the bottom of the chat panel from Chat to Agent, open a folder (the agent needs a workspace to write into), then ask for what you want — e.g. "create a FastAPI project with a health endpoint and a Dockerfile". It will scaffold the files for you.
capabilities: [tool_use] (shown in the config above). The Ollima build ships this on all chat models; if you're hand-configuring Continue or Cline, add the line yourself. Without it the model only narrates ("I've created the file…") while nothing is actually written to disk.By default every file-write or command pauses for your approval — you click Accept on the tool card before it runs. To skip that for a given tool, open Tools settings (the tools icon in the chat toolbar, or the ⚙ gear → Tools) and change its policy:
| Policy | Behavior |
|---|---|
| Automatic | Runs immediately — no Accept click. |
| Ask First (default) | Shows the Accept card for write & terminal tools. |
| Excluded | Tool is disabled entirely. |
Verify it routed
Don't trust that text merely appeared — confirm it went through Ollima. Send a prompt, then open app.ollima.com → Logs. The inference shows up with the model name and token counts. That's proof the request hit our gateway and not some other provider the editor had configured.
Other editors
The same four values work in any extension with a custom OpenAI-compatible provider:
- Cline / Roo Code / Kilo Code — settings → API Provider → OpenAI Compatible → Base URL
https://api.ollima.com/v1/, paste the key, type the model ID. - GitHub Copilot Chat (BYOK) — model picker → Manage Models → an OpenAI-compatible option, then the same base URL, key, and model ID. Availability of a custom base-URL field depends on your VS Code + Copilot version; if you only see fixed named providers, use a Continue/Cline-style extension instead.
Local models (Ollama) — free & private
Want fully-free, fully-private inference with no key at all? Run models locally with Ollama and point the extension at it. Because this runs on your machine, it's configured directly in the editor — not through the Ollima cloud gateway (a cloud service can't reach your localhost).
- Install Ollama and pull a coding model:
ollama pull qwen2.5-coder. - Add it to the same
config.yamlwith theollamaprovider:
# local — no apiKey, runs on your machine - name: Qwen2.5 Coder (local) provider: ollama model: qwen2.5-coder apiBase: http://localhost:11434
Mix and match: keep Ollima cloud models for the heavy lifting and a local Ollama model for offline or sensitive work — both appear in the same model picker. Local runs are free and never leave your machine, but quality and speed depend on your hardware.
Troubleshooting
| Symptom | Cause / fix |
|---|---|
401 Unauthorized | Key typo, or it isn't a real sk-t0-…. Re-copy from the Keys page. |
404 Not Found | Base URL lost its trailing slash. It must be …/v1/. |
| Empty autocomplete | You assigned a reasoning model to autocomplete. Switch to qwen3-coder-next. |
429 Too Many Requests | Free-plan rate limit. See Rate limits. |
| Text appears but nothing in Logs | The editor is using a different provider, not Ollima. Re-check which model is selected in the picker. |
| Agent says "I created the file" but nothing is written | Either you're in Chat mode (switch to Agent), or the model is missing capabilities: [tool_use]. Add it and reload. |
| Agent can't write files | No folder is open. File → Open Folder first — the agent needs a workspace. |
403 request blocked from an OpenAI SDK | A bot/WAF filter is blocking the SDK User-Agent. On Cloudflare, exempt api. from "Block AI bots". |