Sync ollama docs from eab97e9f on 2026-10-12
This commit is contained in:
The Librarian
+269
-28
@@ -2,59 +2,300 @@
|
||||
title: Quickstart
|
||||
---
|
||||
|
||||
Install Ollama and get your first response.
|
||||
Use Ollama in [desktop apps](#connect-a-desktop-app) and [coding agents](#use-a-coding-agent), or [build an application](#build-an-application) with an API key.
|
||||
|
||||
## 1. Download Ollama
|
||||
## Get started
|
||||
|
||||
Ollama runs on macOS, Windows, and Linux.
|
||||
|
||||
<a
|
||||
href="https://ollama.com/download"
|
||||
target="_blank"
|
||||
className="inline-block px-6 py-2 bg-black rounded-full dark:bg-neutral-700 text-white font-normal border-none"
|
||||
>
|
||||
Download Ollama
|
||||
</a>
|
||||
|
||||
## 2. Open the menu
|
||||
|
||||
Run `ollama` in your terminal to open the interactive menu:
|
||||
[Download Ollama](https://ollama.com/download) for macOS, Windows, or Linux. Open the app, or get started from your terminal:
|
||||
|
||||
```shell
|
||||
ollama
|
||||
```
|
||||
|
||||
From the menu you can:
|
||||
Follow the setup prompts. Sign in to use cloud models, or choose a local model.
|
||||
|
||||
- **Run a model** - Start an interactive chat
|
||||
- **Launch tools** - [Claude Code](/integrations/claude-code), [OpenClaw](/integrations/openclaw), [VS Code](/integrations/vscode), and more
|
||||
## Connect a desktop app
|
||||
|
||||
## 3. Start a chat
|
||||
On macOS, open Ollama and select **Apps**. Connect **Claude** or **ChatGPT (Desktop)**. Follow the prompts to install or restart the app.
|
||||
|
||||
Run a model to start your first chat.
|
||||
Choose your Ollama models in **Settings → Apps**.
|
||||
|
||||
- [Claude Desktop](/integrations/claude-desktop) — use Ollama models in Claude.
|
||||
- [ChatGPT Desktop](/integrations/chatgpt) — use Ollama models in Codex mode. Regular Chat and voice use your usual ChatGPT connection.
|
||||
|
||||
## Use a coding agent
|
||||
|
||||
From your project directory, launch your agent:
|
||||
|
||||
<Tabs>
|
||||
<Tab title="Claude Code">
|
||||
|
||||
```shell
|
||||
ollama run gemma4
|
||||
ollama launch claude
|
||||
```
|
||||
|
||||
Cloud models work the same way:
|
||||
Ollama offers to install Claude Code if needed. See [Claude Code](/integrations/claude-code) for details.
|
||||
|
||||
</Tab>
|
||||
<Tab title="Codex CLI">
|
||||
|
||||
[Install Codex CLI](/integrations/codex#install) first, then launch it:
|
||||
|
||||
```shell
|
||||
ollama run gemma4:cloud
|
||||
ollama launch codex
|
||||
```
|
||||
|
||||
Send your first message:
|
||||
See [Codex CLI](/integrations/codex) for setup.
|
||||
|
||||
</Tab>
|
||||
<Tab title="OpenCode">
|
||||
|
||||
```shell
|
||||
ollama launch opencode
|
||||
```
|
||||
|
||||
Ollama offers to install OpenCode if needed. See [OpenCode](/integrations/opencode) for details.
|
||||
|
||||
</Tab>
|
||||
</Tabs>
|
||||
|
||||
Choose a model when prompted, then try:
|
||||
|
||||
```text
|
||||
Explain why the sky is blue in one paragraph.
|
||||
Explain how this repository is organized.
|
||||
```
|
||||
|
||||
To leave the chat, type:
|
||||
For more tools, see [Integrations](/integrations). To connect an agent directly with an API key, see [Claude Code](/integrations/claude-code#connect-directly-to-ollama-cloud).
|
||||
|
||||
## Build an application
|
||||
|
||||
Use cloud models with an API key, or run models locally without one. Cloud requests do not require an Ollama installation.
|
||||
|
||||
### 1. Create an API key
|
||||
|
||||
For local models, skip this step and select **Local** under [Send a request](#2-send-a-request).
|
||||
|
||||
For cloud models, sign in or create an account, then create an [API key](https://ollama.com/settings/keys).
|
||||
|
||||
Set your key in the terminal:
|
||||
|
||||
<CodeGroup>
|
||||
|
||||
```shell macOS / Linux
|
||||
export OLLAMA_API_KEY="your_api_key"
|
||||
```
|
||||
|
||||
```powershell Windows
|
||||
$env:OLLAMA_API_KEY = "your_api_key"
|
||||
```
|
||||
|
||||
</CodeGroup>
|
||||
|
||||
Keep your key on your application's server, outside browser code and source control.
|
||||
|
||||
### 2. Send a request
|
||||
|
||||
Make your first request to Ollama
|
||||
|
||||
<Tabs>
|
||||
<Tab title="Cloud">
|
||||
|
||||
These examples use the `gemma4:31b` [cloud model](https://ollama.com/search?c=cloud).
|
||||
|
||||
<Tabs>
|
||||
<Tab title="Ollama API">
|
||||
|
||||
```shell
|
||||
/bye
|
||||
curl https://ollama.com/api/chat \
|
||||
-H "Authorization: Bearer $OLLAMA_API_KEY" \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "gemma4:31b",
|
||||
"messages": [
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Say hello in one sentence."
|
||||
}
|
||||
],
|
||||
"stream": false
|
||||
}'
|
||||
```
|
||||
|
||||
Read the answer from `message.content`. See [Ollama's API and libraries](/api/introduction).
|
||||
|
||||
</Tab>
|
||||
<Tab title="OpenAI Chat Completions">
|
||||
|
||||
```shell
|
||||
curl https://ollama.com/v1/chat/completions \
|
||||
-H "Authorization: Bearer $OLLAMA_API_KEY" \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "gemma4:31b",
|
||||
"messages": [
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Say hello in one sentence."
|
||||
}
|
||||
]
|
||||
}'
|
||||
```
|
||||
|
||||
Read the answer from `choices[0].message.content`. See [OpenAI compatibility](/api/openai-compatibility) for client setup and supported features.
|
||||
|
||||
</Tab>
|
||||
<Tab title="OpenAI Responses">
|
||||
|
||||
```shell
|
||||
curl https://ollama.com/v1/responses \
|
||||
-H "Authorization: Bearer $OLLAMA_API_KEY" \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "gemma4:31b",
|
||||
"input": "Say hello in one sentence."
|
||||
}'
|
||||
```
|
||||
|
||||
Read the `output_text` content blocks inside `output`. The OpenAI Python client exposes the text as `response.output_text`.
|
||||
|
||||
Responses requests are stateless: include conversation history in each request. `previous_response_id` and `conversation` aren't supported. See [Responses compatibility](/api/openai-compatibility#responses-api).
|
||||
|
||||
</Tab>
|
||||
<Tab title="Anthropic Messages">
|
||||
|
||||
```shell
|
||||
curl https://ollama.com/v1/messages \
|
||||
-H "Authorization: Bearer $OLLAMA_API_KEY" \
|
||||
-H "Content-Type: application/json" \
|
||||
-H "anthropic-version: 2023-06-01" \
|
||||
-d '{
|
||||
"model": "gemma4:31b",
|
||||
"max_tokens": 1024,
|
||||
"messages": [
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Say hello in one sentence."
|
||||
}
|
||||
]
|
||||
}'
|
||||
```
|
||||
|
||||
Read text blocks from `content`. Direct cloud requests use bearer authentication. See [Anthropic compatibility](/api/anthropic-compatibility) for client setup and supported features.
|
||||
|
||||
</Tab>
|
||||
</Tabs>
|
||||
|
||||
OpenAI and Anthropic compatibility each cover a subset of the original API. See [Cloud](/cloud) for models and usage limits.
|
||||
|
||||
</Tab>
|
||||
<Tab title="Local">
|
||||
|
||||
Run [Gemma 4 E2B](https://ollama.com/library/gemma4:e2b) on your computer. No API key required.
|
||||
|
||||
<Note>
|
||||
The model download is about 7.2 GB. We recommend 8 GB of available VRAM, or unified memory on a Mac. Larger context windows need more memory. With less VRAM, Ollama can use system RAM, but responses may be slower.
|
||||
</Note>
|
||||
|
||||
[Download Ollama](https://ollama.com/download) and open the app. On Linux, start the server with `ollama serve` if it is not already running.
|
||||
|
||||
Download the model:
|
||||
|
||||
```shell
|
||||
ollama pull gemma4:e2b
|
||||
```
|
||||
|
||||
Send a request to your local server:
|
||||
|
||||
<Tabs>
|
||||
<Tab title="Ollama API">
|
||||
|
||||
```shell
|
||||
curl http://localhost:11434/api/chat \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "gemma4:e2b",
|
||||
"messages": [
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Say hello in one sentence."
|
||||
}
|
||||
],
|
||||
"stream": false
|
||||
}'
|
||||
```
|
||||
|
||||
</Tab>
|
||||
<Tab title="OpenAI Chat Completions">
|
||||
|
||||
```shell
|
||||
curl http://localhost:11434/v1/chat/completions \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "gemma4:e2b",
|
||||
"messages": [
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Say hello in one sentence."
|
||||
}
|
||||
]
|
||||
}'
|
||||
```
|
||||
|
||||
Read the answer from `choices[0].message.content`. See [OpenAI compatibility](/api/openai-compatibility) for client setup and supported features.
|
||||
|
||||
</Tab>
|
||||
<Tab title="OpenAI Responses">
|
||||
|
||||
```shell
|
||||
curl http://localhost:11434/v1/responses \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "gemma4:e2b",
|
||||
"input": "Say hello in one sentence."
|
||||
}'
|
||||
```
|
||||
|
||||
Read the `output_text` content blocks inside `output`. The OpenAI Python client exposes the text as `response.output_text`.
|
||||
|
||||
Responses requests are stateless: include conversation history in each request. `previous_response_id` and `conversation` aren't supported. See [Responses compatibility](/api/openai-compatibility#responses-api).
|
||||
|
||||
</Tab>
|
||||
<Tab title="Anthropic Messages">
|
||||
|
||||
```shell
|
||||
curl http://localhost:11434/v1/messages \
|
||||
-H "Content-Type: application/json" \
|
||||
-H "anthropic-version: 2023-06-01" \
|
||||
-d '{
|
||||
"model": "gemma4:e2b",
|
||||
"max_tokens": 1024,
|
||||
"messages": [
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Say hello in one sentence."
|
||||
}
|
||||
]
|
||||
}'
|
||||
```
|
||||
|
||||
Read text blocks from `content`. See [Anthropic compatibility](/api/anthropic-compatibility) for client setup and supported features.
|
||||
|
||||
</Tab>
|
||||
</Tabs>
|
||||
|
||||
</Tab>
|
||||
</Tabs>
|
||||
|
||||
## Run a model locally
|
||||
|
||||
[Download Ollama](https://ollama.com/download), then run:
|
||||
|
||||
```shell
|
||||
ollama run gemma4:e2b
|
||||
```
|
||||
|
||||
Ollama downloads the model and starts a chat on your computer. Type `/bye` to leave.
|
||||
|
||||
## Next steps
|
||||
|
||||
Use a model with an [integration](/integrations), make an [API request](/api/introduction), or browse more [models](https://ollama.com/search).
|
||||
Add [tool calling](/capabilities/tool-calling), [stream responses](/capabilities/streaming), or browse [more models](https://ollama.com/search).
|
||||
|
||||
Reference in New Issue
Block a user