jeu. 30 juil. 2026
Deploymates
Ollama
ai
llm apis
OSS

Ollama

Run LLMs locally

4,521 likesopen-sourceOpen source
Visiter OllamaGitHub
Vue d'ensemble

Download and run Llama, Mistral, and other models locally with a simple CLI and API.

The default local inference stack — zero config, huge model catalog, perfect dev companion.

Fonctionnalités clés

  • Run Llama, Mistral, Gemma locally with one command
  • OpenAI-compatible REST API on localhost:11434
  • Model library with quantized variants for consumer GPUs
  • Cross-platform: macOS, Linux, Windows (WSL)

Cas d'usage

  1. 01Local LLM prototyping before sending traffic to cloud APIs
  2. 02Privacy-sensitive workflows (legal, health, internal docs)
  3. 03Pair with Open WebUI or LiteLLM for production-style routing

Démarrage rapide

shell — quick start
curl -fsSL https://ollama.com/install.sh | sh
ollama run llama3.2

Compatibilité stack

Open WebUI
LiteLLM
LangChain
RunPod

Tags

Articles associés