LLM CLI
A CLI and Python library for OpenAI, Claude, Gemini, local and other models: prompts, chats, tools, embeddings and a SQLite log
- 12,681 ★ on the repository
- Last commit
- Apache-2.0
Extended access
Why this level
- Sends data to external model providers
- Stores API keys and prompt history locally
Install
In your terminal, with SkillFoxx CLI
npx skillfoxx add cli/llmDetects the agents on your machine, shows the access level and pins the version.
Other ways to install
Access and checks
How we reviewExtended accessThe tool runs code or makes network calls and only reads external data.
- Sends data to external model providers
- Stores API keys and prompt history locally
This is third-party code. Review the repository files before installing.
What it does
LLM runs prompts against language models from the terminal and from Python. Models come through plugins: remote APIs such as Gemini and Anthropic, and local ones such as Ollama. Every prompt and response is logged to SQLite so you can revisit and analyze history. It can build embeddings, extract structured data by schema from text and images, and let models call tools. Output pipes cleanly, so LLM is often used in scripts and by agents.
Who it is for. For developers and analysts who want one terminal interface to many models for scripts and experiments.
Good fit when
- You need a model call inside a shell script or pipeline
- You want to compare models and keep a history
- You need quick embeddings or schema-based extraction
Not a fit when
- You need an agent that edits code in the project itself
- You want a graphical chat client
Example request
Use llm to run every file in the logs folder through a model and list the errors it findsLimitations
Cloud models need provider keys, and OpenAI, Anthropic and Gemini APIs do not work from Russia without a VPN. Local models via plugins need no external services. The Homebrew install has caveats noted in the docs.
How to disable. Uninstall the same way you installed: pip uninstall llm, pipx uninstall llm, uv tool uninstall llm or brew uninstall llm.
FAQ
Can I use local models?
Yes, via plugins such as llm-ollama or by pointing at an OpenAI-compatible endpoint like LM Studio.
Where is history stored?
In a SQLite database managed by LLM, which you can search and report on.
Discussion
No questions or reviews yet.
Related
CLI toolsLM Studio is a desktop app for running open models locally, with a chat, a local server in OpenAI and Anthropic formats, and MCP support.
A skill that asks ChatGPT and Gemini before Claude shows its plan, weighs the three views and delivers one plan crediting each model's contribution
oterm is a terminal chat for Ollama, OpenAI, Anthropic and other providers: SQLite-stored sessions, MCP servers, built-in and custom tools
A vLLM-style inference server on MLX that runs language models on Apple Silicon Macs and serves them over an API
A local model server for Apple Silicon Macs in OpenAI, Anthropic and Ollama formats: Claude Code, Codex and OpenCode connect with one command
An MCP server that lets Claude Code, Codex and other agents call Gemini, GPT, Grok and local models for review, debugging and consensus
README in short
The README lists capabilities: command-line prompts, SQLite logging, embeddings, schema extraction and tool calling. Install via pip, Homebrew, pipx or uv, or run without install via uvx against an OpenAI-compatible endpoint. It shows setting keys, installing Gemini, Anthropic and Ollama plugins and starting a chat. Full docs are at llm.datasette.io. Apache-2.0 licensed.