AIChat
A Rust CLI for over 20 LLM providers: command mode, REPL chat, RAG and tool calling from the terminal
Medium risk
We rate an entry medium when the tool runs code, makes network calls or reads project files. Check what exactly it does before installing.
Why this level
- The shell assistant generates and can run commands on the user's system
- It talks over the network to the configured LLM providers
Install
Manual install
cargo install aichatFor those who already have Rust installed.
This is third-party code. Review the repository files before installing.
What it does
AIChat is a single command-line interface over many providers: OpenAI, Claude, Gemini, Ollama, Groq, Bedrock, OpenRouter and others through one config. It works in three modes: a one-off command, a REPL chat with autocomplete and history, and a shell-assistant mode that turns a natural-language task description into a command for the current OS. It can call external tools and functions, attach documents and web pages for RAG, and run a local web server with a playground and an OpenAI-compatible API.
Who it is for. For developers who want to work with different LLMs from the terminal through one tool instead of a separate client for each provider.
Good fit when
- You need quick access to several LLM providers from one terminal client
- You need a shell assistant that turns a description into a command
- You need a local OpenAI-compatible server on top of other providers
Not a fit when
- You need a full coding agent that edits a project, not a terminal chat
- A specific provider's web interface is already enough
Example request
Set up aichat to work with Ollama and show how to ask a question in REPL modeLimitations
Each provider needs its own API key configured separately. Cloud providers like OpenAI and Claude are not reachable from Russia without a VPN, but local models via Ollama and some other providers remain available.
How to disable. Remove the aichat binary from PATH or uninstall the package with whichever manager installed it (cargo uninstall aichat, brew uninstall aichat, and so on).
Security check
- The shell assistant generates and can run commands on the user's system
- It talks over the network to the configured LLM providers
README in short
The README describes aichat as an all-in-one CLI supporting over 20 providers through a single interface. It lists three key modes: CMD for one-off commands, REPL with autocomplete and configurable keybindings, and Shell Assistant for turning natural-language tasks into commands for the current OS. It also mentions function calling, RAG over your own documents, and a local server with a playground. Installed via cargo, brew, pacman, scoop, or prebuilt binaries from GitHub Releases.
FAQ
Can it work without cloud API keys?
Yes, aichat supports Ollama and other local models that need no external key.
Is there a server mode?
Yes, aichat can run a local server with a playground and an OpenAI-compatible API on top of the configured providers.
Related
A skills library that gives coding agents a development process: brainstorming, planning, TDD, subagents and code review
Skills for real engineers by Matt Pocock
Skills For Real Engineers
Small composable skills for engineering with agents: plan grilling, TDD, bug diagnosis, code review and architecture
GitHub toolkit for spec-driven development: the specify CLI adds agent commands and skills to a project, from principles to implementation
Reference MCP servers
Model Context Protocol servers
Official reference MCP servers: Filesystem, Fetch, Git, Memory, Sequential Thinking, Time and Everything