ChainForge prompt
A visual environment for testing prompts: a graph compares the answers of several models to prompt variations, with evaluators and 188 example flows
- 3,035 ★ on the repository
- Last commit
- MIT
Extended access
Why this level
- Can run Python code on your machine
- Queries to several models spend the keys' balance
Install
In your terminal, with SkillFoxx CLI
npx skillfoxx add prompts/chainforgeDetects the agents on your machine, shows the access level and pins the version.
Other ways to install
Access and checks
How we reviewExtended accessThe tool runs code or makes network calls and only reads external data.
- Can run Python code on your machine
- Queries to several models spend the keys' balance
This is third-party code. Review the repository files before installing.
What it does
ChainForge is an application with a browser interface where flows are built as a graph. It queries several models at once, compares answers across prompt variations, models and settings and scores the result with metrics: Python evaluators or a model. It comes with 188 example flows, and RAG can be added (`pip install chainforge[rag]`). Launch: `pip install chainforge`, then `chainforge serve` and the address localhost:8000 in Chrome, Firefox, Edge or Brave. Model provider keys are needed.
Who it is for. For prompt engineers and researchers who need to compare prompt wordings and models on the same inputs instead of guessing from a single answer.
Good fit when
- You need to compare several prompt variants across several models in one table
- You need metrics to score answers automatically
- You need a learning set of ready flows to get started
Not a fit when
- You need a plugin or a skill for an agent: ChainForge is a separate application with a browser interface
- You cannot run Python evaluator code on the machine
Example request
Build a flow with three prompt variants for a short summary and compare the answers of two models by length and accuracyLimitations
ChainForge is a separate application, not an agent plugin. Per the README it can run Python code on your machine, so the server accepts requests only from its own page. Model provider keys are needed, and queries to several models at once spend their balance. Launch with `chainforge serve`, with the interface at localhost:8000 in Chrome, Firefox, Edge or Brave. Version 0.3.7 from 16.09.2026.
How to disable. Stop the server (Ctrl+C), remove the package with pip uninstall chainforge and revoke the provider keys you entered.
FAQ
What is ChainForge?
An environment with a graphical interface for testing prompts: it compares the answers of several models to variations of a prompt and settings.
Is it a plugin for an agent?
No, it is a separate application. It launches with chainforge serve and opens in the browser.
What is needed to run it?
pip install chainforge, model provider keys and a Chrome, Firefox, Edge or Brave browser.
Does it run code?
Per the README ChainForge can run Python code on your machine, so the server accepts requests only from its own page.
Discussion
No questions or reviews yet.
Related
PromptsA Claude Code plugin that asks several AI models the same question and shows their answers side by side with a synthesis of agreement and divergence
Open prompt library with a Claude Code plugin, MCP server and CLI: search, fetch and improve prompts and skills from an agent
A structured prompt system: templates with role, profile, skills, rules and workflow for repeatable model requests
A skill that writes precise prompts tailored to a specific tool: Cursor, Claude Code, Midjourney, Stable Diffusion and more
An MCP server and web tool for improving prompts: three tools for optimizing system and user prompts with iterative refinement
A CLI and MCP server that turns doc sites, repos, PDFs and videos into skills and RAG-ready data
README in short
The README describes ChainForge as a visual environment for testing prompts: a flow graph, model comparison, metrics, 188 example flows, RAG and launch with chainforge serve. MIT license.