Arize Skills plugin
Official Arize skills: LLM app tracing, experiments, evaluators, prompt optimization and migration from Langfuse
- 72 ★ on the repository
- Last commit
- MIT
Extended access
Why this level
- The skills work with an Arize API key and create and manage datasets, prompts and platform settings
- The agent adds tracing instrumentation to application code, so review the changes before accepting
Install
- Works in
In your terminal, with SkillFoxx CLI
npx skillfoxx add plugins/arize-skillsDetects the agents on your machine, shows the access level and pins the version.
Other ways to install
Access and checks
How we reviewExtended accessThe tool runs code or makes network calls and only reads external data.
- The skills work with an Arize API key and create and manage datasets, prompts and platform settings
- The agent adds tracing instrumentation to application code, so review the changes before accepting
This is third-party code. Review the repository files before installing.
What it does
A set of 18 skills from the Arize platform teaches coding agents to add observability, run experiments and improve prompts of LLM apps. The skills handle `ax` CLI flags, data shape quirks and multi-step recipes. They work with Cursor, Claude Code, Codex, GitHub Copilot, Windsurf, Devin and dozens of other agents. The `arize-instrumentation` skill adds Arize AX tracing to an app in two phases: analyze the code, then implement. `arize-trace` exports traces and spans by trace, span or session ID and helps find failures. Experiments run through `arize-dataset` and `arize-experiment`, LLM-as-judge evaluators and continuous monitoring are made by `arize-evaluator`, and `arize-prompt-optimization` improves prompts from trace data and experiments. Other skills cover annotations, Prompt Hub, model provider credentials, deep links into the UI and routing spans to spaces and projects. Separate skills move data: `arize-phoenix-migration`, `arize-migrate-langfuse`, `arize-migrate-langsmith` and `arize-migrate-braintrust` import historical traces, datasets, prompts and evaluators. `arize-admin` manages organizations, roles and API keys, and `arize-compliance-audit` prepares a checklist for the EU AI Act, NIST AI RMF, GDPR and HIPAA and is not legal advice.
Who it is for. Developers and ML engineers who run LLM applications on Arize AX and want the agent to set up tracing, run experiments and analyze failures itself.
Good fit when
- An LLM app needs tracing and you want to confirm a trace reaches Arize AX
- You have traces and the agent should export recent ones and find errors and latency issues
- You need a dataset, an experiment and an LLM-as-judge evaluator for regression checks
- A team is leaving Langfuse, LangSmith, Braintrust or Phoenix and must move traces, datasets and prompts
- A prompt needs improving from trace data and experiment results
Not a fit when
- You have no Arize platform: the skills work through the `ax` CLI and the Arize API
- You need a legal compliance assessment: `arize-compliance-audit` gives only a guidance checklist
- You need tracing in another observability service: the instrumentation targets Arize AX
Example request
Install the Arize skills from https://github.com/Arize-ai/arize-skills and add tracing to this application through arize-instrumentation, then verify a trace reached Arize AX.Limitations
The skills work through the `ax` CLI (v0.39.0 or newer, installed with `uv tool install arize-ax-cli` or `pipx install arize-ax-cli`) and need Arize credentials: an API key and a space name or ID. Integrations and evaluators may need `OPENAI_API_KEY` and `ANTHROPIC_API_KEY`. For an on-prem Arize deployment the `ax` profile is set to a single host and port.
The `arize-compliance-audit` skill gives guidance only and is not legal advice or a complete compliance assessment. The `install.sh` and `install.ps1` installers place skills as symlinks and install the `ax` CLI on request. The last commit is from November 11, 2026 and the license is MIT.
How to disable. For the skills run `ax skills clear --yes` or `./install.sh --uninstall`, for the Claude Code plugin `/plugin uninstall arize-skills@arize-skills`. The `ax` CLI is removed with `uv tool uninstall arize-ax-cli` (or `pipx uninstall`), and the profile and key live in the `ax` configuration.
FAQ
How do I install the Arize skills?
With `npx skills add Arize-ai/arize-skills --skill "*" --yes`: it finds your agent and links the skills in place. Claude Code has a plugin: `/plugin marketplace add Arize-ai/arize-skills` and `/plugin install arize-skills@arize-skills`.
What do I need besides the skills?
The `ax` CLI and credentials: an Arize API key and a space name. A profile is created with `ax profiles create` and the space name comes from `ax spaces list -o json`.
How do I add tracing to my app?
Ask the agent to install the skills and apply `arize-instrumentation`. The agent analyzes the code, adds tracing and verifies a trace reaches Arize AX. You only enter credentials and approve the code changes.
Can I move data from Langfuse or LangSmith?
Yes, there are `arize-migrate-langfuse`, `arize-migrate-langsmith` and `arize-migrate-braintrust`: import of traces over OTLP, datasets, prompts and evaluators, with an optional live cutover.
Does it work with self-hosted Arize?
Yes, create an `ax` profile with a single host and port, usually 443: `ax profiles create my-onprem --api-key ... --single-host arize.yourcompany.com --single-port 443`, then `ax profiles validate`.
Discussion
No questions or reviews yet.
Related
Pluginsagent-toolkit offers generic skills for engineering tasks: from a ticket to a plan, tasks and a handover for review.
A skill that runs a full refactor so agents read code more easily: it finds hidden links and needless dependencies.
Tech Leads Club Agent Skills
Agent Skills
A vetted skill registry with a CLI that installs into twenty-plus agents and an MCP server for on-demand skill lookup
A skill set against AI slop: UI and typography audits, change review, releases, docs and SEO.
Skills for commits, review and ZenTao plus a status line, gateway balance and session logs for Claude Code, Codex, OpenCode.
Nine short skills: tests, review, ADR plans, slides, a wiki, image generation, worktrees and plan implementation.
Comparison with similar tools
Cards that share the main search query, and how they differ.
| Tool | Official | Authentication | Repository stars | Main difference |
|---|---|---|---|---|
| Arize Skills (this card) | yes | 72 | ||
| Langfuse Skills | yes | 339 | skills for the Langfuse platform, while these work with Arize AX and also move data from Langfuse, LangSmith and Braintrust | |
| Arize Phoenix | yes | OAuth | 12,268 | the open Phoenix tracing platform, while these skills add work with Arize AX and migration of Phoenix traces into it |
README in short
The description opens with ready prompts for an agent: add tracing or analyze existing traces. It then covers five install paths, the requirements for the `ax` CLI and credentials, the skill table, installer flags and Devin setup.
README badge
Original SKILL.md
---
name: arize-instrumentation
description: Adds Arize AX tracing to an LLM application for the first time. Detects the stack, routes to the single matching integration doc, wires auto-instrumentation after user confirmation, and verifies traces land. Use when the user wants to instrument their app, add tracing from scratch, set up LLM observability, integrate OpenTelemetry or openinference, or get started with Arize tracing.
metadata:
author: arize
version: "2.0"
---
# Arize Instrumentation Skill
Add **Arize AX tracing** to an app for the first time: **detect the stack → fetch the one matching integration doc → wire auto-instrumentation → verify a trace lands.**
**Route locally.** Map the detected stack to a single doc page via [references/integration-routing.md](references/integration-routing.md) and fetch **only that page**. When the app uses an agent framework, route on the **framework**, not the provider SDK it wraps — a bare `openai`/`anthropic` import inside a framework app is not the integration target; route to a provider page only when the app calls the provider SDK directly with no framework in play. When the stack isn't listed there, search [llms.txt](https://arize.com/docs/llms.txt) for its integration page per the router; with no match, use [manual instrumentation](https://arize.com/docs/ax/instrument/manual-instrumentation). Never bulk-read the [PROMPT.md](https://arize.com/docs/PROMPT.md) aggregate.
**Rules:** inspect before mutating; tracing is additive, never change business logic; follow existing style; no secrets in code and **never ask the user to paste secrets (API keys, tokens) into the chat** -- reference `ARIZE_API_KEY`/`ARIZE_SPACE_ID` env vars only, set by the user in their own `.env`/shell; preserve or ask for the app's Arize region/export endpoint instead of assuming US -- see [references/regions-and-endpoints.md](references/regions-and-endpoints.md); ask before persistent local state (`ax` profiles, `.zshrc`, env vars) -- see [references/ax-profiles.md](references/ax-profiles.md).
## Phase 1: Analysis (read-only — no code/files)
Detect from manifests + imports: language, package manager, LLM providers, frameworks, existing tracing (`TracerProvider`, `register()`, `ARIZE_*`/`OTEL_*`, Datadog/Honeycomb), existing Arize endpoint/region config (`ARIZE_COLLECTOR_ENDPOINT`, an in-code Arize endpoint option, or an `OTEL_EXPORTER_OTLP_ENDPOINT` confirmed to target Arize), and whether the app runs tools / an agent loop (manual CHAIN/TOOL spans only if the matched framework instrumentor doesn't already cover them — decided in Phase 2). **Confirm scope first** — a monorepo, multiple services, or multiple frameworks needs a "which one?" question before touching anything; don't pick for the user.
Output a short summary (stack, proposed integration, existing tracing, scope). If the target is clear and the user asked to instrument now, continue; if ambiguous or analysis-only was requested, stop and confirm.
## Phase 2: Implementation (after the target is confirmed)
1. **Fetch the matched integration doc** and follow its install + wiring verbatim.
2. **Install** with the detected package manager, before writing code — exact packages come from the matched doc. Python base: `arize-otel` (current PyPI release) + `openinference-instrumentation-{name}` (package hyphens, import underscores). TS/JS: `@opentelemetry/sdk-trace-node` + the matched `@arizeai/openinference-*` (or a first-party exporter, e.g. Mastra's `@mastra/arize`). Go has **no integration doc** — see [references/go.md](references/go.md) for install, wiring, flush, and manual spans.
3. **Credentials and region** — app needs an API key + Space + exporter endpoint/region. Inspect only the target app's own config; never scan sibling repos/shell files, surface secrets, or accept a pasted key. See [references/credentials-and-config.md](references/credentials-and-config.md), [references/regions-and-endpoints.md](references/regions-and-endpoints.md), and [references/ax-profiles.md](references/ax-profiles.md).
4. **Centralize** init in one module, **before** any LLM client is created. Existing OTel → add Arize as an *additional* exporter; don't replace it.
5. **Filter non-GenAI spans when the selected TypeScript integration supports a filter.** Make this the default for the Arize exporter so generic HTTP/fetch, framework, and infrastructure spans do not flood the project. For Vercel AI SDK v7 with `@arizeai/openinference-vercel`, set `spanFilter: isOpenInferenceSpan` and `reparentOrphanedSpans: true` on `OpenInferenceSimpleSpanProcessor`; otherwise AI spans can retain references to filtered-out HTTP parents. For Mastra with `@mastra/observability`, configure `spanFilter: span => span.type !== SpanType.GENERIC` on the Arize observability config, after checking that the app does not rely on GENERIC spans as its only user-facing boundary. Do not assume a universal OpenTelemetry option: inspect the matched integration's current API. If it has no filter, avoid enabling unrelated HTTP/auto-instrumentations for the Arize pipeline, or use a supported processor/collector filter that retains the intended GenAI spans. Keep useful semantic request boundaries; filtering policy should not silently discard the app's only user input/final answer span.