Claude Video Vision

Install

npx skillfoxx add mcp/claude-video-vision

claude mcp add --transport stdio claude-video-vision -- npx -y claude-video-vision@latest

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

code --add-mcp '{"name":"claude-video-vision","type":"stdio","command":"npx","args":["-y","claude-video-vision@latest"]}'

{
  "servers": {
    "claude-video-vision": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

codex mcp add claude-video-vision -- npx -y claude-video-vision@latest

[mcp_servers.claude-video-vision]
command = "npx"
args = ["-y", "claude-video-vision@latest"]

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

{
  "mcp": {
    "claude-video-vision": {
      "type": "local",
      "command": [
        "npx",
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

{
  "context_servers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

{
  "mcpServers": {
    "claude-video-vision": {
      "command": "npx",
      "args": [
        "-y",
        "claude-video-vision@latest"
      ]
    }
  }
}

/plugin marketplace add https://github.com/jordanrendric/claude-video-vision
/plugin install claude-video-vision

This is third-party code. Review the repository files before installing.

What it does

The MCP server extracts video frames via ffmpeg and processes audio with one of three backends: Gemini API, local Whisper or OpenAI API. The agent receives frames as images and audio transcription with timestamps; the server is a perception layer, not an interpretation layer. Local files and YouTube URLs are supported, downloaded with yt-dlp and preferring captions. It exposes six tools: video_info, video_analyze, video_watch, video_detail, video_configure, video_setup. The plugin adds a /watch-video slash command, a setup wizard and a video-perception skill that guides the agent's workflow. Frame options and the Whisper model are configurable.

Who it is for. For developers and analysts who need the agent to understand video content.

Example request

Watch this video and tell me what happens in the first minute: ~/Downloads/demo.mp4

Limitations

Needs Node.js 20 or newer and ffmpeg, plus yt-dlp for YouTube URLs. The Gemini API backend needs a GEMINI_API_KEY, the OpenAI backend needs an OPENAI_API_KEY and paid per-usage billing, and both services are unavailable from Russia without a VPN. The local whisper.cpp backend runs offline and keyless, with Whisper models downloaded on first use. At the first release it was tested on macOS with the local backend.

How to disable. Remove the claude-video-vision plugin via /plugin or drop the server from the client's MCP configuration.

MCP

Transport

stdio

Authentication

not required

Security check

• Runs ffmpeg and yt-dlp and downloads Whisper models
• The cloud backends send audio to Gemini or OpenAI

README in short

The README describes a Claude Code plugin with an MCP server that gives the agent video perception. The server extracts frames via ffmpeg and transcribes audio via the Gemini API, local Whisper or OpenAI API, returning frames and text with timestamps. Local files and YouTube URLs via yt-dlp are supported. The plugin installs with /plugin commands, the server is pulled via npx, and configuration runs through the /setup-video-vision wizard. There are six MCP tools and a /watch-video slash command. MIT licensed.

Related