Streamling Plugin Skills
Six skills that teach an agent to write Streamling plugins in Rust: sources, sinks, transforms and SQL functions.
- 109 ★ on the repository
- Last commit
Minimal access
Why this level
- The skills only give plugin writing guidance and run nothing themselves.
Install
- Works in
Manual install
Clone the repository, run the symlink loop for `skills/streamling-*` from the skills README into `~/.claude/skills` and `~/.agents/skills`, restart the agent and check `skill://streamling-plugin-basics`.
Access and checks
How we reviewMinimal accessThe tool runs nothing and makes no network calls.
- The skills only give plugin writing guidance and run nothing themselves.
This is third-party code. Review the repository files before installing.
What it does
Streamling is a columnar runtime for streaming and batch data processing, extended by dynamically linked plugins. The `skills/` folder holds six skills that teach an agent to write such plugins correctly: exact registration macro signatures, constructor contracts, checkpoint and exactly-once lifecycle, error types, option and secret patterns. The skills: `streamling-plugin-basics` (start here), `streamling-source-plugin`, `streamling-sink-plugin`, `streamling-transform-plugin`, `streamling-udf-plugin` (DataFusion scalar functions callable from SQL) and `streamling-advanced-plugins` (preprocessors, side outputs, partitioned plugins, low-level FFI). Skills cross-reference each other with `skill://<name>` links.
Who it is for. Rust data engineers who extend Streamling with their own sources, sinks and SQL functions using an agent.
Good fit when
- A source is needed with resumable cursor pagination and backpressure.
- A sink writes in batches with retries and acknowledges checkpoints.
- A scalar function is added to DataFusion and called from SQL.
- A plugin is needed as a `cdylib` with correct registration.
Not a fit when
- You only run ready pipelines and write no plugins.
- General runtime documentation is needed: the skills cover plugin development only.
- The FSL-1.1 license does not fit your use case.
Example request
Write a Streamling sink that writes NDJSON in batches with retries and acknowledges checkpoints.Limitations
The skills cover plugin development against the Streamling API in this repository only. They are discovered at agent startup, so the session is restarted after install. For Claude Code the skills directory is `~/.claude/skills/`, while Codex, Copilot CLI and Gemini CLI share `~/.agents/skills/`. The runtime itself ships under the Functional Source License 1.1 with an Apache 2.0 future license, which restricts competing use. A copy install freezes a snapshot while symlinks follow the repository.
How to disable. Delete the `streamling-*` symlinks or copies from `~/.claude/skills/` and `~/.agents/skills/` and restart the agent.
FAQ
Which skill do I start with?
With `streamling-plugin-basics`: crate setup, registration macros, lifecycle, errors and options.
How do I install for several agents at once?
Link the skill folders into `~/.claude/skills/` and `~/.agents/skills/`; the second is shared by Codex, Copilot CLI and Gemini CLI.
Does the agent need a restart?
Yes. Skills are discovered at startup, so the session is restarted after install.
What is `streamling-udf-plugin`?
A skill on DataFusion scalar functions: `ScalarUDFImpl`, the modern `invoke_with_args` API and calling functions from SQL.
Where does signature accuracy come from?
The skills are derived from the plugin API in this repository, so macros and contracts match the runtime code.
Discussion
No questions or reviews yet.
Related
SkillsHundreds of per-provider skills teach an agent to receive webhooks, verify signatures and handle events, with code examples.
Skills for server-side Swift and the swift-server-lint linter: Swift NIO, Hummingbird, Postgres, concurrency and a lint hook.
Sixteen Spring Boot skills: the agent explores the application first, then edits JPA, DTOs, REST, Security, Kafka and tests.
The RubyLLM skill and plugin help an agent write chats, tools, MCP and structured output in Ruby and Rails applications
PlanetScale Database Skills
planetscale-database-skills
Skills for agents working with databases: one subfolder per technology. Made by PlanetScale, with a separate plugin for Cursor
A skill for Claude Code and Codex on direct-style Scala: Ox structured concurrency, Tapir, error handling and configuration.
README in short
The `skills/README.md` file lists the skills and when to use them, explains the directories of different agents, installing by symlink or copy and verification.