Agentic Kaggle Skill

A skill that runs a Kaggle competition from rules and folds to a scored submission, with hidden-rerun debugging and ensembles

  • 191 ★ on the repository
  • Last commit
  • MIT
Skill

Extended access

Why this level

  • Following the instructions the agent runs scripts and creates notebooks and datasets in your Kaggle account, spending GPU quota
  • The skill submits solutions for scoring: each submission counts toward the competition limit and shows in your profile
All reasons and checks

franks-intellab/agentic-kaggle-skill

Install

In your terminal, with SkillFoxx CLI

npx skillfoxx add skills/agentic-kaggle-skill

Detects the agents on your machine, shows the access level and pins the version.

Other ways to install

Access and checks

How we review

Extended accessThe tool runs code or makes network calls and only reads external data.

  • Following the instructions the agent runs scripts and creates notebooks and datasets in your Kaggle account, spending GPU quota
  • The skill submits solutions for scoring: each submission counts toward the competition limit and shows in your profile

This is third-party code. Review the repository files before installing.

What it does

The skill walks an agent through a Kaggle competition in one repeatable loop. It first reads the rules, data terms, metric and submission format and classifies the competition: an ordinary file submission or a code competition where Kaggle reruns the final notebook on hidden data. It then builds validation before the model: folds are saved into the training file, the metric is reproduced locally and out-of-fold predictions are recorded for every model. Next come a simple baseline, a strong model with stable validation and experiments with a run log. The agent moves heavy training and inference to Kaggle notebooks with GPU. Multi-stage solutions split into independent producers that save models and features as private Kaggle datasets and one consumer that attaches the datasets, builds the ensemble and produces the submission file. The loop ends only with a score: the agent submits, retrieves the status and result, or records a concrete blocker. If a code competition fails with a vague error, the skill starts a debugging loop: fetch logs, classify the failure, patch, rerun the notebook and resubmit. The scripts scaffold_competition.py, make_folds.py, prepare_kaggle_kernel.py and prepare_kaggle_dataset.py cover the routine.

Who it is for. Kaggle competitors and ML practitioners who hand Codex or Hermes the routine: validation, Kaggle cloud runs and submission error triage.

Good fit when

  • A new competition starts and you need to read the rules first and build folds with out-of-fold predictions
  • In a code competition the final notebook fails on the hidden rerun with no clear reason
  • Local GPU memory is not enough and training has to move into Kaggle notebooks with GPU
  • You need an ensemble of several models without leakage between folds
  • The agent must reach a leaderboard score and record the result or the reason it stopped

Not a fit when

  • The task has nothing to do with Kaggle: the kit rests on its notebooks, datasets and submissions
  • You want a walkthrough of one model or an article on a method: the skill describes competition process, not theory
  • You have no Kaggle account or have not accepted the competition rules: submission is impossible without them
  • The competition rules forbid sharing code or artifacts outside the team

Example request

Use $agentic-kaggle-skill: read this competition's rules, build the folds and take a baseline solution all the way to a leaderboard score

Limitations

  • The skill is built for Kaggle. Cloud runs need an account, accepted competition rules and API or kagglehub access.
  • Codex and Hermes are officially supported. The agents/openai.yaml file targets Codex only, and Hermes-era examples live in references/research/.
  • Scripts use the Python standard library, but make_folds.py needs pandas and numpy. Dependencies install from requirements.txt.
  • The skill does not guarantee a leaderboard place: it drives the process and documents blockers, and it does not bypass GPU quota or platform rules. The last commit in the repository is dated October 2026.

How to disable. Delete the agentic-kaggle-skill folder from ~/.agents/skills/ for Codex or from ~/.hermes/skills/data-science/ for Hermes and restart the agent.

FAQ

What does Agentic Kaggle Skill do?

It takes an agent through a Kaggle competition from rules and validation to a leaderboard score. The skill builds folds, computes the metric locally, moves heavy runs to Kaggle and triages submission errors.

How do I install the skill for Codex?

Clone the repository into ~/.agents/skills/agentic-kaggle-skill and restart Codex if needed. You can call it explicitly: Use $agentic-kaggle-skill to help me start this Kaggle competition.

How does the skill handle code competitions?

From the start it treats the final notebook, which Kaggle reruns on hidden data, as the deliverable. On a failure the skill fetches logs, classifies the error, patches, reruns the notebook and submits it again.

What are out-of-fold predictions and why do they matter?

They are model predictions for rows it did not see in training. The skill saves them for every model and uses them for thresholds, error analysis and ensembles without leakage.

Can I use other participants' public notebooks?

Only as hints. The skill explicitly forbids copying code, text, models and derived data without checking the competition rules, the data license and attribution requirements.

Discussion

No questions or reviews yet.

Skills

For a repeatable experiment, an agent downloads a Kaggle dataset to a working directory and retrieves notebook outputs.

CLIExtended access7.6KRepository stars

A skill and Python package for hyperparameter tuning: the agent reads the code, proposes the next set of values, and your own run measures the result

SkillBroad access798Repository stars

High-Stakes Analytics Lab

High-Stakes Analytics & Decision Lab

An evidence-gated analytics skill for high-stakes decisions: profiles data, picks a method the evidence supports, can answer with a data request

SkillExtended access1KRepository stars

A three-stage workflow for math modeling tasks: analysis and model choice, Python or MATLAB computation, and paper assembly in Word or LaTeX

SkillExtended access1.9KRepository stars

A skill set for math modeling contests: problem parsing, method selection, Python and MATLAB code, and paper writing

PluginExtended access1.1KRepository stars

Eight skills for math modeling contests that carry a task from the problem to a paper with figures and checked references

SkillExtended access321Repository stars

README in short

The README is bilingual, in English and Chinese. It shows a before-and-after table, a feature list, install steps for Codex and Hermes, the repository layout, two real competition case studies and rules for using other people's material.

README badge

Original SKILL.md

---
name: agentic-kaggle-skill
description: Kaggle-first end-to-end competition workflow for scored submissions. Use when Codex must run Kaggle or competitive ML workflows through scored submission, including code competitions, validation, metrics, policy-safe public notebook/discussion intel, tabular/text/image modeling, tuning, ensembling/stacking, proactive multi-notebook architectures, producer notebooks that train models and export private Kaggle artifact datasets, downstream consumer notebooks, Kaggle GPU offload, kagglehub access, hidden-test debugging, and public score retrieval.
---

# Agentic Kaggle Skill

## Operating Loop

Treat every competition as a validation problem first and a modeling problem second. The default target platform is Kaggle, so prefer Kaggle-native notebooks/scripts, datasets, model artifacts, competition submissions, and score receipts. For code competitions, assume the final notebook/kernel will be rerun by Kaggle against hidden data unless the competition docs prove otherwise.

1. Read the competition page, classify the submission mode as classic file submission or code/notebook scoring, then inspect the rules, data-use terms, sharing policy, data dictionary, metric, submission format, train/test construction hints, and leakage warnings.
2. If live competition intelligence tools are available, inspect top public open notebook solutions and relevant discussion activity before major architecture choices; treat them as clues, not authority.
3. Identify the task type: binary, multiclass, multilabel, regression, ranking, image, segmentation, text, time series, grouped entities, or a hybrid.
4. Design folds before feature engineering or modeling. Prefer a fold column saved into the training data so every experiment uses the same comparison surface.
5. Build the simplest metric-correct baseline and produce out-of-fold (OOF) predictions plus a valid submission.
6. Proactively plan a stronger architecture once the baseline is trustworthy: diverse model families, feature/embedding producers, augmentation/pseudo-label/distillation stages, calibration/postprocessing, and an ensemble or stacker.
7. Iterate with validation gates: test one meaningful change at a time when possible, but launch several independent producer notebooks in parallel when they create diverse artifacts that can be compared by OOF score or ensemble diversity.
8. Offload heavy training, inference, embedding generation, image/text experiments, or memory-risky jobs to Kaggle notebooks/scripts when local compute may OOM or take too long. Before GPU scheduling or availability claims, fetch fresh quota and apply the GPU quota accounting rule below.
9. For sophisticated architectures, split work into a small Kaggle pipeline: run several independent producer notebooks/scripts first, save each useful producer output as a private Kaggle dataset, then run one consumer notebook/script that attaches those datasets and creates the final OOF/test/submission outputs. When a producer trains a model, its checkpoint, tokenizer/config, fold metadata, OOF/test predictions, and manifest should be exported as a Kaggle dataset; downstream notebooks load the model from `/kaggle/input/...`.
10. Submit the final submission-producing artifact to Kaggle for scoring and retrieve the resulting submission status/score.
11. If Kaggle returns a code-competition error or vague scoring failure, enter the debugging loop: retrieve available logs, classify likely failure mode, patch defensively, rerun the final kernel, resubmit, and repeat until scored or concretely blocked.
12. Track local CV, remote Kaggle run status, Kaggle submission score, public LB, private-risk notes, seed, code version, data version, and artifact paths for every run.
13. Ensemble only with OOF predictions generated without in-fold leakage.

## Resource Map

- Read `references/method-map.md` for the neutral workflow map behind the skill.
- Read `references/information-sharing-policy.md` before publishing competition code, notebooks, datasets, models, artifacts, or reports outside the active team or workspace.
- Read `references/competition-intel.md` when a Kaggle competition slug, URL, title, public leaderboard context, open solutions, or discussion activity may inform the approach.
- Read `references/cross-validation-and-metrics.md` when choosing folds, metrics, thresholds, or leakage checks.
- Read `references/tabular-workflow.md` for categorical variables, feature engineering, selection, and hyperparameter tuning.
- Read `references/image-text-workflow.md` for image, segmentation, and NLP competition approaches.
- Read `references/kaggle-code-competition-pipeline.md` when the target is a Kaggle code competition, hidden rerun, final notebook scoring flow, or model artifact handoff between producer and consumer notebooks.
- Read `references/advanced-notebook-architecture.md` when a stronger solution may need multiple model families, staged feature/embedding/model producers, pseudo-labeling, distillation, postprocessing, blending, stacking, or parallel Kaggle GPU notebooks.
- Read `references/kaggle-offload.md` when local runs are heavy, GPU is useful, Kaggle data access is needed, or remote notebook results must be collected.
- Read `references/kaggle-pipeline-datasets.md` when using multiple Kaggle notebooks, intermediate datasets, notebook output sources, or `kagglehub`.
- Read `references/submission-endgame.md` before stopping work; this skill is not done until Kaggle scoring has been attempted and the result has been collected or a concrete blocker is documented.
- Read `references/code-competition-debugging.md` when a Kaggle code competition submission fails, times out, OOMs, produces no score, or reports a vague hidden-run/scoring error.
- Read `references/ensembling-and-reproducibility.md` for project layout, OOF artifacts, stacking, blending, and repeatability.
- Read `references/research/` or `examples/` only when the user asks for historical case studies, Hermes-era patterns, or concrete competition lessons from this repository.
- Run `scripts/scaffold_competition.py` to create a competition workspace.
- Run `scripts/make_folds.py` to add a fold column to a training CSV.
- Run `scripts/prepare_kaggle_kernel.py` to create a Kaggle kernel folder with metadata and retrievable experiment logs.
- Run `scripts/prepare_kaggle_dataset.py` to create metadata and commands for versioned intermediate artifact datasets.

Report a problem

Foxx AIAgentic Kaggle Skill
Foxx AI

I am Foxx AI and I have already vetted this tool. Ask about install, setup or anything else, and I will keep it simple.