Agentic Kaggle Skill
A skill that runs a Kaggle competition from rules and folds to a scored submission, with hidden-rerun debugging and ensembles
- 191 ★ on the repository
- Last commit
- MIT
Extended access
Why this level
- Following the instructions the agent runs scripts and creates notebooks and datasets in your Kaggle account, spending GPU quota
- The skill submits solutions for scoring: each submission counts toward the competition limit and shows in your profile
Install
- Works in
In your terminal, with SkillFoxx CLI
npx skillfoxx add skills/agentic-kaggle-skillDetects the agents on your machine, shows the access level and pins the version.
Other ways to install
Access and checks
How we reviewExtended accessThe tool runs code or makes network calls and only reads external data.
- Following the instructions the agent runs scripts and creates notebooks and datasets in your Kaggle account, spending GPU quota
- The skill submits solutions for scoring: each submission counts toward the competition limit and shows in your profile
This is third-party code. Review the repository files before installing.
What it does
The skill walks an agent through a Kaggle competition in one repeatable loop. It first reads the rules, data terms, metric and submission format and classifies the competition: an ordinary file submission or a code competition where Kaggle reruns the final notebook on hidden data. It then builds validation before the model: folds are saved into the training file, the metric is reproduced locally and out-of-fold predictions are recorded for every model. Next come a simple baseline, a strong model with stable validation and experiments with a run log. The agent moves heavy training and inference to Kaggle notebooks with GPU. Multi-stage solutions split into independent producers that save models and features as private Kaggle datasets and one consumer that attaches the datasets, builds the ensemble and produces the submission file. The loop ends only with a score: the agent submits, retrieves the status and result, or records a concrete blocker. If a code competition fails with a vague error, the skill starts a debugging loop: fetch logs, classify the failure, patch, rerun the notebook and resubmit. The scripts scaffold_competition.py, make_folds.py, prepare_kaggle_kernel.py and prepare_kaggle_dataset.py cover the routine.
Who it is for. Kaggle competitors and ML practitioners who hand Codex or Hermes the routine: validation, Kaggle cloud runs and submission error triage.
Good fit when
- A new competition starts and you need to read the rules first and build folds with out-of-fold predictions
- In a code competition the final notebook fails on the hidden rerun with no clear reason
- Local GPU memory is not enough and training has to move into Kaggle notebooks with GPU
- You need an ensemble of several models without leakage between folds
- The agent must reach a leaderboard score and record the result or the reason it stopped
Not a fit when
- The task has nothing to do with Kaggle: the kit rests on its notebooks, datasets and submissions
- You want a walkthrough of one model or an article on a method: the skill describes competition process, not theory
- You have no Kaggle account or have not accepted the competition rules: submission is impossible without them
- The competition rules forbid sharing code or artifacts outside the team
Example request
Use $agentic-kaggle-skill: read this competition's rules, build the folds and take a baseline solution all the way to a leaderboard scoreLimitations
- The skill is built for Kaggle. Cloud runs need an account, accepted competition rules and API or kagglehub access.
- Codex and Hermes are officially supported. The agents/openai.yaml file targets Codex only, and Hermes-era examples live in references/research/.
- Scripts use the Python standard library, but make_folds.py needs pandas and numpy. Dependencies install from requirements.txt.
- The skill does not guarantee a leaderboard place: it drives the process and documents blockers, and it does not bypass GPU quota or platform rules. The last commit in the repository is dated October 2026.
How to disable. Delete the agentic-kaggle-skill folder from ~/.agents/skills/ for Codex or from ~/.hermes/skills/data-science/ for Hermes and restart the agent.
FAQ
What does Agentic Kaggle Skill do?
It takes an agent through a Kaggle competition from rules and validation to a leaderboard score. The skill builds folds, computes the metric locally, moves heavy runs to Kaggle and triages submission errors.
How do I install the skill for Codex?
Clone the repository into ~/.agents/skills/agentic-kaggle-skill and restart Codex if needed. You can call it explicitly: Use $agentic-kaggle-skill to help me start this Kaggle competition.
How does the skill handle code competitions?
From the start it treats the final notebook, which Kaggle reruns on hidden data, as the deliverable. On a failure the skill fetches logs, classifies the error, patches, reruns the notebook and submits it again.
What are out-of-fold predictions and why do they matter?
They are model predictions for rows it did not see in training. The skill saves them for every model and uses them for thresholds, error analysis and ensembles without leakage.
Can I use other participants' public notebooks?
Only as hints. The skill explicitly forbids copying code, text, models and derived data without checking the competition rules, the data license and attribution requirements.
Discussion
No questions or reviews yet.
Related
SkillsFor a repeatable experiment, an agent downloads a Kaggle dataset to a working directory and retrieves notebook outputs.
A skill and Python package for hyperparameter tuning: the agent reads the code, proposes the next set of values, and your own run measures the result
High-Stakes Analytics Lab
High-Stakes Analytics & Decision Lab
An evidence-gated analytics skill for high-stakes decisions: profiles data, picks a method the evidence supports, can answer with a data request
A three-stage workflow for math modeling tasks: analysis and model choice, Python or MATLAB computation, and paper assembly in Word or LaTeX
A skill set for math modeling contests: problem parsing, method selection, Python and MATLAB code, and paper writing
Eight skills for math modeling contests that carry a task from the problem to a paper with figures and checked references
README in short
The README is bilingual, in English and Chinese. It shows a before-and-after table, a feature list, install steps for Codex and Hermes, the repository layout, two real competition case studies and rules for using other people's material.
README badge
Original SKILL.md
--- name: agentic-kaggle-skill description: Kaggle-first end-to-end competition workflow for scored submissions. Use when Codex must run Kaggle or competitive ML workflows through scored submission, including code competitions, validation, metrics, policy-safe public notebook/discussion intel, tabular/text/image modeling, tuning, ensembling/stacking, proactive multi-notebook architectures, producer notebooks that train models and export private Kaggle artifact datasets, downstream consumer notebooks, Kaggle GPU offload, kagglehub access, hidden-test debugging, and public score retrieval. --- # Agentic Kaggle Skill ## Operating Loop Treat every competition as a validation problem first and a modeling problem second. The default target platform is Kaggle, so prefer Kaggle-native notebooks/scripts, datasets, model artifacts, competition submissions, and score receipts. For code competitions, assume the final notebook/kernel will be rerun by Kaggle against hidden data unless the competition docs prove otherwise. 1. Read the competition page, classify the submission mode as classic file submission or code/notebook scoring, then inspect the rules, data-use terms, sharing policy, data dictionary, metric, submission format, train/test construction hints, and leakage warnings. 2. If live competition intelligence tools are available, inspect top public open notebook solutions and relevant discussion activity before major architecture choices; treat them as clues, not authority. 3. Identify the task type: binary, multiclass, multilabel, regression, ranking, image, segmentation, text, time series, grouped entities, or a hybrid. 4. Design folds before feature engineering or modeling. Prefer a fold column saved into the training data so every experiment uses the same comparison surface. 5. Build the simplest metric-correct baseline and produce out-of-fold (OOF) predictions plus a valid submission. 6. Proactively plan a stronger architecture once the baseline is trustworthy: diverse model families, feature/embedding producers, augmentation/pseudo-label/distillation stages, calibration/postprocessing, and an ensemble or stacker. 7. Iterate with validation gates: test one meaningful change at a time when possible, but launch several independent producer notebooks in parallel when they create diverse artifacts that can be compared by OOF score or ensemble diversity. 8. Offload heavy training, inference, embedding generation, image/text experiments, or memory-risky jobs to Kaggle notebooks/scripts when local compute may OOM or take too long. Before GPU scheduling or availability claims, fetch fresh quota and apply the GPU quota accounting rule below. 9. For sophisticated architectures, split work into a small Kaggle pipeline: run several independent producer notebooks/scripts first, save each useful producer output as a private Kaggle dataset, then run one consumer notebook/script that attaches those datasets and creates the final OOF/test/submission outputs. When a producer trains a model, its checkpoint, tokenizer/config, fold metadata, OOF/test predictions, and manifest should be exported as a Kaggle dataset; downstream notebooks load the model from `/kaggle/input/...`. 10. Submit the final submission-producing artifact to Kaggle for scoring and retrieve the resulting submission status/score. 11. If Kaggle returns a code-competition error or vague scoring failure, enter the debugging loop: retrieve available logs, classify likely failure mode, patch defensively, rerun the final kernel, resubmit, and repeat until scored or concretely blocked. 12. Track local CV, remote Kaggle run status, Kaggle submission score, public LB, private-risk notes, seed, code version, data version, and artifact paths for every run. 13. Ensemble only with OOF predictions generated without in-fold leakage. ## Resource Map - Read `references/method-map.md` for the neutral workflow map behind the skill. - Read `references/information-sharing-policy.md` before publishing competition code, notebooks, datasets, models, artifacts, or reports outside the active team or workspace. - Read `references/competition-intel.md` when a Kaggle competition slug, URL, title, public leaderboard context, open solutions, or discussion activity may inform the approach. - Read `references/cross-validation-and-metrics.md` when choosing folds, metrics, thresholds, or leakage checks. - Read `references/tabular-workflow.md` for categorical variables, feature engineering, selection, and hyperparameter tuning. - Read `references/image-text-workflow.md` for image, segmentation, and NLP competition approaches. - Read `references/kaggle-code-competition-pipeline.md` when the target is a Kaggle code competition, hidden rerun, final notebook scoring flow, or model artifact handoff between producer and consumer notebooks. - Read `references/advanced-notebook-architecture.md` when a stronger solution may need multiple model families, staged feature/embedding/model producers, pseudo-labeling, distillation, postprocessing, blending, stacking, or parallel Kaggle GPU notebooks. - Read `references/kaggle-offload.md` when local runs are heavy, GPU is useful, Kaggle data access is needed, or remote notebook results must be collected. - Read `references/kaggle-pipeline-datasets.md` when using multiple Kaggle notebooks, intermediate datasets, notebook output sources, or `kagglehub`. - Read `references/submission-endgame.md` before stopping work; this skill is not done until Kaggle scoring has been attempted and the result has been collected or a concrete blocker is documented. - Read `references/code-competition-debugging.md` when a Kaggle code competition submission fails, times out, OOMs, produces no score, or reports a vague hidden-run/scoring error. - Read `references/ensembling-and-reproducibility.md` for project layout, OOF artifacts, stacking, blending, and repeatability. - Read `references/research/` or `examples/` only when the user asks for historical case studies, Hermes-era patterns, or concrete competition lessons from this repository. - Run `scripts/scaffold_competition.py` to create a competition workspace. - Run `scripts/make_folds.py` to add a fold column to a training CSV. - Run `scripts/prepare_kaggle_kernel.py` to create a Kaggle kernel folder with metadata and retrievable experiment logs. - Run `scripts/prepare_kaggle_dataset.py` to create metadata and commands for versioned intermediate artifact datasets.