AI SummaryTrackio is an experiment tracking library for logging and visualizing ML training metrics. It syncs to Hugging Face Spaces for real-time monitoring dashboards. Use in your training scripts to log metrics: → See references/logging_metrics.md for setup, TRL integration, and configuration options.
Install
Copy this and paste it into Claude Code, Cursor, or any AI assistant:
I want to install the "huggingface-trackio" skill in my project. Please run this command in my terminal: # Install skill into your project (4 files) mkdir -p .claude/skills/huggingface-trackio && curl --retry 3 --retry-delay 2 --retry-all-errors -o .claude/skills/huggingface-trackio/SKILL.md "https://raw.githubusercontent.com/huggingface/skills/main/skills/huggingface-trackio/SKILL.md" && mkdir -p .claude/skills/huggingface-trackio/references && curl --retry 3 --retry-delay 2 --retry-all-errors -o .claude/skills/huggingface-trackio/references/alerts.md "https://raw.githubusercontent.com/huggingface/skills/main/skills/huggingface-trackio/references/alerts.md" && mkdir -p .claude/skills/huggingface-trackio/references && curl --retry 3 --retry-delay 2 --retry-all-errors -o .claude/skills/huggingface-trackio/references/logging_metrics.md "https://raw.githubusercontent.com/huggingface/skills/main/skills/huggingface-trackio/references/logging_metrics.md" && mkdir -p .claude/skills/huggingface-trackio/references && curl --retry 3 --retry-delay 2 --retry-all-errors -o .claude/skills/huggingface-trackio/references/retrieving_metrics.md "https://raw.githubusercontent.com/huggingface/skills/main/skills/huggingface-trackio/references/retrieving_metrics.md" Then restart Claude Code (or reload the window in Cursor) so the skill is picked up.
Description
Track and visualize ML training experiments with Trackio. Use when logging metrics during training (Python API), firing alerts for training diagnostics, or retrieving/analyzing logged metrics (CLI). Supports real-time dashboard visualization, alerts with webhooks, HF Space syncing, and JSON output for automation.
Trackio - Experiment Tracking for ML Training
Trackio is an experiment tracking library for logging and visualizing ML training metrics. It syncs to Hugging Face Spaces for real-time monitoring dashboards.
Three Interfaces
| Task | Interface | Reference | |------|-----------|-----------| | Logging metrics during training | Python API | references/logging_metrics.md | | Firing alerts for training diagnostics | Python API | references/alerts.md | | Retrieving metrics & alerts after/during training | CLI | references/retrieving_metrics.md |
Python API → Logging
Use import trackio in your training scripts to log metrics: • Initialize tracking with trackio.init() • Log metrics with trackio.log() or use TRL's report_to="trackio" • Finalize with trackio.finish() Key concept: For remote/cloud training, pass space_id — metrics sync to a Space dashboard so they persist after the instance terminates. → See references/logging_metrics.md for setup, TRL integration, and configuration options.
Python API → Alerts
Insert trackio.alert() calls in training code to flag important events — like inserting print statements for debugging, but structured and queryable: • trackio.alert(title="...", level=trackio.AlertLevel.WARN) — fire an alert • Three severity levels: INFO, WARN, ERROR • Alerts are printed to terminal, stored in the database, shown in the dashboard, and optionally sent to webhooks (Slack/Discord) Key concept for LLM agents: Alerts are the primary mechanism for autonomous experiment iteration. An agent should insert alerts into training code for diagnostic conditions (loss spikes, NaN gradients, low accuracy, training stalls). Since alerts are printed to the terminal, an agent that is watching the training script's output will see them automatically. For background or detached runs, the agent can poll via CLI instead. → See references/alerts.md for the full alerts API, webhook setup, and autonomous agent workflows.
Discussion
Health Signals
My Fox Den
Community Rating
Sign in to rate this booster