8 boosters for "vllm" — open source, verified from GitHub, ready to install
Fast, calibration-free weight quantization supporting 8/4/3/2/1-bit precision with multiple optimized backends. HQQ uses to define quantization parameters: The core quantized layer that replaces :
This skill is for running evaluations against models on the Hugging Face Hub on local hardware. It does not cover: If the user wants to run the same eval remotely on Hugging Face Jobs, hand off to the skill and pass it one of the local scripts in this skill.
This skill automates the process of adding, extracting, and managing evaluation results in Hugging Face model cards, supporting multiple data sources including Artificial Analysis API and custom evaluations with vLLM/lighteval. It's valuable for ML practitioners and model maintainers who need to track and display model performance metrics.
A skill for adapting and optimizing Hugging Face or custom LLM models to run efficiently on vLLM with Ascend NPU support, enabling developers to validate and deploy models with deterministic testing and single-commit delivery.
Query a structured, cross-referenced knowledge base of GPU kernel optimization for NVIDIA Blackwell (SM100) and Hopper (SM90). The repository update date is recorded in ; run for current corpus counts. Trigger this skill when the user asks about: Do NOT use this skill for:
Graphsignal observes inference workloads from a sidecar process — the profiler. It never shares a process with CUDA: the profiler watches the workload externally via CUPTI, OTLP/gRPC, Prometheus scraping, and NVML. Auto-instrumentation covers vLLM, SGLang, and PyTorch out of the box. Two install pat
"name": "inference-builder", "description": "Generate deployable Vision AI pipelines with high-performance video and streaming capabilities on NVIDIA GPUs. Create GPU-accelerated inference microservices using DeepStream, Triton, vLLM, TensorRT-LLM, or PyTorch backends.",
"description": "Code-grounded Agent Skills for building with Pi (pi-mono). Covers all 7 packages: pi coding agent (workspace, extensions, packages, RPC/SDK, customization), pi-ai (multi-provider LLM API), pi-agent-core (agent runtime), pi-tui (terminal UI), pi-web-ui (web components), pi-mom (Slack
