Skip to content
Plugin

inference-builder

by NVIDIA-AI-IOT

AI Summary

"name": "inference-builder", "description": "Generate deployable Vision AI pipelines with high-performance video and streaming capabilities on NVIDIA GPUs. Create GPU-accelerated inference microservices using DeepStream, Triton, vLLM, TensorRT-LLM, or PyTorch backends.",

Install

Type these inside Claude Code's chat:

/plugin marketplace add NVIDIA-AI-IOT/inference_builder
/plugin install inference-builder@inference_builder

Description

Generate deployable Vision AI pipelines with high-performance video and streaming capabilities on NVIDIA GPUs. Create GPU-accelerated inference microservices using DeepStream, Triton, vLLM, TensorRT-LLM, or PyTorch backends.

Discussion

0/2000
Loading comments...

Health Signals

MaintenanceCommitted 1mo ago
Active
AdoptionUnder 100 stars
72 ★ · Niche
DocsREADME + description
Well-documented

GitHub Signals

Stars72
Forks17
Issues1
Updated1mo ago
View on GitHub
Apache-2.0 License

My Fox Den

Community Rating

Sign in to rate this booster

Works With

Claude Code