MIT LLM Serve Dashboard I am making open source

A single-file, dependency-free live dashboard for your local LLM serving box — GPU utilization, per-model throughput, KV/context fill, and system stats for llama.cpp and vLLM , in one green terminal-styled page. No framework, no build step, no external requests. The frontend is one index.html (opens on file:// ); the backend is one stdlib Python file that reads nvidia-smi and each server's Prometheus /metrics . github.com/NHClimber87/llm-serve-dashboard What it shows GPUs — per-card utilization, VRA