Deleting the 8.4GB Python Sidecar: Pure Go + CUDA with CGO_ENABLED=0

Deleting the 8.4GB Python Sidecar: Pure Go + CUDA with CGO_ENABLED=0 图片 1

TL;DR: I built gocudrv so Go services can talk directly to NVIDIA GPUs — no cgo, no CUDA toolkit, no bloated Python dependencies. One static binary. Last month I was reviewing a production AI service. The core business logic was clean, efficient Go (15MB binary), but GPU access was routed through a Python sidecar. The results were painful: 8.4GB Docker images — bloated with unused CUDA toolkits and PyTorch dependencies 4-minute cold starts during autoscaling Extra serialization + network hops between Go → P

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论