Over reliance on LLMs: Has anyone else run into the problem where LLM costs look fine during MVP, then quietly become painful as usage grows? - I will not promote

We keep seeing startups route even simple backend and application logic through frontier models. This includes extracting fields, classifying support tickets, normalizing messy records, matching entities, converting text into JSON, scoring categories, summarizing highly templated notes, and deciding the next workflow step. To my surprise, I recently discovered there is a well regarded (technical prowess) unicorn startup whose engineering team also fell into this tarpit. Early on, this makes complete sense.

添加评论
点赞收藏
点踩分享查看原文
评论
?
参与讨论