(Photo by Jp Valery on Unsplash)
Today's genAI PSA: check your bill.
No, seriously. If you're in any way responsible for paying for your company's LLM usage, it's time to see what you owe.
I keep hearing about companies that rack up a massive bill from Claude, ChatGPT, or some other provider...
... and only then do they implement periodic checks or set token usage caps.
(We saw the same thing with cloud computing. So many people had the story of "I launched this and forgot about it till the bill came." I know this post dredges up cringeworthy memories for some of you!)
When it comes to genAI, remember that it's a metered service and companies are strongly encouraging employees to use it. Given that, this seems like a good time to set caps + establish checks.