My LLM API Bill Hit $847/Month. Here is the Open-Source Proxy That Cut It to $89.

My LLM API Bill Hit $847/Month. Here's the Open-Source Proxy That Cut It to $89. Last November, I got the bill. $847.32 for LLM API calls. I was using GPT-4o for everything — code generation, content writing, data analysis, chatbot responses. Most of those requests didn't need GPT-4o. A $0.14/M-token model could handle 80% of them just fine. So I built a proxy. A single Python file. No framework, no dependencies, no Docker required (though I included one). It sits between your app and the LL...