I Built a Production-Grade AI Gateway in Rust — Here's What I Learned

TL;DR — I built a production-ready, distributed API gateway in Rust that routes traffic to OpenAI, Anthropic (Claude), and Ollama with auth, Redis rate limiting, PostgreSQL usage tracking, Prometheus metrics, and AWS Terraform deployment. Gateway overhead is ~1.2ms P99. Here's why and how. 👉 GitHub: MihirMohapatra/rust-ai-gateway The Problem I Kept Running Into Six months ago, my team was using OpenAI directly in every service. Then we wanted to test Claude 3.5 Sonnet for some...