I Built an LLM Gateway That Learns Which Model to Use — Here's How the Routing Works

How it works: Request arrives at an OpenAI-compatible endpoint Classifier detects task type + complexity Adaptive router picks the highest-scoring model for that cell Quality feedback (user ratings + LLM judge) continuously improves routing Change 2 lines in your code. That's it. But it's more than a router. Full platform: Request logs with replay + diff view Time-series analytics (cost, latency p50/p95/p99) A/B testing between models Guardrails (PII redaction) Prompt template versioning Spen...