How I Rebuilt My AI Decision Tool From a Summarizer Into a Constraint-Driven Arbitrator

A few weeks ago, I shipped a tool called Arbiter that takes a business decision, runs it through GPT-4o, and returns a structured analysis. The output looked impressive. Recommendation, confidence score, pros and cons, risk ratings, next steps. Everything you'd expect from an AI decision tool. Then I posted it on Reddit and got destroyed in the comments. Not because the output was wrong. Because the output was vague. One commenter pointed out that the AI was just hand-waving its way to a conclu...