I Wish I Ran the Numbers on Open Source AI APIs Sooner

The author reflects on a pivotal moment when they proposed self-hosting a project using open source AI APIs but ended up charging $3,500 for a GPU server setup instead. This experience led them to dig deeper into the cost-benefit analysis of open source solutions, revealing that the actual financial savings could be significant. This shift underscores the importance of not just relying on assumptions about open source being "free," but instead carefully evaluating the real costs and benefits. The article serves as a cautionary tale for freelancers and small businesses considering self-hosting versus outsourcing.