How I built an open source visual QA tool after every AI agent I tried failed

I had a test spec to run against a web app. A couple of dozen test cases covering login, navigation, data persistence, drag-and-drop interactions, and settings. The kind of document that sits in a folder and gets run manually before each release. Running it manually takes most of a morning. So I decided to automate it properly. The first attempt I built a browser agent using a local Ollama model and pointed it at the app. Gave it the test cases as a prompt and let it run. The first run, it n...