I Tried Building GPT Without Training — Just Math. Here’s Where It Broke | Shivnath Tathe

The Question What if we skipped training entirely? Every language model — GPT, LLaMA, BERT — learns by optimising a loss function over millions of gradient steps. But the underlying data is just text: words appearing near other words. Co-occurrence. Counting. So I asked: how far can pure mathematics take us toward text generation, without a single training step? I built the whole thing from scratch in Python with NumPy. No PyTorch, no TensorFlow, no model.train(). Just matrices, statistics,...