Your LLM can't read. Here's the weird trick it uses instead

Here's a fact that breaks people's mental model of large language models the first time they really sit with it: A language model never sees your words. Not one. It sees numbers — and only numbers. When you type Hello, world into ChatGPT, the model on the other end isn't reading English. By the time your text reaches the neural network, it's been chopped into chunks called tokens and each chunk has been swapped for an integer ID. The model is, underneath all the magic, a very expensive functio...